Planning for LVC Simulation Experiments
- 1 Air Force Institute of Technology, Wright-Patterson Air Force Base, Ohio, USA
- 2 Air Force Institute of Technology, Wright-Patterson Air Force Base, Ohio, USA
- 3 Air Force Institute of Technology, Wright-Patterson Air Force Base, Ohio, USA
Abstract
The use of Live, Virtual and Constructive (LVC) simulations are increasingly being examined for potential analytical use particularly in test and evaluation. In addition to system-focused tests, LVC simulations provide a mechanism for conducting joint mission testing and system of systems testing when fiscal and resource limitations prevent the accumulation of the necessary density and diversity of assets required for these complex and comprehensive tests. LVC simulations consist of a set of entities that interact with each other within a situated environment ( i.e. , world) each of which is represented by a mixture of computer-based models, real people and real physical assets. The physical assets often consist of geographically dispersed test assets which are interconnected by persistent networks and augmented by virtual and constructive entities to create the joint test environment under evaluation. LVC experiments are generally not statistically designed, but really should be. Experimental design methods are discussed followed by additional design considerations when planning experiments for LVC. Some useful experimental designs are proposed and a case study is presented to illustrate the benefits of using statistical experimental design methods for LVC experiments. The case study only covers the planning portion of experimental design. The results will be presented in a subsequent paper.
- Bjorkman, E.A. and Gray, F. B. (2009) Testing in a Joint Environment 2004-2008: Findings, Conclusions, and Recommendations from the Joint Test and Evaluation Methodology Project. ITEA Journal, 30, 39-44.
- Department of Defense (2003) Joint Capabilities Integration and Development System. Chairman of the Joint Chiefs of Staff Instruction 3170.01C.
- Department of Defense (2007) Capability Test Methodology v3.0. https://www.jte.osd.mil/jtemctm/handbooks/PM\_Online/PM_Handbook\_17Apr09.htm
- Hodson, D.D. and Hill, R.R. (2014) The Art and Science of Live, Virtual, and Constructive Simulation for Test and Analysis. Journal of Defense Modeling and Simulation, 11, 77-89. http://dx.doi.org/10.1177/1548512913506620
- Hodson, D.D. (2009) Performance Analysis of Live-Virtual-Constructive and Distributed Virtual Simulations: Defining Requirements in Terms of Temporal Consistency. Ph.D. Thesis, Air Force Institute of Technology, Wright-Patterson AFB, Ohio.
- Thorp, H.W. and Knapp, G.F. (2003) The Joint National Training Capability the Centerpiece of Training Transformation. In: Proceedings of the Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), Orlando, FL.
- Montgomery, D.C. (2009) Design and Analysis of Experiments. 7th Edition, John Wiley & Sons, New York.
- Coleman, D.E. and Montgomery, D.C. (1993) A Systematic Approach to Planning for a Designed Industrial Experiment. Technometrics, 35, 1-12. http://dx.doi.org/10.1080/00401706.1993.10484984
- Madni, A.M. (2010) Integrating Humans with Software and Systems: Technical Challenges and a Research Agenda. Systems Engineering, 13, 232-243.
- Wang, J. and Wu, C. (1992) Nearly Orthogonal Arrays with Mixed Levels and Small Runs. Technometrics, 34, 409-422. http://dx.doi.org/10.1080/00401706.1992.10484952
- Heydat, A.S., Sloane, N. and Stufken, J. (1999) Orthogonal Arrays: Theory and Applications. Springer-Verlag, New York. http://dx.doi.org/10.1007/978-1-4612-1478-6
- Nguyen, N.-K. (1996) A Note on the Construction of Near-Orthogonal Arrays with Mixed Levels and Economic Run Size. Technometrics, 38, 279-283. http://dx.doi.org/10.1080/00401706.1996.10484508
- Xu, H. (2002) An Algorithm for Constructing Orthogonal and Nearly-Orthogonal Arrays with Mixed Levels and Small Runs. Technometrics, 44, 356-368. http://dx.doi.org/10.1198/004017002188618554