Application of Multiple Sensor Data Fusion for the Analysis of Human Dynamic Behavior in Space: Assessment and Evaluation of Mobility-Related Functional Impairments — Oak Academic Publishing
Research ArticleOpen AccessGoogle Scholar indexed
Application of Multiple Sensor Data Fusion for the Analysis of Human Dynamic Behavior in Space: Assessment and Evaluation of Mobility-Related Functional Impairments
Department of Electrical and Computer Engineering, University of Texas, El Paso, TX, USA
,
Department of Electrical and Computer Engineering, University of Texas, El Paso, TX, USA
,
Computational Sciences Program, University of Texas, El Paso, TX, USA
,
Department of Mechanical Engineering, University of Texas, El Paso, TX, USA
,
Paul L. Foster School of Medicine, El Paso, TX, USA
1 Department of Electrical and Computer Engineering, University of Texas, El Paso, TX, USA
2 Department of Electrical and Computer Engineering, University of Texas, El Paso, TX, USA
3 Computational Sciences Program, University of Texas, El Paso, TX, USA
4 Department of Mechanical Engineering, University of Texas, El Paso, TX, USA
5 Paul L. Foster School of Medicine, El Paso, TX, USA
The authors have applied a systems analysis approach to describe the musculoskeletal system as consisting of a stack of superimposed kinematic hier-archical segments in which each lower segment tends to transfer its motion to the other superimposed segments. This segmental chain enables the derivation of both conscious perception and sensory control of action in space. This applied systems analysis approach involves the measurements of the complex motor behavior in order to elucidate the fusion of multiple sensor data for the reliable and efficient acquisition of the kinetic, kinematics and electromyographic data of the human spatial behavior. The acquired kinematic and related kinetic signals represent attributive features of the internal recon-struction of the physical links between the superimposed body segments. In-deed, this reconstruction of the physical links was established as a result of the fusion of the multiple sensor data. Furthermore, this acquired kinematics, kinetics and electromyographic data provided detailed means to record, annotate, process, transmit, and display pertinent information derived from the musculoskeletal system to quantify and differentiate between subjects with mobility-related disabilities and able-bodied subjects, and enabled an inference into the active neural processes underlying balance reactions. To gain insight into the basis for this long-term dependence, the authors have applied the fusion of multiple sensor data to investigate the effects of Cerebral Palsy, Multiple Sclerosis and Diabetic Neuropathy conditions, on biomechanical/neurophysiological changes that may alter the ability of the human loco-motor system to generate ambulation, balance and posture.
KeywordsSuperimposed Body SegmentsTransfer FunctionsMultiple Sensor Data FusionMusculoskeletal System
Mergner, T. (2002) The Matryoshka Dolls Principle in Human Dynamic Behaviour in Space: A Theory of Linked References for Multisensory Perception and Control of Action. Cahiers de Psychologie Cognitive, 21, 129-212.
Maurer, C., Mergner, T., Bolha, B. and Hlavacka, F. (2000) Vestibular, Visual, and Somatosensory Contributions to Human Control of Upright Stance. Neuroscience Letters, 281, 99-102. https://doi.org/10.1016/S0304-3940(00)00814-4
Mergner, T. (2004) Meta Level Concept versus Classic Reflex Concept for the Control of Posture and Movement. Archives Italiemes de Biologie, 142, 175-198.
Mergner, T. and Becker, W. (2003) A Modeling Approach to the Human Spatial Orientation System. Annals of the New York Academy of Sciences, 1004, 303-315. https://doi.org/10.1196/annals.1303.028
Berbyuk, V., Demydyuk, M. and Lytwyn, B. (2005) Mathematical Modeling and Optimization of Walking of Human Being with Prosthesis of Crus. Journal of Automation and Information Sciences, 37, 46-60. https://doi.org/10.1615/J Automat Inf Scien.v37.i6.60
Berbyuk, V., Krasyuk, G. and Nischenko, N. (1997) Mathematical Modeling of Human Gait Dynamics in Sagittal Plane. Journal of Mathematical Methods and Physicomechanical Fields, 40, 127-138.
Beryuk, V.E. and Nishenko, N.I. (1997) Energetically Optimal Control over Human Motion in the Phase of Support by an Artificial Leg. Probl. Upravl. Inf., No. 2, 75-86.
Hausdorff, J.M. (2007) Gait Dynamics, Fractals and Falls: Finding Meaning in the Stride-to-Stride Fluctuations of Human Walking. Human Movement Science, 26, 554-589. https://doi.org/10.1016/j.humov.2007.05.003
Winter, D.A. (2005) Biomechanics and Motor Control of Human Movement. 3rd Edition, John Wiley & Sons, Inc., Hoboken.
Jensen, K.J. (2005) Diagnostics of Human Locomotion. M.S. Thesis, New Mexico Institute of Mining and Technology, Department of Mechanical Engineering, Mechatronics Program.
Jensen, K. and Sarkodie-Gyan, T. (2004) The Paradigm of a Smart Gait Emulator. Proceedings of the 2004 Japan-USA Symposium on Flexible Automation, Denver, 19-21.
Frenkel-Toledo, S., Giladi, N., Peretz, C., Herman, T., Gruendlinger, L. and Hausdorff, J.M. (2005) Treadmill Walking as an External Pacemaker to Improve Gait Rhythm and Stability in Parkinson’s Disease. Movement Disorders, 20, 1109-1114. https://doi.org/10.1002/mds.20507
Hausdorff, J.M., Peng, C.K., Ladin, Z., Wei, J.Y. and Goldberger, A.L. (1995) Is Walking a Random Walk? Evidence for Long-Range Correlations in Stride Interval of Human Gait. Journal of Applied Physiology, 78, 349-358.
Nishikawa, K., Biewener, A.A., Aerts, P., et al. (2007) Neuromechanics: An Integrative Approach for Understanding Motor Control. Integrative and Comparative Biology, 47, 16-54. https://doi.org/10.1093/icb/icm024
Hausdorff, J.M. (2005) Gait Variability: Methods, Modeling and Meaning. Journal NeuroEngineering and Rehabiliation, 2, 19.
Platz, T., van Kaick, S., Moller, L., Freund, S., Winter, T. and Kim, I.H. (2005) Impairment-Oriented Training and Adaptive Motor Cortex Reorganization after Stroke: A fTMS Study. Journal of Neurology, 252, 1363-1371. https://doi.org/10.1007/s00415-005-0868-y
Hausdorff, J.M., Peng, C.K., Ladin, Z., Wei, J.Y. and Goldberger, A.L. (1995) Is Walking a Random Walk? Evidence for Long-Rang Correlations in Stride Interval of Human Gait. Journal Applied Physiology, 78, 349-358. https://doi.org/10.1016/j.humov.2007.05.003
Cram, J.R., Kasman, G.S. and Holtz, J. (1998) Introduction to Surface Electromyography. Aspen Publishers, Maryland.
Lai, D.T.H., Levinger, P., Begg, R.K., Gilleard, W.L. and Palaniswami, M. (2009) Automatic Recognition of Gait Patterns Exhibiting Patellofemoral Pain Syndrome Using a Support Vector Machine Approach. IEEE Transactions on Information Technology in Biomedicine, 13, 810-817. https://doi.org/10.1109/TITB.2009.2022927
Lafuente, R., Belda, J.M., Sanches-Lacuesta, J., Soler, C. and Prat, J. (1997) Design and Test of Neural Networks and Statistical Classifiers in Computer Aided Movement Analysis: A Case Study on Gait Analysis. Clinical Biomechincs, 13, 216-229. https://doi.org/10.1016/S0268-0033(97)00082-X
Begg, R.K., Palaniswami, M. and Owen, B. (2005) Support Vector Machines for Automated Gait Classification. IEEE Transactions on Biomedical Engineering, 52, 828-883. https://doi.org/10.1109/TBME.2005.845241
Begg, R. and Kamruzzaman, J. (2005) A Machine Learning Approach for Automated Recognition of Movement Patterns Using Basic, Kinetic and Kinematic Gait Data. Journal of Biomechanics, 38. 401-408. https://doi.org/10.1016/j.jbiomech.2004.05.002
Pasparkis, D. and Darras, N. (2009) Normal Walking: Principles, Basic Concepts, Terminology, 3-Dimensional Clinical Gait Analysis. Hellenic Orthopaedic Association, 60, 183-194.
Winter, D.A. (2009) Biomechanics and Motor Control of Human Movement. 4th Edition, John Wiley & Sons, Hoboken, New Jersey. https://doi.org/10.1002/9780470549148
De Luca, C.J. (2006) Electromyography Encyclopedia of Medical Devices and Instrumentation. John Wiley Publisher, Hoboken, 98-109.
Allison, G.T., Marshal, R.N. and Singer, K.P. (1993) EMG Signal Amplitude Normalization Technique in Stretch-Shortening Cycle Movements. Journal of Electromyography and Kinesiology, 3, 236-244. https://doi.org/10.1016/1050-6411(93)90013-M
Ricamato, A.L. and Hidler, J.M. (2005) Quantification of the Dynamic Properties of EMG Patterns during Gait. Journal of Electromyography and Kinesiology, 15, 384-392. https://doi.org/10.1016/j.jelekin.2004.10.003
Murad, A., Yu, H.Y., Brower, R., Abdelgawad, A. and Sarkodie-Gyan, T. (2011) Application of Wearable Sensors for Human Gait Analysis Using Fuzzy Computational Algorithm. Engineering Applications of Artificial Intelligence, 24, 1018-1025. https://doi.org/10.1016/j.engappai.2011.04.010
Yu, H.Y., Alaqtash, M., Spier, E. and Sarkodie-Gyan, T. (2010) Analysis of Muscle Activity during Gait Cycle Using Fuzzy Rule-Based Reasoning. Measurement, 9, 1106-1114. https://doi.org/10.1016/j.measurement.2010.04.010
Alaqtash, M. (2012) The Application of Fuzzy Granular Computing for the Analysis of Human Dynamic Behavior in 3D Space. PhD Dissertation, University of Texas, El Paso.
Pedrycz, W. and Vukovich, G. (2002) Feature Analysis through Information Granulation and Fuzzy Sets. Pattern Recognition, 35, 825-834. https://doi.org/10.1016/S0031-3203(01)00102-9
Yu, F.S. and Pedrycz, W. (2009) The Design of Fuzzy Information Granules: Tradeoffs between Specificity and Experimental Evidence. Applied Soft Computing, 9, 264-273. https://doi.org/10.1016/j.asoc.2007.10.026
Mencar, C. and Fanelli, A.M. (2008) Interpretability Constraints for Fuzzy Information Granulation. Information Sciences, 178, 4585-4618. https://doi.org/10.1016/j.ins.2008.08.015
Pedrycz, W. and Gacek, A. (2002) Temporal Granulation and Its Application to Signal Analysis. Information Sciences, 143, 47-71. https://doi.org/10.1016/S0020-0255(02)00179-2
Sarkodie-Gyan, T., Yu, H.Y., Murad, A., Abdelgawad, A., Spier, E. and Brower, R. (2011) Measurement of Functional Impairments in Human Locomotion Using Pattern Analysis. Measurement, 44, 181-191. https://doi.org/10.1016/j.measurement.2010.09.043
Sarkodie-Gyan, T., Yu, H.Y., Alaqtash, M., Spier, E. and Brower, R. (2009) Recognition and Deci-sion-Making Algorithm in Human Locomotion Based on the Principles of Fuzzy Reasoning. Proceedings of the IEEE International Conference on Robotics and Biomimetics, Guilin, 19-23 December, 2009, 529-534.
Yu, H., Nava, P., Brower, R., Ceberio, M. and Sarkodie-Gyan, T. (2007) Identification of Human Gait Using Fuzzy Inferential Reasoning. Proceedings of the International Conference on Rehabilitation Robotics, Netherlands, 13-15 June 2007, 656-660.
Yu, H.Y., Riskowski, J., Brower, R. and Sarkodie-Gyan, T. (2009) Gait Variability While Walking with Three Different Speeds. Proceedings of the International Conference on Rehabilitation on Robotics, Kyoto, 23-26 June 2009, 823-827. https://doi.org/10.1109/icorr.2009.5209486
Hausdorff, J.M., Mitchell, S.L., Firton, R.E., Peng, C.K., Cudkowicz, M.E., Wei, J.Y. and Goldberger, A.L. (1997) Altered Fractal Dynamics of Gait: Reduced Stride-Interval Correlations with Aging and Huntington’s Disease. Journal of Applied Physiology, 82, 262-269.
Liu, T., Inoue, Y. and Shibata, K. (2009) Development of a Wearable Sensor System for Quantitative Gait Analysis. Measurement, 42, 978-988. https://doi.org/10.1016/j.measurement.2009.02.002
Giansanti, D., Macellari, V. and Maccioni, G. (2005) The Development and Test of a Device for the Reconstruction of 3-D Position and Orientation by Means of a Kinematic Sensor Assembly with Rate Gyroscopes and Accelerometers. IEEE Transactions on Biomedical Engineering, 52, 1271-1277. https://doi.org/10.1109/TBME.2005.847404
Ruth, E., Mayagoitaia, A., Nene, V. and Veltink, P.H. (2002) Accelerometer and Rate Gyroscope Measurement of Kinematics: An Inexpensive Alternative to Optical Motion Analysis Systems. Journal of Biomechanics, 35, 537-542.
Nolan, L., Wit, A., Dudzinski, K., Lees, A., Lake, M. and Wychowanski, M. (2003) Adjustments in Gait Symmetry with Walking Speed in Trans-Femoral and Trans-Tibial Amputees. Gait and Posture, 17, 142-151. https://doi.org/10.1016/S0966-6362(02)00066-8
Aminian, K., Trevisan, C., Najafi, B., Dejnabadi, H., Frigo, C., Pavan, E., Telonio, A. and Robert, P. (2004) Evaluaiton of an Ambulatory System for Gait Analysis in Hip Osteoarthritis and after Total Hip Replacement. Gait and Posture, 20, 102-107. https://doi.org/10.1016/S0966-6362(03)00093-6
Mathie, M.J., Coster, A.C.F., Lowell, N.H. and Cellar, B.G. (2004) Accelerometry: Providing an Integrated Practical Method for Long-Term, Ambulatory Monitoring of Human Movement. Physiological Measurement, 25, 1-20. https://doi.org/10.1088/0967-3334/25/2/r01
Berbyuk, V., Demydyuk, M. and Lytwyn, B. (2005) Mathematical Modeling and Optimization of Human Walking on a Below-Knee Prosthesis. Int. J. Problems of Control and Informatics, No. 3, 128-144.
Berbyuk, V. (1996) Multibody System Modeling and Optimization Problems of Lower Limb Prostheses. In: Bestle, D. and Schiehlen, W., Eds., Proceedings of the IUTAM Symposium on Optimization of Mech. Systems, Kluwer Academic Publishers, Dordrecht, 25-32. https://doi.org/10.1007/978-94-009-0153-7_4
Bosco, G. and Poppele, R.E. (2001) Proprioception from a Spinocerebellar Perspective. Physiological Reviews, 81, 539-568.
Poppele, R.E., Bosco, G. and Rankin, A.M. (2002) Independent Representations of Limb Axis Length and Orientation in Spinocerebellar Response Components. Journal of Neurophysiology, 87, 409-422.
Poppele, R. and Bosco, G. (2003) Sophisticated Spinal Contributions to Motor Control. Trends in Neurosciences, 26, 269-276. https://doi.org/10.1016/S0166-2236(03)00073-0
Grasso, R., Bianchi, L. and Lacquaniti, F. (1998) Motor Patterns for Human Gait: Backward versus forward Locomotion. Journal of Neurophys, 80, 1868-1885.
Williams, S.E., Gibbs, S., Meadows, C.B., et al. (2011) Classification of the Reduced Vertical Component of the Ground Reaction Force in Late Stance in Cerebral Palsy Gait. Gait and Posture, 34, 370-373. https://doi.org/10.1016/j.gaitpost.2011.06.003
Kelleher, K.J., Spence, W.D., Solomonidis, S.E. and Apatsidis, D. (2010) The Characterization of Gait Patterns with Multiple Sclerosis. Disability and Rehabilitation, 32, 1242-1250. https://doi.org/10.3109/09638280903464497
Restoring Neurological Function (2004) Putting the Neurosciences to Work in Neurorehabilitation. Academy of Medical Sciences.
Neurorehabilitation Disorders (2006) Public Health Chal-lenges. World Health Organization.
Ohtaki, Y., Sagawa, K. and Inooka, H. (2009) A Method for Gait Analysis in a Daily Living Environment by Body-Mounted Instruments. Japan Society of Mechanical Engineers (JSME) International Journal, 44, 1125-1132.
Garza-Ulloa, J., Yu, H.Y. and Sarkodie-Gyan, T. (2012) A Mathematical Model for the Validation of the Ground Reaction Force Sensor in Human Gait Analysis. Elsevier Measurement, 45, 755-762. https://doi.org/10.1016/j.measurement.2011.12.015