The evolution of methods for the capture of human movement leading to markerless motion capture for biomechanical applications
Tóm tắt
Over the centuries the evolution of methods for the capture of human movement has been motivated by the need for new information on the characteristics of normal and pathological human movement. This study was motivated in part by the need of new clinical approaches for the treatment and prevention of diseases that are influenced by subtle changes in the patterns movement. These clinical approaches require new methods to measure accurately patterns of locomotion without the risk of artificial stimulus producing unwanted artifacts that could mask the natural patterns of motion. Most common methods for accurate capture of three-dimensional human movement require a laboratory environment and the attachment of markers or fixtures to the body's segments. These laboratory conditions can cause unknown experimental artifacts. Thus, our understanding of normal and pathological human movement would be enhanced by a method that allows the capture of human movement without the constraint of markers or fixtures placed on the body. In this paper, the need for markerless human motion capture methods is discussed and the advancement of markerless approaches is considered in view of accurate capture of three-dimensional human movement for biomechanical applications. The role of choosing appropriate technical equipment and algorithms for accurate markerless motion capture is critical. The implementation of this new methodology offers the promise for simple, time-efficient, and potentially more meaningful assessments of human movement in research and clinical practice. The feasibility of accurately and precisely measuring 3D human body kinematics for the lower limbs using a markerless motion capture system on the basis of visual hulls is demonstrated.
Tài liệu tham khảo
Weber W, Weber E: Mechanik der menschlichen Gehwerkzeuge. Göttingen: Dieterich 1836.
Muybridge E: Animal locomotion. Philadelphia: J.B. Lippincott Company; 1887.
Marey E: Animal Mechanism: A Treatise on Terrestrial and Aerial Locomotion. London: Henry S. King & Co.; 1874.
Braune W, Fischer O: Determination of the moments of inertia of the human body and its limbs. Berlin: Springer-Verlag; 1988.
Eberhart H, Inman V: Fundamental studies of human locomotion and other information relating to design of artificial limbs. In Report to the National Research Council. University of California, Berkeley; 1947.
Inman V, Ralston H, Todd F: Human Walking. Baltimore: Williams & Wilkins; 1981.
Cappozzo A, Capello A, Della Croce U, Pensalfini F: Surface marker cluster design criteria for 3-D bone movement reconstruction. IEEE Transactions on Biomedical Engineering 1997, 44: 1165-1174. 10.1109/10.649988
Sati A, De Giuse J, Larouche S, Drouin G: Quantitative assessment of skin-bone movement at the knee. The Knee 1996, 3: 121-138. 10.1016/0968-0160(96)00210-4
Reinschmidt C, van den Bogert A, Nigg B, Lundberg A, Murphy N: Effect of skin movement on the analysis of skeletal knee joint motion during running. Journal of Biomechanics 1997, 30: 729-732. 10.1016/S0021-9290(97)00001-8
Holden J, Orsini J, Siegel K, Kepple T, Gerber L, Stanhope S: Surface movements errors in shank kinematics and knee kinematics during gait. Gait and Posture 1997, 3: 217-227. 10.1016/S0966-6362(96)01088-0
Leardini A, Chiari L, Della Croce U, Capozzo A: Human movement analysis using stereophotogrammetry Part 3: Soft tissue artifact assessment and compensation. Gait and Posture 2005, 21: 221-225. 10.1016/j.gaitpost.2004.05.002
Jonsson H, Karrholm J: Three-dimensional knee joint movements during a step-up: evaluation after cruciate ligament rupture. Journal of Orthopedic Research 1994,12(6):769-779. 10.1002/jor.1100120604
Lafortune MA, Cavanagh PR, Sommer HJ, Kalenak A: Three-dimensional kinematics of the human knee during walking. Journal of Biomechanics 1992,25(4):347-357. 10.1016/0021-9290(92)90254-X
Banks S, Hodge W: Accurate measurement of three dimensional knee replacement kinematics using single-plane flouroscopy. IEEE Transactions on Biomedical Engineering 1996,46(6):638-649. 10.1109/10.495283
Stiehl J, Komistek R, Dennis D, Paxson R, Hoff W: Flouroscopic analysis of kinematics after posterior-cruciate retaining knee arthroplasty. Journal of Bone and Joint Surgery 1995, 77: 884-889.
Santos J, Gold G, Besier T, Hargreaves B, Draper C, Beaupre G, Delp S, Pauly J: Full-Flexion Patellofemoral Joint Kinematics with Real-Time MRI at 0.5 T. ISMRM 13th Scientific Meeting: Miami, FL 2005.
Cappozzo A, Catani F, Leardini A, Benedetti M, Della Croce U: Position and orientation in space of bones during movement: experimental artifacts. Clinical Biomechanics 1996, 11: 90-100. 10.1016/0268-0033(95)00046-1
Benedetti M, Cappozzo A: Anatomical landmark definition and identification in computer aided movement analysis in a rehabilitation context. In Internal Report. Universita Degli Studi La Sapienza; 1994.
Spoor C, Veldpas F: Rigid body motion calculated from spatial coordinates of markers. Journal of Biomechanics 1988, 13: 391-393. 10.1016/0021-9290(80)90020-2
Lu T, O'Connor J: Bone position estimation from skin marker coordinates using global optimization with joint constraints. Journal of Biomechanics 1999, 32: 129-134. 10.1016/S0021-9290(98)00158-4
Lucchetti L, Cappozzo A, Capello A, Della Croce U: Skin movement artefact assessment and compensation in the estimation of knee-joint kinematics. Journal of Biomechanics 1998, 31: 977-984. 10.1016/S0021-9290(98)00083-9
Andriacchi T, Sen K, Toney M, Yoder D: New developments in musculoskeletal testing. In Canadian Society of Biomechanics. Calgary, Canada; 1994.
Andriacchi TP, Alexander EJ, Toney MK, Dyrby C, Sum J: A point cluster method for in vivo motion analysis: applied to a study of knee kinematics. Journal of Biomechanical Engineering 1998,120(6):743-749. 10.1115/1.2834888
Alexander EJ, Andriacchi TP: Correcting for deformation in skin-based marker systems. Journal of Biomechanics 2001,34(3):355-361. 10.1016/S0021-9290(00)00192-5
Banks S, Otis J, Backus S, Laskin R, Campbell D, Lenhoff M, Furman G, Haas S: Integrated analysis of knee arthroplasty mechanics using simultaneous fluoroscopy, force-plates, and motion analysis. 45th Annual Meeting of the Orthopedic Research Society: Anaheim, CA 1999.
Andriacchi TP, Mündermann A, Smith RL, Alexander EJ, Dyrby CO, Koo S: A framework for the in vivo pathomechanics of osteoarthritis at the knee. Annals of Biomedical Engineering 2004,32(3):447-457. 10.1023/B:ABME.0000017541.82498.37
Andriacchi TP, Alexander EJ: Studies of human locomotion: Past, present and future. Journal of Biomechanics 2000,33(10):1217-1224. 10.1016/S0021-9290(00)00061-0
Harris GF, Smith PA: Human Motion Analysis: Current Applications and Future Directions. New York: IEEE Press; 1996.
Mündermann A, Dyrby CO, Hurwitz DE, Sharma L, Andriacchi TP: Potential strategies to reduce medial compartment loading in patients with knee OA of varying severity: Reduced walking speed. Arthritis and Rheumatism 2004,50(4):1172-1178. 10.1002/art.20132
Simon RS: Quantification of human motion: gait analysis benefits and limitations to its application to clinical problems. Journal of Biomechanics 2004, 37: 1869-1880. 10.1016/j.jbiomech.2004.02.047
Moeslund G, Granum E: A survey of computer vision-based human motion capture. Computer Vision and Image Understanding 2001,81(3):231-268. 10.1006/cviu.2000.0897
Wang L, Hu W, Tan T: Recent Developments in Human Motion Analysis. Pattern Recognition 2003,36(3):585-601. 10.1016/S0031-3203(02)00100-0
Hogg D: Model-based vision: A program to see a walking person. Image and Vision Computing 1983,1(1):5-20. 10.1016/0262-8856(83)90003-3
Wagg DK, Nixon MS: Automated markerless extraction of walking people using deformable contour models. Computer Animation and Virtual Worlds 2004,15(3–4):399-406. 10.1002/cav.43
Lee HJ, Chen Z: Determination of 3D human body posture from a single view. Comp Vision, Graphics, Image Process 1985, 30: 148-168. 10.1016/0734-189X(85)90094-5
Gavrila D, Davis L: 3-D model-based tracking of humans in action: a multi-view approach. Conference on Computer Vision and Pattern Recognition: San Francisco, CA 1996.
Cutler RG, Duraiswami R, Qian JH, Davis LS: Design and implementation of the University of Maryland Keck Laboratory for the analysis of visual movement. In Technical Report, UMIACS. University of Maryland; 2000.
Narayanan PJ, Rander P, Kanade T: Synchronous capture of image sequences from multiple cameras. In Technical Report CMU-RI-TR-95-25. Robotics Institute Carnegie Mellon University; 1995.
Kakadiaris IA, Metaxes D: 3D human body model acquisiton from multiple views. Intl Jl Computer Vision 1998, 30: 191-218. 10.1023/A:1008071332753
Kanade T, Collins R, Lipton A, Burt P, Wixson L: Advances in co-operative multi-sensor video surveillance. DARPA Image Understanding Workshop 1998, 3-24.
O'Rourke J, Badler NI: Model-based image analysis of human motion using constraint propagation. IEEE Transactions on Pattern Analysis and Machine Intelligence 1980, 2: 522-536.
Bregler C, Malik J: Tracking people with twists and exponential maps. Computer Vision and Pattern Recognition 1997, 568-574.
Yamamoto M, Koshikawa K: Human motion analysis based on a robot arm model. Computer Vision and Pattern Recognition 1991.
Bharatkumar AG, Daigle KE, Pandy MG, Cai Q, Aggarwal JK: Lower limb kinematics of human walking with the medial axis transformation. Workshop on Motion of Non-Rigid and Articulated Objects: Austin, TX 1994.
Isard M, Blake A: Visual tracking by stochastic propagation of conditional density. 4th European Conference on Computer Vision: Cambridge, UK 1996, 343-356.
Wren CR, Azarbayejani A, Darrel T, Pentland AP: Pfinder: Real-time tracking of the human body. Trans on Pattern Analysis and Machine Intelligence 1997,19(7):780-785. 10.1109/34.598236
Legrand L, Marzani F, Dusserre L: A marker-free system for the analysis of movement disabilities. Medinfo 1998,9(2):1066-1070.
Deutscher J, Blake A, Reid I: Articulated body motion capture by annealed particle filtering. Computer Vision and Pattern Recognition: Hilton Head, SC 2000.
Bottino A, Laurentini A: A silhouette based technique for the reconstruction of human movement. Computer Vision and Image Understanding 2001, 83: 79-95. 10.1006/cviu.2001.0918
Cheung G, Baker S, Kanade T: Shape-from-silhouette of articulated objects and its use for human body kinematics estimation and motion capture. IEEE Conference on Computer Vision and Pattern Recognition: Madison, WI: IEEE 2003, 77-84.
Moon H, Chellappa R, Rosenfeld A: 3D object tracking using shape-encoded particle propagation. Intl Conf on Computer Vision: Vancouver, BC 2001.
Marzani F, Calais E, Legrand L: A 3-D marker-free system for the analysis of movement disabilities – an application to the legs. IEEE Trans Inf Technol Biomed 2001,5(1):18-26. 10.1109/4233.908371
Darrel T, Maes P, Blumberg B, Pentland AP: A novel environment for situated vision and behavior. Workshop for Visual Behaviors at CVPR 1994.
Chu CW, Jenkins OC, Matari MJ: Towards model-free markerless motion capture. Computer Vision and Pattern Recognition: Madison, WI 2003.
Corazza S, Mündermann L, Andriacchi TP: Model-free markerless motion capture through visual hull and laplacian eigenmaps. Summer Bioengineering Conference: Vail, CO 2005.
Cedras C, Shah M: Motion-based recognition: a survey. Image and Vision Computing 1995,13(2):129-155. 10.1016/0262-8856(95)93154-K
Aggarwal J, Cai Q: Human motion analysis: a review. Computer Vision and Image Understanding 1999,73(3):295-304. 10.1006/cviu.1998.0744
Gavrila D: The visual analysis of human movement: a survey. Computer Vision and Image Understanding 1999,73(3):82-98. 10.1006/cviu.1998.0716
Zakotnik J, Matheson T, Dürr V: A posture optimization algorithm for model-based motion capture of movement sequences. Journal of Neuroscience Methods 2004, 135: 43-54. 10.1016/j.jneumeth.2003.11.013
Lanshammar H, Persson T, Medved V: Comparison between a marker-based and a marker-free method to estimate centre of rotation using video image analysis. Second World Congress of Biomechanics 1994.
Persson T: A marker-free method for tracking human lower limb segments based on model matching. Int J Biomed Comput 1996,41(2):87-97. 10.1016/0020-7101(95)01161-7
Pinzke S, Kopp L: Marker-less systems for tracking working postures – results from two experiments. Applied Ergonomics 2001,32(5):461-471. 10.1016/S0003-6870(01)00023-0
Anguelov D, Mündermann L, Corazza S: An Iterative Closest Point Algorithm for Tracking Articulated Models in 3D Range Scans. Summer Bioengineering Conference: Vail, CO 2005.
Besl P, McKay N: A method for registration of 3D shapes. Transactions on Pattern Analysis and Machine Intelligence 1992,14(2):239-256. 10.1109/34.121791
Rusinkiewicz S, Levoy M: Efficient variants of the ICP algorithm. International Conference on 3-D Digital Imaging and Modeling: 2001.
Ma Y, Soatto S, Kosecka Y, Sastry S: An invitation to 3D vision. Springer Verlag; 2004.
Mündermann L, Corazza S, Anguelov D, Andriacchi TP: Estimation of the accuracy and precision of 3D human body kinematics using markerless motion capture and articulated ICP. Summer Bioengineering Conference: Vail, CO 2005.
Mündermann L, Anguelov D, Corazza S, Chaudhari AM, Andriacchi TP: Validation of a markerless motion capture system for the calculation of lower extremity kinematics. International Society of Biomechanics & American Society of Biomechanics: Cleveland, OH 2005.
Mündermann L, Corazza S, Chaudhari AM, Alexander EJ, Andriacchi TP: Most favorable camera configuration for a shape-from-silhouette markerless motion capture system for biomechanical analysis. SPIE-IS&T Electronic Imaging 2005, 5665: 278-287.
Haritaoglu I, Davis L: W4: real-time surveillance of people and their activities. IEEE Transactions on Pattern Analysis and Machine Intelligence 2000,22(8):809-830. 10.1109/34.868683
Martin W, Aggarwal J: Volumetric description of objects from multiple views. IEEE Transactions on Pattern Analysis and Machine Intelligence 1983,5(2):150-158.
Laurentini A: The Visual Hull concept for silhouette base image understanding. IEEE Transactions on Pattern Analysis and Machine Intelligence 1994, 16: 150-162. 10.1109/34.273735
Cheung K, Baker S, Kanade T: Shape-From-Silhouette Across Time Part I: Theory and Algorithm. International Journal of Computer Vision 2005,62(3):221-247. 10.1007/s11263-005-4881-5
Mündermann L, Mündermann A, Chaudhari AM, Andriacchi TP: Conditions that influence the accuracy of anthropometric parameter estimation for human body segments using shape-from-silhouette. SPIE-IS&T Electronic Imaging 2005, 5665: 268-277.
Cheung G, Baker S, Kanade T: Shape-From-Silhouette Across Time Part II: Applications to Human Modeling and Markerless Motion Tracking. International Journal of Computer Vision 2005,63(3):225-245. 10.1007/s11263-005-6879-4
Andriacchi TP, Andersson GBJ, Fermier RW, Stern D, Galante JO: A study of lower-limb mechanics during stair-climbing. Journal of Bone and Joint Surgery 1980,62(A):749-757.
Bell AL, Pedersen DR, Brand RA: A comparison of the accuracy of several hip center location prediction methods. Journal of Biomechanics 1990, 23: 617-621. 10.1016/0021-9290(90)90054-7
Corazza S, Mündermann L, Chaudhari AM, Demattio T, Cobelli C, Andriacchi TP: A markerless motion capture system to study musculoskeletal biomechanics: visual hull and simulated annealing approach. Annals of Biomedical Engineering conditionally accepted.
Mündermann L, Corazza S, Mündermann A, Lin T, Chaudhari AM, Andriacchi TP: Gait retraining to reduce medial compartment load at the knee assessed using a markerless motion capture. Transactions of the Orthopaedic Research Society 2006, 52: 170.
Sharma L, Hurwitz DE, Thonar EJ, Sum JA, Lenz ME, Dunlop DD, Schnitzer TJ, Kirwan-Mellis G, Andriacchi TP: Knee adduction moment, serum hyaluronan level, and disease severity in medial tibiofemoral osteoarthritis. Arthritis and Rheumatism 1998,41(7):1233-1240. Publisher Full Text10.1002/1529-0131(199807)41:7<1233::AID-ART14>3.0.CO;2-L
Miyazaki T, Wada M, Kawahara H, Sato M, Baba H, Shimada S: Dynamic load at baseline can predict radiographic disease progression in medial compartment knee osteoarthritis. Annals of the Rheumatic Diseases 2002,61(7):617-622. 10.1136/ard.61.7.617
Andriacchi TP, Birac D: Functional testing in the anterior cruciate ligament-deficient knee. Clinical Orthopaedics and Related Research 1993, 288: 40-47.
Prodromos CC, Andriacchi TP, Galante JO: A relationship between gait and clinical changes following high tibial osteotomy. Journal of Bone and Joint Surgery 1985,67(8):1188-1194.
Andriacchi TP, Galante JO, Fermier RW: The influence of total knee-replacement design on walking and stair-climbing. Journal of Bone and Joint Surgery American volume 1982,64(9):1328-1335.
Mündermann A, Dyrby CO, Andriacchi TP: Secondary gait changes in patients with medial compartment knee osteoarthritis: Increased load at the ankle, knee and hip during walking. Arthritis and Rheumatism 2005,52(9):2835-2844. 10.1002/art.21262