Creating a Virtual Perception for Upper Limb Rehabilitation

Authors: Nina Robson, Kenneth John Faller II, Vishalkumar Ahir, Arthur Ricardo Deps Miguel Ferreira, John Buchanan, Amarnath Banerjee

Abstract:

This paper describes the development of a virtual-reality system ARWED, which will be used in physical rehabilitation of patients with reduced upper extremity mobility to increase limb Active Range of Motion (AROM). The ARWED system performs a symmetric reflection and real-time mapping of the patient’s healthy limb on to their most affected limb, tapping into the mirror neuron system and facilitating the initial learning phase. Using the ARWED, future experiments will test the extension of the action-observation priming effect linked to the mirror-neuron system on healthy subjects and then stroke patients.

Keywords: Physical rehabilitation, mirror neuron, virtual reality, stroke therapy.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1129896

References:

[1] J. A. Beebe and C. E. Lang, "Active Range of Motion Predicts Upper Extremity Function 3 Months After Stroke," Stroke, vol. 40, pp. 1772-1779, 2009.
[2] N. Hogan, & Krebs, H. I., "Interactive robots for neuro-rehabilitation," Restor Neurol Neurosci, vol. 22, pp. 349-358, 2004.
[3] J. W. Krakauer, "Motor learning: its relevance to stroke recovery and neurorehabilitation.," Curr Opin Neurol, vol. 19, pp. 84-90, 2006.
[4] Buchanan, J.J., Ramos, J. & Robson, N, “Simulated human arm motion drives perception-action learning in post-stroke individuals,” Program No. 563.17. 2013 Neuroscience Meeting Planner, San Diego, CA: Neuroscience, 2013.
[5] D. Maslovat, Hodges, N. J., Krigolson, O. E., & Handy, T. C., "Observational practice benefits are limited to perceptual improvements in the acquisition of a novel coordination skill.," Exp Brain Res, vol. 204, pp. 119-130, 2010.
[6] N. R. H. S. Moon, R. Langari, J. Buchanan, "How Does the Central Nervous System Govern Motions with Reduced Arm Mobility," in ASME/IMECE, Houston, 2012.
[7] M. Villiger, Bohli, D., Kiper, D., Pyk, P., Spillmann, J., et al., "Virtual reality-augmented neurorehabilitation improves motor function and reduces neuropathic pain in patients with incomplete spinal cord injury.," Neurorehabil Neural Repair, vol. 27, pp. 675-683, 2013.
[8] S. Kim, Min, W., Kim, J., & Lee, B., "The effects of vr-based wii fit yoga on physical function in middle-aged female lbp patients.," Journal of Physical Therapy Science, vol. 26, pp. 549-552., 2014.
[9] M. Walker, Ringleb, S., Maihafer, G., Walker, R., Crouch, J., et al., "Virtual reality–enhanced partial body weight–supported treadmill training poststroke: Feasibility and effectiveness in 6 subjects.," Archives of Physical Medicine and Rehabilitation, vol. 91, pp. 115-122, 2010.
[10] M. Golomb, Mcdonald, B., Warden, S., Yonkman, J., Saykin, A., et al., "In-home virtual reality videogame telerehabilitation in adolescents with hemiplegic cerebral palsy.," Archives of Physical Medicine and Rehabilitation, vol. 91, pp. 1-8. e1, 2010.
[11] B. Lee, "Clinical usefulness of augmented reality using infrared camera based real-time feedback on gait function in cerebral palsy: A case study.," Journal of Physical Therapy Science, vol. 28, pp. 1387-1391, 2016.
[12] B.-H. Lee, "Clinical Usefulness of Augmented Reality Using Infrared Camera Based Real-Time Feedback on Gait Function in Cerebral Palsy: A Case Study," Journal of physical therapy science, vol. 28, p. 1387, 2016.
[13] A. Kalron, I. Fonkatz, L. Frid, H. Baransi, and A. Achiron, "The Effect of Balance Training on Postural Control in People with Multiple Sclerosis Using the CAREN Virtual Reality System: A Pilot Randomized Controlled Trial," Journal of neuroengineering and rehabilitation, vol. 13, p. 1, 2016.
[14] M. Sousa, J. Vieira, D. Medeiros, A. Arsénio, and J. Jorge, "SleeveAR: Augmented Reality for Rehabilitation using Realtime Feedback," in Proceedings of the 21st International Conference on Intelligent User Interfaces, 2016, pp. 175-185.
[15] A. J. Agrawal. (2015, 10/14/2016). How Virtual Reality Will Change Physical Therapy Forever. Available: http://www.inc.com/aj-agrawal/how-virtual-reality-will-change-physical-therapy-forever.html
[16] G. Sgandurra, Ferrari, A., Cossu, G., Guzzetta, A., Fogassi, L., & Cioni, G., "Randomized trial of observation and execution of upper extremity actions versus action alone in children with unilateral cerebral palsy.," Neurorehabil Neural Repair, vol. 27, pp. 808-815, 2013.
[17] B. Calvo-Merino, Glaser, D. E., Grèzes, J., Passingham, R. E., & Haggard, P., "Action Observation and Acquired Motor Skills: An fMRI Study with Expert Dancers.," Cerebral Cortex, vol. 15, pp. 1243-1249, 2005.
[18] A. Casile, V. Caggiano, and P. F. Ferrari, "The Mirror Neuron System: A Fresh View," The neuroscientist, p. 1073858410392239, 2011.
[19] L. Fogassi, Ferrari, P. F., Gesierich, B., Rozzi, S., Chersi, F., & Rizzolatti, G., "Parietal lobe: from action organization to intention understanding. Science," vol. 308, pp. 662-667, 2005.
[20] C. Press, Bird, G., Flach, R., & Heyes, C., "Robotic movement elicits automatic imitation.," Brain Res Cogn Brain Res, vol. 25, pp. 632-640, 2005.
[21] L. M. Oberman, McCleery, J. P., Ramachandran, V. S., & Pineda, J. A., "EEG evidence for mirror neuron activity during the observation of human and robot actions: Toward an analysis of the human qualities of interactive robots. ." Neurocomput, 2007.
[22] C. C. Tsai, & Brass, M., "Does the human motor system simulate Pinocchio's actions? Coacting with a human hand versus a wooden hand in a dyadic interaction," Psychol Sci, vol. 18, pp. 1058-1062, 2007.
[23] C. Urgesi, Moro, V., Candidi, M., & Aglioti, S. M., "Mapping implied body actions in the human motor system.," J Neurosci, vol. 26, pp. 7942-7949, 2006.
[24] G. Buccino, Solodkin, A., & Small, S. L., "Functions of the Mirror Neuron System: Implications for Neurorehabilitation.," Cognitive and Behavioral Neurology, vol. 19, pp. 55-63, 2006.
[25] S. Franceschini, S. Gori, M. Ruffino, K. Pedrolli, and A. Facoetti, "A causal link between visual spatial attention and reading acquisition," Current Biology, vol. 22, pp. 814-819, 2012.
[26] V. M. Pomeroy, Clark, C. A., Miller, J. S., Baron, J. C., Markus, H. S., & Tallis, R. C., "The potential for utilizing the "mirror neurone system" to enhance recovery of the severely affected upper limb early after stroke: a review and hypothesis.," Neurorehabil Neural Repair, vol. 19, pp. 4-13, 2005.
[27] D. Ertelt, Small, S., Solodkin, A., Dettmers, C., McNamara, A., Binkofski, F., & Buccino, G., "Action observation has a positive impact on rehabilitation of motor deficits after stroke.," Neuroimage, vol. 36, pp. T164-173, 2007.
[28] K. Eng, Siekierka, E., Pyk, P., Chevrier, E., Hauser, Y., et al., "Interactive visuo-motor therapy system for stroke rehabilitation. Medical & Biological Engineering & Computing," Medical & Biological Engineering & Computing, vol. 45, pp. 901-907, 2007.
[29] I. Pastor, Hayes, H. A., & Bamberg, S. J., "feasibility study of an upper limb rehabilitation system using Kinect and computer games. ," Conf Proc IEEE Eng Med Biol Soc, 2012.
[30] H. Moon, N. Hoang, N. P. Robson, and R. Langari, "Human Arm Motion Planning Against a Joint Constraint," in the 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), ed, 2012, pp. 401-406.
[31] H. Moon, N. P. Robson, R. Langari, and J. J. Buchanan, "Experimental Observations on the Human Arm Motion Planning Under an Elbow Joint Constraint," in International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS), ed: IEEE, 2012, pp. 3870-3873.
[32] H. Moon, N. P. Robson, R. Langari, and J. J. Buchanan, "Experimental Observations on the Central Nervous System's Governing Strategies on the Arm Reaching with Reduced Mobility," in ASME International Mechanical Engineering Congress and Exposition (IMECE), ed. Houston, TX: American Society of Mechanical Engineers (ASME), 2012, pp. 483-492.
[33] N. Patarinsky-Robson, McCarthy, J. M., & Tumer, I. Y., "Failure Recovery Planning for an Arm Mounted on an Exploratory Rover," IEEE Transactions on Robotics, vol. 25, pp. 1448-1453, 2009.
[34] N. Robson and J. M. McCarthy, "Applications of the Geometric Design of Mechanical Linkages with Task Acceleration Specifications," in ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE), ed. San Diego, CA: American Society of Mechanical Engineers (ASME), 2009, pp. 1105-1114.
[35] N. Robson, J. M. McCarthy, and I. Tumer, "Exploring New Strategies for Failure Recovery of Crippled Robot Manipulators," in ASME/IFToMM International Conference on Reconfigurable Mechanisms and Robots (ReMAR), Z. M. S. Dai, Xianwen Kong, Ed., ed. London, UK, 2009, pp. 656-664.
[36] O. Bimber, & Raskar, R., Spatial Augmented Reality: Merging Real and Virtual Worlds: A. K. Peters, Ltd., 2005.
[37] D. Bowman, Coquillart, S., Froehlich, B., Hirose, M., Kitamura, Y., et al., "3D User Interfaces: New Directions and Perspectives," IEEE Computer Graphics and Applications, p. 28(6), 2008.
[38] F. Smit, Liere, R. v., & Froehlich, B., "A Programmable Display Layer for Virtual Reality System Architectures.," IEEE Transactions on Visualization and Computer Graphics, vol. 16, pp. 28-42, 2010.
[39] N. Robson, & Soh, G. S., "Geometric Design of Eight-Bar Wearable Devices Based on Limb Physiological Contact Task.," Mechanism and Machine Theory, pp. 358-367, 2016.
[40] N. Robson and S. Ghosh, "Geometric Design of Planar Mechanisms Based on Virtual Guides for Manipulation," Robotica, pp. 1-16, 2015.
[41] N. Robson and G. S. Soh, "Dimensional Synthesis of a Passive Eight-bar Slider Exo-Limb for Grasping Tasks," in ASME International Design Engineering Technical Conferences, ed, 2016, p. (Accepted).
[42] N. R. a. G. S. Soh, "Dimensional Synthesis of a Passive Eight-bar Slider Exo-Limb for Grasping Tasks," ASME International Design Engineering Technical Conference, 2016.
[43] I. Pastor, Hayes, H. A., & Bamberg, S. J., "A feasibility study of an upper limb rehabilitation system using Kinect and computer games," in IEEE Eng Med Biol Soc, 2012, pp. 1286-1289.
[44] N. Patarinsky-Robson, McCarthy, J. M., & Tumer, I., "Exploring new strategies for failure recovery of crippled robot manipulators," in Reconfigurable Mechanisms and Robots, 2009.
[45] J. M. M. a. I. T. N. Patarinsky Robson, "Applications of the Geometric Design of Mechanical Linkages with Task Acceleration Specifications," in ASME Int. Design Eng. Tech. Conf, San Diego, 2009.
[46] J. A. Ramos, "Development of a Robotic Device for the Physical Training of Human Upper Extremity," 2013.
[47] Buchanan, J.J., Ramos, J. & Robson, N., “The perception-action dynamics of action competency are altered by both physical and observational training,” Experimental Brain Research, 233: 1289-1305.