MRehab: A Mixed Reality Rehabilitation System Supporting Integrated Speech and Hand Training

Author:

Wang Qi1ORCID,Luo Can1ORCID,Yang Shuai1ORCID,Xu Shuo2ORCID,Yang Yibo1ORCID,Jia Jie3ORCID,Yu Bin4ORCID

Affiliation:

1. College of Design and Innovation, Tongji University, Shanghai, China

2. Zhangzhou Municipal Hospital of Fujian Medical University, Zhangzhou, China

3. Huashan hospital, Fudan university, Shanghai, China

4. Nyenrode Business University, Breukelen, Netherlands

Abstract

Integrated speech and hand-motor training is an effective post-stroke rehabilitation method. However, few interactive systems and assistive technologies were developed in this field. Driven by this challenge, we leverage Mixed Reality technology, which merges immersive virtual scenarios with physical hands-on tools in the real world, to provide patients with multi-modal interactions and engaging training experiences. Following a user-centered design approach, we first interviewed seven therapists to identify user requirements and design considerations. We further designed MRehab, an interactive rehabilitation system that allows patients to regain speech and hand skills through MR scenarios that depict daily living activities. We conducted a preliminary user test with 12 patients and 5 therapists to validate the feasibility and understand the user experience with MRehab. The results confirmed its feasibility for hand-motor training. Additionally, the patients expressed high motivation, engagement, and a positive attitude toward using MRehab. Our findings demonstrate the potential of MR technology in integrated speech and hand function rehabilitation training.

Funder

Natural Science Foundation of China

?Sino-German Cooperation 2.0 Funding Program of Tongji University

National Key R&D Program of China

Publisher

Association for Computing Machinery (ACM)

Reference68 articles.

1. Insights and perspectives on sensory-motor integration and rehabilitation;Ackerley Rochelle;Multisensory Research,2016

2. Bamidele O Adeyemo, Marcel Simis, Debora Duarte Macea, and Felipe Fregni. 2012. Systematic review of parameters of stimulation, clinical trial design characteristics, and motor outcomes in non-invasive brain stimulation in stroke. Frontiers in psychiatry 3 (2012), 88.

3. MYF Aladin, AW Ismail, NA Ismail, and MSM Rahim. 2020. Object selection and scaling using multimodal interaction in mixed reality. In IOP Conference Series: Materials Science and Engineering, Vol. 979. IOP Publishing, 012004.

4. Deanna Anderlini, Guy Wallis, and Welber Marinovic. 2019. Language as a predictor of motor recovery: the case for a more global approach to stroke rehabilitation. Neurorehabilitation and neural repair 33, 3 (2019), 167--178.

5. MemHolo: mixed reality experiences for subjects with Alzheimer’s disease

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3