Lu Liu - Software Engineer & Deep Learner Online Portfolio

Design and Implementation of an Immersive Task for Rehabilitation

Home
VR

Project information

Visual Design & Virtual Scene Construction: Lu Liu
Software Development : Lu Liu
Duration Time: Three Months
Hardware & Software: Oculus Rift VR System, Unity3D, C#

Designed Bilateral Arm Training tasks

With the incidence of Stroke considerably climbing up within recent years, bilateral arm trainings are expected to be highlighted since bilateral arm movements are dominantly involved in ADLs. Studies have shown that VR (virtual reality) rehabilitation trainings can effectively assist the patients to overcome the slacking effect and improve the ADLs.

In this project, an immersive VR rehabilitation system was established and a series of experiments was conducted based on the designed immersive tasks for rehabilitation in ADLs.

Firstly, the overall system was constructed based on Oculus Rift VR platform, the bilateral arm training task was designed, and the evaluation index was proposed.

Secondly, a series of experiments was conducted based on the designed bilateral arm training tasks, including the unilateral and bilateral comparison experiments and the verification experiments of learning effect. Furthermore, the experimental results were analyzed quantitatively.

Finally, a non-immersive VR rehabilitation system was built and a couple of experiments was conducted separately in non-immersive and immersive VR system based on the designed bilateral arm training tasks. Moreover, the rehabilitation effects were evaluated between the two systems.

In conclusion, grounded on the immersive VR system, a couple of experiments was conducted based on the designed immersive tasks for rehabilitation in ADLs, contributing to the verification of learning effect and the comparison between the unilateral and bilateral training method. Additionally, the rehabilitation effects of non- immersive and immersive VR rehabilitation system were further assessed in detail.

System Design

Architecture of Immersive Virtual Reality Rehabilitation System

The structure of the immersive virtual reality rehabilitation system is shown in the left. The patient's healthy side and affected side upper limbs simultaneously control the movement of the Oculus Touch handle. Oculus Sensor sensors track and detect the movement of both upper limbs in real time, and the virtual scene in Oculus Rift glasses follows the patient's head movement and body position changes in real time Update, and provide the patient with corresponding vision and audio feedback, so that the patient can clearly know the rehabilitation training task and the movement status of his own upper limbs.

Oculus Rift glasses, Oculus Touch handles and Oculus Sensor sensors are connected and interacted with data via Oculus software, and the real-time data transmission is carried out with virtual scenes through the VR interface of Unity3D and a series of software development kits.

During the experiment, the movement data of both hands, including the movement position, speed and acceleration, can be obtained in real time through the sensors in the Oculus Touch handle, and the user's hand movement status information can be obtained through the program component designed and written in the Unity3D model, facilitating the recording and analysis of subsequent experimental results.