Development of a Biomechatronic Device for Motion Analysis Through a RGB-D Camera

Abstract

This work investigates the validity and reliability of a novel biomechatronic device providing an interactive environment in Augmented Reality (AR) for neuromotor rehabilitation. A RGB-depth camera and telemonitoring/remote signaling module are the main components of the device, together with a PC-based interface. The interactive environment, which implements some optimized algorithms of body motion capture and novel methodologies for human body motion analysis, enables neuromotor rehabilitation treatments that are adaptable to the performance and individual characteristics of the patient. The RGB-Depth camera module is implemented through a Microsoft Kinect, ORBBEC ZED2K devices; the telemonitoring module for teleassistance and therapy supervision is implemented as a cloud service.

Within the module of body motion tracking, the abduction and adduction movements of the limbs of the full-body structure are tracked and the joints angles are measured in real-time; the most distinctive feature of the tracking module is the control of the trunk and shoulder posture during the exercises performed by the patient. Indeed, the device recognizes an incorrect position of the patient's body that could affect the objective of the exercise to be performed.  The recognition of an incorrect exercise is associated to the generation of an alert both to the patient and the physician, in order to maximize the effectiveness of the treatment based on the user's potential and to increase the chances of a better biofeedback.

The experimental tests, which have been carried out by reproducing several neuromotor exercises on the interactive environment, show that the feature recognition and extraction of the joints and segments of the musculo-skeletal structure of the patient's, and of wrong posture during exercises, can achieve good performance in the different experimental conditions. 

The developed device is a valid tool for patients affected by chronic disability, but it could be extended to neurodegenerative diseases in the early stages of the disease. Thanks to the enhanced interactivity in augmented reality, the patient can overcome some difficulties in interaction with the most common IT tools and technologies; at the meanwhile she/he can perform rehabilitation at home. The physician can also check in real time the results and customize the care pathway.

The enhanced interactivity provided by the device during rehabilitation session increases both the motivation by the patient and the continuity of the care, as well as it supports low-cost remote assistance and telemedicine by optimizing therapy costs.

The key points are:

1. i) making rehabilitation motivating for the patient, becoming a "player";


2. ii) optimize effectiveness and costs;

iii) possibility of low-cost remote assistance and telemedicine.