Projects
On Usage of EEG Brain Control for Rehabilitation of Stroke Patients

On Usage of EEG Brain Control for Rehabilitation of Stroke Patients

This paper demonstrates rapid prototyping of a stroke rehabilitation system consisting of an interactive 3D virtual reality computer game environment interfaced with an EEG headset for control and interaction using brain waves. The system is intended for training and rehabilitation of partially monoplegic stroke patients and uses low- cost commercial-off-the-shelf products like the Emotiv EPOC EEG headset and the Unity 3D game engine. A number of rehabilitation methods exist that can improve motor control and function of the paretic upper limb in stroke survivors. Unfortunately, most of these methods are commonly characterised by a number of drawbacks that can limit intensive treatment, including being repetitive, uninspiring, and labour intensive; requiring one-on-one manual interaction and assistance from a therapist, often for several weeks; and involve equipment and systems that are complex and expensive and cannot be used at home but only in hospitals and institutions by trained personnel. Inspired by the principles of mirror therapy and game-stimulated rehabilitation, we have developed a first prototype of a game-like computer application that tries to avoid these drawbacks. For rehabilitation purposes, we deprive the patient of the view of the paretic hand while being challenged with controlling a virtual hand in a simulated 3D game environment only by means of EEG brain waves interfaced with the computer. Whilst our system is only a first prototype, we hypothesise that by iteratively improving its design through refinements and tuning based on input from domain experts and testing on real patients, the system can be tailored for being used together with a conventional rehabilitation programme to improve patients’ ability to move the paretic limb much in the same vain as mirror therapy. Our proposed system has several advantages, including being game-based, customisable, adaptive, and extendable. In addition, when compared with conventional rehabilitation methods, our system is extremely low-cost and flexible, in particular because patients can use it in the comfort of their homes, with little or no need for professional human assistance. Preliminary tests are carried out to highlight the potential of the proposed rehabilitation system, however, in order to measure its efficiency in rehabilitation, the system must first be improved and then run through an extensive field test with a sufficiently large group of patients and compared with a control group.

Publications

Tom Verplaetse, Filippo Sanfilippo, Adrian Rutle, Ottar L. Osen, and Robin T. Bye. On Usage of EEG Brain Control for Rehabilitation of Stroke Patients. In Proceeding of the 30th European Conference on Modelling and Simulation (ECMS), Regensburg, Germany. 2016. (Best student paper award).

Related Articles

Share it!
On Usage of EEG Brain Control for Rehabilitation of Stroke Patients - Filippo Sanfilippo

Supervised Theses

Spring 2015
Interfacing an EEG Headset with a 3D Simulation Environment for Rehabilitation in Partially Paraplegic,Stroke Victims.
Student: Tom Verplaetse; BSc in Automation Engineering, Department of Engineering and Natural Sciences, AAUC.
Advisors: Robin Trulssen Bye, Filippo Sanfilippo.
Interfacing an EEG Headset with a 3D Simulation Environment for Rehabilitation in Partially Paraplegic,Stroke Victims
On the Usage of Single-Electrode EEG Devices for Biometric-Based Person Identification.
Students: Guilherme Felipe Bosger, Rodrigo Bessa Juliao, Hugo de Almeida Ribeiro; BSc in Automation Engineering, Department of Engineering and Natural Sciences, AAUC.
Advisors: Filippo Sanfilippo, Siebe van Albada.
On the Usage of Single-Electrode EEG Devices for Biometric-Based Person Identification
Active Heave Compensating Crane for Loading/Unloading of Platform Supply Vessels (PSV).
Students: Ivan Flatval, Ørjan Gjelseth; BSc in Automation Engineering, Department of Engineering and Natural Sciences, AAUC.
Company Contact: Dag Sverre Grønmyr, Rolls Royce
Marine.
Advisors: Siebe van Albada, Filippo Sanfilippo.
Active Heave Compensating Crane for Loading/Unloading of Platform Supply Vessels (PSV)

Supervised Student Projects

Among all the supervised student projects, a selection of them is listed in the following.

Summer 2015
Grasping and Locomotion for Modular Snake-Like Robots in a Search and Rescue Operations Scenario.

Student: Per Myren. Student Summer Job within the BSc in Automation Engineering, Department of Engineering and Natural Sciences, AAUC.
Advisors: Filippo Sanfilippo and Houxiang Zhang.
Grasping and Locomotion for Modular Snake-Like Robots in a Search and Rescue Operations Scenario
Fall 2014
Wearable Tactile Feedback Integration for Offshore Operations.

Students: Bjørn Tomren, Kai Henning Humberset and Rolf-Magnus Hjørungdal; within the course of Mechatronics, robots and deck machines, BSc in Automation Engineering, Department of Engineering and Natural Sciences, AAUC.
Advisors: Filippo Sanfilippo and Houxiang Zhang.
Wearable Tactile Feedback Integration for Offshore Operations
A Wave Simulator Framework for Offshore Crane Operations.

Students: Håkon Østrem, Håkon Eikrem and Bjarne
Humlen; within the course of Real-time computer programming, BSc in Automation Engineering, Department of Engineering and Natural Sciences, AAUC.
Advisors: Filippo Sanfilippo, Girts Strazdins, Ivar Blindheim and Webjørn Rekdalsbakken.
Within the following project: project description.
A Wave Simulator Framework for Offshore Crane Operations
A Camera Guided Laser Shooter for Tracking Moving Objects.

Students: Birger Skogeng Pedersen and Webjørn Yksnøy Bergmann; within the course of Real-time computer programming, BSc in Automation Engineering, Department of Engineering and Natural Sciences, AAUC.
Advisors: Filippo Sanfilippo, Girts Strazdins, Ivar Blindheim and Webjørn Rekdalsbakken.
Link: project demo.
A Camera Guided Laser Shooter for Tracking Moving Objects
Advanced Control Methods for a Search & Rescue Drone.

Students: Rolf Ottar Rovde, Kristian Østgaard and Kim Gjøran Robertsen; within the course of Real-time computer programming, BSc in Automation Engineering, Department of Engineering and Natural Sciences, AAUC.
Advisors: Filippo Sanfilippo, Girts Strazdins, Ivar Blindheim and Webjørn Rekdalsbakken.
Link: project demo.
Advanced Control Methods for a Search & Rescue Drone
An Automated Monitoring System for Detecting Suspicious Subjects in Crowded Areas.

Students: Benjamin Selvåg Skinnes, Øyvind Valderhaug Strømsheim and Steffen Sunde; within the course of Real-time computer programming, BSc in Automation Engineering, Department of Engineering and Natural Sciences, AAUC.
Advisors: Filippo Sanfilippo, Girts Strazdins, Ivar Blindheim and Webjørn Rekdalsbakken.
Link: project demo.
An Automated Monitoring System for Detecting Suspicious Subjects in Crowded Areas
Summer 2013
Development of an Integrated Virtual-Prototyping Framework for Designing Modular Robotic Hands.

Students: Stian Sandviknes, Ole Jonny Varhaugvik and
Andreas Bull Enger; Student Summer Job within the
BSc in Automation Engineering, Department of Engineering and Natural Sciences, AAUC.
Advisors: Filippo Sanfilippo and Houxiang Zhang.
Within the following project: project description.
Development of an Integrated Virtual-Prototyping Framework for Designing Modular Robotic Hands
Summer 2012
Haptic Feedback Integration for Maritime Crane Control.

Student: Lars Ivar Hatledal; Student Summer Job within the BSc in Automation Engineering, Department of Engineering and Natural Sciences, AAUC.
Advisors: Filippo Sanfilippo and Houxiang Zhang.
Within the following project: project description.
Haptic Feedback Integration for Maritime Crane Control
Spring 2012
A Modular Grasping Snake Robot.

Students: Gøncz Thomas, Frostad Katrine, Hjelme Camilla Hesseberg, Helland Thomas; within the
course of Mechatronics, robots and deck machines, BSc
in Automation Engineering, Department of Engineering and Natural Sciences, AAUC.
Advisors: Filippo Sanfilippo and Houxiang Zhang.
Link: project description.
The Demonstrator and Imitator Robots
The Demonstrator and Imitator Robots.

Students: Ole Martin Longva, Marius Pieroth Skinnes, Christian Steiner Nilsen, Jan Ove Strand; within the
course of Mechatronics, robots and deck machines, BSc
in Automation Engineering, Department of Engineering and Natural Sciences, AAUC.
Advisors: Filippo Sanfilippo and Houxiang Zhang.
Link: project description.
The Demonstrator and Imitator Robots
A Modular 5-Legged Robot.

Students: Håkon Sandanger Lunheim, Kenneth
Strandabø, Eskil Fjørtoft Breivik, Jonas Roald Nordstrand in one group and Lars Ivar Hatledal, Ådne
Heggem and Økland Higraff Espen in another group;
within the course of Mechatronics, robots and deck machines, BSc in Automation Engineering, Department of
Engineering and Natural Sciences, AAUC.
Advisors: Filippo Sanfilippo and Houxiang Zhang.
Link: project description.
A Modular 5-Legged Robot
A Modular H-Shaped 4-Legged Robot.

Students: Roy Perez Folke-Olsen, Kim Andrè Langelo,
Christoffer Flesjø Toverød; within the course of Mechatronics, robots and deck machines, BSc in Automation
Engineering, Department of Engineering and Natural
Sciences, AAUC.
Advisors: Filippo Sanfilippo and Houxiang Zhang.
Link: project description.
A Modular H-Shaped 4-Legged Robot
A Modular Robotic Hand with Vision Object Recognition capabilities.

Students: Kim Andrè Sund, Kjetil Thorsen, Svein Rune Stangeland, Brita Erica Godfrey; within the course ofMechatronics, robots and deck machines, BSc in Automation Engineering, Department of Engineering andNatural Sciences, AAUC.
Advisors: Filippo Sanfilippo and Houxiang Zhang.
Link: project description.
A Modular Robotic Hand with Vision Object Recognition capabilities

Funding Projects

The work concerning maritime cranes and robot was partly supported by the Research Council of Norway through the Centres of Excellence funding scheme, project number 223254 and the Innovation Programme for Maritime Activities and Offshore Operations, project number 217768. In this context, a close cooperation is established with different partners including Rolls-Royce Marine AS, Norway, Huse Engineering, and the Offshore Simulation Centre AS.

Support was also received from the Centre for Autonomous Marine Operations and Systems (AMOS), Research Council of Norway, Centres of Excellence funding scheme, project number 223254.

Regarding robotic hands, the work was partially supported by the European Commission with the Collaborative Project no. 248587, “THE Hand Embodied”, within the FP7-ICT- 2009-4-2-1 program “Cognitive Systems and Robotics” and the Collaborative EU-Project “Hands.dvi” in the context of ECHORD (European Clearing House for Open Robotics Development). In this context, a close cooperation was established with the Department of Advanced Robotics at the Istituto Italiano di Tecnologia, Italy, and the Department of Information Engineering at the University of Siena, Italy.

Filippo Sanfilippo