A wheelchair control system using human-machine interaction: single-modal and multimodal approaches

Shahin, MK, Tharwat, A, Gaber, T ORCID: https://orcid.org/0000-0003-4065-4191 and Hassanien, AE 2017, 'A wheelchair control system using human-machine interaction: single-modal and multimodal approaches' , Journal of Intelligent Systems, 28 (1) .

[img] PDF - Accepted Version
Restricted to Repository staff only

Download (3MB) | Request a copy


Recent research studies showed that brain-controlled systems/devices are breakthrough technology. Such devices can provide disabled people with the power to control the movement of the wheelchair using different signals (e.g. EEG signals, head movements, and facial expressions). With this technology, disabled people can remotely steer a wheelchair, a computer, or a tablet. This paper introduces a simple, low-cost human-machine interface system to help chaired people to control their wheelchair using several control sources. To achieve this paper’s aim, a laptop was installed on a wheelchair in front of the sitting person, and the 14-electrode Emotiv EPOC headset was used to collect the person’s head impressions from the skull surface. The superficially picked-up signals, containing the brain thoughts, head gestures, and facial emotions, were electrically encoded and then wirelessly sent to a personal computer to be interpreted and then translated into useful control instructions. Using these signals, two wheelchair control modes were proposed: automatic (using single-modal and multimodal approaches) and manual control. The automatic mode controller was accomplished using a software controller (Arduino), whereas a simple hardware controller was used for the manual mode. The proposed solution was designed using wheelchair, Emotiv EPOC EEG headset, Arduino microcontroller, and Processing language. It was then tested by totally chaired volunteers under different levels of trajectories. The results showed that the person’s thoughts can be used to seamlessly control his/her wheelchair and the proposed system can be configured to suit many levels and degrees of disability.

Item Type: Article
Schools: Schools > School of Computing, Science and Engineering > Salford Innovation Research Centre
Journal or Publication Title: Journal of Intelligent Systems
Publisher: De Gruyter
ISSN: 0334-1860
Related URLs:
Depositing User: Dr. Tarek Gaber
Date Deposited: 05 Sep 2019 12:52
Last Modified: 16 Feb 2022 02:31
URI: https://usir.salford.ac.uk/id/eprint/52064

Actions (login required)

Edit record (repository staff only) Edit record (repository staff only)


Downloads per month over past year