Self-driving AI wheelchair edges closer to aiding people with disabilities

by ,

Close up of footrest on wheelchair

Robot expert’s team has won $50,000 to further develop an eye-controlled, artificially intelligent wheelchair.

The research prize will help a team at Imperial College London to develop a self-driving, self-navigating wheelchair for paralysed people who can lead with their gaze. They also hope to make it available to the public at low cost.

Dr Aldo Faisal from Imperial’s Departments of Computing and Bioengineering, who leads the project, said: “Our wheelchair will help people to navigate their homes and the world outside. If the user can move their eyes to look at the world, they can operate the wheelchair that reads their intentions from their eyes.”

The prize was announced as part of Mobility Unlimited Challenge Discovery Award, which is funded by Toyota Mobility Foundation and run by Nesta’s Challenge Prize Centre.

Self-mapping, self-navigating

The self-driving artificially intelligent wheelchair combines existing widely available technologies, such as eye tracking system and laptops, with

The power of AI is becoming accessible and affordable to regular people. We at Imperial are harnessing its power to improve lives. Dr Aldo Faisal

electric wheelchairs. It uses a Light Detection and Ranging (LiDAR) sensor, which is an infrared-based sensor commonly used on self-driving cars, to build a 360-degree map of the user’s environment.

The eye tracker gathers information on eye movements, and the AI programme defines where the wheelchair should move to, and guides it to avoid obstacles.


Spinning LiDAR camera and eye tracker

The AI system uses the LiDAR to build maps of the environment as the wheelchair moves about, just as in self-driving cars.

LiDAR builds a map of surroundings in real time

Thanks to the AI and LiDAR components, users can now specify that they want to drive out of a cluttered kitchen, and leave it to the wheelchair to navigate the route and avoids obstacles without further human input.

The gaze-led wheelchair moves and can avoid obstacles thanks to the 3D map
"If the user can move their eyes, they can operate the wheelchair."

A frugal innovation

The technology will help severely disabled people restore their independence at low cost. Noyan Songur & Mahendran Subramanian

Dr Faisal said: “Our wheelchair is a great example of a frugal innovation. It also demonstrates that the power of AI is becoming accessible and affordable to regular people. We at Imperial are harnessing its power to improve lives.”

Graduate students on Aldo’s team, Noyan Songur and Mahendran Subramanian, said: “Such intelligent AI systems can learn and improve specific to the user over time, so we are able to work with patients from day one to pinpoint their needs and expectations. The technology will help severely disabled people restore their independence at low cost.”

The next stage of the Mobility Unlimited Challenge will be to compete for $1 million prize, for which the winner will be announced at the Tokyo 2020 Summer Paralympics. If won, this will go towards making necessary improvements and putting the wheelchair on the market.

Reporters

Martin Sayers

Martin Sayers
Communications Division

Click to expand or contract

Contact details

Tel: +44 (0)20 7594 8140
Email: m.sayers@imperial.ac.uk

Show all stories by this author

Caroline Brogan

Caroline Brogan
Communications Division

Click to expand or contract

Contact details

Tel: +44 (0)20 7594 3415
Email: caroline.brogan@imperial.ac.uk

Show all stories by this author

Tags:

Strategy-share-the-wonder, Year-of-Engineering, Artificial-intelligence, Disability-support, Research, Industry, Imaging, Strategy-multidisciplinary-research, Postdoctoral-researchers
See more tags