Tech allows people to play games with their thoughts

Engineers have created a program that allows people to use their thoughts to control video games.

The innovation is part of research into brain-computer interfaces to help improve the lives of people with motor disabilities.

The researchers incorporated machine learning capabilities with their brain-computer interface, making it a one-size-fits-all solution.

Typically, these devices require extensive calibration for each user—every brain is different, both healthy and disabled users—and this has been a major barrier to mainstream adoption. This new solution can quickly understand the needs of an individual subject and self-calibrate through iteration. This means that many patients can use the device without having to tune it to the individual.

“When we think about it in a clinical setting, this technology will make it so that we won’t need a specialized team to do this calibration process, which is long and tedious,” says Satyam Kumar, a graduate student in José’s lab. del R. Millán, a professor at the University of Texas at Austin Cockrell School of Engineering’s Department of Electrical and Computer Engineering and the Department of Neurology at the Dell Medical School. “It will be much faster to go from patient to patient.”

Research on the no-calibration interface appears in the PNAS Nexus.

Subjects wear a cap filled with electrodes that is connected to a computer. The electrodes collect data by measuring electrical signals from the brain, and the decoder interprets that information and translates it into game action.

Millán’s work on brain-computer interfaces helps users direct and strengthen their neural plasticity, the brain’s ability to change, grow and reorganize over time. These experiments are designed to improve brain function for patients and use devices controlled by brain-computer interfaces to make their lives easier.

In this case, the actions were twofold: the car racing game and a simpler task of balancing the left and right sides of a digital bar. An expert was trained to develop a “decoder” for the simplest tape task that makes it possible for the interface to translate brain waves into commands. The decoder serves as a baseline for other users and is the key to avoiding the lengthy calibration process.

The decoder worked well enough that subjects trained simultaneously on the grass game and the more complicated car racing game, which required thinking several steps ahead to make turns.

The researchers call this work fundamental, in that it sets the stage for further innovation of the brain-computer interface. This project used 18 subjects without motor impairment. Eventually, as they continue down this path, they will test this in people with motor impairments to apply it to larger groups in clinical settings.

“On the one hand, we want to translate BCI into the clinical field to help people with disabilities; on the other hand, we need to improve our technology to make it easier to use, so that the impact for these people with disabilities is stronger,” says Millán.

On the translational side of the research, Millán and his team continue to work on a wheelchair that users can drive with a brain-computer interface. At the South by Southwest Conference and Festivals this month, researchers demonstrated another potential use of the technology, controlling two hand and arm rehabilitation robots. This was not part of the new paper, but a sign of where this technology could go in the future. Some people volunteered and succeeded in operating brain-controlled robots within minutes.

“The purpose of this technology is to help people, to help them in their daily lives,” says Millán. “We will continue this path wherever it takes us in our quest to help people.”

Source: University of Texas at Austin

By admin

Leave a Reply

Your email address will not be published. Required fields are marked *