Neurable: A Game You Can Control With Your Mind [NYT]

8/28/2017

When you pull the headset over your eyes and the game begins, you are transported to a tiny room with white walls. Your task is to break out of the room, but you cannot use your hands. There is no joystick or game pad. You must use your thoughts.

You turn toward a ball on the floor, and your brain sends a command to pick it up. With another thought, you send the ball crashing into a mirror, breaking the glass and revealing a few numbers scribbled on a wall. You mentally type those numbers into a large keypad by the door. And you are out.

Designed by Neurable, a small start-up founded by Ramses Alcaide, an electrical engineer and neuroscientist, the game offers what you might call a computer mouse for the mind, a way of selecting items in a virtual world with your thoughts.

Incorporating a headset with virtual reality goggles and sensors that can read your brain waves, this prototype is a few years from the market. And it is limited in what it can do. You cannot select an object with your mind unless you first look in its general direction, narrowing the number of items you may be considering.

But it works. I recently played the game, which has the working title Awakening, when Mr. Alcaide and two Neurable employees passed through San Francisco, and a few hundred others tried it this month at the Siggraph computer graphics conference in Los Angeles.

The prototype is among the earliest fruits of a widespread effort to embrace technology that was once science fiction — and in some ways still is. Driven by recent investments from the United States government and by the herd mentality that so often characterizes the tech world, a number of a start-ups and bigger companies like Facebook are working on ways to mentally control machines. They are also looking for smoother ways to use virtual reality technology.

“Neurotechnology has become cool,” said Ed Boyden, a professor of biological engineering and brain and cognitive sciences at the M.I.T. Media Lab who advises one of those start-ups.

But it works. I recently played the game, which has the working title Awakening, when Mr. Alcaide and two Neurable employees passed through San Francisco, and a few hundred others tried it this month at the Siggraph computer graphics conference in Los Angeles.

The prototype is among the earliest fruits of a widespread effort to embrace technology that was once science fiction — and in some ways still is. Driven by recent investments from the United States government and by the herd mentality that so often characterizes the tech world, a number of a start-ups and bigger companies like Facebook are working on ways to mentally control machines. They are also looking for smoother ways to use virtual reality technology.

“Neurotechnology has become cool,” said Ed Boyden, a professor of biological engineering and brain and cognitive sciences at the M.I.T. Media Lab who advises one of those start-ups.

After you do this for a few minutes, the game learns to recognize when you are concentrating on an item. “We look at specific brain signals,” Mr. Alcaide said, “and once we understand them, we can use them.”

When you play the game, the same light bounces around the virtual room. When it hits the item you are thinking about, the system can identify the increase in brain activity.

The technique works with equipment that already exists. Neurable’s prototype uses virtual reality goggles from HTC, a consumer electronics company, and seven EEG sensors placed at specific spots around your head. But given the physical limits of what these sensors can read, an EEG-based game is unlikely to do more than slowly and simply select digital objects.

Some companies are working to move beyond that. Facebook, for example, is exploring methods for optically reading brain activity from outside the skull. Such a system would shine light into the brain to directly read chemical changes.

“What if you could type directly from your brain?” Regina Dugan of Facebook said this spring as she unveiled the company’s efforts to build this kind of optical interface. “It sounds impossible, but it’s closer than you may realize.” In a few years, she said, Facebook hopes to have a system that allows people to type with their thoughts five times faster than they now type using a smartphone keyboard.

That is well beyond the realm of current research, and a number of neuroscientists question whether it will ever be possible, arguing that such speed will only come with devices planted inside the skull.

Several start-ups are now working to do just that. But some, including a Silicon Valley start-up called Paradromics, hope to do this as a way of treating people with medical conditions like blindness, deafness and paralysis.

Implanting hardware in the brain is dangerous, but the reward for patients could outweigh the risks. For companies like Paradromics, the goal is to significantly refine and expand the current methods, providing a faster and more complete way for patients to operate machines with their thoughts.

Mr. Musk’s Neuralink is moving in a similar direction, but the company’s ambitions appear to stretch much further, to eventually implanting chips in healthy people’s brains.

The dangers of brain surgery make this unlikely. But Mr. Boyden said there were some possibilities.

“I do find it implausible that an implant would go directly into the brain of someone with zero health problems,” he said. “But if companies take the right approach in helping people with the greatest need, then there may be a way for this to spread into people with less severe conditions, and then eventually become a kind of brain augmentation.”

Certainly, many of these projects will be met with skepticism. And Silicon Valley’s enthusiasm does not always mesh with the physical limitations of medicine and the human body.

“In the physical sciences, there are physical boundaries,” said Matt Angle, a neuroscientist and the founder of Paradromics. “To think that you’ll be able to blow through fundamental laws by sheer ambition and enthusiasm is naïve.”