Using virtual reality — and mom’s sewing machine — for stroke rehab

For people recovering from a stroke, even the simplest motions can become a struggle. To lift a hand, for example, requires a signal from the brain that travels all the way down an arm to the hand. That’s a lot of moving parts — and when something is damaged, it makes regaining those skills an arduous and slow process.

That could all change, though, with the help of some innovation and advances in virtual reality.

It was almost by chance that USC researcher Sook-Lei Liew started thinking about virtual reality. She was a neuroscientist; so was her husband. When she became a USC faculty member in 2015, her husband got a job in the Mixed Reality Lab at the USC Institute for Creative Technologies — and, between the two, a brain trust was born between VR and stroke rehab.

For Liew, the light bulbs really started to flash when she attended the Neurotech conference — a big industry-academic partnership featuring the latest in tech advances. Liew had already been working on stroke rehab for a while and studying brain-feedback interfaces — devices that essentially allow patients to see what is going on inside their brains.

At the Neurotech conference, something clicked.

“There was a lot of tech, but not a lot of science behind it,” said Liew, who has joint appointments with the USC Division of Biokinesiology and Physical Therapy, the USC Chan Division of Occupational Science and Occupational Therapy, the Mark and Mary Stevens Neuroimaging and Informatics Institute and the Department of Neurology at the Keck School of Medicine of USC.

Liew started to dig into VR research and found some fascinating studies about bodies inside a VR system. One study showed that if you give someone an avatar with long arms in the virtual world, they interact with the real world as if they had long arms. The effect even lasts for 10 or 15 minutes after a person removes the VR headset.

And another study showed if you give someone a childlike body in VR, that person starts to have more childlike features in the real world.

That made Liew wonder something that would change her work forever: “If you give someone a healthy body in VR, will that help them recover their health?”

She launched a project in early 2016, submitting a grant proposal to the American Heart Association and receiving $150,000 to explore the possibility of a VR brain-computer interface to treat stroke survivors. She and her partners (initially her husband but then other researchers) wanted to create something that was low-cost and portable. Her lab, the Neural Plasticity and Neurorehabilitation Laboratory, was home base for the work.

Brain-computer interfaces

Most brain-computer interfaces used functional magnetic resistance imaging (fMRI), a huge and expensive technology that measures brain activity by detecting changes associated with blood flow.

“The problem is that it’s really hard to get somewhere if you have a severe stroke,” Liew said. “Typically you can’t drive and your mobility is impaired.” That made it all the more vital to get the device to people, rather than have people come to the tool.

The team built a prototype, using a laptop computer, an off-the-shelf VR rig, a $9 swim cap and an open-source brain-computer interface electroenchepalogram (EEG) system. Liew used her mother’s sewing machine to connect the electrodes to the cap. The whole system costs less than $5,000. It’s called REINVENT: Rehabilitation Environment using the Integration of Neuromuscular-based Virtual Enhancements for Neural Training.

How it works

This is how it works: The system uses virtual reality as well as brain and muscle sensors to show arm and hand movement in the virtual world when the patient has used the correct brain and muscle signals even if the patient cannot move his or her arm or hand in the real world. Over time, they can train the damaged circuits to work again.
So far, the system has only been tested on healthy older adults, but, in the next six months, it will be tested on people recovering from a stroke.

Ryan Spicer, a programmer analyst on the project, pointed out that older adults are generally a population that isn’t thought of as VR adopters — but some of them were very interested. The initial results showed that the healthy older adults were happy to use VR. Spicer said that, in the future, the activities and art could be tailored to each person’s interests.

The team demonstrated the project at the South by Southwest festival this year, and the experience was mind-bending for Liew.

“Our booth was across the hall from NASA, and they had a Mars habitat. Whereas we had a system that was sewn together with my mom’s sewing machine,” she said, with a laugh.
Still, she said they received great feedback during the conference. Out of 38 VR demonstrations, REINVENT won a special prize: special jury recognition for innovative use of virtual reality technology in the field of health.

Most of the demonstrated uses for VR are gaming or entertainment right now. But the future has got to include VR for health care, too.

Sook-Lei Liew

“Most of the demonstrated uses for VR are gaming or entertainment right now,” Liew pointed out. “But the future has got to include VR for health care, too.”
Are people in the future going to be controlling houses and cars with their brains? Liew thinks it’s unlikely.

“If you can use your hands, your brain has lots of experience telling your hand to manipulate things,” she said. “The area where VR is the most useful is where they allow us to do things we can’t otherwise do.” That could include, for example, immersive worlds to distract people while they’re getting chemo in the hospital. “It’s a way to take your body out of a situation,” Liew said.

David Krum, a computer scientist on the team, agrees.

“Everyone is excited about entertainment, but there are other uses for VR,” he said. “A lot of companies are more interested in monetizing games. Some of these other applications are a really important social good, but the economics of it are different.”

Liew sees VR as a true interdisciplinary venture: “It’s a blend of tech, industry, science and the clinic,” she said. “It really takes it to a whole new level.”