Mind Control of Robotic Arm
December 14, 2016 | University of Minnesota College of Science and EngineeringEstimated reading time: 3 minutes
Researchers at the University of Minnesota have made a major breakthrough that allows people to control a robotic arm using only their minds. The research has the potential to help millions of people who are paralyzed or have neurodegenerative diseases.
“This is the first time in the world that people can operate a robotic arm to reach and grasp objects in a complex 3D environment using only their thoughts without a brain implant,” said Bin He, a University of Minnesota biomedical engineering professor and lead researcher on the study. “Just by imagining moving their arms, they were able to move the robotic arm.”
The noninvasive technique, called electroencephalography (EEG) based brain-computer interface, records weak electrical activity of the subjects’ brain through a specialized, high-tech EEG cap fitted with 64 electrodes and converts the “thoughts” into action by advanced signal processing and machine learning.
Eight healthy human subjects completed the experimental sessions of the study wearing the EEG cap. Subjects gradually learned to imagine moving their own arms without actually moving them to control a robotic arm in 3D space. They started from learning to control a virtual cursor on computer screen and then learned to control a robotic arm to reach and grasp objects in fixed locations on a table. Eventually, they were able to move the robotic arm to reach and grasp objects in random locations on a table and move objects from the table to a three-layer shelf by only thinking about these movements.
All eight subjects could control a robotic arm to pick up objects in fixed locations with an average success rate above 80 percent and move objects from the table onto the shelf with an average success rate above 70 percent.
“This is exciting as all subjects accomplished the tasks using a completely noninvasive technique. We see a big potential for this research to help people who are paralyzed or have neurodegenerative diseases to become more independent without a need for surgical implants,” He said.
The researchers said the brain-computer interface technology works due to the geography of the motor cortex—the area of the cerebrum that governs movement. When humans move, or think about a movement, neurons in the motor cortex produce tiny electric currents. Thinking about a different movement activates a new assortment of neurons, a phenomenon confirmed by cross-validation using functional MRI in He’s previous study. Sorting out these assortments using advanced signal processing laid the groundwork for the brain-computer interface used by the University of Minnesota researchers, He said.
The robotic arm research builds upon He’s research published three years ago in which subjects were able to fly a small quadcopter using the noninvasive EEG technology. The research gained international media attention.
“Three years ago, we weren’t sure moving a more complex robotic arm to grasp and move objects using this brain-computer interface technology could even be achieved,” He said. “We’re happily surprised that it worked with a high success rate and in a group of people.”
He anticipates the next step of his research will be to further develop this brain-computer interface technology realizing a brain-controlled robotic prosthetic limb attached to a person’s body or examine how this technology could work with someone who has had a stroke or is paralyzed.
In addition to Professor He, who also serves as director of the University of Minnesota Institute for Engineering in Medicine, the research team includes biomedical engineering postdoctoral researcher Jianjun Meng (first author); biomedical engineering graduate student Bryan Baxter; Institute for Engineering in Medicine staff member Angeliki Bekyo; and biomedical engineering undergraduate students Shuying Zhang and Jaron Olsoe. The researchers are affiliated with the University of Minnesota College of Science and Engineering and the Medical School.
The University of Minnesota study was funded by the National Science Foundation (NSF), the National Center for Complementary and Integrative Health, National Institute of Biomedical Imaging and Bioengineering, and National Institute of Neurological Disorders and Stroke of the National Institutes of Health (NIH), and the University of Minnesota’s MnDRIVE (Minnesota’s Discovery, Research and InnoVation Economy) Initiative funded by the Minnesota Legislature.
Suggested Items
Siemens, Sony Deliver Breakthrough Immersive Engineering for the Industrial Metaverse
01/09/2025 | Siemens Digital IndustriesSiemens Digital Industries Software, in collaboration with Sony Corporation, announced today that it is delivering on its next-generation immersive engineering roadmap that brings together Siemens’ NX software for product engineering with Sony’s breakthrough head-mounted display (HMD) to enable the industrial metaverse.
The Test Connection, Inc. Celebrates 45 Years of Excellence in Test Engineering Solutions
01/06/2025 | The Test Connection Inc.The Test Connection Inc. (TTCI), a leading provider of electronic test and manufacturing solutions, proudly marks its 45th anniversary in 2025, celebrating decades of delivering high-quality test engineering solutions to the electronics industry. Founded in 1980 by Bill Horner, TTCI emerged as a pioneer in response to the increasing demand for outsourced test engineering products and services. Since its inception, the company has built a legacy of innovation, technical expertise, and world-class customer service.
P&R Measurement Showcases AI-Empowered Solutions at CES 2025
01/03/2025 | PRNewswireP&R Measurement, a leader in precision measurement and control solutions, is set to make a groundbreaking announcement at CES 2025, taking place from January 7 to 10 in Las Vegas. As the world's largest consumer electronics event, CES 2025 (Consumer Electronics Show®) will focus on the theme "Dive In," exploring how the synergy between humanity and next-generation technologies can address global challenges and shape the future.
Spotlight on PEDC: Filbert Arzola
12/19/2024 | Andy Shaughnessy, Design007 MagazineIPC and FED have teamed up to create a new PCB design conference in Vienna, Austria. The Pan-European Electronics Design Conference (PEDC) takes place Jan. 29-30 at the NH Danube City hotel in Vienna. Raytheon’s Filbert Arzola is presenting “Engineering and Adapting Model-based PCB Design in Step with Sustainability and Digital Twins” at PEDC. I asked Filbert to discuss what attendees can expect from his class.
Accurate Circuit Engineering on Passion and Pushing the Envelope
12/03/2024 | Andy Shaughnessy, Design007 MagazineIn this interview at PCB Carolina in November, James Hofer, general manager of Accurate Circuit Engineering (ACE), shares insights into the company’s innovative approach to component embedding and highlights the passion and dedication driving his team’s commitment to quality and innovation in PCB manufacturing. James is still having fun as they push boundaries and do some pretty cool things in the process.