Research & Development World

  • R&D World Home
  • Topics
    • Aerospace
    • Automotive
    • Biotech
    • Careers
    • Chemistry
    • Environment
    • Energy
    • Life Science
    • Material Science
    • R&D Management
    • Physics
  • Technology
    • 3D Printing
    • A.I./Robotics
    • Software
    • Battery Technology
    • Controlled Environments
      • Cleanrooms
      • Graphene
      • Lasers
      • Regulations/Standards
      • Sensors
    • Imaging
    • Nanotechnology
    • Scientific Computing
      • Big Data
      • HPC/Supercomputing
      • Informatics
      • Security
    • Semiconductors
  • R&D Market Pulse
  • R&D 100
    • Call for Nominations: The 2025 R&D 100 Awards
    • R&D 100 Awards Event
    • R&D 100 Submissions
    • Winner Archive
    • Explore the 2024 R&D 100 award winners and finalists
  • Resources
    • Research Reports
    • Digital Issues
    • R&D Index
    • Subscribe
    • Video
    • Webinars
  • Global Funding Forecast
  • Top Labs
  • Advertise
  • SUBSCRIBE

Workers Could Use VR to Operate Robots Remotely

By Kenny Walter | October 6, 2017

VR system from Computer Science and Artificial Intelligence Laboratory could make it easier for factory workers to telecommute. Credit: Jason Dorfman, MIT CSAIL

While it is inevitable that robots are coming to the assembly line, thanks to virtual reality the supervisor may not even need to be in the same building.

Researcher’s from the Massachusetts Institute of Technology’s Computer Science and Artificial Intelligence Laboratory (CSAIL) have developed a virtual reality system that enables a user to teleoperate a robot using an Oculus Rift headset, which could transform how robots and virtual reality is used in industry.

The system allows a user in a VR control room with multiple sensor displayers to feel like they are inside the robot’s head and match their movements to the robot’s to complete various tasks by using gestures.

“A system like this could eventually help humans supervise robots from a distance,” CSAIL postdoctoral associate Jeffrey Lipton said in a statement. “By teleoperating robots from home, blue-collar workers would be able to tele-commute and benefit from the IT revolution just as white-collars workers do now.”

In the past, researchers have either used a direct model for teleoperation, with VR where the user’s vision is directly coupled to the robot’s state, or the cyber-physical model, where the user interacts with a virtual copy of the robot and the environment.

The CSAIL team combined the two methods to solve the delay issue associated with the direct model, while also solving the need for a similar environment because the user logs into a virtual system inside of the robot’s head.

Using the Oculus controller, a user can interact with controls that appear in the virtual space to open and close the hand grippers to pick up, move and retrieve items.      

A user can also plan movements based on the distance between the arm’s location marker and their hand while looking at the live display of the arm.

For the movements to be possible the researchers mapped the human’s space into the virtual space and then mapped the virtual space into the robot space to provide a sense of co-location.

The team successfully controlled the Baxter humanoid robot from Rethink Robots, but believe that the approach would work with other robot platforms as well.

During testing, users grasped objects 95 percent of the time and were 57 percent faster at completing tasks. The teams also were able to pilot the robot from hundreds of miles away.

The next step will be to focus on making the system more scalable for many users with different types of robots that can be compatible with current automation technologies. 

 

Related Articles Read More >

Is your factory (or lab) ready to think? An insider’s take on next-gen automation and what really works
8 reasons all is not well in GenAI land
Efficiency first: Sandia’s new director balances AI drive with deterrent work
GreyB’s AI-driven Slate offers single search across 160 million patents, 264 million papers
rd newsletter
EXPAND YOUR KNOWLEDGE AND STAY CONNECTED
Get the latest info on technologies, trends, and strategies in Research & Development.
RD 25 Power Index

R&D World Digital Issues

Fall 2024 issue

Browse the most current issue of R&D World and back issues in an easy to use high quality format. Clip, share and download with the leading R&D magazine today.

Research & Development World
  • Subscribe to R&D World Magazine
  • Enews Sign Up
  • Contact Us
  • About Us
  • Drug Discovery & Development
  • Pharmaceutical Processing
  • Global Funding Forecast

Copyright © 2025 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search R&D World

  • R&D World Home
  • Topics
    • Aerospace
    • Automotive
    • Biotech
    • Careers
    • Chemistry
    • Environment
    • Energy
    • Life Science
    • Material Science
    • R&D Management
    • Physics
  • Technology
    • 3D Printing
    • A.I./Robotics
    • Software
    • Battery Technology
    • Controlled Environments
      • Cleanrooms
      • Graphene
      • Lasers
      • Regulations/Standards
      • Sensors
    • Imaging
    • Nanotechnology
    • Scientific Computing
      • Big Data
      • HPC/Supercomputing
      • Informatics
      • Security
    • Semiconductors
  • R&D Market Pulse
  • R&D 100
    • Call for Nominations: The 2025 R&D 100 Awards
    • R&D 100 Awards Event
    • R&D 100 Submissions
    • Winner Archive
    • Explore the 2024 R&D 100 award winners and finalists
  • Resources
    • Research Reports
    • Digital Issues
    • R&D Index
    • Subscribe
    • Video
    • Webinars
  • Global Funding Forecast
  • Top Labs
  • Advertise
  • SUBSCRIBE