Technical Briefs

Sensor Augmented Virtual Reality Based Teleoperation Using Mixed Autonomy

[+] Author and Article Information
Muthukkumar S. Kadavasal

Human Computer Interaction Program, Virtual Reality Applications Center, Iowa State University, Ames, IA 50010

James H. Oliver

Department of Mechanical Engineering, Virtual Reality Applications Center, Iowa State University, Ames, IA 50010

J. Comput. Inf. Sci. Eng 9(1), 014502 (Mar 03, 2009) (5 pages) doi:10.1115/1.3086030 History: Received August 29, 2007; Revised December 28, 2008; Published March 03, 2009

A multimodal teleoperation interface is introduced, featuring an integrated virtual reality (VR) based simulation augmented by sensors and image processing capabilities onboard the remotely operated vehicle. The proposed virtual reality interface fuses an existing VR model with live video feed and prediction states, thereby creating a multimodal control interface. VR addresses the typical limitations of video based teleoperation caused by signal lag and limited field of view, allowing the operator to navigate in a continuous fashion. The vehicle incorporates an onboard computer and a stereo vision system to facilitate obstacle detection. A vehicle adaptation system with a priori risk maps and a real-state tracking system enable temporary autonomous operation of the vehicle for local navigation around obstacles and automatic re-establishment of the vehicle’s teleoperated state. The system provides real time update of the virtual environment based on anomalies encountered by the vehicle. The VR based multimodal teleoperation interface is expected to be more adaptable and intuitive when compared with other interfaces.

Copyright © 2009 by American Society of Mechanical Engineers
Your Session has timed out. Please sign back in to continue.



Grahic Jump Location
Figure 2

Disparity map results for static camera

Grahic Jump Location
Figure 3

Risk map classification




Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In