Research Papers

Freehand Gesture and Tactile Interaction for Shape Design

[+] Author and Article Information
Monica Bordegoni, Giandomenico Caruso, Umberto Cugini

Department of Mechanical Engineering,
Politecnico di Milano,
Via La Masa 1,
Milano 20156, Italy

Mario Covarrubias

Department of Mechanical Engineering,
Politecnico di Milano,
Via La Masa 1,
Milano 20156, Italy
e-mail: mario.covarrubias@polimi.it

Contributed by the Computers and Information Division of ASME for publication in the JOURNAL OF COMPUTING AND INFORMATION SCIENCE IN ENGINEERING. Manuscript received January 18, 2016; final manuscript received March 16, 2016; published online November 7, 2016. Assoc. Editor: Charlie C.L. Wang.

J. Comput. Inf. Sci. Eng 16(4), 041002 (Nov 07, 2016) (7 pages) Paper No: JCISE-16-1026; doi: 10.1115/1.4033230 History: Received January 18, 2016; Revised March 16, 2016

This paper presents a novel system that allows product designers to design, experience, and modify new shapes of objects, starting from existing ones. The system allows designers to acquire and reconstruct the 3D model of a real object and to visualize and physically interact with this model. In addition, the system allows designer to modify the shape through physical manipulation of the 3D model and to eventually print it using a 3D printing technology. The system is developed by integrating state-of-the-art technologies in the sectors of reverse engineering, virtual reality, and haptic technology. The 3D model of an object is reconstructed by scanning its shape by means of a 3D scanning device. Then, the 3D model is imported into the virtual reality environment, which is used to render the 3D model of the object through an immersive head mounted display (HMD). The user can physically interact with the 3D model by using the desktop haptic strip for shape design (DHSSD), a 6 degrees of freedom servo-actuated developable metallic strip, which reproduces cross-sectional curves of 3D virtual objects. The DHSSD device is controlled by means of hand gestures recognized by a leap motion sensor.

Copyright © 2016 by ASME
Your Session has timed out. Please sign back in to continue.



Grahic Jump Location
Fig. 1

Product design process: (a) traditional approach and (b) proposed approach

Grahic Jump Location
Fig. 2

Structure sensor [17] and steps of the process used for scanning the geometry of an object

Grahic Jump Location
Fig. 3

MEC spline approach for representing the 2D cross section curve: (c) frontal view

Grahic Jump Location
Fig. 4

Interaction modalities using gestures tracked and recognized by the LeapMotion sensor. In (a) and (b), the user sees the virtual environment displayed on a desktop monitor and in (c) and (d) the user wears the Oculus Rift HMD.

Grahic Jump Location
Fig. 5

Example of global modification of the vacuum cleaner: (a) original CAD model, (b) mesh-editing grid for global and local modification, and (c) results for global modification modality

Grahic Jump Location
Fig. 6

System components and integration

Grahic Jump Location
Fig. 7

Examples of target curves selected on the digital model and physically rendered by the haptic strip: (a) the three target curves, (b) target curve “A,” (c) target curve “B,” and (d) target curve “C”

Grahic Jump Location
Fig. 8

Moving the virtual strip through the pinch gesture: (a) the pinch is recognized by LeapMotion, (b) the user moves the strip, and (c) continuous movement up to the desired position

Grahic Jump Location
Fig. 9

Moving the 3D model through the hand and/or the index finger: (a) the virtual strip “floating” in space and (b) the 3D model movement is driven by the hand and/or the index finger through leap motion




Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In