Gesture-based user interactions for product design review

Loading...
Thumbnail Image
Date
2017
Authors
Xiao, Yu
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Human-computer interactions (HCI) are essential in computer-aided design (CAD) systems. Replacing the traditional computer mouse and keyboard by gestures for the design input has aroused wide interests of researchers to improve the naturalness and intuitiveness of HCI. Gesture-based design review systems are developed in this thesis for the CAD model review. Body gestures and hand gestures are captured using Microsoft Kinect and Leap Motion Controller, respectively. A template-based method is applied for the gesture recognition with the average gesture recognition rate of over 80%. Three of the frequently-used CAD commands including translation, rotation and scaling are proposed using gestures for the design review process. Applications of the design review systems show that the proposed methods are able to effectively trigger required design review operations via gestures. Results of the user tests show that intuitiveness and naturalness of HCI are improved via gestures compared to traditional methods of the design input. Users can have a better understanding of the product design using body gestures for the assembly review, and hand gestures for the detail review.
Description
Keywords
HCI, Gesture recognition, Template mapping, CAD model manipualtion
Citation
Harvard