real-time occlusion handling in augmented reality based on an object tracking approach实时阻塞处理在增强现实技术基于对象跟踪的方法.pdfVIP

Sensors 2010, 10, 2885-2900; doi:10.3390/s100402885 OPEN ACCESS sensors ISSN 1424-8220 /journal/sensors Article Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach Yuan Tian, Tao Guan* and Cheng Wang Digital Engineering Simulation Research Center, Huazhong University of Science and Technology, Wuhan 430074, China; E-Mails: tianyuancolor@ (Y.T.); wangch@ (C.W.) * Author to whom correspondence should be addressed; E-Mail: qd_gt@126.com; Tel.: +86-027 Fax: +86-027 Received: 28 January 2010; in revised form: 2 March 2010 / Accepted: 14 March 2010 / Published: 29 March 2010 Abstract: To produce a realistic augmentation in Augmented Reality, the correct relative positions of real objects and virtual objects are very important. In this paper, we propose a novel real-time occlusion handling method based on an object tracking approach. Our method is divided into three steps: selection of the occluding object, object tracking and occlusion handling. The user selects the occluding object using an interactive segmentation method. The contour of the selected object is then tracked in the subsequent frames in real- time. In the occlusion handling step, all the pixels on the tracked object are redrawn on the unprocessed augmented image to produce a new synthesized image in which the relative position between the real and virtual object is correct. The proposed method has several