5.Fundamental Study on Hidden Surface Removal for Interactions between User’s Bare Hands and Virtual Objects in Augmented Reality

Makoto Sakamoto, Takahiro Ishizu, Kenji Sakoma, Takahiro Shinoda, Amane Takei, Takao Ito
Pages 21-25
Abstract
Augmented reality (AR)technology is a technique of superimposing information generated by a computer on perceptual information that we receive from real space. Recently, much attention has been focused on interaction techniques between users and virtual objects, such as the user directlymanipulating virtual objects with his/her bare hands. On the other hand, in AR technology, since the 3-dimensional (3D) model is superimposed on the image of the real space afterwards, it is always displayed on the front side than the hand. Thus, it becomes an unnatural scene in some cases (occlusionproblem). In this study, this system considers the object-context relations between the user's hand and the virtual object by acquiring depth information of the user's finger.In the evaluation experiment, it is confirmed that the hidden surface removal in this study not only makes it possible to consider the object-context relations but also can distinguish between finger boundaries and to clarify and process finger contours.
Keywords:Augmented Reality (AR), Occlusion Problem, Hidden Surface Removal, Hand Detection