Mixed Reality (MR) opens a new dimension for Human Computer Interaction (HCI). Combined with comp... more Mixed Reality (MR) opens a new dimension for Human Computer Interaction (HCI). Combined with computer vision (CV) techniques, it is possible to create advanced input devices. This paper describes a novel form of HCI for the MR environment that combines CV with MR to allow a MR user to interact with a floating virtual touch screen using their bare hands. The system allows the visualisation of the virtual interfaces and touch screen through a Head Mounted Display (HMD). Visual tracking and interpretation of the user’s hand and finger motion allows the detection of key presses on the virtual touch screen. We describe an implementation of this type of interfaces and demonstrate the results through a virtual keypad application.
This paper describes two methods of fitting deformable templates when tracking articulated object... more This paper describes two methods of fitting deformable templates when tracking articulated objects using particle filters. One method fits a template to each of the links of an articulated object in a hierarchical way. The method first fits a template for the base of the articulated object and then fits a template for each of the links deeper in the hierarchy. The second method fits the whole articulated object as a rigid object, and then refines the fitting for each of the links of the articulated object in a hierarchical way, starting from the base. Advantages and disadvantages of each method are discussed and a way of combining the best of each method in a single tracker is presented.
In this paper we present an approach for animating a virtual hand model with the animation data e... more In this paper we present an approach for animating a virtual hand model with the animation data extracting from hand tracking results. We track the hand by using particle filters and deformable contour templates with a web camera; then we extend the 2D tracking results into 3D animation data using inverse kinematics method; finally, local frame based method is proposed to simulate a 3D virtual hand with the 3D animation data. Our system performs in real time.
Mixed Reality (MR) opens a new dimension for Human Computer Interaction (HCI). Combined with comp... more Mixed Reality (MR) opens a new dimension for Human Computer Interaction (HCI). Combined with computer vision (CV) techniques, it is possible to create advanced input devices. This paper describes a novel form of HCI for the MR environment that combines CV with MR to allow a MR user to interact with a floating virtual touch screen using their bare hands. The system allows the visualisation of the virtual interfaces and touch screen through a Head Mounted Display (HMD). Visual tracking and interpretation of the user’s hand and finger motion allows the detection of key presses on the virtual touch screen. We describe an implementation of this type of interfaces and demonstrate the results through a virtual keypad application.
This paper describes two methods of fitting deformable templates when tracking articulated object... more This paper describes two methods of fitting deformable templates when tracking articulated objects using particle filters. One method fits a template to each of the links of an articulated object in a hierarchical way. The method first fits a template for the base of the articulated object and then fits a template for each of the links deeper in the hierarchy. The second method fits the whole articulated object as a rigid object, and then refines the fitting for each of the links of the articulated object in a hierarchical way, starting from the base. Advantages and disadvantages of each method are discussed and a way of combining the best of each method in a single tracker is presented.
In this paper we present an approach for animating a virtual hand model with the animation data e... more In this paper we present an approach for animating a virtual hand model with the animation data extracting from hand tracking results. We track the hand by using particle filters and deformable contour templates with a web camera; then we extend the 2D tracking results into 3D animation data using inverse kinematics method; finally, local frame based method is proposed to simulate a 3D virtual hand with the 3D animation data. Our system performs in real time.
Uploads
Papers by Martin Tosas