Papers by Sebastian Herholz
Sparse Registration - 3D Reconstruction from Pairs of 2D Line Scans
Real-time gaze-tracking of freely moving observers for wall-sized displays
Vmv, 2008
ACM SIGGRAPH 2011 Posters on - SIGGRAPH '11, 2011
: Scene lit by a blue and yellow light source. Basic SSAO (left), the proposed approach (center) ... more : Scene lit by a blue and yellow light source. Basic SSAO (left), the proposed approach (center) and side-by-side comparison of a close-up (right). Accounting for directional occlusion and incoming radiance leads to realistic colors and shapes of the shadows.
2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video, 2010
Orientation estimation based on image data is a key technique in many applications. Robust estima... more Orientation estimation based on image data is a key technique in many applications. Robust estimates are possible in case of omnidirectional images due to the large field of view of the camera. Traditionally, techniques based on local image features have been applied to this kind of problem. Another very efficient technique is to formulate the problem in terms of correlation on the sphere and to solve it in Fourier space. While both methods claim to provide accurate and robust estimates, a quantitative comparison has not been reported yet. In this paper we evaluate the two approaches in terms of accuracy, image resolution and robustness to noise by comparing the estimated rotations of virtual as well as real images to ground-truth data.
Gaze-tracking of freely moving observers for wall-sized displays Vision, Modeling, and Visualization
Screen Space Spherical Harmonics Occlusion Sampling
Integrated real-time eye, head, and body tracking in front of a wall-sized display
SIFT vs. SOFT—A comparison of feature and correlation based rotation estimation for panoramic images
Sparse Registration-3D Reconstruction from Pairs of 2D Line
Dual space directional occlusion
The Visual Computer, 2013
ABSTRACT Current real-time ambient or directional occlusion approximation methods are either scre... more ABSTRACT Current real-time ambient or directional occlusion approximation methods are either screen space or object space based. Both methods suffer from drawbacks such as time incoherence and occlusion popping for screen space methods or loss of detailed occlusion effects caused by geometry simplification for object space methods. We present an algorithm that combines both methods to overcome these drawbacks. To avoid over or underestimations during the combination, we use the Spherical Harmonics representation of the directional occlusion information. We therefore combine “Screen Space Spherical Harmonics Occlusion” (Herholz et al. in VMV, 2012) with “Interactive Voxel Cone Tracing” (CT) (Crassin et al. in Comput. Graph. Forum, 2011). The result is a directional occlusion approximation including both occlusions from distant or not directly visible objects and detailed occlusions effects from fine geometrical structures. To increase the quality of CT for occlusion sampling, we also present several extensions such as view dependent cascaded voxelization and a method for voxel coverage estimation.
Real-time gaze-tracking of freely moving observers for wall-sized displays
Screen Space Spherical Harmonic Occlusion
Sparse Registration-3D Reconstruction from Pairs of 2D Line Scans
libGaze: an open-source library for computing gaze in real-time
libGaze: an open-source library for estimating the gaze of freely moving observers in real-time
Head mobility influences gaze behaviour across natural viewing tasks
We present a mobile system for tracking the gaze of an observer in real-time as they move around ... more We present a mobile system for tracking the gaze of an observer in real-time as they move around freely and interact with a wall-sized display. The system combines a head-mounted eye tracker with a motion capture system for tracking markers attached to the eye tracker. Our open-source software library libGaze provides routines for calibrating the system and computing the viewer's position and gaze direction in real-time. The modular architecture of our system supports simple replacement of each of the main components with alternative technology. We use the system to perform a psychophysical user-study, designed to measure how users visually explore large displays. We find that observers use head move-ments during gaze shifts, even when these are well within the range that can be comfortably reached by eye movements alone. This suggests that free movement is important in normal gaze behaviour,motivating further applications in which the tracked user is free to move.
Uploads
Papers by Sebastian Herholz