Proceeding CHI '15 Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems
Distant pointing at objects and persons is a highly expressive gesture that is widely used in hum... more Distant pointing at objects and persons is a highly expressive gesture that is widely used in human communication. Pointing is also used to control a range of interactive systems. For determining where a user is pointing at, different ray casting methods have been proposed. In this paper we assess how accurately humans point over distance and how to improve it. Participants pointed at projected targets on a wall display from 2m and 3m while standing and sitting. Testing three common ray casting methods, we found that even with the most accurate one the average error is 61.3cm. We found that all tested ray casting methods are affected by systematic displacements. Therefore, we trained a polynomial to compensate this displacement. We show that using a user-, pose-, and distant-independent quartic polynomial can reduce the average error by 37.3%.
Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services - MobileHCI '11, 2011
Abstract In the search for novel and more expressive interaction techniques for mobile devices, b... more Abstract In the search for novel and more expressive interaction techniques for mobile devices, bodily aspects such as movement, gesture, and touch based interfaces are prominent. For instance, touch-screen gestures have found widespread application in ...
… of the fifth international conference on …, Jan 1, 2011
Nowadays, mobile devices provide new possibilities for gesture interaction due to the large range... more Nowadays, mobile devices provide new possibilities for gesture interaction due to the large range of embedded sensors they have and their physical form factor. In addition, auditory interfaces can now be more easily supported through advanced mobile computing capabilities. Although different types of gesture techniques have been proposed for handheld devices, there is still little knowledge about the acceptability and use of some of these techniques, especially in the context of an auditory interface. In this paper, we propose a novel approach to the problem by studying the design space of gestures proposed by end-users for a mobile auditory interface. We discuss the results of this explorative study, in terms of the scope of the gestures proposed, the tangible aspects, and the users’ preferences. This study delivers some initial gestures recommendations for eyes-free auditory interfaces.
We have put forwards significant evidence to support that declarativeness and openness are needed... more We have put forwards significant evidence to support that declarativeness and openness are needed to deal with a plethora of systems, composed by several autonomous entities which collaborate and interact to the aim of achieving complex goals, impossible to be accomplished on their own. We have considered four challenging settings, namely Business Process Management, Clinical Guidelines, Service Oriented and Multi-Agent Systems. We have argued that all these application domains require a suitable balance between ...
Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems Extended Abstracts - CHI EA '12, 2012
I am motivated by the idea to capitalize the hand's abilities for becoming a natural input device... more I am motivated by the idea to capitalize the hand's abilities for becoming a natural input device. This can be achieved through finger-worn sensors that track their movements. I am particular interested in finger gestures that are feasible while grasping devices. Executing gestures on a steering wheel while driving, such as those seen in , are just some examples of interactions, which would not require any devicerelease. The resulting question is: To what extent can users interact with grasped objects through tiny microgestures that are performed while grasping? This extended abstract shows the progress of my research and presents the design of a study that is in preparation. Around this study design I formulated research questions. My approach aims to apply motor and mental models for designing interactions and interfaces regarding human motor abilities, interaction favors, and the mental model of themselves within their environment.
Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion - MobileHCI '12, 2012
ABSTRACT Regardless of how gestural phone interaction (like pinching on a touch screen for conten... more ABSTRACT Regardless of how gestural phone interaction (like pinching on a touch screen for content zooming) is implemented in almost any mobile device; there are still no design guidelines for gestural control. These should be designed with respect to ergonomics and hand anatomy. There are many human-side aspects to take care of when designing gestures. We evaluate gestures regarding the ergonomic aspects while interacting with mobile devices and present ergonomic requirements of finger gestures on the back and side of a vertically and as well as horizontally hand-held phone, such as dragging and lifting fingers from the surface. The results suggest that drag and lift gestures have the potential to be executed one-handed while using the phone and that certain device configurations may be accessed seamlessly with that type of gesture control.
Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction - TEI '13, 2013
ABSTRACT Sensory hand augmentation extends the manual function spectrum from controlling analogue... more ABSTRACT Sensory hand augmentation extends the manual function spectrum from controlling analogue objects to digital or smart objects but also might add an interface to any graspable thing and therefore add a digital interface to everyday objects. We propose a finger-attached interface to control grasped objects intended to explore design parameters for always available interfaces. Our device detects finger motions and classifies them according to a set of five gestures. In user studies we found that our gesture classification has a stable performance with respect to different organic-shaped surfaces. Finally, the scalability of our approach towards generic object control will point out its potential.
Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction - TEI '13, 2013
ABSTRACT We present a wearable interface that consists of motion sensors. As the interface can be... more ABSTRACT We present a wearable interface that consists of motion sensors. As the interface can be worn on the user's fingers (as a ring) or fixed to it (with nail polish), the device controlled by finger gestures can be any generic object, provided they have an interface for receiving the sensor's signal. We implemented four gestures: tap, release, swipe, and pitch, all of which can be executed with a finger of the hand holding the device. In a user study we tested gesture appropriateness for the index finger at the back of a handheld tablet that offered three different form factors on its rear: flat, convex, and concave (undercut). For all three shapes, the gesture performance was equally good, however pitch performed better on all surfaces than swipe. The proposed interface is an example towards the idea of ubiquitous computing and the vision of seamless interactions with grasped objects. As an initial application scenario we implemented a camera control that allows the brightness to be configured using our tested gestures on a common SLR device.
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15, 2015
People use gestures to give verbal communication more expression and also to replace the speech. ... more People use gestures to give verbal communication more expression and also to replace the speech. One of the most concise and expressive gestures is the pointing gesture. Pointing gesture can be observed in the early childhood. In these early years, it is used to point at objects or people. Later, people use pointing gestures even for more complex things such as to visualize directions. Increasing pointing gestures are also used for interacting with computers. For example, gestures can be used to remotely interact with a display, without using an input tool. In this work we investigated how people point to objects and how the recognition accuracy can be improved by using a gesture recognition system. We performed a user study, where participants had to point on projected pointing targets. These gestures were recorded as reference data with the help of motion capture system. We used a variety of starting positions in which the study was carried out. For this the participants were placed with a distance of 2 to 3 meters to the pointing targets. At these two positions the participants had to sit and stand while pointing to the targets. From the recorded reference data we derived a pointing vector. Each vector describes the direction in which the gesture is directed. We generate these vectors out of different body parts. This is done to show that there are different ways to create these vectors but they behave all the same. In the optimal case, this vector would describe the path of the person pointing to the object, in this case, the projected point. By mathematical analyzes we show that in average over several experiments and over several participants a systematic deviation from this optimal vector can be detected. We specify models, which can compensate the systematic deviation. These models shift the pointing vector in the direction of the average distance between optimum and average study vector. Products of the consumer market can be used to detect pointing gestures. There gestures can be improved with the generated models. The focus here is, for example, products like the Kinect.
Proceeding CHI '15 Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems
Distant pointing at objects and persons is a highly expressive gesture that is widely used in hum... more Distant pointing at objects and persons is a highly expressive gesture that is widely used in human communication. Pointing is also used to control a range of interactive systems. For determining where a user is pointing at, different ray casting methods have been proposed. In this paper we assess how accurately humans point over distance and how to improve it. Participants pointed at projected targets on a wall display from 2m and 3m while standing and sitting. Testing three common ray casting methods, we found that even with the most accurate one the average error is 61.3cm. We found that all tested ray casting methods are affected by systematic displacements. Therefore, we trained a polynomial to compensate this displacement. We show that using a user-, pose-, and distant-independent quartic polynomial can reduce the average error by 37.3%.
Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services - MobileHCI '11, 2011
Abstract In the search for novel and more expressive interaction techniques for mobile devices, b... more Abstract In the search for novel and more expressive interaction techniques for mobile devices, bodily aspects such as movement, gesture, and touch based interfaces are prominent. For instance, touch-screen gestures have found widespread application in ...
… of the fifth international conference on …, Jan 1, 2011
Nowadays, mobile devices provide new possibilities for gesture interaction due to the large range... more Nowadays, mobile devices provide new possibilities for gesture interaction due to the large range of embedded sensors they have and their physical form factor. In addition, auditory interfaces can now be more easily supported through advanced mobile computing capabilities. Although different types of gesture techniques have been proposed for handheld devices, there is still little knowledge about the acceptability and use of some of these techniques, especially in the context of an auditory interface. In this paper, we propose a novel approach to the problem by studying the design space of gestures proposed by end-users for a mobile auditory interface. We discuss the results of this explorative study, in terms of the scope of the gestures proposed, the tangible aspects, and the users’ preferences. This study delivers some initial gestures recommendations for eyes-free auditory interfaces.
We have put forwards significant evidence to support that declarativeness and openness are needed... more We have put forwards significant evidence to support that declarativeness and openness are needed to deal with a plethora of systems, composed by several autonomous entities which collaborate and interact to the aim of achieving complex goals, impossible to be accomplished on their own. We have considered four challenging settings, namely Business Process Management, Clinical Guidelines, Service Oriented and Multi-Agent Systems. We have argued that all these application domains require a suitable balance between ...
Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems Extended Abstracts - CHI EA '12, 2012
I am motivated by the idea to capitalize the hand's abilities for becoming a natural input device... more I am motivated by the idea to capitalize the hand's abilities for becoming a natural input device. This can be achieved through finger-worn sensors that track their movements. I am particular interested in finger gestures that are feasible while grasping devices. Executing gestures on a steering wheel while driving, such as those seen in , are just some examples of interactions, which would not require any devicerelease. The resulting question is: To what extent can users interact with grasped objects through tiny microgestures that are performed while grasping? This extended abstract shows the progress of my research and presents the design of a study that is in preparation. Around this study design I formulated research questions. My approach aims to apply motor and mental models for designing interactions and interfaces regarding human motor abilities, interaction favors, and the mental model of themselves within their environment.
Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion - MobileHCI '12, 2012
ABSTRACT Regardless of how gestural phone interaction (like pinching on a touch screen for conten... more ABSTRACT Regardless of how gestural phone interaction (like pinching on a touch screen for content zooming) is implemented in almost any mobile device; there are still no design guidelines for gestural control. These should be designed with respect to ergonomics and hand anatomy. There are many human-side aspects to take care of when designing gestures. We evaluate gestures regarding the ergonomic aspects while interacting with mobile devices and present ergonomic requirements of finger gestures on the back and side of a vertically and as well as horizontally hand-held phone, such as dragging and lifting fingers from the surface. The results suggest that drag and lift gestures have the potential to be executed one-handed while using the phone and that certain device configurations may be accessed seamlessly with that type of gesture control.
Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction - TEI '13, 2013
ABSTRACT Sensory hand augmentation extends the manual function spectrum from controlling analogue... more ABSTRACT Sensory hand augmentation extends the manual function spectrum from controlling analogue objects to digital or smart objects but also might add an interface to any graspable thing and therefore add a digital interface to everyday objects. We propose a finger-attached interface to control grasped objects intended to explore design parameters for always available interfaces. Our device detects finger motions and classifies them according to a set of five gestures. In user studies we found that our gesture classification has a stable performance with respect to different organic-shaped surfaces. Finally, the scalability of our approach towards generic object control will point out its potential.
Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction - TEI '13, 2013
ABSTRACT We present a wearable interface that consists of motion sensors. As the interface can be... more ABSTRACT We present a wearable interface that consists of motion sensors. As the interface can be worn on the user's fingers (as a ring) or fixed to it (with nail polish), the device controlled by finger gestures can be any generic object, provided they have an interface for receiving the sensor's signal. We implemented four gestures: tap, release, swipe, and pitch, all of which can be executed with a finger of the hand holding the device. In a user study we tested gesture appropriateness for the index finger at the back of a handheld tablet that offered three different form factors on its rear: flat, convex, and concave (undercut). For all three shapes, the gesture performance was equally good, however pitch performed better on all surfaces than swipe. The proposed interface is an example towards the idea of ubiquitous computing and the vision of seamless interactions with grasped objects. As an initial application scenario we implemented a camera control that allows the brightness to be configured using our tested gestures on a common SLR device.
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15, 2015
People use gestures to give verbal communication more expression and also to replace the speech. ... more People use gestures to give verbal communication more expression and also to replace the speech. One of the most concise and expressive gestures is the pointing gesture. Pointing gesture can be observed in the early childhood. In these early years, it is used to point at objects or people. Later, people use pointing gestures even for more complex things such as to visualize directions. Increasing pointing gestures are also used for interacting with computers. For example, gestures can be used to remotely interact with a display, without using an input tool. In this work we investigated how people point to objects and how the recognition accuracy can be improved by using a gesture recognition system. We performed a user study, where participants had to point on projected pointing targets. These gestures were recorded as reference data with the help of motion capture system. We used a variety of starting positions in which the study was carried out. For this the participants were placed with a distance of 2 to 3 meters to the pointing targets. At these two positions the participants had to sit and stand while pointing to the targets. From the recorded reference data we derived a pointing vector. Each vector describes the direction in which the gesture is directed. We generate these vectors out of different body parts. This is done to show that there are different ways to create these vectors but they behave all the same. In the optimal case, this vector would describe the path of the person pointing to the object, in this case, the projected point. By mathematical analyzes we show that in average over several experiments and over several participants a systematic deviation from this optimal vector can be detected. We specify models, which can compensate the systematic deviation. These models shift the pointing vector in the direction of the average distance between optimum and average study vector. Products of the consumer market can be used to detect pointing gestures. There gestures can be improved with the generated models. The focus here is, for example, products like the Kinect.
Uploads
Papers by Katrin Wolf