Proceedings of the 9th annual ACM symposium on User interface software and technology - UIST '96, 1996
... Figure 1: A screen capture of the simulation along with the rake widget. ... The bottom widge... more ... Figure 1: A screen capture of the simulation along with the rake widget. ... The bottom widget uses a slider to control length, a dial for density and a button to retain the 3D cursor functionality of the original widget. ... Brian Knep. Lecture on the making of jurassic park. ...
We present Dynamic Dragging, a virtual reality (VR) technique for input of smooth 3D trajectories... more We present Dynamic Dragging, a virtual reality (VR) technique for input of smooth 3D trajectories with varying curvature. Users "drag" a virtual pen behind a hand-held tracked stylus to sweep out curving 3D paths in the air. Previous explorations of dragging-style input have established its utility for producing controlled, smooth inputs relative to freehand alternatives. However, a limitation of previous techniques is the reliance on a fixed-length drag line, biasing input toward trajectories of a particular curvature range. Dynamic Dragging explores the design space of techniques utilizing an adaptive drag line that adjusts length dynamically based on the local properties of the input, such as curvature and drawing speed. Finding the right mapping from these local properties to drag line length proves to be critical and challenging. Three potential mappings have been explored, and results of informal evaluations are reported. Initial findings indicate that Dynamic Dragging makes input of many styles of 3D curves easier than traditional drag-style input, allowing drag techniques to approach the flexibility for varied input of more sophisticated and much harder to learn techniques, such as two-handed tape drawing.
Designing interfaces for architectural and mechanical design, scientific visualization, 3D illust... more Designing interfaces for architectural and mechanical design, scientific visualization, 3D illustration, and other complex applications presents many challenges. These applications require users to perform a range of design tasks including creating, viewing, manipulating, ...
Motion blurring fast-moving objects is highly desirable for virtualenvironments and 3D user inter... more Motion blurring fast-moving objects is highly desirable for virtualenvironments and 3D user interfaces. However, all currently knownalgorithms to generate motion blur are too slow for inclusion in interactive3D applications.We introduce a new motion blur algorithm that works in 3D on aper-object basis. The algorithm operates in real-time even for complexobjects consisting of several thousand polygons. While it onlyapproximates true motion
2008 19th International Conference on Pattern Recognition, 2008
We present an online system for recognizing handwritten mathematical matrices in the context of a... more We present an online system for recognizing handwritten mathematical matrices in the context of an interactive computational tool called MathPaper. Automatic segmentation and recognition of multiple expressions are supported based on a spacing algorithm that leverages recognized symbol identities, sizes, and relative locations of individual symbols. Matrices with ellipses can be recognized and instantiated with non-ellipsis elements. Both well-and non-well-formed matrices can also be recognized. Matrix elements can be any general mathematical expressions including imbedded matrices. Our recognizer also addresses the poor column alignment problem of handwritten matrices, and allows for slight horizontal overlaps between elements in neighboring columns and different rows.
Proceedings of the 1999 symposium on Interactive 3D graphics - SI3D '99, 1999
We present a novel approach to controlling a virtual 3D camera with a 2D mouse or stylus input de... more We present a novel approach to controlling a virtual 3D camera with a 2D mouse or stylus input device that is based on gestural interaction. Our approach to 3D camera manipulation, UniCam, requires only a single-button stylus or mouse to directly invoke specific camera operations within a single 3D view. No 2D widgets or keyboard modifiers are necessary. By gesturally invoking all camera functionality, UniCam reduces the modal nature of typical desktop 3D graphics applications, since remaining mouse or stylus buttons can be used for other application functionality. In addition, the particular choice and refinement of UniCam controls efficiently enables a wide range of camera manipulation tasks, including translation in three-dimensions, orbiting about a point, animated focusing on an object surface, animated navigation around an object, zooming in upon a region, and saving and restoring viewpoints. UniCam's efficiency derives primarily from improved transitions between techniques and to a lesser degree from adaptations of existing techniques. Although we have conducted no formal user evaluations, UniCam is the result of years of iterative development with approximately one hundred users. During this time more conventional modifier key and menu-based implementations were implemented and either refined or rejected. Informally, users appear to require a few hours of training to become proficient with UniCam controls, but then typically choose them almost exclusively even when widget-based controls, such as those provided by an Inventor viewer, are simultaneously available.
Proceedings of the 1999 symposium on Interactive 3D graphics - SI3D '99, 1999
3D interaction with a computer is hard. As human interaction in the real world is quite dependent... more 3D interaction with a computer is hard. As human interaction in the real world is quite dependent on haptics, we believe that adding haptics will alleviate many of the problems of 3D interaction with a computer. The naive approach to incorporating haptics would be to simply find existing objects and imitate them. This, however, would not seem to adequately leverage what is possible with a reasonably general force feedback device, as it does not take advantage of the ability to provide forces that are not physically based, or to simulate objects and behavior that could have been physically realized but weren't, or which would have been prohibitively difficult to physically realize. From our extensive experience with designing haptic computer user interfaces and using haptic interfaces in the real world we have abstracted from those interactions certain qualities which we present in this paper. In addition, this paper demonstrates how to use these qualities in the analysis and design of a suite of 3D haptic widgets, most of which are novel and many of which include non-physically based forces.
Proceedings of the 1997 symposium on Interactive 3D graphics - SI3D '97, 1997
We explore a range of techniques that use two hands to control two independent cursors to perform... more We explore a range of techniques that use two hands to control two independent cursors to perform operations in 3D desktop applications. Based on research results in 2D applications , we believe that two-handed input provides the potential for creating more efficient and more fluid interfaces, especiall y for tasks that are context-sensitive or that have many degre es of
We present a novel class of virtual reality input devices that combine pop through buttons with 6... more We present a novel class of virtual reality input devices that combine pop through buttons with 6 DOF trackers. Compared to similar devices that use conventional buttons, pop through devices double the number of potential discrete interaction modes, since each button has two activation states corresponding to light and firm pressure. This additional state per button provides a foundation to address a range of shortcomings with conventional virtual environment input devices that includes reducing the physical dexterity required to perform interactions, reducing the cognitive complexity of some compound tasks, and enabling the design of less obtrusive devices without sacrificing expressive power. Specifically, we present two novel input devices: the FingerSleeve was designed to be minimally obtrusive physically, whereas the TriggerGun was designed to be physically similar to, yet more functional than a conventional hand-held trigger device. Further, we present a set of novel navigation and interaction techniques that leverage the capabilities of our pop through button devices to improve interaction quality, and provide insight into harnessing the potential of pop through buttons for other tasks. Finally, we discuss how we incorporated one of our devices into a real application.
Proceedings of the 11th annual ACM symposium on User interface software and technology - UIST '98, 1998
Permission to make digital or hard copies of all or part of this work for personal or classroom u... more Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy ...
Proceedings of the 14th annual ACM symposium on User interface software and technology - UIST '01, 2001
We present a range of novel interactions enabled by a simple modification in the design of a comp... more We present a range of novel interactions enabled by a simple modification in the design of a computer mouse. By converting each mouse button to pop through tactile push-buttons, similar to the focus/shutter-release buttons used in many cameras, users can feel, and the computer can sense, two distinct "clicks" corresponding to pressing lightly and pressing firmly to pop through. Despite
Proceedings of the 14th annual ACM symposium on User interface software and technology - UIST '01, 2001
We present a range of novel interactions enabled by a simple modification in the design of a comp... more We present a range of novel interactions enabled by a simple modification in the design of a computer mouse. By converting each mouse button to pop through tactile push-buttons, similar to the focus/shutter-release buttons used in many cameras, users can feel, and the computer can sense, two distinct "clicks" corresponding to pressing lightly and pressing firmly to pop through. Despite
We present MathPaper, a system for fluid pen-based entry and editing of mathematics with support ... more We present MathPaper, a system for fluid pen-based entry and editing of mathematics with support for interactive computation. MathPaper provides a paper-like environment in which multiple mathematical expressions and even algorithms can be entered anywhere on the page. Mathematical expressions can also be modified using simple deletion and dragging gestures with real-time recognition and computation feedback. In addition, we support
SKETCH targets the exploration and communication of 3D geo- metric ideas. Traditionally, people h... more SKETCH targets the exploration and communication of 3D geo- metric ideas. Traditionally, people have attacked conceptualdesign with paper and pencil, not with computers, even though computer models offer numerous advantages. The reasons for this include the low overhead of a ...
SKETCH targets the exploration and communication of 3D geo- metric ideas. Traditionally, people h... more SKETCH targets the exploration and communication of 3D geo- metric ideas. Traditionally, people have attacked conceptualdesign with paper and pencil, not with computers, even though computer models offer numerous advantages. The reasons for this include the low overhead of a ...
Motion blurring fast-moving objects is highly desirable for virtualenvironments and 3D user inter... more Motion blurring fast-moving objects is highly desirable for virtualenvironments and 3D user interfaces. However, all currently knownalgorithms to generate motion blur are too slow for inclusion in interactive3D applications.We introduce a new motion blur algorithm that works in 3D on aper-object basis. The algorithm operates in real-time even for complexobjects consisting of several thousand polygons. While it onlyapproximates true motion
Proceedings of the 9th annual ACM symposium on User interface software and technology - UIST '96, 1996
... Figure 1: A screen capture of the simulation along with the rake widget. ... The bottom widge... more ... Figure 1: A screen capture of the simulation along with the rake widget. ... The bottom widget uses a slider to control length, a dial for density and a button to retain the 3D cursor functionality of the original widget. ... Brian Knep. Lecture on the making of jurassic park. ...
We present Dynamic Dragging, a virtual reality (VR) technique for input of smooth 3D trajectories... more We present Dynamic Dragging, a virtual reality (VR) technique for input of smooth 3D trajectories with varying curvature. Users "drag" a virtual pen behind a hand-held tracked stylus to sweep out curving 3D paths in the air. Previous explorations of dragging-style input have established its utility for producing controlled, smooth inputs relative to freehand alternatives. However, a limitation of previous techniques is the reliance on a fixed-length drag line, biasing input toward trajectories of a particular curvature range. Dynamic Dragging explores the design space of techniques utilizing an adaptive drag line that adjusts length dynamically based on the local properties of the input, such as curvature and drawing speed. Finding the right mapping from these local properties to drag line length proves to be critical and challenging. Three potential mappings have been explored, and results of informal evaluations are reported. Initial findings indicate that Dynamic Dragging makes input of many styles of 3D curves easier than traditional drag-style input, allowing drag techniques to approach the flexibility for varied input of more sophisticated and much harder to learn techniques, such as two-handed tape drawing.
Designing interfaces for architectural and mechanical design, scientific visualization, 3D illust... more Designing interfaces for architectural and mechanical design, scientific visualization, 3D illustration, and other complex applications presents many challenges. These applications require users to perform a range of design tasks including creating, viewing, manipulating, ...
Motion blurring fast-moving objects is highly desirable for virtualenvironments and 3D user inter... more Motion blurring fast-moving objects is highly desirable for virtualenvironments and 3D user interfaces. However, all currently knownalgorithms to generate motion blur are too slow for inclusion in interactive3D applications.We introduce a new motion blur algorithm that works in 3D on aper-object basis. The algorithm operates in real-time even for complexobjects consisting of several thousand polygons. While it onlyapproximates true motion
2008 19th International Conference on Pattern Recognition, 2008
We present an online system for recognizing handwritten mathematical matrices in the context of a... more We present an online system for recognizing handwritten mathematical matrices in the context of an interactive computational tool called MathPaper. Automatic segmentation and recognition of multiple expressions are supported based on a spacing algorithm that leverages recognized symbol identities, sizes, and relative locations of individual symbols. Matrices with ellipses can be recognized and instantiated with non-ellipsis elements. Both well-and non-well-formed matrices can also be recognized. Matrix elements can be any general mathematical expressions including imbedded matrices. Our recognizer also addresses the poor column alignment problem of handwritten matrices, and allows for slight horizontal overlaps between elements in neighboring columns and different rows.
Proceedings of the 1999 symposium on Interactive 3D graphics - SI3D '99, 1999
We present a novel approach to controlling a virtual 3D camera with a 2D mouse or stylus input de... more We present a novel approach to controlling a virtual 3D camera with a 2D mouse or stylus input device that is based on gestural interaction. Our approach to 3D camera manipulation, UniCam, requires only a single-button stylus or mouse to directly invoke specific camera operations within a single 3D view. No 2D widgets or keyboard modifiers are necessary. By gesturally invoking all camera functionality, UniCam reduces the modal nature of typical desktop 3D graphics applications, since remaining mouse or stylus buttons can be used for other application functionality. In addition, the particular choice and refinement of UniCam controls efficiently enables a wide range of camera manipulation tasks, including translation in three-dimensions, orbiting about a point, animated focusing on an object surface, animated navigation around an object, zooming in upon a region, and saving and restoring viewpoints. UniCam's efficiency derives primarily from improved transitions between techniques and to a lesser degree from adaptations of existing techniques. Although we have conducted no formal user evaluations, UniCam is the result of years of iterative development with approximately one hundred users. During this time more conventional modifier key and menu-based implementations were implemented and either refined or rejected. Informally, users appear to require a few hours of training to become proficient with UniCam controls, but then typically choose them almost exclusively even when widget-based controls, such as those provided by an Inventor viewer, are simultaneously available.
Proceedings of the 1999 symposium on Interactive 3D graphics - SI3D '99, 1999
3D interaction with a computer is hard. As human interaction in the real world is quite dependent... more 3D interaction with a computer is hard. As human interaction in the real world is quite dependent on haptics, we believe that adding haptics will alleviate many of the problems of 3D interaction with a computer. The naive approach to incorporating haptics would be to simply find existing objects and imitate them. This, however, would not seem to adequately leverage what is possible with a reasonably general force feedback device, as it does not take advantage of the ability to provide forces that are not physically based, or to simulate objects and behavior that could have been physically realized but weren't, or which would have been prohibitively difficult to physically realize. From our extensive experience with designing haptic computer user interfaces and using haptic interfaces in the real world we have abstracted from those interactions certain qualities which we present in this paper. In addition, this paper demonstrates how to use these qualities in the analysis and design of a suite of 3D haptic widgets, most of which are novel and many of which include non-physically based forces.
Proceedings of the 1997 symposium on Interactive 3D graphics - SI3D '97, 1997
We explore a range of techniques that use two hands to control two independent cursors to perform... more We explore a range of techniques that use two hands to control two independent cursors to perform operations in 3D desktop applications. Based on research results in 2D applications , we believe that two-handed input provides the potential for creating more efficient and more fluid interfaces, especiall y for tasks that are context-sensitive or that have many degre es of
We present a novel class of virtual reality input devices that combine pop through buttons with 6... more We present a novel class of virtual reality input devices that combine pop through buttons with 6 DOF trackers. Compared to similar devices that use conventional buttons, pop through devices double the number of potential discrete interaction modes, since each button has two activation states corresponding to light and firm pressure. This additional state per button provides a foundation to address a range of shortcomings with conventional virtual environment input devices that includes reducing the physical dexterity required to perform interactions, reducing the cognitive complexity of some compound tasks, and enabling the design of less obtrusive devices without sacrificing expressive power. Specifically, we present two novel input devices: the FingerSleeve was designed to be minimally obtrusive physically, whereas the TriggerGun was designed to be physically similar to, yet more functional than a conventional hand-held trigger device. Further, we present a set of novel navigation and interaction techniques that leverage the capabilities of our pop through button devices to improve interaction quality, and provide insight into harnessing the potential of pop through buttons for other tasks. Finally, we discuss how we incorporated one of our devices into a real application.
Proceedings of the 11th annual ACM symposium on User interface software and technology - UIST '98, 1998
Permission to make digital or hard copies of all or part of this work for personal or classroom u... more Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy ...
Proceedings of the 14th annual ACM symposium on User interface software and technology - UIST '01, 2001
We present a range of novel interactions enabled by a simple modification in the design of a comp... more We present a range of novel interactions enabled by a simple modification in the design of a computer mouse. By converting each mouse button to pop through tactile push-buttons, similar to the focus/shutter-release buttons used in many cameras, users can feel, and the computer can sense, two distinct "clicks" corresponding to pressing lightly and pressing firmly to pop through. Despite
Proceedings of the 14th annual ACM symposium on User interface software and technology - UIST '01, 2001
We present a range of novel interactions enabled by a simple modification in the design of a comp... more We present a range of novel interactions enabled by a simple modification in the design of a computer mouse. By converting each mouse button to pop through tactile push-buttons, similar to the focus/shutter-release buttons used in many cameras, users can feel, and the computer can sense, two distinct "clicks" corresponding to pressing lightly and pressing firmly to pop through. Despite
We present MathPaper, a system for fluid pen-based entry and editing of mathematics with support ... more We present MathPaper, a system for fluid pen-based entry and editing of mathematics with support for interactive computation. MathPaper provides a paper-like environment in which multiple mathematical expressions and even algorithms can be entered anywhere on the page. Mathematical expressions can also be modified using simple deletion and dragging gestures with real-time recognition and computation feedback. In addition, we support
SKETCH targets the exploration and communication of 3D geo- metric ideas. Traditionally, people h... more SKETCH targets the exploration and communication of 3D geo- metric ideas. Traditionally, people have attacked conceptualdesign with paper and pencil, not with computers, even though computer models offer numerous advantages. The reasons for this include the low overhead of a ...
SKETCH targets the exploration and communication of 3D geo- metric ideas. Traditionally, people h... more SKETCH targets the exploration and communication of 3D geo- metric ideas. Traditionally, people have attacked conceptualdesign with paper and pencil, not with computers, even though computer models offer numerous advantages. The reasons for this include the low overhead of a ...
Motion blurring fast-moving objects is highly desirable for virtualenvironments and 3D user inter... more Motion blurring fast-moving objects is highly desirable for virtualenvironments and 3D user interfaces. However, all currently knownalgorithms to generate motion blur are too slow for inclusion in interactive3D applications.We introduce a new motion blur algorithm that works in 3D on aper-object basis. The algorithm operates in real-time even for complexobjects consisting of several thousand polygons. While it onlyapproximates true motion
Uploads
Papers by R. Zeleznik