Making Pen-Based Operation More Seamless and Continuous

2025

The use of pens in human-computer interaction has been investigated since Ivan Sutherland's Sketchpad graphical communication system in the early 1960s. We provide an overview of the major developments in pen-based interaction over the last six decades and compare different hardware solutions and pen-tracking techniques. In addition to pen-based interaction with digital devices, we discuss more recent digital pen and paper solutions where pen and paper-based interaction is augmented with digital information and services. We outline different interface and interaction styles and present various academic as well as commercial application domains where pen-based interaction has been successfully applied. Furthermore, we discuss several issues to be considered when designing pen-based interactions and conclude with an outlook of potential future challenges and directions for penbased human-computer interaction.

Proceedings of the workshop on Advanced visual interfaces - AVI '96, 1996

Sit.t Sen Chok and I(im Ma.rriot.t .klor~ash I. niversit.y, Vict.orla, Australia less,marriott }'~.'s,monash .edu.au I. iNTRODUCTiON Recent hardware advances have brought intera.ctive graphic tablets and pen-ba.sed notepa.d computers into the market place. This new technology, however, while offering great potential has not yet~ been very successful. One of the main reasons is that. software for pen-based computers is still immature: gesture recognition is poor and few applications make use of t, he new capabilities of the pen. The aim of the PF;N(~UINS project, is 1.o provide a. tools that. help in tim dewelopmel~t of sol't.warc for pen-based coinput.ers which t.a.kes full advallt.a.ge of the pen's new capabilit.ies. The project is based on the iT~telliyqe~t pen (~.~d paper metaphor for human-computer interaction wit.h i)ellbased computers In this int.eract.ion ~et=apl~or. t.lw user comrnunicates with the comput.er using a~ application specific visual language-" co~posed of hai~dwrittcu text and diagrams. This contrasts with the usual stat.e of affairs, in which the input, of diagrams is a CUll/l~ersome, indirect process, requiring sophisticated lll,,2/ttlbased graphic editors with many complex ii~odes. Intelligent pen and fmper, however, promises *,hal s~ch input will be a.ble to be given in frec tbrnl, i~,od<'lessly in any order and place, and modified using tin.rural gesture commands. Users will thus be able to express themselves directly in the ting~a fvattca of t.hcir applicat, ion domain using visual languages such as flowcharl.s, PERT-charts, entit.y-relat.ionship diagrams, sl.at, echarts, electric circuit diagrams, musical not.at.ion, struct.uralchemical formulae, or mathema.tical equations, llox~ever, before the potential of the intelligent pen aud paper metaphor can be fully realized, int.egrated software tools are needed which support the constructiou ()f a user interface based on a partict~la: visual la~guag< The PENGUINS toolkit, provides such fools.

2007

This article presents a pen-based framework for manual edition of digital documents on tablet computers. In this system, the user draws certain proofreading symbols on the text parts to edit; some symbols can be accompanied by handwritten text. The input is interpreted and the corresponding editing action is executed in real time. The possibility that the input contains handwritten text is a novelty with respect to previous real-time systems that faced sketch-based edition, where usually text input is carried out via keyboard. Also, multimodal feedback mechanisms for error recovery are present. In this work we focus on the symbol recognition part. Different features are evaluated in recognition experiments using a support vector machine classifier. Experiments show that the symbol recognition is efficient enough for a real-time task and that the system can be used in real conditions with some experience.

Inking and gesturing are two central tasks in pen-based user interfaces. Switching between modes for entry of uninterpreted ink and entry of gestures is required by many pen-based user interfaces. Without an appropriate mode switching technique, pen-based interactions in such situations may be inefficient and cumbersome. In this paper, we investigate five techniques for switching between ink and gesture modes in pen interfaces, including a penpressure based mode switching technique that allows implicit mode transition. A quantitative experimental study was conducted to evaluate the performance of these techniques. The results suggest that pressing a button with the non-preferred hand offers the fastest performance, while the technique of holding the pen still is significantly slower and more prone to error than the other techniques. Pressure, while promising, did not perform as well as the non-preferred hand button with our current implementation.

Proceedings of the SIGCHI conference on Human …, 1998

Computers & Graphics, 2005

Proceedings of the 11th Brazilian Symposium on Multimedia and the web - WebMedia '05, 2005

Pen-based interaction allows users to register information using a variety of devices such as PDAs, Tablet PCs or electronic whiteboards. As a result, users have the opportunity to review the information by means of a document that represents the final, static, result. Alternatively, users may be able to play back the digital ink using, for instance, the same application used for capture.

We provide an overview of the Penguins project. The aim of this project is to develop tools that facilitate the development of software for pen-based graphics editors. The project is based on the intelligent pen and paper metaphor for human-computer interaction. In this metaphor, the user communicates with the computer using an application specific visual language composed of handwritten text and diagrams. As the diagram is drawn with a pen , the underlying graphic editor parses the diagram, performing error correction and collect ing geometric constraints which capture the relationships between diagram components. During manipulation these constraints are maintained by the editor in order to preserve the semantics of the diagram. The Penguins system contains tools which, given a grammatical specification of a visual language, automatically construct a core user interface for that visual language which embodies the intelligent pen and paper metaphor. This core user interface consists of a tokenizer, constraint so lver , layout controller and constraint-based graphics editor together with an incremental parser for the specified visual language. The specification language is based on constraint multiset grammars.

Proceedings of Graphics Interface 2004, 2004

Asia Pacific Journal of Multidisciplinary Research, 2015

Technologies have reached the classroom. It is one of the means of teaching strategies nowadays. Multimedia projectors have become one of the teaching tools the teacher cannot bear without it. The concept of making this tool to be interactive and easier to use was far conceived by the researcher. The researcher's objective was to develop such tool and evaluate it according to its portability, simplicity, robustness, user-friendliness, effectiveness and efficiency. The respondents of the project were both the students and teachers of Batangas State University ARASOF-Nasugbu. The researcher has developed different prototypes for the interactive pen and tested in different environment and demonstrated the "know-how" of the project. The project was built using a simple infrared light emitting diode (IR LED), infrared tracker, and software which computes, detects and interact with the application program. Evaluation of the project followed the demonstration. The project got a high acceptance according to its portability, simplicity, robustness, user-friendliness, effectiveness and efficiency. The researcher is recommending the full implementation of the project in the Batangas State University ARASOF-Nasugbu and for better enhancement of the project by eliminating the pen.