Virtual Keyboard
XAVIER INSTITUTE OF ENGINEERING
Under the guidance of
Prof. Shailaja Udtewar
Vishal Jangle Roll No: 26
Waqaar Khatri Roll No: 36
Rakesh Hande Roll No: 25
Tejas Kamble Roll No: 30
Abstract enabled PDA, Smart phone, laptop or PC. Unlike many small
. Virtual keyboard uses sensor technology and artificial snap-on keyboards for PDAs.
intelligence to let users work on any surface as if it were a keyboard. We are witnesses of new technology improvements that are
This paper develops an application to visualize the keyboard of surprising us every day when we hear about them or even look
computer with the concept of image processing. The virtual keyboard
should be accessible and functioning. With the help of camera image
at them. The computers and computers technology
of keyboard will be fetched. The typing will be captured by camera, revolutionize the world and the way of life. Since the
as we type on cardboard simply drawn on paper. Camera will beginning in the 50s, every new achievement in this section
capture finger movement while typing, and accordingly the pressed was accepted by the vast masses of people which were
key will be process through a program and will be displayed expecting new improvements with huge hope for making
business and life easier and more successful. In this century,
KeywordsArtificial intelligence, QWERTY keyword, Virtual the computers rule the world. Beginning from the first
keyboard interface, sensor, computer ENIAC, which proportions were huge, the
. technology came up with microchips, tiny devices which are
hundred times smaller then the basic of the structure of
Introduction ENIAC, the electronic tube. The technology of creating
microchips, allows us to create smaller devices like CPUs,
Computers have undergone rapid miniaturization from being a Integrated Circuits, Microcontrollers, and so onFrom other
'space saver' to 'as tiny as your palm'. Disks and components side, the classic science in the same time was making very
grew smaller in size, but one component still remained the important researches and discoveries, especially physics.
same for decades - it's the keyboard. Miniaturization of The physicist discovered laser rays and sensors of the same
keyboard had proved nightmare for users. Users of PDAs and rays, which are getting more sophisticated and more powerful.
smart phones are annoyed by the tiny size of the keys. The If we put these two parts of science in one, we will have more
new innovation Virtual Keyboard uses advanced technologies than hundred products which are making our life easier, more
to project a full-sized computing key-board to any surface. successful and more secured. Products like this are IR,
This device has become the solution for mobile computer Bluetooth transmitters and receivers, optical mouse, LCD
users who prefer to do touch-typing than cramping over tiny Projectors, Large Video Beams and the latest gadget of the
keys. Typing information into mobile devices usually feels technology called Virtual Laser Keyboard.
about as natural as a linebacker riding a Big Wheel. Virtual
Keyboard is a way to eliminate finger cramping. All that's
needed to use the keyboard is a flat surface. Using laser I. LITERATURE SURVEY
technology, a bright red image of a keyboard is projected from
a device such as a handheld. Detection technology based on Many researchers in computer science and human computer
optical recognition allows users to tap the images of the keys interaction developed various technologies related to virtual
so the virtual keyboard behaves like a real one. It's designed to keyboard and mouse. However all of them used different
support any typing speed. techniques. Approaches related to keyboard, where in
The Virtual Laser Keyboard (VKB) leverages the power of Eckert. M [1] developed for the persons with physical
laser and infrared technology and projects a full-size keyboard impairments with presenting a new middleware for mapping
onto any flat surface. As you type on the laser projection, gestures, obtained by a motion sensing camera device.
detection technology based on optical recognition enables the Another approach was developed by Zhang, Yunzhou
user to tap the images of the keys, complete with realistic introduced a method by the use of infrared laser module,
tapping sounds, which feed into the compatible Bluetooth keyboard pattern projector, embedded system and a single
image sensor where every keystroke can be determine
accurately by image processing including morphology
principle and ellipse fitting[2].
Our project was inspired by a paper of Jun Hu [3].They
developed bare-finger touch interaction on regular planar
surfaces for e.g. walls or tables, with only one standard camera
and one projector. The touching information of finger tips is
recovered just from the 2-D image captured by the camera. We
used the concept of camera and image processing but without
the help of projector and laser light a simple keyboard is
drawn on the paper and the movement of typing is captured by
camera same for the mouse the eye movement is captured.
II. PROPOSED SYSTEM VI. COMPONENT SPECIFICATIONS
Virtual Keyboard and Mouse system uses camera, blank Light source Red diode laser
paper for drawing the keyboard. This method is easy to use
less expensive and even portable such as keyboard. However,
the system developed is user friendly. In previous system the Keyboard layout 63 key
virtual keyboard used projector and camera which used bare -
finger touch interaction and the captured 2D image is then Keyboard size 295 x 95 mm
recovered. But, due to the use of laser light and projector the Keyboard position 60 mm from VKB unit
battery power is lowered and leads to the limitation. Hence Required Projection surface Non-reflective, opaque flat
only by using the camera and paper keyboard the virtual surface
keyboard is developed to overcome the drawbacks. The
system will work in the following manner shown below KEYBOARD PROJECTION
respectively,
1. The keyboard will be drawn on blank paper. IR SENSOR
2. A camera will be there to capture live feed of fingers Detection Rate Up to 400 characters
typing on blank paper with keyboard drawn on it. per minute
3. Hence, with the Image processing, in real time typed
words on keyboard will be detected. Detection algorithm Multiple keystroke support
4. Those words will be screened on desktop.
Effective keystroke Approximately 2 mm
Operating surface Non-reflective, opaque flat
V. SYSTEM ARCHITECTURE surface
Visibility Any firm flat surface with
no protrusions greater than
1mm
ELECTRICAL AND DIMENSIONS
Power Source 3.6V rechargeable lithium-
ion battery
Battery Capacity >120 minutes continuous
typing
Charge Method Included 100-240V AC Wall
adapter
Dimension Approximately 35 x 92 x 25
mm (1.38" x 3.6" x 1")
SOFTWARE USED MATLAB Image Acquisition
Toolbox
VII. FEATURES
o Personal Digital Assistants (PDA's) X. EXPECTED RESULTS
o Cellular Telephones
o Laptops We are expecting to make and fully working interface of
o Tablet PCs keyboard which can detect key stroke for letters and project it
o Space saving Computers on any surface
o Clean Rooms
o Industrial Environments
o Test Equipment
o Sterile and Medical Environments
o Transport (Air, Rail, Automotive)
o Allows the convenience of regular keyboard typing in
a tiny form factor
o Rechargeable battery lasts for 120 minutes
of continuous typing
o Tiny size only 3.5 inches high
o Compatible with Palm OS 5, Pocket PC 2003,
Windows Smart phone and Windows 2000/XP. XI. CONCLUSION
Limited Mac OS X Support
We developed a system to get an input of keyboard drawn on a
blank paper using a real - time camera. However, it is difficult
to get stable results because of the variety of lighting and skin
VIII. ADVANTAGES colours of human races. Most vision algorithms have
illumination issues. From the results, we can expect that if the
o It can be projected on any surface or you can type in vision algorithms can work in all environments then our
the plain air. system will work more efficiently. This system could be useful
o It can be useful in places like operation theaters in presentations and to reduce work space.
where low noise is essential.
o The typing does not require a lot of force. So easing XII. ACKNOWLEDGEMENT
the strain on wrists and digits. We would like to take this opportunity to thank my internal
o The Virtual Keyboard is not restricted to the guide Prof. Shailaja Udtewar for giving us all the help and
QWERTY touch-typing; adjustments can be done to guidance we needed. We are really grateful to them for their
the software to fit other touch-typing paradigms as kind support. Their valuable suggestions were very helpful
well.
o No driver software necessary, It can be used as a plug
and play device. XIII. REFERENCES
o High battery life.
[1]Eckert, M. Lopez, M. ; Lazaro, C. ; Meneses, J. ; Martinez
Ortega, J.F., 2015 Mokey - A motion based keyboard
IX. APPLICATIONS interpreter .Tech. Univ. of Madrid, Madrid, Spain
[2]Su, Xiaolin, Zhang, Yunzhou ; Zhao, Qingyang ; Gao,
o High-tech and industrial Sectors Liang, 2015 Virtual keyboard: A human-computer interaction
o Used with Smart phones, PDAs, email, word device based on laser and image processing, Virtual keyboard:
processing and spreadsheet tasks. A human-computer interaction device based on laser and
o As computer/PDA input. image processing, College of Information Science and
o Gaming control. Engineering, North-eastern University, Shenyang, China
[3]Jun Hu, Guolin Li, Xiang Xie, Zhong Lv, and Zhihua
o TV remote control. Wang, Senior Member, IEEE:Bare-fingers Touch Detection by
the Buttons Distortion in a ProjectorCamera System
