Proposal 0
Proposal 0
Proposal 0
1. Introduction
The thesis applies a new way to interact with sources of information using an
interactive projected display. For a long time the ubiquitous mouse and keyboard has
been used to control a graphical display. Recently advances and research in human
computer interaction (HCI) has paved the way for techniques such as vision, sound,
speech recognition, and context-aware devices that allow for a much richer, multimodal
interaction between man and machine.
In the past decades, with the advent of increased processing power and technology,
there has been great interest from the academic and commercial sector in developing new
and innovative human computer interfaces. Some of the available devices have developed
into track-ball, electronic pens, cyber-gloves, 3D-mice and magnetic tracking devices to
name a few. Recent research moves away from traditional input devices. PUI or
Perceptual User Interfaces and VBI or Vision Based Interfaces are examples of recent
research areas. (Turk, 1998 & Porta, 2002). What is interesting in this line of research is
the development of natural and intuitive interface methods that make use of human body.
A certain class of this research falls under bare hand human-computer interaction which
this study is about. Bare hand human interaction uses as a basis of input the human hands
without the use of devices in contact with the human body.
1.3 OBJECTIVES
The proponents will create a real time interactive projected display using a
projector and camera. The proponents will use development tools for image/video
processing and computer vision to program the PC. Algorithms for hand detection and
tracking will be implemented using these tools.
The projector and camera set-up will be fixed in such a way that blocking the
projector is not a problem. Trapezoidal distortion which results from projecting from an
angle will be manually compensated if present. Since the system is dependent on the
camera and projection, the lighting conditions will be controlled. The set-up area must
not have too much light as to overpower the projection.
The study applies a new way of presenting information using projected displays
and allows the user to interact with it. A projected display conserves space as the system
is ceiling mounted and there is no hardware that directly involves the user. Using only the
hands of the user as an input, the system is intuitive and natural-- key criteria for effective
interfaces. It presents an alternative to computer based modules where space can be a
problem.
The study is an endeavor towards the development of natural interfaces. The use
of a Projector and camera provides a means of producing an augmented reality that is
natural -- Requiring no special goggles or gloves that the user has to wear. In public
spaces where information is very valuable, a system that can provide an added dimension
to reality is very advantageous and the use of nothing but the hands means the user can
instantly tap the content of the projected interface.
1.6 DESCRIPTION OF THE PROJECT
The system is comprised of 3 main components; (1) the PC which houses the
information and control content, (2) the projector which displays the information, and (3)
the PC camera which is the input of the system. Development of the study would be
heavily invested in the software programming of the PC. The functions of the PC would
be the following: detection of the position and action of the hands of the user relative to
the screen, generating a response from a specific action, hosting the information rich
content. Techniques of image/video processing and machine vision will be used to
facilitate the first two functions of the PC.
As a demo application an interactive map of the school is used. The projector will
project the campus directory of De La Salle University Manila. The camera will capture
the images needed and will upload to the computer. The user will then pick on which
building he/she would like to explore using his/her hand as the pointing tool. Once the
user has chosen a building, a menu will appear that will give information about the
building. Information includes brief history, floor plans, facilities, faculties, etc. Once the
user is finished exploring the building, he/she can touch the back button to select another
building in the campus. The cycle will just continue until the user is satisfied.
1.7 METHODOLOGY
Projector……………………………….…..P50,000
PC Camera……………………………..…. P1500-2000
Open Source SDK…………………………Free
Development / prototype Computer………..Available
Miscellaneous…………………………….. P5000
REFERENCES