A Technical seminar Report

On
“Mind reading computer”

Submitted as a part of
“Technical Seminar III”
Submitted by
P.JITHENDRA
21311A0430

Under the Supervision of

“Anvesh pillalamarri”

Department of Electronics & Communication Engineering

Sreenidhi Institute of Science & Technology

(An Autonomous Institution affiliated to JNTUH)
Yamnampet , Ghatkesar , Hyderabad – 501 301.
(2022-23)
 Contents

1. Introduction

2. Definition of mind reading

3. A Computational Model of Mind Reading

4. Working

5. Application

6. Advantages

7. Disadvantages

8. Conclusion

9. Reference
 INTRODUCTION

People express their mental states; like emotions, thoughts, and desires, all the time
through facial expressions, vocal nuances and gestures etc. this is often true even once they
are interacting with computers also as humans. Our mental states shape the choices that we
make, govern how we communicate with others and affect our overall performance. The
power to infer mental states to others from their behavior and to use that knowledge to
guide our own actions and predict those of others is understood as theory of mind or mind
reading. A computer may wait indefinitely for input from a user who is not any longer there,
or plan to do irrelevant tasks while user is frantically working towards an imminent
deadline. As a result, existing computer technologies often disappoint the user, have little
effective power and can't begin interactions with the user. They are doing take the initiative,
just like the retired Microsoft Paperclip, they're often misguided and irrelevant, and easily
frustrate the user. With the increasing complexity of technology and therefore the
omnipresence of mobile and wearable devices and there's a requirement for machines that
are conscious of the user’s psychological state which adaptively answer these mental states.

A theory of mind may be a representational set of abilities that permits one to

read the mind. It’s the power to attribute mental states of others, and use that to predict
the actions and expressions of others within an intentional or goal-directed framework
(Dennett in [2] refers thereto because the intentional stance). Facial movements and eye
language especially play an important role in recognizing basic emotions (such as happiness,
sadness, disgust and fear) also as “cognitive” or complex mental states (such as distrust,
recognize, scheme, admire, interest, thoughtfulness etc.). Employing a digital video camera,
the mind-reading computing system analyses an individual's facial features in real time and
infers that person's underlying psychological state , like whether he or she is agreeing or
disagreeing, interested or bored, thinking or confused. Prior knowledge of how particular
mental states are expressed within the face is combined with analysis of facial expressions
and head gestures occurring in real time.

DEFINITION OF MIND READING

Mind reading may be defined as inferring of the human thoughts emotions and desires,
etc. The simplest method of mind reading is by simple understanding the facial expression
given by the person as people express their mental states mostly through facial expression
and gesture. Using a digital video camera the mind reading computing system analyses an
individual's countenance in real time and infers that persons underlying psychological state.

A Computational Model of Mind Reading

The goal is to reinforce the human-computer interaction through compassionate responses,

to increase the productivity of the user and to enable the applications to initiate interactions
with and on behalf of the user, without waiting for an input from that user. The model
represents these at different granularities, starting with the Face and Head movements and
building them in time & in space to form an effective and clearer model of what mental
state is being represented. Colour, Movement and Shape are then analysed to identify the
gestures like a smile or eyebrows being raised. Combinations of all these gestures occurring
over time indicate the various mental states. For example, a mixture of head nods, with a
smile and eyebrows raised might mean interest.

WORKING

The mind reading actually involves measuring the quantity and oxygen level of the blood
round the subject's brain, using technology called functional near-infrared spectroscopy
(fNIRS). The user wears a kind of futuristic headband that sends light therein spectrum into
the tissues of the top where it's absorbed by active, blood-filled tissues. The scarf then
measures v what proportion light wasn’t absorbed, letting the pc gauge the metabolic
demands that the brain is making. The results are often compared to an MRI, but are often
gathered with lightweight, non-invasive equipment. Wearing the fNIRS sensor, experimental
subjects were asked to count the amount of squares on a rotating onscreen cube and to
perform other tasks. The themes were then asked to rate the problem of the tasks, and
their ratings agreed with the work intensity detected by the fNIRS system up to 83
percentage of the time. The actual area of the brain where the blood-flow change occurs
should provide indications of the brain's metabolic changes and by extension workload,
which might be a proxy for emotions like frustration. "Measuring mental workload,
frustration and distraction is usually limited to qualitatively observing computer users or to
administering surveys after completion of a task, potentially missing valuable insight into
the users' changing experiences. NASA has developed the pc program which may read
silently spoken words by analysing the nerve signals in our throats and mouth . Just the
slightest movement within the larynx and tongue is enough to figure. Initially scientists
trained the software program to acknowledge the six words-including go, left, right and 10
numbers. Participants attached to the sensors silently, said the words to themselves and
therefore the software correctly picked up the signals 92% of the time.

APPLICATIONS

Mind Controlled Wheelchair

The mind controlled wheelchair was developed by the University of Electro-Communications in

Japan. With the power of mind you can move the wheelchair. It can be done by mapping the brain
waves when you think about moving forward or backward, left, right and then assigns required
actions to a wheelchair command of actually moving forward or backward, left, right.

Fig -9: A man sitting on mind controlled wheel chair

Mind Controlled Wheelchair could be useful for people who are paralyzed, and are not able to
control their body parts. The main parts of this wheel chair system include an electrical wheelchair, a
laptop pc, an Arduino, an interface circuit, an EEG headset, and a set of ready-made and custom
software. The EEG headset, which connects wirelessly to laptop and then allows the operator to
simply think "forward" or "left" or "right" to cause the wheelchair to move. The Performance is
directly related to practice by the user, better configuration of the software, and good contact made
by the EEG electrodes on the scalp of the operator. The interface circuit connects between the
Arduino's digital pins and therefore the joystick of the wheelchair. When the Arduino receives a
command from the pc, it makes the circuit to "fool" the wheelchair into thinking that the operator or
the human has moved the joystick.

Brain to Vehicle Communication

Autonomous driving has been portrayed as a really hands-off, computer-led concept. Most
manufacturers use pictures of individuals reading the newspaper or scrolling through their phone, in
cabins with no wheel or pedals, whenever a replacement selfdriving concept is released. You may
have heard of Vehicle-to-Vehicle or V2V technology, but Nissan calls this new technology Brain-to-
Vehicle or B2V technology. It’s a driving system that interprets signals from the driver’s brain to
“make the drive even more exciting and enjoyable”. Future vehicles will be both self-driving
(autonomous) and manual. Car makers and tech companies from Ford to Google have made huge
progress in making fully automated cars a reality - but there are still hurdles to beat. Changing and
unpredictable weather can interfere with the car’s ability to identify or track moving objects and GPS
and AI vision systems can struggle in remote or inaccessible areas.

Drowsy Driver Detection

Driver’s drowsiness detection is a car safety method which helps to prevent accidents caused by the
driver getting drowsy. Various studies have introduced that around 20% of all road accidents are
fatigue-related, up to 50% on certain roads. The state of drowsiness can be defined as “a state that
cannot be defined as sleepy but an inclination to sleep”. This state of mind causes the driver to lose
his/her attention from the current scenario and the ability to react against various phenomena.
Hence it is very much necessary to take preventive measures to detect the drowsiness of the person
on road so as to prevent the road accidents caused by the drowsiness of the driver. Physiological
measures use the physiological signals such as Electrocardiogram (ECG), Electromyogram (EMG),
Electroencephalogram (EEG), and delectrooculogram (EoG) to detect drowsiness. a smart wearable
device named BioHarness, manufactured by Zephyr Technologies, has been introduced. It is a
module that enables the capture and transmission of comprehensive e physiological data on the
wearer via mobile and fixed data networks. Hence it guarantees to enable genuine remote
monitoring of human performance and condition in the real world. This device can be placed closer
to the person’s chest by wearing a shirt, a strap or a holder when he is driving.

Fig -11: Bioharness

The sensor monitors the physiological parameters and transmits them to the smart phone. The
measured data will be processed by the drowsiness detection application on the smart phone. If the
processing result is above threshold, a wake up signal will be played to alert the driver.

ADVANTAGES

This technology can be helpful for paralyze patients and handicapped person this can also be very
useful for comma patients who are to be unable to speak. For example a prototype mind controlled
wheelchair developed from the University of Electro Communications is Japan. This works by
mapping brain waves when you think about moving left, right, forward or back and work
accordingly. This can be used in military purposes, sting operations and in investigations. Mind
reading computer can prevent from terrorism. Also it can be combined with consoles and used for
mind gaming

DISADVANTAGES

The biggest disadvantage of this system is that confidential data can be hacked by unauthorized
person so the privacy can be breached. terrorist and hackers can steal the important data so this can
be more dangerous and also 100% accuracy can't be gained by using mind reading computers.
Accuracy of the mind reading computer can be up to 86.4%.

CONCLUSION

Mind reading is the ability to infer people's mental state and use that to make sense and predict
their behaviour. In this paper we had a brief study regarding major aspects of mind reading
techniques, applications, result, advantages, disadvantages, etc. IBM says that mind reading
computers are no longer from the world. Computer Scientist are biomedical engineers at Tufts
University are collaborating to make this a reality someday soon. Thus, the mind reading technology
will bring amusing changes in technical fields which will be rather more efficient and useful.

REFERENCE

[1] Aarti, Renuka, “Mind Reading Computer”, International Journal of Engineering Research &
Technology (IJERT),ISSN: 2278-0181, 2017
[2] Daniel Dennett, “International System Theory”, The Intentional Stance, 1987.

[3] Baron-Cohen, S., Wheelwright, S., and Jolliffe T, “Is There a Language of the Eyes? Evidence from
Normal Adults, and Adults with Autism or Asperger Syndrome”, Visual Cognition 4 (3): 311-331, 1997
.

[4] Komal Tomar, “How Mindreading Computer Work And How It Is Useful In Different Working
Areas?”, International Journal of Computer Applications Technology and Research Volume 3– Issue
8, 505 - 509,ISSN: 2319–8656, 2014

[5] http://www.scholarpedia.org/article/Eigenfaces