Handwriting Analysis Using Image Processing and Pattern Recognition

Naveen Kumar B.M, 2nd Year M.Tech, P.E.S.C.E, Mandya

Abstract – Handwriting analysis is a modern form of psychology that identifies personality traits and human
character through handwriting. This paper demonstrates how we can use Image Processing and Pattern Recognition
techniques for Handwriting analysis. Even though analysis can be done manually, to get 100% accuracy and to save
time I thought of giving a techno-touch to this science. So I came out with this idea of using image processing
techniques for handwriting analysis.

1. Introduction Traditionally, these methods are grouped into

two categories: structural methods and feature
In image processing, after acquiring a digitized space methods. Structural methods are useful in
image, the main tasks are: enhancement or situations where the different classes of entity
rectification; segmentation; measurement; and can be distinguished from each other by
data analysis. Image enhancement and image structural information, e.g. in character
rectification are often used to emphasize certain recognition different letters of the alphabet are
features and to remove artifacts respectively. structurally different from each other. The
Two types of measurements are made: feature earlier-developed structural methods were the
measurements are taken off individual objects syntactic methods, based on using formal
which have been defined by a segmentation grammars to describe the structural are machine
process, and field measurements are obtained vision methods such as those based on poling
globally from complete images. Finally, these distribution models, active contours,etc.
feature and field measurements must be
analyzed.

Pattern recognition by computer is, in 2. Image Processing and Pattern

general, a complex procedure requiring a variety Recognition
of techniques that successively transform the
iconic data to information directly usable for 2.1 Image Processing
recognition. Many methods of artificial pattern
Sight is a human being’s principle
recognition have been proposed, applicable in
sense. A visual image is rich in information
general not only to objects in a visual image but
from the outer world and receiving and
also to other types of real world entity.
analyzing such images is part of the routine
activity of human beings throughout their In image processing, after acquiring a
walking lives. At a more sophisticated level, digitized image, the main tasks are:
human beings may generate record or transmit enhancement or rectification; segmentation;
images. These activities together comprise measurement; and data analysis, as indicated in
image processing. Figure 2.1. Image enhancement and image
rectification are often used to emphasize certain
Theories and techniques of image
features and to remove artifacts respectively.
processing originated in the study of optics and
Two types of measurements are made: feature
optical instruments. However, the advent of measurements are taken off individual objects
digital computers opened vast new possibilities which have been defined by a segmentation
for artificial image processing. By the mid- process, and field measurements are obtained
1960’s, third-generation computers offered the globally from complete images. Finally, these
speed and storage necessary for practical feature and field measurements must be
implementation of image-processing algorithms; analyzed.
and in 1964 the capabilities of digital image
processing were spectacularly demonstrated
when pictures of the moon transmitted b the
Enhanceme segment Feature
Ranger 7 space probe were processed to correct nt or ation measureme
various types of image distortion inherent in the nt

on-board television camera.

Since that date, the field of image processing

Field
has experienced vigorous growth. Digital image measurem
ent
processing techniques are used today in a wide
range of applications that, although otherwise Digital Image
unrelated, share a common need for methods Data
analysis
capable of enhancing pictorial information for
human interpretation and analysis. These
applications include: remote sensing; security
monitoring; medical diagnosis; automatic
inspection; radar; sonar; detection of military Interpretati
targets; robotics; business communication; on
television enhancement;etc.
Fig 2.1 Diagram of Image processing for object
In civil engineering, it has been used for recognition
structural monitoring, hydrology, and soil
microstructure.
2.2 Pattern Recognition

In communication with the outer world, one of recognition have been proposed, applicable in
the most important goals for human beings is to general not only to objects in a visual image but
recognize objects. For example, from an image, also to other types of real world entity.
image set, or image sequence of objects, we
need to recognize which directions the objects
are oriented toward, where they are located, Traditionally, these methods are grouped into
how they are arranged, what size and shape they two categories: structural methods and feature
have, and what sorts of things they are. space methods. Structural methods are useful in
situations where the different classes of entity
During the past 30 years, pattern recognition
can be distinguished from each other by
has had a considerable growth. The need for
structural information, e.g. in character
theoretical methods and experimental software
recognition different letters of the alphabet are
and hardware is increasing. Applications of
structurally different from each other. The
pattern recognition now include: character
earlier-developed structural methods were the
recognition; target detection; medical diagnosis;
syntactic methods, based on using formal
biomedical signal and image analysis; remote
grammars to describe the structural are machine
sensing; identification of human faces and of
vision methods such as those based on point
fingerprints; reliability analyses;
distribution models, active contours,etc.
socioeconomics; archaeology; speech
recognition and understanding; machine part
recognition; automatic inspection; and many
others In feature-space methods, a set of
measurements (typically numerical) is made on
each real-world entity (or pattern), and from the
measurement set there is extracted a set of
Pattern recognition by computer is, in
features which together characterize the class of
general, a complex procedure requiring a variety
patterns to which the given pattern belongs. The
of techniques that successively transform the
features are regarded as the elements of a vector
iconic data to information directly usable for
drawn from the origin in a multi-dimensional
recognition. Many methods of artificial pattern
feature space. Ideally, the measurements and where there exists a continuum of pattern
features are so chosen that (a) the extremities of classes, rather than a set of discrete classes.
the vectors representing patterns belonging to Feature-space methods are useful in situations
the same class tend to cluster together in a where the distinctions between different pattern
region of feature space, and (b) the extremities classes are readily expressible in terms of
of the vectors representing patterns belonging to numerical measurements of this kind. Such a
different classes tend to occur in distinct such situation often exists, for example, in the study
clusters in distinct regions of feature space. A of soil microstructure, where, for example,
classifier can then assign an unseen real-world important distinctions between soil particles,
pattern to a particular class according to the required by soil engineers, are based on such
region of feature space in which the vector considerations as roundness versus angularity.
representing this pattern falls. These and other aspects both of the nature of a
soil particle and of soil structure lend
themselves to numerical measurement, and there
was an urgent need for numerically based
The traditional approach to feature-space
classification for immediate comparison with
pattern recognition is the statistical approach,
numerical properties of the soil. The feature
where the boundaries between the regions
space approach is the one that has therefore
representing pattern classes in feature space are
been used in this research.
found by statistical inference based on a design
set of sample patterns of known class
membership. An unseen pattern can then be
classified simply by determining the region of
3. Design Issues in Pattern
feature space in which it lies. An alternative
Recognition System
approach is to use a mathematical or physical
model of the pattern generating mechanism to Unclassified specimens are the specimens
predict the regions: this approach is useful in which are to be classified. Pattern analysis is the
situations where it is costly or impossible to process of extracting the characteristics of the
obtain sufficient numbers of design samples to specimens; these characteristics might be
allow statistical conclusions to be drawn form measurements or structured observations.
them with any degree of confidence. A third Training is specimens whose class membership
possibility, which appears to be due to the is taken as known a priori; in almost all cases, it
author, is to choose features sot hat the total is the set of characteristics obtained from these
hyper volume of feature space within which specimens which is used.
feature points can occur is know a priori. The
whole of feature space can then be partitioned A priori definitions are definitions of the

according to some suitable scheme for the classes which have been set up in advance,

problem in hand. This approach might be useful either on the basis of some theoretical analysis
or in an entirely arbitrary fashion depending on A pattern is the set of characteristics which is
the nature of the problem. The criteria are inherent in a sample. These patterns may be
definitions of the closeness with which an taken from real samples; BT some synthetic
unclassified specimen must match the definition patterns designed to test the system may be
of a particular class in order to be placed in that included. Here, pattern analysis is the process of
class; if no class is sufficiently closely matched, extracting the actual set of characteristics to be
the specimen ma be rejected i.e. not placed in used in the classification.
any class. These criteria may be set to broad or
The a priori definitions, training samples,
narrow limits depending on the use to which the
and criteria, are the current versions of these
results of the classification will be put.
parts of the system; but during the design
Decision making is the process of process, these may not yet have been finalized.
comparing the actual characteristics with those The results are then inspected to see whether
on which the classification is to be based. In they are judged to be satisfactory. If not, the
some cases, it is appropriate to monitor the lack error is fed back to modify the current versions
of fit, i.e. the error, and to use this to modify the of the parts of the system. Figures 3.1(a) and
set of characteristics which is actually being 3.2(b) is a simplified and generalized view of
used for classification. the process of designing a pattern recognition
system.

Classifier (Analysis Phase)

Error

Unclassified Pattern Decision classes

Analysis making
Specimens

Criteria A priori Training

definitio samples
 Figure 3.1(a) Operation of a pattern recognition system

A priori Error
definition
s

Pattern Training Decision

Patterns recognitio samples making classes
n

Criteria

Figure 3.1(b) Designing a pattern recognition system.

4. Example System: Handwriting Analysis personality is a subcategory of general psychology.

Personality is a cluster of character traits and the
Handwriting analysis is a modern form of psychology corresponding behaviors based on those character
that identifies personality traits and human character traits. Handwriting analysis is the quickest way to
through handwriting. Personality is the term for
behavior and character. In the study of psychology,
accurately discover someone’s true personality out of To get accuracy we will be comparing all the letters,
any formal psychological test on the market today. instead of stopping at one or two letters.

Handwriting analysis is categorized into to groups, If the letters are not segregated it is not possible to
those are apply this method.

1. Micro Analysis 2. Macro Analysis

We can reveal more than 100 personality traits using In this we need find the size of the writing as well as
this analysis. Even though not all the letters slant of the writing. This can be done by using
contributes to this analysis, we will need them at Emotional Gauge.
some point of time.
AB B CD
C
With the help of image processing and pattern
DE
recognition techniques we would be able to segregate
each letters from the handwriting samples.
E+

After that we would be comparing the captured

Large
image (i.e. letter) with the pre-defined set of images. Averag
e
If that particular criterion matches then we will say Small

that the man has that particular trait.

So, we need to maintain a database for storing the Fig 4.1 Emotional Gauge.

pre-defined images. Before we compare the captured

The first step is to decide which letters you are going
letter with the pre-defined image, we will place a
to use to measure slant. Some letters have three or
control point (collection of pixels) on the captured
more strokes to constitute the entire letter. Measuring
letter, to avoid the conflict between two over lapped
for slant is actually measuring one stroke; so many
letters
letters could have more than one measurable stroke,

Let us see with an example, consider the letter ‘t’ or none. The easiest letters to measure are the cursive

which is captured from the handwriting sample. t, b, l, m, n, r, s, d, h, and k.

5. Applications and Limitations of

Control
Handwriting Analysis
points

5.1 Applications of Handwriting Analysis

Here the control points are considered as edges for There are many uses of handwriting analysis. Below
that letter, we would be only concentrating only up to are a few of the most popular applications we use
those edges not beyond. today. You will find more.

• Dating and Socializing

 • Employee hiring and human resources • Handwriting samples must be scanned
or captured through digital cameras.
• Police profiling

• Self improvement and professional speaking

6. Conclusion
• Counselor, therapist, and coaching
applications. The work presented here is mainly aimed at
analyzing the people’s handwriting to know more
5.2 Limitations of Handwriting analysis
about them through the computer by making use of

Below are a few of the limitations of Handwriting the science called graphology.

analysis
I hope the tool which I am designing will reach out
the people for the best utilization. I am aiming at the
• Handwriting does not reveal the AGE of the
design of the tool which will be very much user
writer
friendly rather than a messy one.
• Handwriting does not reveal the Gender of
The proposed scheme assumes that the handwriting
the writer
samples provided for analysis are legible to read and
• Handwriting does not reveal if the writer has not a printed one as well.
written using left or the right hand or any
The future work encompasses finding out the hell
other part of the body.
traits and giving the remedy for it.

• Caste, religion, race, creed or religious

References
preferences cannot be found in the
handwriting [1] Daisheng Luo, Pattern Recognition and Image
Processing, Horwood Publishing 1998.
• The future cannot be predicted with the
handwriting. [2] Jorge Boliva, Nearest Neighbor in Pattern
Recognition, IEEE/ACM, Jan 1990.

[3] Laveen Kanal, On Patterns and Categories, 11th

Limitations when we do analysis using image
international conference on Pattern Recognition,
processing techniques are:
September 1992

• We cannot know the pressure of

[4] Bart A Baggett, Handwriting Analysis & Success
writing.
Secrets

• Dealing with illegible writing is

difficult.