MACHINE LEARNING – ALGORITHMS AND

APPLICATIONS

22MCAP401

Dr. A. Prabhakaran
Assistant Professor, Department of Computer Application / MITS
1
Unit-1

• Learning problems

• Designing a Learning system

• Perspectives and issues in Machine Learning

• Types of Machine Learning

• Bayes theorem and Concept learning

• Least squared Error hypotheses

2
What is Machine Learning?
• Optimize a performance criterion using example data or past
experience.
• Role of Statistics: Inference from a sample
• Role of Computer science: Efficient algorithms to
• Solve the optimization problem
• Representing and evaluating the model for inference

“Learning is any process by which a system improves performance

from experience.”
- Herbert Simon
3
4
5
 The foundation of machine learning started in the 18th and 19th centuries. The first
related work dates back to 1763. In that year, Thomas Bayes’s work ‘An Essay towards
solving a Problem in the Doctrine of Chances’ was published two years after his death
Reference:
https://en.wikipedia.org/wiki/Bayes%27_theorem

Bayes theorem was actually formalized by the French mathematician Pierre Simon
Laplace. The method of least squares, which is the foundational concept to solve
regression problems, was formalized in 1805.
https://en.wikipedia.org/wiki/Pierre-Simon_Laplace

Andrey Markov came up with the concept of Markov chains.

https://en.wikipedia.org/wiki/Andrey_Markov

6
However, the real start of focused work in the field of
machine learning is considered to be Alan Turing’s seminal
work in 1950. In his paper ‘Computing Machinery and
Intelligence’ (Mind, New Series, Vol. 59, No. 236, Oct., 1950,
pp. 433–460), Turing posed the question ‘Can machines
think?’ or in other words, ‘Do machines have intelligence?’.
He was the first to propose that machines can ‘learn’ and
become artificially intelligent. In 1952, Arthur Samuel of IBM
laboratory started working on machine learning programs,
and first developed programs that could play Checkers. In
1957,
https://en.wikipedia.org/wiki/Alan_Turing

Frank Rosenblatt designed the first neural network program

simulating the human brain. From then on, for the next 50
years, the journey of machine learning has been fascinating.
https://en.wikipedia.org/wiki/Frank_Rosenblatt 7
Evolution of machine learning

8
Learning…
• Learning under expert guidance
• Learning guided by knowledge gained from experts
• Learning by self

1. Do machines really learn?

2. If so, how do they learn?
3. Which problem can we consider as a well-posed learning problem?
4. What are the important features that are required to well-define a
learning problem?
9
What is Machine Learning?
• Definition by Tom Mitchell (1998):
Machine Learning is the study of algorithms that
• Improve performance P
• At some task T
• With experience E.
A well-defined learning task is given by . <P, T, E>

10
How do machines learn?
The basic machine learning process can be divided into three parts.
1. Data Input: Past data or information is utilized as a basis for future decision-
making
2. Abstraction: The input data is represented in a broader way through the
underlying algorithm
3. Generalization: The abstracted representation is generalized to form a
framework for making decisions

11
Machines learning Model & Training
Data
• The data cannot be used in the original shape and form.
• Abstraction helps in deriving a conceptual map based on the input data. This
map, or a model
The model may be in any one of the following forms
 Computational blocks like if/else rules
 Mathematical equations
 Specific data structures like trees or graphs
 Logical groupings of similar observations
• This process of fitting the model based on the input data is known as training.
• the input data based on which the model is being finalized is known as
training data.
12
Well-posed learning problem
1. What is the problem?
Informal description of the problem
Assumptions
2. Why does the problem need to be solved?
Motivation
Solution benefits
Solution use
3. How to solve the problem?

13
Why “Learn” ?

Machine learning is programming

computers to optimize a
performance criterion using
example data or past experience.

• There is no need to “learn” to

calculate payroll

14
When Do We Use Machine Learning?
ML is used when:
• Human expertise does not exist (navigating on Mars)
• Humans can’t explain their expertise (speech recognition)
• Models must be customized (personalized medicine)
• Models are based on huge amounts of data (genomics)

15
Some more examples of tasks that are best
solved by using a learning algorithm
• Recognizing patterns:
– Facial identities or facial expressions
– Handwritten or spoken words
– Medical images
• Generating patterns:
– Generating images or motion sequences
• Recognizing anomalies:
– Unusual credit card transactions
– Unusual patterns of sensor readings in a nuclear power plant
• Prediction:
– Future stock prices or currency exchange rates
16
Sample Applications
• Web search
• Computational biology
• Finance
• E-commerce
• Space exploration
• Robotics
• Information extraction
• Social networks
• Debugging software
• [Your favorite area] & Many more…
17
1. Machine Learning 11. ‘Training set’ and ‘Test set’
2. Data Mining and Machine learning 12. Data Mining and Machine learning
3. ‘Overfitting’ in Machine learning
13. Various approaches for machine
4. Why overfitting happens? learning
5. How can you avoid overfitting? 14. Function of ‘Unsupervised
cross validation / testing and
training datasets Learning’
6. Inductive machine learning 15. Function of ‘Supervised Learning’
7. Popular algorithms of Machine 16. Artificial Intelligence and machine
Learning learning
8. Different Algorithm techniques in 17. Classifier in machine learning
Machine Learning
9. 3 Stages to build the hypotheses or 18. Naive Bayes
model in machine learning 19. Pattern Recognition
10. Standard approach to supervised 20. Ensemble learning
learning
18
State of the Art Applications of Machine
Learning

19
Autonomous Car Technology

20
Types of Learning
• Supervised (inductive) learning
– Given: training data + desired outputs (labels)
• Unsupervised learning
– Given: training data (without desired outputs)
• Semi-supervised learning
– Given: training data + a few desired outputs
• Reinforcement learning
– Rewards from sequence of actions

21
Supervised learning – Also called predictive learning. A machine predicts the class of
unknown objects based on prior class-related information of similar objects. (past
information – Labeled data)
Unsupervised learning – Also called descriptive learning. A machine finds patterns in
unknown objects by grouping similar objects together.
Reinforcement learning – A machine learns to act on its own to achieve the given goals.
22
Knowing Your Task and Knowing Your
Data
• What question(s) am I trying to answer? Do I think the data collected can
answer that question?
• What is the best way to phrase my question(s) as a machine learning
problem?
• Have I collected enough data to represent the problem I want to solve?
• What features of the data did I extract, and will these enable the right
predictions?
• How will I measure success in my application?
• How will the machine learning solution interact with other parts of my
research or business product?
23
Supervised learning
• The major motivation of supervised learning is to learn from past
information.
• Predicting the results of a game
• Predicting whether a tumour is malignant or
benign
• Predicting the price of domains like real
estate, stocks, etc.
• Classifying texts such as classifying a set of
emails as spam or non-spam

predict a categorical or nominal variable, the

problem is known as a classification problem.
predict a real-valued variable, the problem falls
under the category of regression.

24