Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                

SAIFULLA

Download as pdf or txt
Download as pdf or txt
You are on page 1of 51

INTERNSHIP REPORT

A report submitted in partial fulfilment of the requirements for the Award of Degree of

BACHELOR OF TECHNOLOGY
in

ELECTRONICS AND COMMUNICATIONENGINEERING

SAIFULLA

Regd.No.: 20781A04F0

Under Supervision of

T.NIKHIL, Team lead


Verzeo Edutech pvt,ltd

(05/07/2022 to 31/08/2022)

SRI VENKATESWARA COLLEGE OF ENGINEERING& TECHNOLOGY


(AUTONOMOUS)
R.V.S NAGAR, CHITTOOR – 517 127. (A.P)
(Approved by AICTE, New Delhi, Affiliated to JNTUA, Anantapuramu)
(Accredited by NBA, New Delhi & NAAC, Bengaluru) (An ISO 9001:2000
Certified Institution) 2021-
2022
SRI VENKATESWARA COLLEGE OF ENGINEERING& TECHNOLOGY
(AUTONOMOUS)
R.V.S NAGAR, CHITTOOR – 517 127. (A.P)
(Approved by AICTE, New Delhi, Affiliated to JNTUA, Anantapuramu)
(Accredited by NBA, New Delhi & NAAC, Bengaluru) (An ISO 9001:2000
Certified Institution)

CERTIFICATE
This is to certify that the “Internship report” submitted by S.SAIFULLA
(Regd.No.:20781A04F0) is work done by him/her and submitted during 2021- 2022 academic
year, in partial ful fillment of the requirements for the award of the degree of BACHELOR OF

TECHNOLOGY in ELECTRONICS AND COMMUNICATION ENGINEERING, Verzeo


Edutech pvt,ltd, bangalore.

InternshipCoordinator Head of the Department


CERTIFICATE OF INTERNSHIP
ACKNOWLEDGEMENT

A grateful thanks to Dr.R.Venkataswamy, Chairman of Sri Venkateswara College


of Engineering & Technology for providing education in their esteemed institution.

I wish to record my deep sense of gratitude and profound thanks to our beloved

Vice Chairman, Sri R.V.Srinivas for his valuable support throughout the course.

I express our sincere thanks to Dr.M.MOHAN BABU, our beloved principal for his
encouragement and suggestion during the course of study.

With the deep sense of gratefulness, I acknowledge Dr. T.SOMASSOUNDARAM, Head


of the Department, Electronics and Communication Engineering, for giving us inspiring guidance
in undertaking internship.

I express our sincere thanks to the internship coordinator, for her keen interest, stimulating
guidance, constant encouragement with our work during all stages, to bring this report into
fruition.

I wish to convey my gratitude and sincere thanks to all members for their support and
cooperation rendered for successful submission of report.

Finally, I would like to express my sincere thanks to all teaching, non-teaching faculty
members, our parents, friends and for all those who havesupported us to complete the internship
successfully.
V
MACHINE LEARNING WITH PYTHON

ABSTRACT

The field of machine learning is introduced at a conceptual level. Ideas such


as supervised and unsupervised as well as regression and classification are
explained. The tradeoff between bias, variance, and model complexity is
discussed as a central guiding idea of learning. Various types of model that
machine learning can produce are introduced such as the neural network
(feed-forward and recurrent), support vector machine, random forest,
selforganizing map, and Bayesian network. Training a model is discussed
next with its main ideas of splitting a dataset into training, testing, and
validation sets as well as performing cross-validation. Assessing the
goodness of the model is treated next alongside the essential role of the
domain expert in keeping the project real. The chapter concludes with some
practical advice on how to perform a machine learning project.
MACHINE LEARNING WITH PYTHON

TABLE CONTENT

S.NO TABLE CONTENT PAGE NO

CHAPTER-1

INTRODUCTION 4-5

1.1 PYTHON . ……………………………………………………………….. 4

1.2 SCRIPT LANGUAGE……………………………………………………. 4

1.3 OBJECTED ORIENTED PROGRAMMING .................................... 5

CHAPTER-2

DOWNLOADING& INSTALLING PYTHON……………………. 6-11

2.DOWNLOADING PYTHON…………………………………………. 6

2.1INSTALLING PYTHON………………………………………………… 7

2.2SETUP PATH OF VARIBLE …………………………………………. 9

2.3RUNNING THE PYTHON IDE… ........................................................ 9-11

CHAPTER-3

DATA TYPES & OPERATOR………………………………. 12-1

3.1DATA TYPES………………………………………………………….. 12

3.2 VARIBLES ......................................................................................................12


3.3 STRING ....................................................................................................... 13-15
3.4 PYTHON OPERTOR .................................................... 15
CHAPTER-4
TUPLES &LISTS……………………………………………… 16-19
4.1TUPLES…………………………………………………………………. 16
4.2LIST ................................................................................................................ 17-18
4.3 BUILT IN OPERATION............................................................................. 18-19
CHAPTER-5
LOOPS& CONDITION STATEMENTS……………………. 20-23
5.1LOOPS ........................................................................................... 20-21

SVCET(CHITTOOR) 2
MACHINE LEARNING WITH PYTHON
5.2 CONDITION STATEMENT… ................................................................... 22-23
5.3 FUNCTION ..................................................................................................... 23
MACHINE LEARNING
6 Introduction ............................................... 24-25
6.1 TASTE OF MACHINE LEARNING ........................................................ 24-25
6..2 FUTURE OF MACHINE LEARNING ....................................................... 25

7. TECHNOLOGY LEARNT………………………… 26-41

7.1 INTRODUCTION TO AI & MACHINE LEARNING……. 26-27 7.2


DEFINITION OF MACHINE LEARNING ............................ 27-38

7.3 MACHINE LEARNING ALOGRATHIM ..............................39-41

8 TECHINQUES OF MACHINE LEARNING ……………. 42-53

8.1 SUPERSIVED LEARNING……………………………….. 42-44

8.2 TYPES OF SUPERVISED LEARNING…………………... 45-46

8.3 FEATURES ENGINEERING……………………………... 47-51

8.4 INTRODUCTION TO DEEP LEARNING…… 51-53

SVCET(CHITTOOR) 3
MACHINE LEARNING WITH PYTHON

List of Tables
S.NO Name of the Table Page No

1 Example of numbers 13,14

2 Operator with example 15

3 Built in tuple functions 16

4 Function and description 17

5 Basic list operations 18

6 Loop types 20

List of figures
S.NO Name of Figure Page
No

1 Downloading python 6
2 Installing python 7-10
3 Running python IDE 10,11
4 Machine learning 24

5 Time optimization 25
6 Byte marks 26

7 Comparision circles 27
8 Machine learning uses 29
9 Techniques of machine learning 31

SVCET(CHITTOOR) 4
MACHINE LEARNING WITH PYTHON

Chapter-1

introduction
Python is a widely used high-level, general-purpose, interpreted, dynamic
programming
language. Its design philosophy emphasizes code readability, and its syntax allows
programmers to express concepts in fewer lines of code than would be possible in
languages such as C++ or Java. The language provides constructs intended to enable
clear programs on both a small and large scale.

Python supports multiple programming paradigms, including object-oriented,


imperative and functional programming or procedural styles. It features a dynamic
type system and automatic memory management and has a large and comprehensive
standard library. Python interpreters are available for installation on many operating
systems, allowing Python code execution on a wide variety of systems.

Scripting Language
A scripting or script language is a programming language that supports scripts,
programs written for a special run-time environment that automate the execution of
tasks that could alternatively be executed one-by-one by a human operator.

Scripting languages are often interpreted (rather than compiled). Primitives are
usually the elementary tasks or API calls, and the language allows them to be
combined into more
complex programs. Environments that can be automated through scripting include
software applications, web pages within a web browser, the shells of operating
systems

A scripting language can be viewed as a domain-specific language for a particular


environment; in the case of scripting an application, this is also known as an
extension language. Scripting languages are also sometimes referred to as very
highlevel programming languages, as they operate at a high level of abstraction, or as
control languages.
Object Oriented Programming Language

Object-oriented programming (OOP) is a programming paradigm based on the


concept
of "objects", which may contain data, in the form of fields, often known as attributes; and code, in the
form of procedures, often known as methods. A distinguishing feature of objects is that an object's

SVCET(CHITTOOR) 5
MACHINE LEARNING WITH PYTHON

procedures can access and often modify the data fields of the object with which they are associated
(objects have a notion of "this" or "self").

In OO programming, computer programs are designed by making them out of objects


that interact with one another. There is significant diversity in objectoriented
programming, but most popular languages are class-based, meaning that objects are
instances of classes, which typically also determines their type.

History

Python was conceived in the late 1980s, and its implementation was started in
December
1989 by Guido van Rossum at CWI in the Netherlands as a successor to the ABC
language (itself inspired by SETL) capable of exception handling and interfacing
with the
Amoeba operating system. Van Rossum is Python's principal author, and his
continuing central role in deciding the direction of Python is reflected in the title
given to him by the
Python community, benevolent dictator for life (BDFL).

SVCET(CHITTOOR) 6
MACHINE LEARNING WITH PYTHON

Chapter-2

Downloading & Installing Python


About the Behind The Scene of Python origin
of Python, Van Rossum wrote in
1996:

Over six years ago, in December 1989, I was looking for a "hobby" programming project that
would keep me occupied during the week around Christmas. My office ... would be closed,
but I had a home Computer, and not much else on my hands. I decided to write an interpreter
forthe new scripting language I had been thinking about lately: a descendant of ABC that
would appeal to Unix/C hackers. I chose Python as a working title for the project, being n a
slightlyirreverent mood (and a big fan of Monty Python's Flying Circus).

2.1 Downloading python


If you don’t already have a copy of Python installed on your computer, you will need to open up
your Internet browser and go to the Python download page
(http://www.python.org/download/).

Now that you are on the download page, select which of the software builds you would like
to download. For the purposes of this article we will use the most up to date version
available (Python 3.4.1).

Once you have clicked on that, you will be taken to a page with a description of all the new
updates and features of 3.4.1, however, you can always read that while the download is in
process. Scroll to the bottom of the page till you find the “Download” section and click on
the link that says “download page.”

SVCET(CHITTOOR) 7
MACHINE LEARNING WITH PYTHON

Now you will scroll all the way to the bottom of the page and find the
“Windows x86 MSI installer.” If you want to download the 86-64 bit MSI, feel
free to do so. We believe that even if you have a 64-bit operating system installed
on your computer, the 86-bit MSI is preferable. We say this because it will still run
well and sometimes, with the 64bit architectures, some of the compiled binaries
and Python libraries don’t work well.

2.2 Installing Python


Once you have downloaded the Python MSI, simply navigate to the download
location on your computer, double clicking the file and pressing Run when the dialog
box pops up.

If you are the only person who uses your computer, simply leave the “Install for all
users” option selected. If you have multiple accounts on your PC and don’t want to
install it across all accounts, select the “Install just for me” option then press “Next.”

SVCET(CHITTOOR) 8
MACHINE LEARNING WITH PYTHON

if you want to change the install location, feel free to do so; however, it is best to

leave it as is and simply select next, Otherwise..

Scroll down in the window and find the “Add Python.exe to Path” and click on the

small red “x.” Choose the “Will be installed on local hard drive” option then press
“Next.”

2.3 Setup the Path Variable


Begin by opening the start menu and typing in “environment” and select the option
Called

“Edit the system environment variables.”

SVCET(CHITTOOR) 9
MACHINE LEARNING WITH PYTHON

When the “System Properties” window appears, click on “Environment Variables…”

Once you have the “Environment Variables” window open, direct your focus to the
bottom half. You will notice that it controls all the “System Variables” rather than
just this associated with your user. Click on “New…” to create a new variable for
Python.

Simply enter a name for your Path and the code shown below. For the purposes of
this example we have installed Python 2.7.3, so we will call the path:
“Python path.” The string that you will need to enter is:
“C:\Python27\;C:\Python27\Scripts;”

SVCET(CHITTOOR) 10
MACHINE LEARNING WITH PYTHON

2.4 Running The Python IDE


Now that we have successfully completed the installation process and added our
“Environment Variable,” you are ready to create your first basic Python script. Let’s
begin by opening Python’s GUI by pressing “Start” and typing “Python” and
selecting the “IDLE (Python GUI).”

Once the GUI is open, we will begin by using the simplest directive possible. This is
the “print” directive which simply prints whatever you tell it to, into a new line. Start
by typing a print directive like the one shown in the image below or copy and paste
this text then press

“Enter”: print (“Congratulations on executing your first print directive!”)

Python Code Execution


Python’s traditional runtime execution model: source code you type is translated to
byte code, which is then run by the Python Virtual Machine. Your code is
automatically compiled, but then it is interpreted.

SVCET(CHITTOOR) 11
MACHINE LEARNING WITH PYTHON

Source code extension is .py

Byte code extension is .pyc (compiled python code)

SVCET(CHITTOOR) 12
MACHINE LEARNING WITH PYTHON

Chapter-3
DATA TYPES & OPERATORS
3.1 Data types

(this is called dynamic typing). Data types determine whether an object can do
something, or whether it just would not make sense. Other programming languages
often determine whether an operation makes sense for an object by making sure the
object can never be stored somewhere where the operation will be performed on the
object (this type system is called static typing). Python does not do that. Instead it
stores the type of an object with the object, and checks when the operation is
performed whether that operation makes sense for that object Python has many
native data types. Here are the important ones:

Booleans: are either True or False.


Numbers: can be integers (1 and 2), floats (1.1 and 1.2), fractions (1/2 and 2/3), or
even complex numbers.
Strings: are sequences of Unicode characters, e.g. an HTML document.
Bytes and byte arrays:e.g. a JPEG image file.
Lists: are ordered sequences of values.
Tuples: are ordered, immutable sequences of values.

Sets: are unordered bags of values.

3.2 Variables
Variables are nothing but reserved memory locations to store values. This means that
when you create a variable you reserve some space in memory. Based on the data
type of a variable, the interpreter allocates memory and decides what can be stored in
the reserved memory. Therefore, by assigning different data types to variables, you
can store integers, decimals or characters in these variables. Ex: counter = 100
# An integer assignment miles = 1000.0 # A floating point name =
"John" # A string

Multiple Assignment
Python allows you to assign a single value to several variables simultaneously. For example −
a=b=c=1
Here, an integer object is created with the value 1, and all three variables are assigned to the
same memory location. You can also assign multiple objects to multiple variables.
For example −
a,b,c = 1,2,"john"
Here, two integer objects with values 1 and 2 are assigned to variables a and b respectively, and one
string object with the value "john" is assigned to the variable c.

SVCET(CHITTOOR) 13
MACHINE LEARNING WITH PYTHON

Standard Data Types


The data stored in memory can be of many types. For example, a person's age is stored
as a numeric value and his or her address is stored as alphanumeric characters. Python
has various standard data types that are used to define the operations possible on them
and the storage method for each of them. Python has five standard data types −

• Numbers
• String
• List
• Tuple Dictionary

Python Numbers
Number data types store numeric values. Number objects are created when you assign a value
to them. For example −
var1 = 1 var2
= 10
You can also delete the reference to a number object by using the del statement. The syntax of
the del statement is −
del var1[,var2[,var3[. .. ,varN]]]]
You can delete a single object or multiple objects by using the del statement. For example −
del var del var_a,
var_b
Python supports four different numerical types −

• int (signed integers)


• long (long integers, they can also be represented in octal and hexadecimal)
• float (floating point real values)

• complex (complex numbers) Examples


Here are some examples of numbers −
long float complex

Int

10 51924361L 0.0 3.14j

SVCET(CHITTOOR) 14
MACHINE LEARNING WITH PYTHON

100 -0x19323L 15.20 45.j

-786 0122L -21.9 9.322e-36j

080 0xDEFABCECBDAECBFBAEl 32.3+e18 .876j

-0490 535633629843L -90. -.6545+0J

-0x260 -052318172735L -32.54e100 3e+26J

0x69 -4721885298529L 70.2-E12 4.53e-7j

3.3Python operators

Arithmetic Operators

SVCET(CHITTOOR) 15
MACHINE LEARNING WITH PYTHON

Comparison Operator

SVCET(CHITTOOR) 16
MACHINE LEARNING WITH PYTHON

Chapter-4
Tuples &list
4.1 Tuples
A tuple is a sequence of immutable Python objects. Tuples are sequences, just like
lists. The differences between tuples and lists are, the tuples cannot be changed
unlike lists and tuples use parentheses.
Accessing Values in Tuples:
To access values in tuple, use the square brackets for slicing along with the index or
indices to obtain value available at that index. For example − tup1 = ('physics',
'chemistry', 1997,
2000); tup2 = (1, 2, 3, 4, 5, 6, 7 ); print "tup1[0]: ", tup1[0] print "tup2[1:5]: ",
tup2[1:5]

When the above code is executed, it produces the following result − tup1[0]: physics
tup2[1:5]: [2, 3, 4, 5]

Basic Tuples Operations


Tuples respond to the + and * operators much like strings; they mean concatenation
and repetition here too, except that the result is a new tuple, not a string. In fact, tuples
respond to all of the general sequence operations we used on strings in the prior chapter

Built-in Tuple Functions

Python includes the following tuple functions –

SVCET(CHITTOOR) 17
MACHINE LEARNING WITH PYTHON

LISTS

4.2 List
The list is a most versatile datatype available in Python which can be written as a list
of commaseparated values (items) between square brackets. Important thing about a
list is that items in a list need not be of the same type.

Creating a list is as simple as putting different comma-separated values between


square brackets. For example − list1 = ['physics', 'chemistry', 1997,
2000]; list2 = [1, 2, 3, 4, 5 ]; list3 = ["a", "b", "c", "d"];
Similar to string indices, list indices start at 0, and lists can be sliced, concatenated
and so on.
Accessing Values in Lists:
To access values in lists, use the square brackets for slicing along with the index or
indices to obtain value available at that index. For example − list1 = ['physics',
'chemistry',
1997, 2000]; list2
= [1, 2,
3, 4, 5, 6, 7 ]; print "list1[0]: ", list1[0] print "list2[1:5]: ", list2[1:5] Output:
list1[0]: physics list2[1:5]:
[2, 3, 4, 5]
Update: list = ['physics', 'chemistry', 1997, 2000]; print
"Value available at index 2 : " print list[2] list[2] = 2001; print
"New value available at index 2 : " print list[2]
Output: Value available at index 2 : 1997
New value available at index 2 : 2001

SVCET(CHITTOOR) 18
MACHINE LEARNING WITH PYTHON

Delete: list1 = ['physics', 'chemistry', 1997, 2000]; print list1 del


list1[2]; print "After deleting value at index 2 : " print list1
['physics', 'chemistry', 1997, 2000] Output:
After deleting value at index 2 :
['physics', 'chemistry', 2000]
4.3 Basic List Operation

Built-in List Functions & Method

Python includes following list methods

SVCET(CHITTOOR) 19
MACHINE LEARNING WITH PYTHON

SVCET(CHITTOOR) 20
MACHINE LEARNING WITH PYTHON

Chapter-5
Loops& conditional statements

5.1 Loop definition


Programming languages provide various control structures that allow for more
complicated execution paths.

A loop statement allows us to execute a statement or group of statements multiple


times.
The following diagram illustrates a loop statement –

Python programming language provides following types of loops to handle looping


requirements.

Loop Example:

For Loop:
>>> for mynum in [1, 2, 3, 4, 5]:

SVCET(CHITTOOR) 21
MACHINE LEARNING WITH PYTHON

print ("Hello", mynum )


Hello 1
Hello 2
Hello 3
Hello 4
Hello 5
While Loop:
>>> count = 0 >>while(count< 4): print
'The count is:', count count = count + 1
The count is: 0
The count is: 1
The count is: 2
The count is: 3

5.2 Conditional Statements:


Decision making is anticipation of conditions occurring while execution of the
program and specifying actions taken according to the conditions.

Decision structures evaluate multiple expressions which produce TRUE or FALSE


as outcome. You need to determine which action to take and which statements to
execute if outcome is TRUE or FALSE otherwise.

SVCET(CHITTOOR) 22
MACHINE LEARNING WITH PYTHON

Python programming language provides following types of decision making


statements.
Click the following links to check their detail.

Example:
If
Statement: a=33 b=200
If b>a: print(“b”)
If...Else

SVCET(CHITTOOR) 23
MACHINE LEARNING WITH PYTHON

Statement: a=200 b=33


if b>a:

print(“b is greater than a”) else:


print(“a is greater than b”)

5.3 Function

Function blocks begin with the keyword def followed by the function name and
parentheses( ( )
).
Any input parameters or arguments should be placed within these parentheses. You
can also define parameters inside these parentheses.
The first statement of a function can be an optional statement - the documentation
string of the function.

The code block within every function starts with a colon (:) and is indented.

The statement return [expression] exits a function, optionally passing back an


expression to the caller. A return statement with no arguments is the same as return
None.

Syntex:
Def function name(parameters):
“function_doc string”
Function _suite
Return[expression] Def
printme(str):
“this print a passed string into this function” print
str return
1. # Function definition is here def printme( str
):
"This prints a passed string into this function" print str
return;

# Now you can call printme function printme("I'm first


call to user defined function!") printme("Again second call
to the same function")

SVCET(CHITTOOR) 24
MACHINE LEARNING WITH PYTHON

Machine Learning
6. Introduction
6.1.A Taste of Machine Learning

✓ Arthur Samuel, an American pioneer in the field of computer gaming and


artificial intelligence, coined the term "Machine Learning" in 1959.

✓ Over the past two decades Machine Learning has become one of the
mainstays of information technology.

✓ With the ever-increasing amounts of data becoming available there is good


reason to believe that smart data analysis will become even more pervasive as a
necessary ingredient for technological progress.

1.2. Relation to Data Mining

• Data mining uses many machine learning methods, but with different goals;
on the other hand, machine learning also employs data mining methods as
"unsupervised learning" or as a preprocessing step to improve learner
accuracy.
1.3. Relation to Optimization

SVCET(CHITTOOR) 25
MACHINE LEARNING WITH PYTHON

Machine learning also has intimate ties to optimization: many learning problems are formulated
as minimization of some loss function on a training set of examples.

Loss functions express the discrepancy between the predictions of the model being trained and
the actual problem instances

6.2. Future of Machine Learning


• Machine Learning can be a competitive advantage to any company be it a top MNC
or a startup as things that are currently being done manually will be done tomorrow
by machines.

• Machine Learning revolution will stay with us for long and so will be the future of
Machine Learning.

SVCET(CHITTOOR) 26
MACHINE LEARNING WITH PYTHON

Chapter-7
Technology Learnt

7.1. Introduction to AI & Machine Learning


7.1. Definition of Artificial Intelligence

• Data Economy

• World is witnessing real time flow of all types structured and unstructured data from social media,
communication, transportation, sensors, and devices.

• International Data Corporation (IDC) forecasts that 180 zettabytes of data will be generated by
2025.

• This explosion of data has given rise to a new economy known as the Data Economy.

• Data is the new oil that is precious but useful only when cleaned and processed.

• There is a constant battle for ownership of data between enterprises to derive benefits from it.

• Define Artificial Intelligence


Artificial intelligence refers to the simulation of human intelligence in machines that are
programmed to think like humans and mimic their actions. The term may also be applied to
any machine that exhibits traits associated with a human mind such as learning and
problem solving.

7.2Definition of Machine Learning


• Relationship between AI and ML

SVCET(CHITTOOR) 27
MACHINE LEARNING WITH PYTHON

Machine Learning is an approach or subset of Artificial Intelligence that is based on the idea that machines
can be given access to data along with the ability to learn from it.

SVCET(CHITTOOR) 28
MACHINE LEARNING WITH PYTHON

Machine learning with python

• Define Machine Learning


Machine learning is an application of artificial intelligence (AI) that provides systems the ability to
automatically learn and improve from experience without being explicitly programmed. Machine
learning focuses on the development of computer programs that can access data and use it learn for
themselves.

• Features of Machine Learning

• Machine Learning is computing-intensive and generally requires a large amount of training


data.

• It involves repetitive training to improve the learning and decision making of algorithms.

• As more data gets added, Machine Learning training can be automated for learning new data
patterns and adapting its algorithm.
7.3. Machine Learning Algorithms
Traditional Programming vs. Machine Learning Approach

Applications of Machine Learning


MACHINE LEARNING WITH PYTHON


SVCET(CHITTOOR) 28

• Image Processing

• Optical Character Recognition (OCR)

• Self-driving cars

• Image tagging and recognition

• Robotics

• Industrial robotics

• Human simulation

• Data Mining

• Association rules

• Anomaly detection

• Grouping and Predictions

• Video games

• Pokémon

SVCET(CHITTOOR) 30
MACHINE LEARNING WITH PYTHON

• PUBG

• Text Analysis

Spam Filtering

• Information Extraction

• Sentiment Analysis

• Healthcare

• Emergency Room & Surgery

• Research

• Medical Imaging & Diagnostics

SVCET(CHITTOOR) 31
MACHINE LEARNING WITH PYTHON

Chapter-8

Techniques of Machine Learning


8.1 Supervised Learning
• Define Supervised Learning
Supervised learning is the machine learning task of learning a function that maps an input to an output
based on example input-output pairs. It infers a function from labeled training data consisting of a set
of training examples.

In supervised learning, each example is a pair consisting of an input object (typically a vector) and a
desired output value (also called the supervisory signal).

• Supervised Learning Flow


• Data Preparation Clean data

Label data (x, y)

Feature Engineering

Reserve 80% of data for Training (Train_X) and 20% for Evaluation (Train_E)

• Training Step

Design algorithmic logic

Train the model with Train X

Derive the relationship between x and y, that is, y = f(x)


SVCET(CHITTOOR) 32
MACHINE LEARNING WITH PYTHON

Evaluation or Test Step

Evaluate or test with Train E

If accuracy score is high, you have the final learned algorithm y = f(x) If
accuracy score is low, go back to training step

• Production Deployment
Use the learned algorithm y = f(x) to predict production data.

The algorithm can be improved by more training data, capacity, or algo redesign.

• Testing the Algorithms


• Once the algorithm is trained, test it with test data (a set of data instances that do
not appear in the training set).

• A well-trained algorithm can predict well for new test data.

• If the learning is poor, we have an underfitted situation. The algorithm will not
work well on test data. Retraining may be needed to find a better fit.

SVCET(CHITTOOR) 33
MACHINE LEARNING WITH PYTHON

• If learning on training data is too intensive, it may lead to overfitting–a situation


where the algorithm is not able to handle new testing data that it has not seen
before. The technique to keep data generic is called regularization.

• Examples of Supervised Learning

• Voice Assistants

• Gmail Filters

• Weather Apps

SVCET(CHITTOOR) 34
MACHINE LEARNING WITH PYTHON

8.2 Types of Supervised Learning

• Classification

• Answers “What class?"

Applied when the output has finite and discreet values Example: Social media sentiment analysis has
three potential outcomes, positive, negative, or neutral

data preprocessing

Data Preparation
• Data Preparation Process

SVCET(CHITTOOR) 35
MACHINE LEARNING WITH PYTHON


• Machine Learning depends largely on test data.

• Data preparation involves data selection, filtering, transformation, etc.

• Data preparation is a crucial step to make it suitable for ML.

• A large amount of data is generally required for the most common forms of ML.

• Types of Data

• Labelled Data or Training Data

• Unlabeled Data

Test Data

• Validation Data

8.3 Feature Engineering


• Define Feature Engineering
The transformation stage in the data preparation process includes an important step known as Feature
Engineering.

SVCET(CHITTOOR) 36
MACHINE LEARNING WITH PYTHON

Feature Engineering refers to selecting and extracting right features from the data that are relevant to
the task and model in consideration.

• Aspects of Feature Engineering

• Feature Selection
Most useful and relevant features are selected from the available data

• Feature Addition
New features are created by gathering new data

• Feature Extraction
Existing features are combined to develop more useful ones

• Feature Filtering
Filter out irrelevant features to make the modelling step easy

Feature Scaling
• Define Feature Scaling

• Feature scaling is an important step in the data transformation stage of data


preparation process.

• Feature Scaling is a method used in Machine Learning for standardization of


independent variables of data features.

• Techniques of Feature Scaling

SVCET(CHITTOOR) 37
MACHINE LEARNING WITH PYTHON

• Standardization

• Standardization is a popular feature scaling method, which gives data the property
of a standard normal distribution (also known as Gaussian distribution).

• All features are standardized on the normal distribution (a mathematical model).

• The mean of each feature is centered at zero, and the feature column has a standard
deviation of one.

SVCET(CHITTOOR) 38
MACHINE LEARNING WITH PYTHON

• Normalization

• In most cases, normalization refers to rescaling of data features between 0 and 1,


which is a special case of Min-Max scaling.

SVCET(CHITTOOR) 39
MACHINE LEARNING WITH PYTHON

• In the given equation, subtract the min value for each feature from each feature
instance and divide by the spread between max and min.

• In effect, it measures the relative percentage of distance of each instance from the
min value for that feature.

2.3.4. Datasets
• Machine Learning problems often need training or testing datasets.

• A dataset is a large repository of structured data.

• In many cases, it has input and output labels that assist in Supervised Learning.

Dimensionality Reduction with Principal Component Analysis


• Define Dimensionality Reduction

• Dimensionality reduction involves transformation of data to new dimensions in a way


that facilitates discarding of some dimensions without losing any key information.

SVCET(CHITTOOR) 40
MACHINE LEARNING WITH PYTHON

• Define Principal Component Analysis (PCA)

• Principal component analysis (PCA) is a technique for dimensionality reduction that


helps in arriving at better visualization models.

• Applications of PCA

• Noise reduction

• Compression

• Preprocess

8.4. Introduction to Deep Learning


Meaning and Importance of Deep Learning
• Define Deep Learning
Deep Learning is a specialized form of Machine Learning that uses supervised, unsupervised, or semi-
supervised learning to learn data representations.

SVCET(CHITTOOR) 41
MACHINE LEARNING WITH PYTHON

It is similar to the structure and function of the human nervous system.

• Why Deep Learning

The vast availability of Big Data enables machines to be trained.

Experts have discovered multi-layered learning networks that can be leveraged for deep
learning as they learn in layers.
Scientists have figured out that high-performing graphics processing units (GPU) can be
used for deep learning.

• ML Vs Deep Learning

Artificial Neural Networks

SVCET(CHITTOOR) 42
MACHINE LEARNING WITH PYTHON

• Deep learning relies on multiple layers of training.

• Artificial Neural Network is a computing system made up of a number of simple, highly


interconnected processing elements which process information by their dynamic state
response to external inputs.

• It is an interconnected group of nodes akin to the vast network of layers of neurons in a


brain.

SVCET(CHITTOOR) 43
MACHINE LEARNING WITH PYTHON

REFERANCE

All Content used in this report is from

https://www.simplilearn.com/

https://www.wikipedia.org/

https://towardsdatascience.com/

https://www.expertsystem.com/

https://www.coursera.org/

https://www.edureka.co/

https://subhadipml.tech/

https://www.forbes.com/

https://medium.com/

https://www.google.com/

All Pictures are from

https://www.simplilearn.com/

https://www.google.com/

https://www.wikipedia.org/

https://www.youtube.com/

https://www.edureka.co/

Book I referred are

Hands-on Machine Learning with Scikit-learn & Tensorflow By Aurelien Geron

Python Machine Learning by Sebastian Raschka

SVCET(CHITTOOR) 44
MACHINE LEARNING WITH PYTHON

CONCLUSION:
I am happy to complete my internship in VERZEO.
The organisation is very friendly to everyone and lecture given by the analytic team are useful.
Project work is the major task for the student .It should be done by individual.Evaluation should
be done by the instructor.
Finally,VERZEO makes the student well fit for future internships.
Best training platform for ever.
→I solemnly declare that the information given above are true and best of my knowledge.

The above all submitted by


BUSIREDDY SIREESHA
(20781A0426)

SVCET(CHITTOOR) 45

You might also like