Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                

Single Layer Perceptron

Download as pdf or txt
Download as pdf or txt
You are on page 1of 14

Single Layer Perceptron

Single Layer Perceptron

• Single-layer perceptron is also called the feed-forward neural


network. The working of the single-layer perceptron (SLP) is
based on the threshold transfer between the nodes. This is the
simplest form of ANN and it is generally used in the linearly
based cases for the machine learning problems.
Single Layer Perceptron

Working of Single Layer Perceptron algorithm:


• In a single layer perceptron, the weights to each input node are
assigned randomly since there is no a priori knowledge
associated with the nodes.
• Also, a threshold value is assigned randomly
• Now SLP sums all the weights which are inputted and if the
sums are is above the threshold then the network is activated.
• If the calculated value is matched with the desired value, then
the model is successful
• If it is not, then since there is no back-propagation technique
involved in this the error needs to be calculated using the below
formula and the weights need to be adjusted again.
Single Layer Perceptron

Perceptron Weight Adjustment


Below is the equation in Perceptron weight adjustment:
Δw = η * d * x
Where,
d: Predicted Output – Desired Output
η: Learning Rate, Usually Less than 1.
x: Input Data.
Since this network model works with the linear classification and
if the data is not linearly separable, then this model will not show
the proper results.
Single Layer Perceptron

Threshold in a perceptron network:

The threshold is one of the key components of the perceptron. It


determines, based on the inputs, whether the perceptron fires
or not. Basically, the perceptron takes all of the weighted input
values and adds them together. If the sum is above or equal to
some value (called the threshold) then the perceptron fires.
Single Layer Perceptron

What is threshold value in neural network?

These certain conditions which differ neuron to neuron are called


Threshold. For example, if the input X1 into the first neuron is
30 and X2 is 0: This neuron will not fire, since the sum 30+0 =
30 is not greater than the threshold i.e 100.
Single Layer Perceptron

Perceptron with optimization techniques

In computational geometry, the perceptron is a type of linear


classifieran algorithm that is used to supervise the
classification of an input into one of the several possible non-
binary outputs. Different types of Perceptron are:

• Single Layer Perceptron


• Multi Layer Perceptron
Single Layer Perceptron

A. Single Layer Perceptron:


• It is simplest form of neural network which is used for the
classification of patterns that are linearly separable.
Adaptive filtering problem:
• Adaptive filteration is automatic removal of errors. The
problem is how to design a multiple input-single output model
of the unknown dynamical system by building it around a
single linear neuron. Adaptive filter operation consists of two
continuous processes-
❖ Filtering process
❖ Adaptive process
Single Layer Perceptron

Filtering process:
Here two signals are computed-an output and an error
signal.
Adaptive process:
Here the automatic adjustment of the synaptic weights of
the neuron in accordance with the error signal is done.
Above two process constitute a feedback loop acting around the
neuron. The manner in which the error signal is used to
control the adjustment to synaptic weights is determined
by the cost function used to derive the adaptive filtering
algorithm.
Single Layer Perceptron

Limitations of single layer perceptron:

• A "single-layer" perceptron can't implement XOR. The


reason is because the classes in XOR are not linearly
separable. You cannot draw a straight line to separate the
points (0,0),(1,1) from the points (0,1),(1,0). Led to invention
of multi-layer networks.
Single Layer Perceptron

Adaptive filtering in neural network:

• An adaptive filter automatically adjusts Its own Impulse


response. In this paper adaptive noise canceller and adaptive
signal enhancer systems are implemented using feedforward
and recurrent neural networks using back propagation
algorithm and real time recurrent learning algorithm
respectively for training.
Single Layer Perceptron

Properties of adaptive filter:

• The principle property of an adaptive filter is its time-varying,


self-adjusting characteristics. An adaptive filter usually takes
on the form of an FIR filter structure, with an adaptive
algorithm that continually updates the filter coefficients, such
that an error signal is minimized according to some criterion.
Single Layer Perceptron

Types of adaptive filters:

The classical configurations of adaptive filtering are :

▪ System identification
▪ Prediction, noise cancellation
▪ Inverse modeling
Thank You

You might also like