Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Scribd Logo
Upload

Welcome to Scribd!

  • 21 views

    55CNN

    Uploaded by

    Madhavan Sridhar
    Convolutional neural networks (CNNs) are a type of neural network that share parameters. CNNs involve sliding filters across input data, such as images, to extract features at different levels of abstraction. The core layers in CNNs are convolution layers, activation layers, pooling layers, and fully-connected layers. Convolution layers apply filters to input data to generate feature maps. Pooling layers reduce the spatial size to minimize parameters and computation. CNNs have been very successful for computer vision and image classification tasks.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd

    55CNN

    Uploaded by

    Madhavan Sridhar
    21 views5 pages
    Convolutional neural networks (CNNs) are a type of neural network that share parameters. CNNs involve sliding filters across input data, such as images, to extract features at different levels of abstraction. The core layers in CNNs are convolution layers, activation layers, pooling layers, and fully-connected layers. Convolution layers apply filters to input data to generate feature maps. Pooling layers reduce the spatial size to minimize parameters and computation. CNNs have been very successful for computer vision and image classification tasks.

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Convolutional neural networks (CNNs) are a type of neural network that share parameters. CNNs involve sliding filters across input data, such as images, to extract features at different levels of abstraction. The core layers in CNNs are convolution layers, activation layers, pooling layers, and fully-connected layers. Convolution layers apply filters to input data to generate feature maps. Pooling layers reduce the spatial size to minimize parameters and computation. CNNs have been very successful for computer vision and image classification tasks.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    21 views5 pages

    55CNN

    Uploaded by

    Madhavan Sridhar
    Convolutional neural networks (CNNs) are a type of neural network that share parameters. CNNs involve sliding filters across input data, such as images, to extract features at different levels of abstraction. The core layers in CNNs are convolution layers, activation layers, pooling layers, and fully-connected layers. Convolution layers apply filters to input data to generate feature maps. Pooling layers reduce the spatial size to minimize parameters and computation. CNNs have been very successful for computer vision and image classification tasks.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    of 5

    Introduction to Convolution Neural Network

     Difficulty Level : Hard


     Last Updated : 08 Jul, 2022

     Read

     Discuss

    It is assumed that the reader knows the concept of Neural networks.


    When it comes to Machine Learning, Artificial Neural Networks perform really well.
    Artificial Neural Networks are used in various classification tasks like image, audio,
    words. Different types of Neural Networks are used for different purposes, for
    example for predicting the sequence of words we use Recurrent Neural Networks
    more precisely an LSTM, similarly for image classification we use Convolution
    Neural networks. In this blog, we are going to build a basic building block for CNN.
    Before diving into the Convolution Neural Network, let us first revisit some concepts
    of Neural Network. In a regular Neural Network there are three types of layers:

    1. Input Layers: It’s the layer in which we give input to our model. The number of
    neurons in this layer is equal to the total number of features in our data (number of
    pixels in the case of an image).
    2. Hidden Layer: The input from the Input layer is then feed into the hidden layer.
    There can be many hidden layers depending upon our model and data size. Each
    hidden layer can have different numbers of neurons which are generally greater
    than the number of features. The output from each layer is computed by matrix
    multiplication of output of the previous layer with learnable weights of that layer
    and then by the addition of learnable biases followed by activation function which
    makes the network nonlinear.
    3. Output Layer: The output from the hidden layer is then fed into a logistic
    function like sigmoid or softmax which converts the output of each class into the
    probability score of each class.
    The data is then fed into the model and output from each layer is obtained this step is
    called feedforward, we then calculate the error using an error function, some common
    error functions are cross-entropy, square loss error, etc. After that, we backpropagate
    into the model by calculating the derivatives. This step is called Backpropagation
    which basically is used to minimize the loss.
    Here’s the basic python code for a neural network with random inputs and two hidden
    layers.

     Python

    activation = lambda x: 1.0/(1.0 + np.exp(-x)) # sigmoid function


    input = np.random.randn(3, 1)

    hidden_1 = activation(np.dot(W1, input) + b1)

    hidden_2 = activation(np.dot(W2, hidden_1) + b2)

    output = np.dot(W3, hidden_2) + b3

    W1,W2,W3,b1,b2,b3 are learnable parameter of the model.

    Image source: cs231n.stanford.edu

    Convolution Neural Network


    Convolution Neural Networks or covnets are neural networks that share their
    parameters. Imagine you have an image. It can be represented as a cuboid having its
    length, width (dimension of the image), and height (as images generally have red,
    green, and blue channels).

    Now imagine taking a small patch of this image and running a small neural network
    on it, with say, k outputs and represent them vertically. Now slide that neural network
    across the whole image, as a result, we will get another image with different width,
    height, and depth. Instead of just R, G, and B channels now we have more channels
    but lesser width and height. This operation is called Convolution. If the patch size is
    the same as that of the image it will be a regular neural network. Because of this small
    patch, we have fewer weights.
    Image source: Deep Learning Udacity

    Now let’s talk about a bit of mathematics that is involved in the whole convolution
    process.

     Convolution layers consist of a set of learnable filters (a patch in the above image).
    Every filter has small width and height and the same depth as that of input volume
    (3 if the input layer is image input).
     For example, if we have to run convolution on an image with dimension 34x34x3.
    The possible size of filters can be axax3, where ‘a’ can be 3, 5, 7, etc but small as
    compared to image dimension.
     During forward pass, we slide each filter across the whole input volume step by
    step where each step is called stride (which can have value 2 or 3 or even 4 for
    high dimensional images) and compute the dot product between the weights of
    filters and patch from input volume.
     As we slide our filters we’ll get a 2-D output for each filter and we’ll stack them
    together and as a result, we’ll get output volume having a depth equal to the
    number of filters. The network will learn all the filters.

    Layers used to build ConvNets


    A covnets is a sequence of layers, and every layer transforms one volume to another
    through a differentiable function.
    Types of layers:
    Let’s take an example by running a covnets on of image of dimension 32 x 32 x 3.

    1. Input Layer: This layer holds the raw input of the image with width 32, height 32,
    and depth 3.
    2. Convolution Layer: This layer computes the output volume by computing the dot
    product between all filters and image patches. Suppose we use a total of 12 filters
    for this layer we’ll get output volume of dimension 32 x 32 x 12.
    3. Activation Function Layer: This layer will apply an element-wise activation
    function to the output of the convolution layer. Some common activation functions
    are RELU: max(0, x), Sigmoid: 1/(1+e^-x), Tanh, Leaky RELU, etc. The volume
    remains unchanged hence output volume will have dimension 32 x 32 x 12.
    4. Pool Layer: This layer is periodically inserted in the covnets and its main function
    is to reduce the size of volume which makes the computation fast reduces memory
    and also prevents overfitting. Two common types of pooling layers are max
    pooling and average pooling. If we use a max pool with 2 x 2 filters and stride 2,
    the resultant volume will be of dimension 16x16x12.

    Image source: cs231n.stanford.edu

    1. Fully-Connected Layer: This layer is a regular neural network layer that takes
    input from the previous layer and computes the class scores and outputs the 1-D
    array of size equal to the number of classes.
    Image source: cs231n.stanford.edu

    1.
    References: Stanford Convolution Neural Network Course (CS231n)
    This article is contributed by Akhand Pratap Mishra. If you like GeeksforGeeks and
    would like to contribute, you can also write an article using write.geeksforgeeks.org or
    mail your article to review-team@geeksforgeeks.org. See your article appearing on
    the GeeksforGeeks main page and help other Geeks.
    Please write comments if you find anything incorrect, or you want to share more
    information about the topic discussed above.

    You might also like