Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Scribd Logo
Upload

Welcome to Scribd!

  • 25 views

    Tutorial SVR01

    Uploaded by

    albaro
    The document discusses machine learning concepts including kernel functions, support vector machines, and kernel approximation. It contains graphs comparing different kernel functions and their approximations. Equations are shown for support vector machine output and mapping examples to feature space with kernel functions.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd

    Tutorial SVR01

    Uploaded by

    albaro
    25 views73 pages
    The document discusses machine learning concepts including kernel functions, support vector machines, and kernel approximation. It contains graphs comparing different kernel functions and their approximations. Equations are shown for support vector machine output and mapping examples to feature space with kernel functions.

    Original Description:

    Suporte vector regretion

    Original Title

    TUTORIAL_SVR01

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    The document discusses machine learning concepts including kernel functions, support vector machines, and kernel approximation. It contains graphs comparing different kernel functions and their approximations. Equations are shown for support vector machine output and mapping examples to feature space with kernel functions.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    25 views73 pages

    Tutorial SVR01

    Uploaded by

    albaro
    The document discusses machine learning concepts including kernel functions, support vector machines, and kernel approximation. It contains graphs comparing different kernel functions and their approximations. Equations are shown for support vector machine output and mapping examples to feature space with kernel functions.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    of 73

    x

    ζ x +ε ζ
    x x
    0
    x x −ε
    x x
    x
    x
    x x x
    x −ε +ε
    x
    3 3
    loss function loss function
    density density

    2.5 2.5

    2 2

    1.5 1.5

    1 1

    0.5 0.5

    0 0

    -3 -2 -1 0 1 2 3 -3 -2 -1 0 1 2 3

    3 3
    loss function "loss function"
    density density

    2.5 2.5

    2 2

    1.5 1.5

    1 1

    0.5 0.5

    0 0

    -3 -2 -1 0 1 2 3 -3 -2 -1 0 1 2 3
    Σ output Σ vi k (x,xi) + b

    v1 v2 ... vm weights

    (.) (.) ... (.) dot product (Φ(x).Φ(xi)) = k (x,xi)

    Φ(x1) Φ(x2) Φ(x) Φ(xn) mapped vectors Φ(xi), Φ(x)

    ... support vectors x1 ... xn

    test vector x
    1 1
    sinc x sinc x + 0.1
    sinc x - 0.1
    0.8 0.8 approximation

    0.6 0.6

    0.4 0.4

    0.2 0.2

    0 0

    -0.2 -0.2

    -0.4 -0.4

    -0.6 -0.6

    -0.8 -0.8

    -1 -1
    -1 -0.8 -0.6 -0.4 -0.2 0 0.2 0.4 0.6 0.8 1 -1 -0.8 -0.6 -0.4 -0.2 0 0.2 0.4 0.6 0.8 1

    1 1
    sinc x + 0.2 sinc x + 0.5
    sinc x - 0.2 sinc x - 0.5
    0.8 approximation 0.8 approximation

    0.6 0.6

    0.4 0.4

    0.2 0.2

    0 0

    -0.2 -0.2

    -0.4 -0.4

    -0.6 -0.6

    -0.8 -0.8

    -1 -1
    -1 -0.8 -0.6 -0.4 -0.2 0 0.2 0.4 0.6 0.8 1 -1 -0.8 -0.6 -0.4 -0.2 0 0.2 0.4 0.6 0.8 1
    1
    sample
    interpolation
    0.8 alpha

    0.6

    0.4

    0.2

    -0.2

    -0.4

    -0.6

    -0.8

    -1
    -1 -0.8 -0.6 -0.4 -0.2 0 0.2 0.4 0.6 0.8 1
    empirical Error

    w1 w2 w3 ||w||
    1 0
    10
    0.9

    0.8
    −50
    0.7 10

    0.6
    k(x)

    0.5
    k(ω)

    −100
    10
    0.4

    0.3
    −150
    10
    0.2

    0.1

    0
    −3 −2 −1 0 1 2 3 −20 −15 −10 −5 0 5 10 15 20
    x 2π⋅ω
    ! !
    !
    ! ! !
    ! ! ! ! !
    "! !
    !
    "" $ %
    "
    ""
    "" "
    "
    ""
    # "" "
    !

    You might also like