Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Scribd Logo
Upload

Welcome to Scribd!

  • 21 views

    Introduction To NLP: What Is Natural Language Processing?

    Uploaded by

    Trinh Ngô Lê Phương
    This document provides an introduction to natural language processing (NLP). It discusses what NLP is, including examples like question answering, information extraction, machine translation, and the challenges of ambiguity. The class will teach key statistical NLP theories and methods, like n-gram language modeling, statistical parsing, and vector space models. Students will need skills in linear algebra, probability, and programming for homework assignments. NLP aims to understand human language through computational models built from large language data.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd

    Introduction To NLP: What Is Natural Language Processing?

    Uploaded by

    Trinh Ngô Lê Phương
    21 views14 pages
    This document provides an introduction to natural language processing (NLP). It discusses what NLP is, including examples like question answering, information extraction, machine translation, and the challenges of ambiguity. The class will teach key statistical NLP theories and methods, like n-gram language modeling, statistical parsing, and vector space models. Students will need skills in linear algebra, probability, and programming for homework assignments. NLP aims to understand human language through computational models built from large language data.

    Original Title

    01 intro.pptx

    Copyright

    © © All Rights Reserved

    Available Formats

    PPTX, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    This document provides an introduction to natural language processing (NLP). It discusses what NLP is, including examples like question answering, information extraction, machine translation, and the challenges of ambiguity. The class will teach key statistical NLP theories and methods, like n-gram language modeling, statistical parsing, and vector space models. Students will need skills in linear algebra, probability, and programming for homework assignments. NLP aims to understand human language through computational models built from large language data.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd
    Download as pptx, pdf, or txt
    21 views14 pages

    Introduction To NLP: What Is Natural Language Processing?

    Uploaded by

    Trinh Ngô Lê Phương
    This document provides an introduction to natural language processing (NLP). It discusses what NLP is, including examples like question answering, information extraction, machine translation, and the challenges of ambiguity. The class will teach key statistical NLP theories and methods, like n-gram language modeling, statistical parsing, and vector space models. Students will need skills in linear algebra, probability, and programming for homework assignments. NLP aims to understand human language through computational models built from large language data.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd
    Download as pptx, pdf, or txt
    of 14

    Introduction to

    NLP

    What is Natural
    Language Processing?
    Dan Jurafsky

    Question Answering: IBM’s Watson


    • Won Jeopardy on February 16, 2011!

    WILLIAM WILKINSON’S
    “AN ACCOUNT OF THE PRINCIPALITIES OF
    WALLACHIA AND MOLDOVIA” Bram Stoker
    INSPIRED THIS AUTHOR’S
    MOST FAMOUS NOVEL

    2
    Dan Jurafsky

    Information Extraction Event: Curriculum mtg


    Date: Jan-16-2012
    Subject: curriculum meeting Start: 10:00am
    Date: January 15, 2012 End: 11:30am
    Where: Gates 159
    To: Dan Jurafsky

    Hi Dan, we’ve now scheduled the curriculum meeting.


    It will be in Gates 159 tomorrow from 10:00-11:30.
    -Chris Create new Calendar entry
    3
    Dan Jurafsky

    Information Extraction & Sentiment Analysis


    Attributes:
    zoom
    affordability
    size and weight
    flash
    ease of use
    Size and weight
    ✓ • nice and compact to carry!
    • since the camera is small and light, I won't need to carry
    ✓ around those heavy, bulky professional cameras either!
    ✗ • the camera feels flimsy, is plastic and very light in weight you
    4 have to be very delicate in the handling of this camera
    Dan Jurafsky

    Machine Translation
    • Helping human translators
    • Fully automatic
    Enter Source Text:

    这 不过 是 一 个 时间 的 问题 .

    Translation from Stanford’s Phrasal:

    This is only a matter of time.

    5
    Dan Jurafsky

    Language Technology
    making good progress
    Sentiment analysis still really hard
    Best roast chicken in San Francisco!
    mostly solved Question answering (QA)
    The waiter ignored us for 20 minutes.
    Q. How effective is ibuprofen in reducing
    Spam detection Coreference resolution fever in patients with acute febrile illness?

    Let’s go to Agra! ✓
    Carter told Mubarak he shouldn’t run again. Paraphrase
    Buy V1AGRA … ✗ Word sense disambiguation XYZ acquired ABC yesterday
    (WSD)
    I need new batteries for my mouse. ABC has been taken over by XYZ
    Part-of-speech (POS) tagging
    ADJ ADJ NOUN VERB ADV Summarization
    Colorless green ideas sleep furiously. Parsing The Dow Jones is up Economy is
    I can see Alcatraz from the window! The S&P500 jumped good
    Housing prices rose
    Named entity recognition (NER) Machine translation (MT)
    PERSON ORG LOC 第13届上海国际电影节开幕… Dialog Where is Citizen Kane playing in SF?
    Einstein met with UN officials in Princeton
    The 13th Shanghai International Film Festival…
    Castro Theatre at 7:30. Do
    Information extraction (IE) you want a ticket?
    Party
    You’re invited to our dinner May 27
    party, Friday May 27 at 8:30 add
    Dan Jurafsky

    Ambiguity makes NLP hard:


    “Crash blossoms”

    Violinist Linked to JAL Crash Blossoms


    Teacher Strikes Idle Kids
    Red Tape Holds Up New Bridges
    Hospitals Are Sued by 7 Foot Doctors
    Juvenile Court to Try Shooting Defendant
    Local High School Dropouts Cut in Half
    Dan Jurafsky

    Ambiguity is pervasive
    New York Times headline (17 May 2000)

    Fed raises interest rates Fed raises interest rates

    Fed raises interest rates 0.5%


    Dan Jurafsky

    In-video quizzes!
    • Most lectures will include a little quiz
    • Just to check basic understanding
    • Simple, multiple-choice.
    • You can retake them if you get them wrong

    9
    Dan Jurafsky

    Why else is natural language


    understanding difficult?
    non-standard English segmentation issues idioms
    Great job @justinbieber! Were
    SOO PROUD of what youve dark horse
    the New York-New Haven Railroad
    accomplished! U taught us 2 get cold feet
    the New York-New Haven Railroad
    #neversaynever & you yourself lose face
    should never give up either♥ throw in the towel

    neologisms world knowledge tricky entity names


    unfriend Mary and Sue are sisters. Where is A Bug’s Life playing …
    Retweet Mary and Sue are mothers. Let It Be was recorded …
    bromance
    … a mutation on the for gene …

    But that’s what makes it fun!


    Dan Jurafsky

    Making progress on this problem…


    • The task is difficult! What tools do we need?
    • Knowledge about language
    • Knowledge about the world
    • A way to combine knowledge sources
    • How we generally do this:
    • probabilistic models built from language data
    • P(“maison”  “house”) high
    • P(“L’avocat général”  “the general avocado”) low
    • Luckily, rough text features can often do half the job.
    Dan Jurafsky

    This class
    • Teaches key theory and methods for statistical NLP:
    • Viterbi
    • Naïve Bayes, Maxent classifiers
    • N-gram language modeling
    • Statistical Parsing
    • Inverted index, tf-idf, vector models of meaning
    • For practical, robust real-world applications
    • Information extraction
    • Spelling correction
    • Information retrieval
    • Sentiment analysis
    Dan Jurafsky

    Skills you’ll need


    • Simple linear algebra (vectors, matrices)
    • Basic probability theory
    • Java or Python programming
    • Weekly programming assignments
    Introduction to
    NLP

    What is Natural
    Language Processing?

    You might also like