Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Scribd Logo
Upload

Welcome to Scribd!

  • 20 views

    CS345A: Data Mining On The Web: Course Introduction Issues in Data Mining Bonferroniƞs Principle

    Uploaded by

    Kushe Shaya
    This document provides an overview of the CS345A: Data Mining on the Web course, including requirements, possible project topics, and an outline of course content. It also discusses issues related to finding meaningful patterns in large datasets, highlighting Bonferroni's principle which notes that if you look for patterns in more places than the data supports, you are likely to find meaningless results. Examples are given including a made-up story about tracking terrorists and Joseph Rhine's parapsychology experiments.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PPT, PDF, TXT or read online from Scribd

    CS345A: Data Mining On The Web: Course Introduction Issues in Data Mining Bonferroniƞs Principle

    Uploaded by

    Kushe Shaya
    20 views27 pages
    This document provides an overview of the CS345A: Data Mining on the Web course, including requirements, possible project topics, and an outline of course content. It also discusses issues related to finding meaningful patterns in large datasets, highlighting Bonferroni's principle which notes that if you look for patterns in more places than the data supports, you are likely to find meaningless results. Examples are given including a made-up story about tracking terrorists and Joseph Rhine's parapsychology experiments.

    Original Title

    Introduction

    Copyright

    © Attribution Non-Commercial (BY-NC)

    Available Formats

    PPT, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    This document provides an overview of the CS345A: Data Mining on the Web course, including requirements, possible project topics, and an outline of course content. It also discusses issues related to finding meaningful patterns in large datasets, highlighting Bonferroni's principle which notes that if you look for patterns in more places than the data supports, you are likely to find meaningless results. Examples are given including a made-up story about tracking terrorists and Joseph Rhine's parapsychology experiments.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PPT, PDF, TXT or read online from Scribd
    Download as ppt, pdf, or txt
    20 views27 pages

    CS345A: Data Mining On The Web: Course Introduction Issues in Data Mining Bonferroniƞs Principle

    Uploaded by

    Kushe Shaya
    This document provides an overview of the CS345A: Data Mining on the Web course, including requirements, possible project topics, and an outline of course content. It also discusses issues related to finding meaningful patterns in large datasets, highlighting Bonferroni's principle which notes that if you look for patterns in more places than the data supports, you are likely to find meaningless results. Examples are given including a made-up story about tracking terrorists and Joseph Rhine's parapsychology experiments.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PPT, PDF, TXT or read online from Scribd
    Download as ppt, pdf, or txt
    You are on page 1of 27

    CS345A: Data Mining on the Web

    Course Introduction Issues in Data Mining Bonferroni s Principle


    1

    Course Staff
    Instructors:
     Anand Rajaraman  Jeff Ullman

    Reach us as cs345a-win0809-staff @ lists.stanford.edu. More info on www.stanford.edu/class/cs345a.


    2

    Requirements
    Homework (Gradiance and other) 20%
     Go to www.gradiance.com/pearson  Enter class code 83769DC9.  If you took CS145 or CS245 in the past year, you should have free access; otherwise you will have to purchase access from Pearson Ed.

    Project 40% Final Exam 40%


    3

    Project
    Software implementation related to course subject matter. Should involve an original component or experiment. More later about available data and computing resources.

    Possible Projects
    Many past projects have dealt with collaborative filtering (advice based on what similar people do).
     E.g., Netflix Challenge.

    Others have dealt with engineering solutions to machine-learning problems.


    5

    ML-Replacement Projects
    ML generally requires a large training set of correctly classified data.
     Example: classifying Web pages by topic.

    Hard to find well-classified data.


     Exception: Open Directory works for page topics, because work is collaborative and shared by many.  Other good exceptions?
    6

    ML-Replacement

    (2)

     Many problems require thought rather than ML:


    1. Tell important pages from unimportant (PageRank). 2. Tell real news from publicity (how?). 3. Distinguish positive from negative product reviews (how?). 4. Etc., etc.
    7

    Team Projects
     Working in pairs OK, but
    1. No more than two per project. 2. We will expect more from a pair than from an individual. 3. The effort should be roughly evenly distributed.

    What is Data Mining?


    Discovery of useful, possibly unexpected, patterns in data. Subsidiary issues:
     Data cleaning: detection of bogus data.
    E.g., age = 150. Entity resolution.

     Visualization: something better than megabyte files of output.


    9

    Cultures
    Databases: concentrate on large-scale (non-main-memory) data. AI (machine-learning): concentrate on complex methods, small data. Statistics: concentrate on models.

    10

    Models vs. Analytic Processing


    To a database person, data-mining is an extreme form of analytic processing queries that examine large amounts of data.
     Result is the query answer.

    To a statistician, data-mining is the inference of models.


     Result is the parameters of the model.
    11

    (Way too Simple) Example


    Given a billion numbers, a DB person would compute their average and standard deviation. A statistician might fit the billion points to the best Gaussian distribution and report the mean and standard deviation of that distribution.
    12

    Outline of Course
    Map-Reduce and Hadoop. Association rules, frequent itemsets. PageRank and related measures of importance on the Web (link analysis ).
     Spam detection.  Topic-specific search.

    Recommendation systems.
     Collaborative filtering.
    13

    Outline
    Finding similar sets.

    (2)

     Minhashing, Locality-Sensitive hashing.

    Extracting structured data (relations) from the Web. Clustering data. Managing Web advertisements. Mining data streams.
    14

    Meaningfulness of Answers
    A big data-mining risk is that you will discover patterns that are meaningless. Statisticians call it Bonferroni s principle: (roughly) if you look in more places for interesting patterns than your amount of data will support, you are bound to find crap.
    15

    Examples of Bonferroni s Principle


    1. A big objection to TIA was that it was looking for so many vague connections that it was sure to find things that were bogus and thus violate innocents privacy. 2. The Rhine Paradox: a great example of how not to conduct scientific research.
    16

    Stanford Professor Proves Tracking Terrorists Is Impossible!


    Three years ago, the example I am about to give you was picked up from my class slides by a reporter from the LA Times. Despite my talking to him at length, he was unable to grasp the point that the story was made up to illustrate Bonferroni s Principle, and was not real.
    17

    The TIA Story


    Suppose we believe that certain groups of evil-doers are meeting occasionally in hotels to plot doing evil. We want to find (unrelated) people who at least twice have stayed at the same hotel on the same day.

    18

    The Details
    109 people being tracked. 1000 days. Each person stays in a hotel 1% of the time (10 days out of 1000). Hotels hold 100 people (so 105 hotels). If everyone behaves randomly (I.e., no evil-doers) will the data mining detect anything suspicious?
    19

    p at some hotel

    q at some hotel

    Calculations

    (1)

    Same hotel

    Probability that given persons p and q will be at the same hotel on given day d :
     1/100 v 1/100 v 10-5 = 10-9.

    Probability that p and q will be at the same hotel on given days d1 and d2:
     10-9 v 10-9 = 10-18.

    Pairs of days:
     5v105.
    20

    Calculations

    (2)

    Probability that p and q will be at the same hotel on some two days:
     5v105 v 10-18 = 5v10-13.

    Pairs of people:
     5v1017.

    Expected number of suspicious pairs of people:


     5v1017 v 5v10-13 = 250,000.
    21

    Conclusion
    Suppose there are (say) 10 pairs of evil-doers who definitely stayed at the same hotel twice. Analysts have to sift through 250,010 candidates to find the 10 real cases.
     Not gonna happen.  But how can we improve the scheme?
    22

    Moral
    When looking for a property (e.g., two people stayed at the same hotel twice ), make sure that the property does not allow so many possibilities that random data will surely produce facts of interest.

    23

    Rhine Paradox

    (1)

    Joseph Rhine was a parapsychologist in the 1950 s who hypothesized that some people had Extra-Sensory Perception. He devised (something like) an experiment where subjects were asked to guess 10 hidden cards red or blue. He discovered that almost 1 in 1000 had ESP they were able to get all 10 right!
    24

    Rhine Paradox

    (2)

    He told these people they had ESP and called them in for another test of the same type. Alas, he discovered that almost all of them had lost their ESP. What did he conclude?
     Answer on next slide.
    25

    Rhine Paradox

    (3)

    He concluded that you shouldn t tell people they have ESP; it causes them to lose it.

    26

    Moral
    Understanding Bonferroni s Principle will help you look a little less stupid than a parapsychologist.

    27

    You might also like