Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Scribd Logo
Upload

Welcome to Scribd!

  • 93 views

    Script Scrapping

    Uploaded by

    NormaFikria
    This Python code uses Selenium to scrape reviews from the Google Play Store. It loads the Selenium webdriver, sets Chrome options, and navigates to a specific app URL. It then loops through reviews, parsing each with BeautifulSoup to extract the date, rating, title, and text. The scraped data is stored in a Pandas dataframe which is exported to a CSV file.

    Copyright:

    © All Rights Reserved
    Download as TXT, PDF, TXT or read online from Scribd

    Script Scrapping

    Uploaded by

    NormaFikria
    93 views2 pages
    This Python code uses Selenium to scrape reviews from the Google Play Store. It loads the Selenium webdriver, sets Chrome options, and navigates to a specific app URL. It then loops through reviews, parsing each with BeautifulSoup to extract the date, rating, title, and text. The scraped data is stored in a Pandas dataframe which is exported to a CSV file.

    Original Description:

    playstore web scrapping

    Original Title

    script scrapping

    Copyright

    © © All Rights Reserved

    Available Formats

    TXT, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    This Python code uses Selenium to scrape reviews from the Google Play Store. It loads the Selenium webdriver, sets Chrome options, and navigates to a specific app URL. It then loops through reviews, parsing each with BeautifulSoup to extract the date, rating, title, and text. The scraped data is stored in a Pandas dataframe which is exported to a CSV file.

    Copyright:

    © All Rights Reserved
    Download as TXT, PDF, TXT or read online from Scribd
    Download as txt, pdf, or txt
    93 views2 pages

    Script Scrapping

    Uploaded by

    NormaFikria
    This Python code uses Selenium to scrape reviews from the Google Play Store. It loads the Selenium webdriver, sets Chrome options, and navigates to a specific app URL. It then loops through reviews, parsing each with BeautifulSoup to extract the date, rating, title, and text. The scraped data is stored in a Pandas dataframe which is exported to a CSV file.

    Copyright:

    © All Rights Reserved
    Download as TXT, PDF, TXT or read online from Scribd
    Download as txt, pdf, or txt
    of 2

    #load webdriver function from selenium

    from selenium import webdriver


    from time import sleep
    from bs4 import BeautifulSoup, Comment
    import pandas as pd

    #Setting up Chrome webdriver Options


    chrome_options = webdriver.ChromeOptions()

    #setting up local path of chrome binary file


    chrome_path= r"C:\Users\USER\Documents\chromedriver_win32\chromedriver.exe"

    #creating Chrome webdriver instance with the set chrome_options


    driver = webdriver.Chrome(chrome_path)
    link = "https://play.google.com/store/apps/details?id=com.kai.kaiticketing&hl=in"
    driver.get(link)
    #driver.execute_script("window.scrollTo(0, document.body.scrollHeight)")
    Ptitle = driver.find_element_by_class_name('id-app-title').text.replace(' ','')
    print(Ptitle)
    #driver.find_element_by_xpath('//*[@id="body-
    content"]/div/div/div[1]/div[2]/div[2]/div[1]/div[4]/button[2]/div[2]').click()

    sleep(1)
    driver.find_element_by_xpath('//*[@id="body-
    content"]/div/div/div[1]/div[2]/div[2]/div[1]/div[4]/button[2]/div[2]/div/div').cli
    ck()
    #select_newest.select_by_visible_text('Newest')
    driver.find_element_by_xpath('//*[@id="body-
    content"]/div/div/div[1]/div[2]/div[2]/div[1]/div[4]/button[2]/div[2]/div/div').cli
    ck()
    sleep(2)

    #driver.find_element_by_css_selector('.review-filter.id-review-sort-
    filter.dropdown-menu-container').click()
    driver.find_element_by_css_selector('.displayed-child').click()
    #driver.find_element_by_xpath("//button[@data-dropdown-value='1']").click()
    driver.execute_script("document.querySelectorAll('button.dropdown-child')
    [0].click()")
    reviews_df = []
    for i in range(1,100):
    try:
    for elem in driver.find_elements_by_class_name('single-review'):
    print(str(i))
    content = elem.get_attribute('outerHTML')
    soup = BeautifulSoup(content, "html.parser")
    #print(soup.prettify())
    date = soup.find('span',class_='review-date').get_text()
    rating = soup.find('div',class_='tiny-star')['aria-label'][6:7]
    title = soup.find('span',class_='review-title').get_text()
    txt = soup.find('div',class_='review-body').get_text().replace('Full
    Review','')[len(title)+1:]
    print(soup.get_text())
    temp = pd.DataFrame({'Date':date,'Rating':rating,'Review
    Title':title,'Review Text':txt},index=[0])
    print('-'*10)
    reviews_df.append(temp)
    #print(elem)
    except:
    print('s')
    driver.find_element_by_xpath('//*[@id="body-
    content"]/div/div/div[1]/div[2]/div[2]/div[1]/div[4]/button[2]/div[2]/div/div').cli
    ck()
    reviews_df = pd.concat(reviews_df,ignore_index=True)

    reviews_df.to_csv(Ptitle+'_reviews_kaiaccess.csv', encoding='utf-8')

    #driver.close()

    You might also like