Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to content

Updated version of 8a_scraper for 2024

License

Notifications You must be signed in to change notification settings

errissa/8a_scraper

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

8a_scraper

8a is a great resource to aggregate statistics on sportclimbers and boulderers. They recently deployed a new version of their website that rendered all the prior scrapers obsolete.

This tool allows 8a users to scrape content from the website using their username, password, Selenium, and BeautifulSoup.

Installing

Via pip

Install using the following command:

pip install 8a-scraper

The latest version is 0.0.3. If you have already installed the package, please update it using the following command:

pip install 8a-scraper --upgrade

Via GitHub

Alternatively, you can just clone this repo and import the libraries at your own discretion.

Usage

To install the package,

This package requires the user to also install Google Chrome and ChromeDriver. Please ensure that the version of ChromeDriver install matches your current version of Google Chrome. You can check your current version of Google Chrome by opening Chrome and checking the 'About Google Chrome' panel. Ensure that the chromedriver executable is in your $PATH variable as well.

The user must also have an email and password that can be used to log into 8a

Additionally, the user must set the following environment variables with their current login info:

_8A_USERNAME='<8a email>'
_8A_PASSWORD='<8a password>'

These variables are accessed using os.getenv(). These can be set in the .bash_profile file on MacOS or by 'Editing the system environmental variables' on Windows.

API

Currently, the package only contains 2 modules: users and ascents. The package will be expanding to include other content as well, but this is a start.

For more information, about the API please refer to the full documentation

About

Updated version of 8a_scraper for 2024

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%