8a is a great resource to aggregate statistics on sportclimbers and boulderers. They recently deployed a new version of their website that rendered all the prior scrapers obsolete.
This tool allows 8a users to scrape content from the website using their username, password, Selenium, and BeautifulSoup.
Install using the following command:
pip install 8a-scraper
The latest version is 0.0.3. If you have already installed the package, please update it using the following command:
pip install 8a-scraper --upgrade
Alternatively, you can just clone this repo and import the libraries at your own discretion.
To install the package,
This package requires the user to also install Google Chrome and ChromeDriver.
Please ensure that the version of ChromeDriver install matches your current version of Google Chrome. You can check your current version of Google Chrome by opening Chrome and checking the 'About Google Chrome' panel. Ensure that the chromedriver executable is in your $PATH variable as well.
The user must also have an email and password that can be used to log into 8a
Additionally, the user must set the following environment variables with their current login info:
_8A_USERNAME='<8a email>'
_8A_PASSWORD='<8a password>'These variables are accessed using os.getenv(). These can be set in the .bash_profile file on MacOS or by 'Editing the system environmental variables' on Windows.
Currently, the package only contains 2 modules: users and ascents. The package will be expanding to include other content as well, but this is a start.
For more information, about the API please refer to the full documentation