When websites change, spiders tend to break. I can’t make a promise to keep this repository up-to-date all by myself, so pull requests are more than welcome!
Adding a new spider¶
Create a branch for the spider, e.g.
Add the spider in tests/test_spiders.py similar to others
Add the spider API in finscraper/spiders.py
Make sure the spider passes all non-benchmark tests within test_spiders.py
Push your branch into Github and make a pull request against master
Updating an existing spider¶
Steps 5. - 8. above.