🐙 GitHub Detail
arbuckle/python_crawler
By arbuckle
Python-driven web crawler and scraper. Uses BeautifulSoup to gather all URLs from a target page, and initiates a crawl from a start URL, considering Whitelist/Blacklist criteria that are populated in crawl.py
Live Snapshot
⭐
Stars
20
🍴
Forks
18
📄
License
Unknown
🧩
Type
Python
About this open-source project
Live information fetched from GitHub.
Python-driven web crawler and scraper. Uses BeautifulSoup to gather all URLs from a target page, and initiates a crawl from a start URL, considering Whitelist/Blacklist criteria that are populated in crawl.py
Default Branch
master
Open Issues
0
Watchers
20