| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| crawlab-team/crawlab | 10,521 |
|
0 | 0 | over 2 years ago | 1 | March 03, 2019 | 58 | bsd-3-clause | Go |
| Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架 | ||||||||||
| Python3WebSpider/ProxyPool | 5,154 | 0 | 0 | over 2 years ago | 0 | 40 | mit | Python | ||
| An Efficient ProxyPool with Getter, Tester and Server | ||||||||||
| Gerapy/Gerapy | 3,144 |
|
8 | 0 | over 2 years ago | 49 | July 19, 2023 | 60 | mit | Python |
| Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js | ||||||||||
| niqdev/packtpub-crawler | 701 | 0 | 0 | over 6 years ago | 0 | 15 | mit | Python | ||
| Download your daily free Packt Publishing eBook https://www.packtpub.com/packt/offers/free-learning | ||||||||||
| speed/newcrawler | 583 | 0 | 0 | over 2 years ago | 0 | 25 | JavaScript | |||
| Free Web Scraping Tool with Java | ||||||||||
| crawljax/crawljax | 493 | 28 | 6 | almost 3 years ago | 18 | June 01, 2023 | 67 | apache-2.0 | Java | |
| Crawljax | ||||||||||
| webrecorder/browsertrix-crawler | 470 | 0 | 0 | about 2 years ago | 0 | 91 | agpl-3.0 | JavaScript | ||
| Run a high-fidelity browser-based crawler in a single Docker container | ||||||||||
| scalingexcellence/scrapybook | 378 | 0 | 0 | over 7 years ago | 0 | 9 | Python | |||
| Scrapy Book Code | ||||||||||
| medialab/hyphe | 308 | 0 | 0 | over 2 years ago | 0 | 56 | agpl-3.0 | JavaScript | ||
| Websites crawler with built-in exploration and control web interface | ||||||||||
| rivermont/spidy | 287 |
|
0 | 0 | almost 4 years ago | 12 | January 25, 2018 | 11 | gpl-3.0 | Python |
| The simple, easy to use command line web crawler. | ||||||||||
