| hellock/icrawler |
792 |
|
11 |
5 |
over 2 years ago |
42 |
June 30, 2023 |
30 |
mit |
Python |
| A multi-thread crawler framework with many builtin image crawlers provided. |
| SYFH/FKDownloader |
225 |
|
0 |
0 |
over 5 years ago |
33 |
June 11, 2020 |
1 |
mit |
Objective-C |
| 👍🏻📥Maybe the best file downloader. |
| ioiogoo/scrapy-monitor |
99 |
|
0 |
0 |
over 9 years ago |
0 |
|
1 |
mit |
Python |
| scrapy-monitor，实现爬虫可视化，监控实时状态 |
| mssun/android-apps-crawler |
88 |
|
0 |
0 |
over 10 years ago |
0 |
|
0 |
|
Python |
| An extensible crawler for downloading Android applications in third-party markets. |
| xboxeer/NScrapy |
82 |
|
0 |
0 |
over 4 years ago |
0 |
|
12 |
apache-2.0 |
C# |
| NScrapy is a .net core corss platform Distributed Spider Framework which provide an easy way to write your own Spider |
| mehmetozkaya/DotnetCrawler |
63 |
|
0 |
0 |
over 6 years ago |
0 |
|
0 |
|
C# |
| DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c |
| zx576/recruitment |
57 |
|
0 |
0 |
over 8 years ago |
0 |
|
4 |
|
JavaScript |
| A project crawling online recruitment websites getting offer information |
| lopuhin/scrapy-pyppeteer |
48 |
|
0 |
0 |
about 6 years ago |
0 |
|
1 |
|
Python |
| Use pyppeteer from a Scrapy spider |
| scrapinghub/scrapy-autoextract |
39 |
|
1 |
0 |
about 4 years ago |
11 |
August 05, 2021 |
6 |
bsd-3-clause |
Python |
| Zyte Automatic Extraction integration for Scrapy |
| ilyaperepelitsa/met_book_downloader |
30 |
|
0 |
0 |
about 8 years ago |
0 |
|
0 |
|
Python |
