| ssteuteville/scrapyz |
188 |
|
0 |
0 |
over 9 years ago |
6 |
July 27, 2015 |
0 |
|
Python |
| "Scrape Easy" - an extension of the Scrapy framework. |
| lawlite19/PythonCrawler-Scrapy-Mysql-File-Template |
153 |
|
0 |
0 |
almost 9 years ago |
0 |
|
2 |
mit |
Python |
| scrapy爬虫框架模板，将数据保存到Mysql数据库或者文件中。 |
| BruceDone/scrapy_demo |
150 |
|
0 |
0 |
about 3 years ago |
0 |
|
2 |
|
Python |
| all kinds of scrapy demo |
| xboxeer/NScrapy |
82 |
|
0 |
0 |
over 4 years ago |
0 |
|
12 |
apache-2.0 |
C# |
| NScrapy is a .net core corss platform Distributed Spider Framework which provide an easy way to write your own Spider |
| lixi5338619/asyncpy |
80 |
|
0 |
0 |
over 3 years ago |
14 |
September 21, 2022 |
4 |
|
Python |
| 使用asyncio和aiohttp开发的轻量级异步协程web爬虫框架 |
| orangain/scrapy-s3pipeline |
66 |
|
1 |
0 |
about 4 years ago |
8 |
January 31, 2021 |
1 |
mit |
Python |
| Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket. |
| mehmetozkaya/DotnetCrawler |
63 |
|
0 |
0 |
over 6 years ago |
0 |
|
0 |
|
C# |
| DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c |
| zx576/recruitment |
57 |
|
0 |
0 |
over 8 years ago |
0 |
|
4 |
|
JavaScript |
| A project crawling online recruitment websites getting offer information |
| Insutanto/scrapy-distributed |
40 |
|
0 |
0 |
almost 3 years ago |
8 |
February 20, 2021 |
10 |
|
Python |
| A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy. |
| scrapy-plugins/scrapy-jsonschema |
39 |
|
0 |
0 |
about 5 years ago |
12 |
March 26, 2021 |
0 |
bsd-3-clause |
Python |
| Scrapy schema validation pipeline and Item builder using JSON Schema |
