| luohaha/jlitespider |
151 |
|
0 |
0 |
almost 9 years ago |
3 |
February 12, 2017 |
2 |
apache-2.0 |
Java |
| A lite distributed Java spider framework :-) |
| roycehaynes/scrapy-rabbitmq |
76 |
|
1 |
0 |
over 3 years ago |
2 |
July 02, 2015 |
3 |
mit |
Python |
| A RabbitMQ Scheduler for Scrapy |
| aaldaber/Distributed-Multi-User-Scrapy-System-with-a-Web-UI |
71 |
|
0 |
0 |
almost 8 years ago |
0 |
|
5 |
|
Python |
| Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner |
| Insutanto/scrapy-distributed |
40 |
|
0 |
0 |
almost 3 years ago |
8 |
February 20, 2021 |
10 |
|
Python |
| A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy. |
| groupbwt/scrapy-boilerplate |
32 |
|
0 |
0 |
almost 3 years ago |
0 |
|
16 |
mit |
Python |
| Scrapy project boilerplate done right |
| LiuRoy/spider_docker |
30 |
|
0 |
0 |
about 10 years ago |
0 |
|
1 |
|
|
| 为爬虫引用创建container，包括的模块：scrapy, mongo, celery, rabbitmq |
| w-zengtao/rb-spider |
14 |
|
0 |
0 |
over 7 years ago |
0 |
|
1 |
mit |
Ruby |
| 基于 RabbitMQ 中间件的爬虫的 Ruby 实现 [Developing] |
| sausheong/saushengine |
14 |
|
0 |
0 |
almost 12 years ago |
0 |
|
0 |
|
Ruby |
| rdcprojects/scrapy-mq-redis |
10 |
|
0 |
0 |
over 9 years ago |
0 |
|
0 |
gpl-3.0 |
Python |
| A RabbitMQ/Redis tool for Scrapy |
| crawlerlab/aragog |
9 |
|
0 |
2 |
over 4 years ago |
9 |
December 15, 2021 |
0 |
mit |
TypeScript |
| Distributed web scraping framework |
