| scrapinghub/spidermon |
486 |
|
0 |
0 |
over 2 years ago |
18 |
September 01, 2023 |
52 |
bsd-3-clause |
Python |
| Scrapy Extension for monitoring spiders execution. |
| Python3WebSpider/ScrapyRedisBloomFilter |
144 |
|
0 |
0 |
over 4 years ago |
5 |
January 03, 2021 |
6 |
|
Python |
| Scrapy Redis Bloom Filter |
| scrapinghub/scrapy-autounit |
42 |
|
0 |
0 |
almost 5 years ago |
32 |
July 09, 2021 |
10 |
bsd-3-clause |
Python |
| Automatic unit test generation for Scrapy. |
| owen9825/captcha-middleware |
38 |
|
0 |
0 |
over 4 years ago |
0 |
|
0 |
gpl-3.0 |
Python |
| A middleware layer for Scrapy that detects CAPTCHA tests and solves them |
| scrapy/scurl |
15 |
|
0 |
0 |
over 7 years ago |
1 |
August 01, 2018 |
11 |
apache-2.0 |
Python |
| Performance-focused replacement for Python urllib |
| ThomasAitken/Scrapy-Testmaster |
12 |
|
0 |
0 |
almost 5 years ago |
0 |
|
1 |
other |
Python |
| The most advanced debugging and testing tool for Scrapy |
| mjhea0/flask-scrapy-test |
7 |
|
0 |
0 |
over 8 years ago |
0 |
|
1 |
|
Python |
| for kristjan |
| ABCnelson/scrapy- |
6 |
|
0 |
0 |
almost 8 years ago |
0 |
|
0 |
|
Python |
| 项目实例：一个学习scrapy的简单实例。帮助你快速的上手scrapy框架。 只需修改2个python文件。items.py 和spiders文件夹中的shushan.py。 需要修改的项，在2个python文件中均进行了备注。 大家可根据备注修改相关内容，再通过命令行运行爬虫程序。 命令行cd至spider目录,运行scrapy crawl shushan -o shushan.csv，生成csv文件，保存爬虫数据。 备注：保存的爬虫数据csv格式，需用WPS版excel打开，或是用txt直接打开。点击右上 star 按钮，喜欢的点个赞吧！（网站也是本人弄的，请放心使用） |
| tcurvelo/scrapy-mock |
6 |
|
0 |
0 |
almost 3 years ago |
1 |
January 06, 2020 |
1 |
mit |
Python |
| Record Scrapy responses and use them as testing fixtures. |
| cyhleo/JinRiTouTiaoNews |
5 |
|
0 |
0 |
almost 6 years ago |
0 |
|
0 |
|
Python |
| scrapy+pyppeteer，爬取今日头条中新闻及热门评论信息。 |
