| scrapy/scrapy |
49,918 |
|
4,185 |
445 |
about 2 years ago |
96 |
September 18, 2023 |
692 |
bsd-3-clause |
Python |
| Scrapy, a fast high-level web crawling & scraping framework for Python. |
| wistbean/learn_python3_spider |
14,425 |
|
0 |
0 |
over 2 years ago |
2 |
August 07, 2019 |
29 |
mit |
Python |
| python爬虫教程系列、从0到1学习python爬虫，包括浏览器抓包，手机APP抓包，如 fiddler、mitmproxy，各种爬虫涉及的模块的使用，如：requests、beautifulSoup、selenium、appium、scrapy等，以及IP代理，验证码识别，Mysql，MongoDB数据库的python使用，多线程多进程爬虫的使用，css 爬虫加密逆向破解，JS爬虫逆向，分布式爬虫，爬虫项目实战实例等 |
| iamshuaidi/CS-Book |
11,024 |
|
0 |
0 |
over 2 years ago |
0 |
|
5 |
|
|
| 计算机类常用电子书整理，并且附带下载链接，包括Java，Python，Linux，Go，C，C++，数据结构与算法，人工智能，计算机基础，面试，设计模式，数据库，前端等书籍 |
| crawlab-team/crawlab |
10,521 |
|
0 |
0 |
over 2 years ago |
1 |
March 03, 2019 |
58 |
bsd-3-clause |
Go |
| Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架 |
| scrapinghub/portia |
8,982 |
|
9 |
2 |
over 2 years ago |
26 |
May 25, 2015 |
127 |
bsd-3-clause |
Python |
| Visual scraping for Scrapy |
| lining0806/PythonSpiderNotes |
6,473 |
|
0 |
0 |
almost 5 years ago |
0 |
|
9 |
|
Python |
| Python入门网络爬虫之精华版 |
| BruceDone/awesome-crawler |
5,859 |
|
0 |
0 |
over 2 years ago |
0 |
|
27 |
mit |
|
| A collection of awesome web crawler,spider in different languages |
| chyroc/WechatSogou |
5,664 |
|
2 |
0 |
over 2 years ago |
25 |
April 10, 2019 |
81 |
apache-2.0 |
Python |
| 基于搜狗微信搜索的微信公众号爬虫接口 |
| rmax/scrapy-redis |
5,392 |
|
176 |
21 |
over 2 years ago |
18 |
July 26, 2022 |
29 |
mit |
Python |
| Redis-based components for Scrapy. |
| SpiderClub/haipproxy |
5,329 |
|
1 |
0 |
over 3 years ago |
7 |
June 18, 2018 |
44 |
mit |
Python |
| :sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis |
