Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
The Top 10 Scrapy Open Source Projects
Open source projects categorized as Scrapy
Categories
>
Data Processing
>
Scrapy
Edit Category
scrapy/scrapy
⭐
49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages
0
total releases
0
most recent commit
about 2 years ago
wistbean/learn_python3_spider
⭐
14,425
python爬虫教程系列、从0到1学习python爬虫，包括浏览器抓包，手机APP抓包，如 fiddler、mitmproxy，各种爬虫涉及的模块的使用，如：requests、beautifulSoup、selenium、appium、scrapy等，以及IP代理，验证码识别，Mysql，MongoDB数据库的python使用，多线程多进程爬虫的使用，css 爬虫加密逆向破解，JS爬虫逆向，分布式爬虫，爬虫项目实战实例等
dependent packages
0
total releases
0
most recent commit
over 2 years ago
iamshuaidi/CS-Book
⭐
11,024
计算机类常用电子书整理，并且附带下载链接，包括Java，Python，Linux，Go，C，C++，数据结构与算法，人工智能，计算机基础，面试，设计模式，数据库，前端等书籍
dependent packages
0
total releases
0
most recent commit
over 2 years ago
crawlab-team/crawlab
⭐
10,521
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
dependent packages
0
total releases
0
most recent commit
over 2 years ago
scrapinghub/portia
⭐
8,982
Visual scraping for Scrapy
dependent packages
0
total releases
0
most recent commit
over 2 years ago
lining0806/PythonSpiderNotes
⭐
6,473
Python入门网络爬虫之精华版
dependent packages
0
total releases
0
most recent commit
almost 5 years ago
BruceDone/awesome-crawler
⭐
5,859
A collection of awesome web crawler,spider in different languages
dependent packages
0
total releases
0
most recent commit
over 2 years ago
chyroc/WechatSogou
⭐
5,664
基于搜狗微信搜索的微信公众号爬虫接口
dependent packages
0
total releases
0
most recent commit
over 2 years ago
rmax/scrapy-redis
⭐
5,392
Redis-based components for Scrapy.
dependent packages
0
total releases
0
most recent commit
over 2 years ago
SpiderClub/haipproxy
⭐
5,329
:sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis
dependent packages
0
total releases
0
most recent commit
over 3 years ago
Get A Weekly Email With Trending Scrapy Projects
No Spam. Unsubscribe easily at any time.
Scrapy
Subscribe
Javascript must be enabled to subscribe.
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2026 Awesome Open Source. All rights reserved.
