| scrapy-plugins/scrapy-splash |
3,028 |
|
134 |
10 |
about 3 years ago |
11 |
February 03, 2023 |
74 |
bsd-3-clause |
Python |
| Scrapy+Splash for JavaScript integration |
| vifreefly/kimuraframework |
874 |
|
4 |
2 |
about 4 years ago |
10 |
January 30, 2019 |
34 |
mit |
Ruby |
| Kimurai is a modern web scraping framework written in Ruby which works out of box with Headless Chromium/Firefox, PhantomJS, or simple HTTP requests and allows to scrape and interact with JavaScript rendered websites |
| eracle/linkedin |
602 |
|
0 |
0 |
about 2 years ago |
0 |
|
81 |
other |
Python |
| Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy |
| kkoooqq/fakebrowser |
290 |
|
0 |
2 |
about 4 years ago |
54 |
January 14, 2022 |
10 |
lgpl-3.0 |
JavaScript |
| 🤖 Fake fingerprints to bypass anti-bot systems. Simulate mouse and keyboard operations to make behavior like a real person. |
| yinzishao/NewsScrapy |
70 |
|
0 |
0 |
almost 6 years ago |
0 |
|
1 |
lgpl-3.0 |
Python |
| 基于scrapy的新闻爬虫 |
| ScrapingBee/scrapy-scrapingbee |
26 |
|
0 |
0 |
about 4 years ago |
5 |
December 26, 2021 |
1 |
|
Python |
| JavaScript support and proxy rotation for Scrapy with ScrapingBee. |
| miroshnikov/scrapyteer |
9 |
|
0 |
0 |
almost 3 years ago |
8 |
June 07, 2023 |
0 |
mit |
TypeScript |
| Web crawling & scraping framework for Node.js on top of headless Chrome browser |
| diemus/multi-selenium-in-scrapy |
8 |
|
0 |
0 |
about 8 years ago |
0 |
|
0 |
|
Python |
| 通过headless chrome实现selenium+scrapy的伪并发,提高动态网站爬取效率。 |
| scrapy-plugins/scrapy-headless |
6 |
|
0 |
0 |
about 6 years ago |
1 |
February 11, 2020 |
1 |
bsd-3-clause |
Python |
| KennethYCK/hkexnews_scrapy |
5 |
|
0 |
0 |
over 7 years ago |
0 |
|
0 |
gpl-3.0 |
Python |
| 使用 Scrapy 拿滬港通及深港通持股紀錄 |