| apify/crawlee |
11,229 |
|
0 |
42 |
about 2 years ago |
747 |
December 10, 2023 |
96 |
apache-2.0 |
TypeScript |
| Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation. |
| yujiosaka/headless-chrome-crawler |
5,051 |
|
10 |
12 |
over 4 years ago |
21 |
June 11, 2018 |
28 |
mit |
JavaScript |
| Distributed crawler powered by Headless Chrome |
| niespodd/browser-fingerprinting |
3,353 |
|
0 |
0 |
about 3 years ago |
0 |
|
7 |
|
JavaScript |
| Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️♂️ when scraping the web? |
| hardkoded/puppeteer-sharp |
3,022 |
|
27 |
120 |
about 2 years ago |
78 |
December 05, 2023 |
120 |
mit |
C# |
| Headless Chrome .NET API |
| transitive-bullshit/awesome-puppeteer |
2,245 |
|
0 |
0 |
over 2 years ago |
0 |
|
19 |
|
|
| A curated list of awesome puppeteer resources. |
| rendora/rendora |
1,950 |
|
0 |
0 |
about 3 years ago |
1 |
January 04, 2019 |
28 |
apache-2.0 |
Go |
| dynamic server-side rendering using headless Chrome to effortlessly solve the SEO problem for modern javascript websites |
| coder-hxl/x-crawl |
718 |
|
0 |
1 |
about 2 years ago |
59 |
November 09, 2023 |
5 |
mit |
TypeScript |
| x-crawl is a flexible Node.js multifunctional crawler library. Flexible usage and numerous functions can help you quickly, safely, and stably crawl pages, interfaces, and files. ---------------- x-crawl 是一个灵活的 Node.js 多功能爬虫库。灵活的使用方式和众多的功能可以帮助您快速、安全、稳定地爬取页面、接口以及文件。 |
| fanyong920/jvppeteer |
549 |
|
0 |
0 |
almost 3 years ago |
15 |
October 30, 2021 |
67 |
apache-2.0 |
Java |
| Headless Chrome For Java （Java 爬虫） |
| webrecorder/browsertrix-crawler |
470 |
|
0 |
0 |
about 2 years ago |
0 |
|
91 |
agpl-3.0 |
JavaScript |
| Run a high-fidelity browser-based crawler in a single Docker container |
| zhuyingda/webster |
465 |
|
0 |
2 |
over 2 years ago |
42 |
November 09, 2023 |
1 |
gpl-3.0 |
JavaScript |
| a reliable high-level web crawling & scraping framework for Node.js. |
