| go-rod/rod |
4,505 |
|
0 |
140 |
about 2 years ago |
406 |
November 06, 2023 |
106 |
mit |
Go |
| A Devtools driver for web automation and scraping |
| skrapeit/skrape.it |
714 |
|
0 |
3 |
over 2 years ago |
14 |
July 19, 2022 |
25 |
mit |
Kotlin |
| A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion. |
| liip/TheA11yMachine |
553 |
|
4 |
2 |
over 6 years ago |
26 |
February 08, 2017 |
35 |
|
JavaScript |
| The A11y Machine is an automated accessibility testing tool which crawls and tests pages of any web application to produce detailed reports. |
| crawljax/crawljax |
493 |
|
28 |
6 |
almost 3 years ago |
18 |
June 01, 2023 |
67 |
apache-2.0 |
Java |
| Crawljax |
| scrapinghub/spidermon |
486 |
|
0 |
0 |
over 2 years ago |
18 |
September 01, 2023 |
52 |
bsd-3-clause |
Python |
| Scrapy Extension for monitoring spiders execution. |
| s0md3v/Bolt |
482 |
|
0 |
0 |
over 2 years ago |
0 |
|
3 |
gpl-3.0 |
Python |
| CSRF Scanner |
| relevance/tarantula |
453 |
|
5 |
1 |
almost 13 years ago |
13 |
May 24, 2013 |
12 |
mit |
Ruby |
| a big hairy fuzzy spider that crawls your site, wreaking havoc |
| offensive-hub/black-widow |
168 |
|
0 |
0 |
almost 4 years ago |
13 |
June 17, 2022 |
2 |
gpl-3.0 |
Python |
| GUI based offensive penetration testing tool (Open Source) |
| google/security-crawl-maze |
135 |
|
0 |
0 |
over 2 years ago |
0 |
|
0 |
apache-2.0 |
HTML |
| Security Crawl Maze is a comprehensive testbed for web security crawlers. It contains pages representing many ways in which one can link resources from a valid HTML document. |
| lisniuse/reqman |
124 |
|
1 |
2 |
over 6 years ago |
6 |
March 08, 2019 |
1 |
mit |
JavaScript |
| Reqman is a tool that can quickly help back-end engineers with api testing, as well as a nodejs-based crawler tool. |
