| ferventdesert/Hawk |
2,638 |
|
0 |
0 |
over 6 years ago |
0 |
|
65 |
apache-2.0 |
C# |
| visualized crawler & ETL IDE written with C#/WPF |
| rajatomar788/pywebcopy |
455 |
|
1 |
2 |
over 2 years ago |
21 |
April 27, 2022 |
21 |
other |
Python |
| Locally saves webpages to your hard disk with images, css, js & links as is. |
| shaohua0116/ICLR2020-OpenReviewData |
355 |
|
0 |
0 |
over 6 years ago |
0 |
|
2 |
mit |
Jupyter Notebook |
| Script that crawls meta data from ICLR OpenReview webpage. Tutorials on installing and using Selenium and ChromeDriver on Ubuntu. |
| rivermont/spidy |
287 |
|
0 |
0 |
almost 4 years ago |
12 |
January 25, 2018 |
11 |
gpl-3.0 |
Python |
| The simple, easy to use command line web crawler. |
| zntfdr/Selenops |
215 |
|
0 |
0 |
about 5 years ago |
0 |
|
0 |
mit |
Swift |
| A Swift Web Crawler 🕷 |
| samwize/python-email-crawler |
213 |
|
0 |
0 |
over 7 years ago |
0 |
|
19 |
|
Python |
| Search on Google, and crawls for emails related to the result |
| machawk1/warcreate |
187 |
|
0 |
0 |
over 2 years ago |
0 |
|
58 |
mit |
JavaScript |
| Chrome extension to "Create WARC files from any webpage" |
| mikecann/Chrome-Crawler |
59 |
|
0 |
0 |
almost 8 years ago |
0 |
|
0 |
|
JavaScript |
| An extension for google chrome that lets a use crawl a webpage for files and links |
| badoux/goscraper |
58 |
|
2 |
6 |
about 6 years ago |
1 |
August 27, 2019 |
3 |
mit |
Go |
| Golang pkg to quickly return a preview of a webpage (title/description/images) |
| qteqpid/spiderq |
50 |
|
0 |
0 |
over 13 years ago |
0 |
|
0 |
other |
C++ |
| web spider |