| NikolaiT/Crawling-Infrastructure |
321 |
|
0 |
0 |
about 4 years ago |
0 |
|
22 |
agpl-3.0 |
TypeScript |
| Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues. |
| creekorful/bathyscaphe |
83 |
|
0 |
0 |
almost 3 years ago |
16 |
March 05, 2021 |
4 |
gpl-3.0 |
Go |
| Fast, highly configurable, cloud native dark web crawler. |
| hase-ryo/youtube_livechat_replay_crawler |
60 |
|
0 |
0 |
almost 3 years ago |
0 |
|
0 |
mit |
Python |
| This script's purpose is to get live chat comments from Youtube. |
| findopendata/findopendata |
49 |
|
0 |
0 |
about 3 years ago |
6 |
December 26, 2019 |
3 |
apache-2.0 |
Python |
| A search engine for Open Data |
| NikolaiT/scrapeulous |
30 |
|
0 |
0 |
about 5 years ago |
0 |
|
7 |
|
JavaScript |
| Cloud crawler functions for scrapeulous |
| novemberde/serverless-crawler-demo |
27 |
|
0 |
0 |
almost 6 years ago |
0 |
|
4 |
mit |
JavaScript |
| Serverless Architecture Crawler demo |
| jieverson/animeapi |
25 |
|
0 |
0 |
almost 10 years ago |
0 |
|
1 |
mit |
JavaScript |
| :cloud: A RESTful API for Anime Data. |
| IBM/akka-react-cloudant |
21 |
|
0 |
0 |
about 4 years ago |
0 |
|
3 |
|
CSS |
| A Soccer Dashboard created by scraping EPL website using Akka backend and ReactJS frontend and IBM Cloudant for object storage. IBM Cloud Foundry is used to host both frontend and backend app. |
| Postiii/twds-crawler |
18 |
|
0 |
0 |
about 4 years ago |
0 |
|
0 |
|
Python |
| Highly scalable webcrawler for towardsdatascience.com by using Python, Selenium, Docker, Kubernetes and the infrastructure of the Google Cloud Platform |
| sahava/web-scraper-gcp |
15 |
|
0 |
0 |
over 5 years ago |
0 |
|
1 |
mit |
JavaScript |
| Scrape all the pages and links of a given domain and write the results to Google Cloud BigQuery. |
