Crawld Alternatives

A data crawler and repositories fetcher
Suggest Alternative
Alternatives To DevMine/crawld
Project Name Stars Downloads Repos Using This Packages Using This Most Recent Commit Total Releases Latest Release Open Issues License Language
SkywalkerDarren/chatWeb 573 0 0 almost 3 years ago 0 4 Python
ChatWeb can crawl web pages, read PDF, DOCX, TXT, and extract the main content, then answer your questions based on the content, or summarize the key points.
moklick/nodejs-stuff 484 0 0 over 6 years ago 0 0 other
Node.js libs I want to keep in mind.
holofans/holoapi 106 0 0 over 4 years ago 0 15 gpl-3.0 JavaScript
Platform to serve Hololive content to the community tools.
heycarsten/lcbo-api 85 0 0 about 6 years ago 0 24 gpl-3.0 JavaScript
A crawler and API server for Liquor Control Board of Ontario retail data
michenriksen/bucketlist 68 0 0 over 8 years ago 0 1 mit HTML
Amazon S3 bucket spelunking!
el10savio/GoCrawler 60 0 0 over 5 years ago 0 0 mit Go
A distributed web crawler implemented using Go, Postgres, RabbitMQ and Docker
shengchenyang/AyugeSpiderTools 46 0 0 about 2 years ago 74 September 15, 2023 0 mit Python
使 scrapy 开发不用在意 item,pipeline,middleware 等通用场景下模块的编写,解放开发者的双手。
crawl/sequell 40 0 0 about 2 years ago 0 3 Ruby
##crawl bot Sequell; depends on https://github.com/crawl/go-sequell
voxpelli/relspider 28 0 0 over 11 years ago 0 6 JavaScript
A web crawler that indexes the identity/social graph of profiles on the web
DevMine/crawld 25 0 0 about 8 years ago 1 March 17, 2018 5 bsd-3-clause Go
A data crawler and repositories fetcher
Alternatives To DevMine/crawld
Select To Compare


Alternative Project Comparisons
Popular Crawler Projects
Popular Postgresql Projects
Popular Data Processing Categories
Related Searches
Get A Weekly Email With Trending Projects
No Spam. Unsubscribe easily at any time.
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2026 Awesome Open Source.  All rights reserved.