Distribute_crawler Alternatives

使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现
Suggest Alternative
Alternatives To gnemoug/distribute_crawler
Project Name Stars Downloads Repos Using This Packages Using This Most Recent Commit Total Releases Latest Release Open Issues License Language
macrozheng/mall 73,367 0 0 about 2 years ago 0 35 apache-2.0 Java
mall项目是一套电商系统,包括前台商城系统及后台管理系统,基于SpringBoot+MyBatis实现,采用Docker容器化部署。 前台商城系统包含首页门户、商品推荐、商品搜索、商品展示、购物车、订单流程、会员中心、客户服务、帮助中心等模块。 后台管理系统包含商品管理、订单管理、会员管理、促销管理、运营管理、内容管理、统计报表、财务管理、权限管理、设置等模块。
0voice/interview_internal_reference 34,839 0 0 almost 3 years ago 0 30 Python
2023年最新总结,阿里,腾讯,百度,美团,头条等技术面试题目,以及答案,专家出题人分析汇总。
JeffLi1993/springboot-learning-example 15,813 0 0 over 2 years ago 0 53 apache-2.0 Java
spring boot 实践学习案例,是 spring boot 初学者及核心技术巩固的最佳实践。
NodeBB/NodeBB 13,712 3 4 about 2 years ago 6 December 12, 2016 148 gpl-3.0 JavaScript
Node.js based forum software built for the modern web
macrozheng/mall-learning 12,417 0 0 over 2 years ago 0 27 apache-2.0 Java
mall学习教程,架构、业务、技术要点全方位解析。mall项目(50k+star)是一套电商系统,使用现阶段主流技术实现。涵盖了SpringBoot 2.3.0、MyBatis 3.4.6、Elasticsearch 7.6.2、RabbitMQ 3.7.15、Redis 5.0、MongoDB 4.2.5、Mysql5.7等技术,采用Docker容器化部署。
macrozheng/mall-swarm 11,038 0 0 over 2 years ago 0 25 apache-2.0 Java
mall-swarm是一套微服务商城系统,采用了 Spring Cloud 2021 & Alibaba、Spring Boot 2.7、Oauth2、MyBatis、Docker、Elasticsearch、Kubernetes等核心技术,同时提供了基于Vue的管理后台方便快速搭建系统。mall-swarm在电商业务的基础集成了注册中心、配置中心、监控中心、网关等系统功能。文档齐全,附带全套Spring Cloud教程。
crawlab-team/crawlab 10,521 0 0 over 2 years ago 1 March 03, 2019 58 bsd-3-clause Go
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
coollabsio/coolify 10,336 0 0 about 2 years ago 0 61 apache-2.0 PHP
An open-source & self-hostable Heroku / Netlify / Vercel alternative.
bytebase/bytebase 9,249 0 0 about 2 years ago 5 June 09, 2022 49 other Go
World's most advanced database DevOps and CI/CD for Developer, DBA and Platform Engineering teams. The GitLab/GitHub for database DevOps.
GetStream/Winds 8,486 0 0 over 4 years ago 0 0 bsd-3-clause JavaScript
A Beautiful Open Source RSS & Podcast App Powered by Getstream.io
Alternatives To gnemoug/distribute_crawler
Select To Compare


Alternative Project Comparisons
Popular Redis Projects
Popular Mongodb Projects
Popular Data Storage Categories
Related Searches
Get A Weekly Email With Trending Projects
No Spam. Unsubscribe easily at any time.
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2026 Awesome Open Source.  All rights reserved.