Litellm Alternatives

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
Suggest Alternative
Alternatives To BerriAI/litellm
Project Name Stars Downloads Repos Using This Packages Using This Most Recent Commit Total Releases Latest Release Open Issues License Language
Kong/kong 36,791 0 0 about 2 years ago 0 98 apache-2.0 Lua
🦍 The Cloud-Native API Gateway
BerriAI/litellm 34,790 0 0 2 months ago 0 224 other Python
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
zeromicro/go-zero 32,874 0 314 11 days ago 157 October 28, 2023 456 mit Go
A cloud-native Go microservices framework with cli tool for productivity.
grpc-ecosystem/grpc-gateway 17,020 0 7,098 about 2 years ago 399 November 06, 2023 127 bsd-3-clause Go
gRPC to JSON proxy generator following the gRPC HTTP spec
forezp/SpringCloudLearning 15,253 0 0 about 5 years ago 0 45 Java
《史上最简单的Spring Cloud教程源码》
Netflix/zuul 13,063 94 32 about 2 years ago 35 October 25, 2023 275 apache-2.0 Java
Zuul is a gateway service that provides dynamic routing, monitoring, resiliency, security, and more.
TykTechnologies/tyk 9,061 0 10 about 2 years ago 499 March 24, 2023 334 other Go
Tyk Open Source API Gateway written in Go, supporting REST, GraphQL, TCP and gRPC protocols
zhoutaoo/SpringCloud 8,388 0 0 over 2 years ago 0 57 apache-2.0 Java
基于SpringCloud2.1的微服务开发脚手架,整合了spring-security-oauth2、nacos、feign、sentinel、springcloud-gateway等。服务治理方面引入elasticsearch、skywalking、springboot-admin、zipkin等,让项目开发快速进入业务开发,而不需过多时间花费在架构搭建上。持续更新中
ThreeMammals/Ocelot 8,009 152 140 about 2 years ago 527 December 08, 2023 362 mit C#
.NET API Gateway
YaoApp/yao 6,697 0 0 about 2 years ago 18 May 18, 2023 72 apache-2.0 Go
:rocket: A performance app engine to create web services and applications in minutes.Suitable for AI, IoT, Industrial Internet, Connected Vehicles, DevOps, Energy, Finance and many other use-cases.
Alternatives To BerriAI/litellm
Select To Compare


Alternative Project Comparisons
Popular Gateway Projects
Popular Projects Projects
Popular Networking Categories
Related Searches
Get A Weekly Email With Trending Projects
No Spam. Unsubscribe easily at any time.
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2026 Awesome Open Source.  All rights reserved.