| falconry/falcon |
9,313 |
|
1,521 |
188 |
about 2 years ago |
81 |
December 05, 2023 |
162 |
apache-2.0 |
Python |
| The no-magic web data plane API and microservices framework for Python developers, with a focus on reliability, correctness, and performance at scale. |
| bigscience-workshop/petals |
8,040 |
|
0 |
1 |
over 2 years ago |
18 |
November 20, 2023 |
76 |
mit |
Python |
| 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading |
| bentoml/OpenLLM |
7,871 |
|
0 |
2 |
about 2 years ago |
132 |
December 07, 2023 |
56 |
apache-2.0 |
Python |
| Operating LLMs in production |
| open-falcon/falcon-plus |
7,120 |
|
0 |
0 |
over 2 years ago |
0 |
|
175 |
apache-2.0 |
Go |
| An open-source and enterprise-level monitoring system. |
| hugapi/hug |
6,757 |
|
208 |
27 |
almost 3 years ago |
71 |
February 06, 2020 |
179 |
mit |
Python |
| Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler. |
| huggingface/text-generation-inference |
6,743 |
|
0 |
5 |
about 2 years ago |
13 |
September 28, 2023 |
239 |
other |
Python |
| Large Language Model Text Generation Inference |
| SJTU-IPADS/PowerInfer |
6,416 |
|
0 |
0 |
about 2 years ago |
0 |
|
59 |
mit |
C |
| High-speed Large Language Model Serving on PCs with Consumer-grade GPUs |
| plotly/falcon |
5,063 |
|
0 |
0 |
almost 3 years ago |
0 |
|
150 |
mit |
JavaScript |
| Free, open-source SQL client for Windows and Mac 🦅 |
| kennethreitz/responder |
3,575 |
|
59 |
10 |
about 2 years ago |
48 |
January 08, 2021 |
45 |
other |
Python |
| A familiar HTTP Service Framework for Python. |
| socketry/falcon |
2,407 |
|
18 |
16 |
over 2 years ago |
126 |
August 28, 2022 |
41 |
mit |
Ruby |
| A high-performance web server for Ruby, supporting HTTP/1, HTTP/2 and TLS. |
