Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
The Top 10 Inference Open Source Projects
Open source projects categorized as Inference
Categories
>
Machine Learning
>
Inference
Edit Category
ultralytics/yolov5
⭐
44,755
YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite
dependent packages
0
total releases
0
most recent commit
about 2 years ago
hpcaitech/ColossalAI
⭐
36,235
Making large AI models cheaper, faster and more accessible
dependent packages
0
total releases
0
most recent commit
about 2 years ago
PaddlePaddle/PaddleOCR
⭐
36,076
Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provide data annotation and synthesis tools, support training and deployment among server, mobile, embedded and IoT devices)
dependent packages
0
total releases
0
most recent commit
about 2 years ago
microsoft/DeepSpeed
⭐
31,015
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
dependent packages
0
total releases
0
most recent commit
about 2 years ago
colinhacks/zod
⭐
28,327
TypeScript-first schema validation with static type inference
dependent packages
0
total releases
0
most recent commit
about 2 years ago
ggerganov/whisper.cpp
⭐
27,404
Port of OpenAI's Whisper model in C/C++
dependent packages
0
total releases
0
most recent commit
about 2 years ago
google/mediapipe
⭐
24,511
Cross-platform, customizable ML solutions for live and streaming media.
dependent packages
0
total releases
0
most recent commit
about 2 years ago
Tencent/ncnn
⭐
18,693
ncnn is a high-performance neural network inference framework optimized for the mobile platform
dependent packages
0
total releases
0
most recent commit
about 2 years ago
vllm-project/vllm
⭐
13,832
A high-throughput and memory-efficient inference and serving engine for LLMs
dependent packages
0
total releases
0
most recent commit
about 2 years ago
gvergnaud/ts-pattern
⭐
10,246
🎨 The exhaustive Pattern Matching library for TypeScript, with smart type inference.
dependent packages
0
total releases
0
most recent commit
about 2 years ago
Get A Weekly Email With Trending Inference Projects
No Spam. Unsubscribe easily at any time.
Inference
Subscribe
Javascript must be enabled to subscribe.
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2026 Awesome Open Source. All rights reserved.
