Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 10 Attention Mechanism Open Source Projects

Open source projects categorized as Attention Mechanism
Categories  > Machine Learning  > Attention Mechanism
Edit Category
lucidrains/vit-pytorch ⭐ 16,298
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
dependent packages 0 total releases 0 most recent commit over 2 years ago
NLP-LOVE/ML-NLP ⭐ 10,874
此项目是机器学习(Machine Learning)、深度学习(Deep Learning)、NLP面试中常考到的知识点和代码实现，也是作为一个算法工程师必会的理论基础知识。
dependent packages 0 total releases 0 most recent commit over 4 years ago
BlinkDL/RWKV-LM ⭐ 10,705
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
dependent packages 0 total releases 0 most recent commit about 2 years ago
brightmart/text_classification ⭐ 7,628
all kinds of text classification models and more with deep learning
dependent packages 0 total releases 0 most recent commit over 2 years ago
lucidrains/PaLM-rlhf-pytorch ⭐ 7,496
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
dependent packages 0 total releases 0 most recent commit about 2 years ago
lucidrains/DALLE-pytorch ⭐ 5,383
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
dependent packages 0 total releases 0 most recent commit over 2 years ago
benedekrozemberczki/awesome-graph-classification ⭐ 4,685
A collection of important graph embedding, classification and representation learning papers with implementations.
dependent packages 0 total releases 0 most recent commit about 3 years ago
cmhungsteve/Awesome-Transformer-Attention ⭐ 3,895
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
dependent packages 0 total releases 0 most recent commit about 2 years ago
Kyubyong/transformer ⭐ 3,882
A TensorFlow Implementation of the Transformer: Attention Is All You Need
dependent packages 0 total releases 0 most recent commit about 3 years ago
lucidrains/x-transformers ⭐ 3,840
A simple but complete full-attention transformer with a set of promising experimental features from various papers
dependent packages 0 total releases 0 most recent commit about 2 years ago
Get A Weekly Email With Trending Attention Mechanism Projects
No Spam. Unsubscribe easily at any time.
Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2026 Awesome Open Source.  All rights reserved.