Pinned Loading

1. Triformer Triformer Public

   Transformers components but in Triton

   Python 32

2. Super-transformers Super-transformers Public

   This project explores transformer improvements through Super-Transformers (scalable softmax, positional encoding ablation) and MiniDeepSeek (multi-latent attention, KV cache, weight absorption) to …

   Python

3. MinGru-pytorch MinGru-pytorch Public

   Pytorch implementation of MinGru and a small project

   Python 1

4. BaseLCM BaseLCM Public

   A PyTorch implementation of the Base Large Concept Model by Meta AI

   Python 3

5. VisionRAG VisionRAG Public

   A new novel multi-modality (Vision) RAG architecture

   Jupyter Notebook 23 1

6. Masked-AutoEncoders Masked-AutoEncoders Public

   Pytorch implementation of Masked Autoencoder I

   Python