Pinned Loading

1. RWKV-LM RWKV-LM Public

   RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RN…

   Python 14.5k 1k

2. Albatross Albatross Public

   Efficient RWKV inference engine. RWKV7 7.2B fp16 decoding 10250 tps @ single 5090.

   Python 103 23

3. ChatRWKV ChatRWKV Public

   ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

   Python 9.5k 692

4. RWKV-CUDA RWKV-CUDA Public

   The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )

   Cuda 231 35

5. modded-nanogpt-rwkv modded-nanogpt-rwkv Public

   Forked from KellerJordan/modded-nanogpt

   RWKV-7: Surpassing GPT

   Python 104 10

6. LinearAttentionArena LinearAttentionArena Public

   Here we will test various linear attention designs.

   Python 62 19