Hackernews posts about Qwerky-72B
- 01Attention is NOT all you need: Qwerky-72B trained using only 8 AMD MI300X GPUssubstack.recursal.ai
- 02Qwerky 72B – A 72B LLM without transformer attentionsubstack.recursal.ai
- 03Qwerky: Attention is not what you need? RWKV mashed into QwQ modelssubstack.recursal.ai
- 04Training large attention free modelssubstack.recursal.ai
· edit