Hackernews posts about Transformer

Transformer is a type of neural network architecture designed for natural language processing tasks that relies on self-attention mechanisms to process input sequences in parallel.

1. Oasis: A Universe in a Transformer (oasis-model.github.io)
   256 points by ChadNauseam 21 days ago | 88 comments
2. TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters (arxiv.org)
   174 points by og_kalu 21 days ago | 33 comments
3. Oasis: A Universe in a Transformer (oasis-model.github.io)
   108 points by gadtfly 22 days ago | 21 comments
4. Don't Look Twice: Faster Video Transformers with Run-Length Tokenization (rccchoudhury.github.io)
   75 points by jasondavies 6 days ago | 16 comments
5. Grant Sanderson: Visualizing transformers and attention [video] (www.youtube.com)
   30 points by skadamat 1 day ago | discuss
6. Oasis: A Universe in a Transformer (www.decart.ai)
   11 points by EvgeniyZh 22 days ago | 1 comments
7. Oasis: A Universe in a Transformer (Playable Demo) (oasis.decart.ai)
   8 points by dnnssl2 22 days ago | 1 comments
8. Largest transformer maker warns of supply crunch (www.ft.com)
   4 points by doener 19 days ago | discuss
9. What Matters in Transformers? Not All Attention Is Needed (arxiv.org)
   4 points by Anon84 28 days ago | discuss
10. Tokenformer: Rethinking transformer scaling with tokenized model parameters (arxiv.org)
    3 points by andy12_ 22 days ago | 1 comments
11. Real-Time Market Data Forecasting with Transformer Models (jdsemrau.substack.com)
    3 points by Brajeshwar 12 days ago | discuss
12. Length-Induced Embedding Collapse in Transformer-Based Models (arxiv.org)
    3 points by Wheatman 19 days ago | discuss
13. Solving Global Lyapunov functions: open problem in mathematics with transformers (arxiv.org)
    3 points by og_kalu 26 days ago | discuss
14. Awesome-graph-transformer: Papers about graph transformers (github.com)
    3 points by gk1 30 days ago | discuss
15. Ask HN: Has the LLM/transformer architecture hit its limit?
    2 points by ianbutler 21 days ago | 7 comments
16. ASIC for Transformers (www.tomshardware.com)
    2 points by KuriousCat 12 days ago | 1 comments
17. Tiny Transformers Excel at Sentence Compression (arxiv.org)
    2 points by PaulHoule 11 days ago | discuss
18. EasyAnimate: Long Video Generation Based on Transformer Architecture (easyanimate.github.io)
    2 points by lnyan 11 days ago | discuss
19. Interpreting Affine Recurrence Learning in GPT-Style Transformers (arxiv.org)
    2 points by PaulHoule 19 days ago | discuss
20. Transformer Circuits Thread (transformer-circuits.pub)
    2 points by plurby 19 days ago | discuss
21. An Analogy for Understanding Transformers (2023) (www.lesswrong.com)
    2 points by _feynon 25 days ago | discuss
22. ALTA: Compiler-Based Analysis of Transformers (arxiv.org)
    2 points by belter 29 days ago | discuss
23. Scaling Transformers at Cohere: What I Learned (vgpu.io)
    1 points by ArcVRArthur 24 days ago | 1 comments
24. Chess Transformers: Teaching transformers to play chess (github.com)
    1 points by teleforce 7 days ago | discuss
25. Transformer Interpretability (arena3-chapter1-transformer-interp.streamlit.app)
    1 points by sebg 8 days ago | discuss
26. In-Context LoRA for Diffusion Transformers (ali-vilab.github.io)
    1 points by smy20011 10 days ago | discuss
27. Training-Free Prompting for Diffusion Transformers (synthical.com)
    1 points by mixeden 17 days ago | discuss
28. TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters (synthical.com)
    1 points by mixeden 20 days ago | discuss
29. Do humans learn like transformer networks? (osf.io)
    1 points by noch 20 days ago | discuss
30. Transformers Are Efficient Compilers, Provably (arxiv.org)
    1 points by PaulHoule 22 days ago | discuss