Hackernews posts about Transformer

Transformer is a type of neural network architecture designed for natural language processing tasks that relies on self-attention mechanisms to process input sequences in parallel.

1. A polynomial autoencoder beats PCA on transformer embeddings (ivanpleshkov.dev)
   106 points by timvisee 16 days ago | 36 comments
2. Unitree GD01: China's $537k rideable transformer robot is now in production (gagadget.com)
   103 points by rguiscard 10 days ago | 80 comments
3. When Fast Fourier Transform Meets Transformer for Image Restoration (2024) (github.com)
   87 points by teleforce 3 days ago | 8 comments
4. Autoregressive next token prediction and KV Cache in transformers (medium.com)
   64 points by coarchitect 4 days ago | discuss
5. Transformers Are Inherently Succinct (2025) (arxiv.org)
   62 points by bearseascape 17 days ago | 9 comments
6. LingBot-Map: Streaming 3D reconstruction with geometric context transformer (technology.robbyant.com)
   45 points by nateb2022 24 days ago | 3 comments
7. Talking to Transformers (miraos.org)
   44 points by taylorsatula 18 days ago | 5 comments
8. Show HN: TRiP – a complete transformer engine in C built from scratch just by me (github.com)
   38 points by carlovalenti 21 days ago | 6 comments
9. Learning Pseudorandom Numbers with Transformers (arxiv.org)
   11 points by pizza 19 days ago | 3 comments
10. Show HN: Semble – Fast code search for agents with near-transformer accuracy (github.com)
    7 points by stephantul 25 days ago | discuss
11. Hope: A post-transformer architecture for general intelligence at low compute (blankline.org)
    6 points by DarenWatson 13 days ago | discuss
12. Transformer vs. Post-Transformer Debate: Kaiser, Kosowski, Jones, Lechner [video] (www.youtube.com)
    5 points by Cappybara12 1 day ago | 3 comments
13. Show HN: Transformer Math Explorer (simonramstedt.com)
    5 points by rmst 12 days ago | 1 comments
14. Φ³−φ⁻³=4 (exact): The transformer's ff/d ratio is algebraic, not empirical (zenodo.org)
    4 points by angusdewer 14 days ago | 2 comments
15. My Calculator Is a Transformer (sinclairs.gitlab.io)
    4 points by radarsat1 21 days ago | 1 comments
16. Sparser, Faster, Lighter Transformer Language Models (pub.sakana.ai)
    4 points by hardmaru 13 days ago | discuss
17. Cryptographic hashing as a transformer attention head (github.com)
    4 points by SkorpSeven 16 days ago | discuss
18. Attention Once Is All You Need: Stateful Transformers (arxiv.org)
    3 points by logotype 8 days ago | 3 comments
19. The metallurgy and artisan secrets of making GOES for large power transformers (frontiermap.substack.com)
    3 points by rob_lh 26 days ago | discuss
20. Local Transformer Language Model Running on GameBoy Color (github.com)
    2 points by redbell 8 days ago | discuss
21. HealthFormer: Transformers for irregular electronic health record events [pdf] (www.medrxiv.org)
    2 points by brandonb 18 days ago | discuss
22. Ouroboros: Dynamic Weight Generation for Recursive Transformers (arxiv.org)
    2 points by OsamaJaber 26 days ago | discuss
23. Llama 4: A Deep Dive into Liquid Transformers 2.0 and Sovereign AI (en.landingfymax.com.br)
    2 points by EvCarvalho 27 days ago | discuss
24. Gemma 4 is not your standard transformer (idlemachines.co.uk)
    2 points by smaddrellmander 30 days ago | discuss
25. Single-layer transformer model "HarEmb" showcasing PII SOTA performance (huggingface.co)
    1 points by fblgit 16 days ago | 1 comments
26. Scaling Real-Time Traffic Forecasting with a Graph-Aware Transformer (www.uber.com)
    1 points by olcaycirit 1 day ago | discuss
27. WorldParticle: Unified World Simulation of Lagrangian Particles via Transformer (arxiv.org)
    1 points by vismit2000 1 day ago | discuss
28. RigidFormer: Learning Rigid Dynamics Using Transformers (arxiv.org)
    1 points by vismit2000 1 day ago | discuss
29. Usual implementation of attention transformers (SDPA) is kind of bad, actually (gist.github.com)
    1 points by teleforce 4 days ago | discuss
30. The understated loading design inside Transformers that saves memory (www.stevhliu.com)
    1 points by vitamincitrus 14 days ago | discuss