Hackernews posts about Transformer

Transformer is a type of neural network architecture designed for natural language processing tasks that relies on self-attention mechanisms to process input sequences in parallel.

1. Understanding Transformers via N-gram Statistics (arxiv.org)
   139 points by pona-a 19 days ago | 16 comments
2. Byte latent transformer: Patches scale better than tokens (2024) (arxiv.org)
   107 points by dlojudice 24 days ago | 22 comments
3. Transformer neural net learns to run Conway's Game of Life just from examples (sidsite.com)
   69 points by montebicyclelo 20 days ago | 35 comments
4. Transformer: The Deep Chemistry of Life and Death (nick-lane.net)
   69 points by mitchbob 23 days ago | 10 comments
5. You could have invented Transformers (gwern.net)
   34 points by jxmorris12 11 days ago | discuss
6. TLOB: Dual Attention Transformer Predicts Price Trends from Order Book Data (arxiv.org)
   22 points by wertyk 3 days ago | discuss
7. SUS backprop: linear backpropagation algorithm for long inputs in transformers (arxiv.org)
   9 points by brandonb 15 days ago | discuss
8. Toto: Time-Series-Optimized Transformer for Observability (github.com)
   4 points by tanelpoder 14 days ago | 1 comments
9. Embeddings: Decoder-Only Transformers are SoTA Encoders (with some fine-tuning) (miguel-martin.com)
   4 points by miguel_martin 15 days ago | discuss
10. Show HN: I made a number transformer where you evolve digits into target forms (numshift.n4ze3m.com)
    3 points by error404x 12 days ago | 1 comments
11. Training-Free Acceleration for Diffusion Transformers (arxiv.org)
    3 points by badmonster 16 days ago | 1 comments
12. From Typewriters to Transformers: AI Is Just the Next Tools Abstraction (hardcoresoftware.learningbyshipping.com)
    3 points by steamboatwillie 5 days ago | discuss
13. From Typewriters to Transformers: AI Is Just the Next Tools Abstraction (hardcoresoftware.learningbyshipping.com)
    3 points by whobre 6 days ago | discuss
14. Understanding AI Large Language Model Transformers: An Analogy for Mere Mortals (jamesmccaffrey.wordpress.com)
    3 points by felineflock 21 days ago | discuss
15. Stripe: We built a transformer-based payments foundation model (twitter.com)
    3 points by mfiguiere 29 days ago | discuss
16. Transformer Lab Now Works with AMD GPUs (old.reddit.com)
    2 points by aliasaria 9 days ago | 8 comments
17. Transformers as Multi-Task Learners: Decoupling Features in Hidden Markov Models (arxiv.org)
    2 points by badmonster 3 days ago | 1 comments
18. New transformer arch emulates imagination and higher-level human mental states (techxplore.com)
    2 points by ciwchris 6 days ago | 1 comments
19. "Attention", "Transformers", in Neural Network "Large Language Models" (bactra.org)
    2 points by Anon84 25 days ago | discuss
20. Mixture-of-Transformers: Sparse and Scalable Architecture for Multi-Modal Models (arxiv.org)
    2 points by mfiguiere 26 days ago | discuss
21. What is the Transformers' Context Window? (and how to make it LONG) (www.youtube.com)
    2 points by research_pie 28 days ago | discuss
22. Show HN: Simple Transformer Implementation in PyTorch (github.com)
    1 points by battle-racket 19 days ago | discuss
23. Transformer Progress (draft.lczero.org)
    1 points by ArneVogel 24 days ago | discuss
24. Hunyuan-TurboS: the first ultra-large Hybrid-Transformer-Mamba MoE model (twitter.com)
    1 points by tosh 24 days ago | discuss
25. Transactions as Transformers (will62794.github.io)
    1 points by we6251 28 days ago | discuss
26. Transactions as Transformers (will62794.github.io)
    1 points by we6251 28 days ago | discuss
27. Exploring Compositional Generalization by Transformers (arxiv.org)
    1 points by PaulHoule 28 days ago | discuss
28. LLMs Are Great, but They're Not Everything
    4 points by procha 29 days ago | 2 comments
29. Show HN: Run 30B model in 4GB Active Memory (github.com)
    4 points by vkkhare about 11 hours ago | 1 comments
30. Show HN: Tinker with Meta's "tokenizer-free" patcher (huggingface.co)
    3 points by lucalp 16 days ago | discuss