Hackernews posts about FP16

1. Show HN: Three new Kitten TTS models – smallest less than 25MB (github.com)
   538 points by rohan_joshi 2 days ago | 178 comments
2. Show HN: ZSE – Open-source LLM inference engine with 3.9s cold starts (github.com)
   58 points by zyoralabs 23 days ago | 9 comments
3. Show HN: Run 500B+ Parameter LLMs Locally on a Mac Mini (github.com)
   17 points by fatihturker 12 days ago | 12 comments
4. Show HN: OpenGraviton – Run 500B+ parameter models on a consumer Mac Mini (opengraviton.github.io)
   13 points by fatihturker 14 days ago | 5 comments
5. Show HN: Efficient LLM Architectures for 32GB RAM (Ternary and Sparse Inference) (github.com)
   2 points by fatihturker 12 days ago | 1 comments
6. Show HN: I made Qwen3.5-4B 13% smarter by compressing it to 4-bit (huggingface.co)
   2 points by singularity_max 13 days ago | discuss
7. AMD Hints at Big FP64 Increases in MI430X GPU as Ozaki Underwhelms (www.hpcwire.com)
   5 points by rbanffy 7 days ago | discuss
8. Felix86 26.03: AVX, AVX2, BMI1 and F16C Support (felix86.com)
   3 points by camel-cdr 19 days ago | discuss
9. Show HN: Demucs music stem separator rewritten in Rust – runs in the browser (github.com)
   19 points by nikhilunni 18 days ago | 3 comments
10. Show HN: Off Grid: On-device AI-web browsing, tools vision,image,voice–3x faster
    12 points by ali_chherawalla 25 days ago | 5 comments
11. Show HN: I wrote an LLM inference engine in pure Go – 48 tok/s zero dependencies (github.com)
    2 points by computerex 14 days ago | discuss
12. Off Grid: On-device AI-web browsing, tools, vision, image gen, voice – 3x faster
    1 points by ali_chherawalla 25 days ago | 1 comments
13. Why I Used a Broken Laptop Instead of Buying a Mac Mini (medium.com)
    1 points by hungryclaw 2 days ago | discuss
14. New Hetzner prices: +30% starting on 1 April (p169.p3.n0.cdn.zight.com)
    2 points by lovegrenoble 23 days ago | 1 comments
15. ONNX Runtime and CoreML May Silently Convert Your Model to FP16 (ym2132.github.io)
    98 points by Two_hands 3 months ago | 17 comments
16. Insights from 84,000 comments on "Ask HN: Who Is Hiring" using Llama3.1-70B-FP16 (exxa.notion.site)
    8 points by Blue_Cosma over 1 year ago | 1 comments
17. Running the Deepseek-R1 671B Model at FP16 Fidelity on AMD EPYC CPUs (www.servethehome.com)
    5 points by tanelpoder 12 months ago | 2 comments
18. 90T/s on my iPhone llama3.2-1B-fp16 (www.reddit.com)
    5 points by darkolorin 12 months ago | 1 comments
19. Defeating the Training-Inference Mismatch via FP16 (arxiv.org)
    2 points by matt_d 5 months ago | discuss
20. PyTorch 2.6 Delivers FP16 Support for x86 CPUs, Better Intel GPU Experience (www.phoronix.com)
    2 points by rbanffy about 1 year ago | discuss
21. Spectra: A Comprehensive Study of Ternary, Quantized, and FP16 Language Models (arxiv.org)
    2 points by fzliu over 1 year ago | discuss
22. Defeating the Training-Inference Mismatch via FP16 (arxiv.org)
    1 points by billyzs 5 months ago | discuss
23. PyTorch 2.6 Delivers FP16 Support for x86 CPUs, Better Intel GPU Experience (www.phoronix.com)
    1 points by mikece about 1 year ago | discuss
24. 150 LoC CUDA I8 Matmul That Beats CuBLAS Tensor Core FP16 (github.com)
    1 points by carsonpoole over 1 year ago | discuss
25. FlashAttention-3: 1.5-2x faster on FP16, up to 740 TFLOPS on H100 (75% util) (twitter.com)
    1 points by quxinxin over 1 year ago | discuss
26. Show HN: Kitten TTS – 25MB CPU-Only, Open-Source TTS Model (github.com)
    1003 points by divamgupta 8 months ago | 361 comments
27. Show HN: Speeding up LLM inference 2x times (possibly) (asciinema.org)
    419 points by kolinko almost 2 years ago | 114 comments
28. Launch HN: Deepsilicon (YC S24) – Software and hardware for ternary transformers
    189 points by areddyyt over 1 year ago | 79 comments
29. Show HN: Appear as anyone in video calls like zoom or Google meets (www.phazr.ai)
    110 points by michaelphi 12 months ago | 51 comments
30. Show HN: GPULlama3.java Llama Compilied to PTX/OpenCL Now Integrated in Quarkus
    24 points by mikepapadim 3 months ago | 6 comments
31. Show HN: Lightweight Llama3 Inference Engine – CUDA C (github.com)
    12 points by abhisheknair10 about 1 year ago | discuss
32. Show HN: Slash your LLM Inference Costs with Overnight Processing
    5 points by Blue_Cosma over 1 year ago | 1 comments
33. Transformers 2.0: What Ilya and Sam Might Have Missed
    5 points by metehan777 over 1 year ago | 1 comments
34. Show HN: HyperAI GPU Leaderboard – A benchmark comparison site for AI workloads (hyper.ai)
    2 points by Ada_trying about 2 months ago | 2 comments
35. Show HN: Loft CLI – Fine-tune and run LLMs (1–3B) on 8 GB MacBook Air, no GPUs
    2 points by dips2umar 8 months ago | 1 comments
36. Show HN: Slashing LLM Costs for Overnight Batch Inference
    2 points by Blue_Cosma over 1 year ago | discuss
37. Show HN: ONNX optimized SigLIP and related foundation models (github.com)
    2 points by rhysdg over 1 year ago | discuss
38. Show HN: Ghost Engine – generate weights on the fly (github.com)
    1 points by saznlamsal 2 months ago | 1 comments
39. Comparing GenAI Inference Engines: TensorRT-LLM, VLLM, HF TGI, and LMDeploy
    1 points by juliensalinas 12 months ago | 1 comments
40. Show HN: Solving the H100 OOM Wall with CTDR – Maxwell Dashboard Included (github.com)
    1 points by Stan_Byriukov 3 months ago | discuss
41. Show HN: Most Efficient Batch API for Open-Source and Custom Models (withexxa.com)
    1 points by Blue_Cosma over 1 year ago | discuss
42. Intel's AMX-BF16: Over 4x the Performance at 69% the Power (www.phoronix.com)
    1 points by speckx 2 months ago | discuss
43. 15 years of FP64 segmentation, and why the Blackwell Ultra breaks the pattern (nicolasdickenmann.com)
    202 points by fp64enjoyer about 1 month ago | 80 comments
44. Neuroplasticity in F16 fighter jet pilots (pmc.ncbi.nlm.nih.gov)
    122 points by bookofjoe over 1 year ago | 46 comments