Hackernews posts about Llama.cpp

1. LLama.cpp Got Screwd (github.com)
   10 points by trilogic 9 days ago | 5 comments
2. I patched llama.cpp to gain 20% prompt processing TPS. Help me make a PR
   6 points by i_am_rocoe 21 days ago | 2 comments
3. Ollama vs. Llama.cpp – Quick Benchmark (blawg.pages.dev)
   6 points by caveman23 6 days ago | discuss
4. As; HN: I was curious why MTP affects PP TPS in llama.cpp. My PoC recovers it?
   4 points by i_am_rocoe 23 days ago | 1 comments
5. TurboPrefill: 2.7× faster than llama.cpp Pipeline Parallel on Llama-3-70B (github.com)
   3 points by trykhlieb 19 days ago | discuss
6. Llama.cpp flags auto-tuning tool (github.com)
   3 points by raketenkater 23 days ago | discuss
7. Show HN: Loqi, a "local-first" translation tool using Ollama/llama.cpp (github.com)
   3 points by danterolle 26 days ago | discuss
8. Hedos – Local models in one native Mac app (llama.cpp, MLX, diffusers) (www.hedos.ai)
   2 points by theiskaa 3 days ago | discuss
9. Show HN: I ported llama.cpp to Apple Watch and ran a 0.8B LLM locally
   1 points by Eric-Terminal 10 days ago | 3 comments
10. Show HN: Low-latency local LLM runner via OpenJDK Panama FFM (Java 22) (github.com)
    38 points by KingJoker 4 days ago | 10 comments
11. Show HN: Run AI chat, image gen, vision, and voice offline on your Mac (github.com)
    11 points by olie_h 19 days ago | 4 comments
12. Show HN: Sipp – Run small local LLMs in browser 3x faster (www.sipp.sh)
    5 points by jjhartmann 24 days ago | 3 comments
13. Show HN: role-model, a router for hybrid local/cloud AI (github.com)
    3 points by try-working 20 days ago | 2 comments
14. Show HN: Trellis2.c – Local 3D generation with Vulkan and CUDA (github.com)
    2 points by wimaxs 3 days ago | discuss
15. Show HN: Biscotti – on-device meeting transcription for macOS
    1 points by scosman 5 days ago | discuss
16. Show HN: Rewire Text – system-wide text transforms with BYOK and local-models (sunsetmesasoftware.com)
    1 points by digitalhobbit 11 days ago | discuss
17. Vision Now Available in Llama.cpp (github.com)
    550 points by redman25 about 1 year ago | 104 comments
18. Llama.cpp guide – Running LLMs locally on any hardware, from scratch (steelph0enix.github.io)
    368 points by zarekr over 1 year ago | 87 comments
19. Heap-overflowing Llama.cpp to RCE (retr0.blog)
    248 points by retr0reg over 1 year ago | 54 comments
20. Llama.cpp supports Vulkan. why doesn't Ollama? (github.com)
    217 points by buyucu over 1 year ago | 228 comments
21. Ollama violating llama.cpp license for over a year (github.com)
    202 points by Jabrov about 1 year ago | 68 comments
22. Llama.cpp Now Supports Qwen2-VL (Vision Language Model) (github.com)
    155 points by BUFU over 1 year ago | 50 comments
23. Go library for in-process vector search and embeddings with llama.cpp (github.com)
    114 points by kelindar over 1 year ago | 29 comments
24. Llama.cpp AI Performance with the GeForce RTX 5090 Review (www.phoronix.com)
    113 points by kristianp over 1 year ago | 78 comments
25. Mistral Integration Improved in Llama.cpp (github.com)
    95 points by decide1000 11 months ago | 15 comments
26. Llama.cpp: Add GPT-OSS (github.com)
    35 points by atgctg 12 months ago | discuss
27. Llama.cpp now has an official website: llama.app (twitter.com)
    17 points by julien_c about 2 months ago | 4 comments
28. Show HN: Llama.cpp Tutorial 2026: Run GGUF Models Locally on CPU and GPU
    13 points by anju-kushwaha 3 months ago | 4 comments
29. Llama.cpp Now Part of the Nvidia RTX AI Toolkit (developer.nvidia.com)
    13 points by alanzhuly almost 2 years ago | 1 comments
30. Ask HN: Is anybody using llama.cpp for production?
    11 points by HardikVala 12 months ago | 1 comments
31. We Found a Heap Overflow in Llama.cpp's Tokenizer (pwno.io)
    9 points by retr0reg about 1 year ago | discuss
32. Show HN: I Built an Image Captioning Tool Using Llama.cpp (github.com)
    8 points by paradox460 7 months ago | 1 comments
33. Llama.cpp now has an official website: llama.app (llama.app)
    7 points by wronglebowski about 2 months ago | 1 comments
34. DeepSeek-R1 speeds up llama.cpp code by x2 (github.com)
    6 points by roboboffin over 1 year ago | 3 comments
35. Apples to Apples: MLX vs. Llama.cpp for Gemma 4 12B on an M1 16GB (ziraph.com)
    6 points by ABS about 1 month ago | 1 comments
36. Llama.cpp AI Performance with the GeForce RTX 5090 (www.phoronix.com)
    6 points by mfiguiere over 1 year ago | 1 comments
37. Show HN: Run Llama.cpp In-Process from Java with Project Panama FFM (deemwar-products.github.io)
    6 points by deemwar about 1 month ago | discuss
38. WebGPU support in llama.cpp (reeselevine.github.io)
    6 points by relivin about 2 months ago | discuss
39. Llama.cpp performance breakthrough for multi-GPU setups (medium.com)
    6 points by epistasis 6 months ago | discuss
40. Llama.cpp: Deterministic Inference Mode (CUDA): RMSNorm, MatMul, Attention (github.com)
    6 points by diwank 10 months ago | discuss
41. Ask HN: 2x Arc A770 or 1x Radeon 7900 XTX for llama.cpp
    5 points by danielEM over 1 year ago | 5 comments
42. Apple MLX vs. llama.cpp: compared and benchmarked [video] (www.youtube.com)
    5 points by nvahalik 2 months ago | discuss
43. Local Agents with Llama.cpp and Pi (huggingface.co)
    5 points by kristianpaul 4 months ago | discuss
44. Tinker with LLMs in the privacy of your own home using Llama.cpp (www.theregister.com)
    5 points by rntn 11 months ago | discuss
45. GitHub deletes popular llama.cpp fork without explanation (github.com)
    4 points by akawry 12 months ago | 2 comments
46. Llama.cpp AI Performance with the GeForce RTX 5090 (www.phoronix.com)
    4 points by rubyn00bie over 1 year ago | 2 comments