Hackernews posts about Llama.cpp

1. llama.cpp (llama.app)
   364 points by kristianpaul 21 days ago | 165 comments
2. Apple Silicon and macOS VMs: Faster LLM Inference with llama.cpp (github.com)
   307 points by frabonacci 21 days ago | 42 comments
3. Building a Rust Inference Engine That Matches Llama.cpp (www.fratepietro.com)
   23 points by antonellof 28 days ago | 41 comments
4. DLLM: Minimal, clean coding agent built directly on llama.cpp without overhead (github.com)
   9 points by teleforce 20 days ago | 3 comments
5. Llama-macOS – Agentic and MCP Native macOS Front End for Llama.cpp (github.com)
   6 points by car 16 days ago | 2 comments
6. The Llama.cpp Fork That Enables Qwen 3.8 27B Large Contexts for 16GB VRAM GPU (github.com)
   5 points by dazhbog 1 day ago | 2 comments
7. Release v0.2.0 · ggml-org/llama.cpp (github.com)
   4 points by kyisaiah47 7 days ago | discuss
8. Privibe - LLM Cli Local first+privacy focus+llama.cpp cache branch + Qwen3.x (github.com)
   2 points by xlayn 17 days ago | 1 comments
9. Privibe – LLM CLI Local first+privacy focus+llama.cpp cache branch and Qwen3.x (github.com)
   1 points by xlayn 15 days ago | 1 comments
10. Show HN: 1667, a terminal UI for writing fiction with language models (1667.ai)
    37 points by refsab 15 days ago | 94 comments
11. Show HN: I shrank DeepSeek V4 Flash to 57GB and it wrote a compiler on my Mac (huggingface.co)
    21 points by hacklas 16 days ago | 3 comments
12. Show HN: Steganeur – Hide secret messages in LLM-generated text (Rust) (github.com)
    3 points by marcsnid 11 days ago | discuss
13. Show HN: FEDERaiDE, a TUI harness with P2P multi-agent routing and built in IDE (federaide.rocklab.in)
    3 points by petrokitty 20 days ago | discuss
14. Show HN: VelocityNote – A tiny Markdown notebook with local AI (velocitynote.app)
    2 points by velocityNote 3 days ago | 1 comments
15. Show HN: Don't trust me bro: fixing GPT-OSS (3.49B tokens, 1k GPU hours, 1x3090) (github.com)
    2 points by iamskeole about 7 hours ago | discuss
16. Show HN: Otaku – A Roleplay Terminal Client (github.com)
    2 points by enclavum5 24 days ago | discuss
17. Show HN: Anjadhe – privacy first AI assistant, no account, no server DB (www.anjadhe.com)
    1 points by ram-bv 11 days ago | 1 comments
18. Show HN: Gainz.fast – Local Inference, Faster (gainz.fast)
    1 points by carsenk 29 days ago | discuss
19. Qwen3.8-27B make medium the default effort level instead of xhigh (github.com)
    16 points by xlayn 14 days ago | 4 comments
20. Gguf: Harden loader against malformed tensor dims and metadata types (github.com)
    3 points by gzxharrison001 6 days ago | discuss
21. Vision Now Available in Llama.cpp (github.com)
    550 points by redman25 over 1 year ago | 104 comments
22. Llama.cpp guide – Running LLMs locally on any hardware, from scratch (steelph0enix.github.io)
    368 points by zarekr almost 2 years ago | 87 comments
23. Heap-overflowing Llama.cpp to RCE (retr0.blog)
    248 points by retr0reg over 1 year ago | 54 comments
24. Llama.cpp supports Vulkan. why doesn't Ollama? (github.com)
    217 points by buyucu over 1 year ago | 228 comments
25. Ollama violating llama.cpp license for over a year (github.com)
    202 points by Jabrov over 1 year ago | 68 comments
26. Llama.cpp Now Supports Qwen2-VL (Vision Language Model) (github.com)
    155 points by BUFU over 1 year ago | 50 comments
27. Go library for in-process vector search and embeddings with llama.cpp (github.com)
    114 points by kelindar almost 2 years ago | 29 comments
28. Llama.cpp AI Performance with the GeForce RTX 5090 Review (www.phoronix.com)
    113 points by kristianp over 1 year ago | 78 comments
29. Mistral Integration Improved in Llama.cpp (github.com)
    95 points by decide1000 about 1 year ago | 15 comments
30. Llama.cpp: Add GPT-OSS (github.com)
    35 points by atgctg about 1 year ago | discuss
31. Llama.cpp now has an official website: llama.app (twitter.com)
    17 points by julien_c 3 months ago | 4 comments
32. Show HN: Llama.cpp Tutorial 2026: Run GGUF Models Locally on CPU and GPU
    13 points by anju-kushwaha 5 months ago | 4 comments
33. Llama.cpp Now Part of the Nvidia RTX AI Toolkit (developer.nvidia.com)
    13 points by alanzhuly almost 2 years ago | 1 comments
34. Show HN: Minute – Offline meeting notes on macOS with Whisper and llama.cpp (github.com)
    12 points by mraza007 about 1 month ago | 6 comments
35. LLama.cpp Got Screwd (github.com)
    11 points by trilogic about 2 months ago | 5 comments
36. Ask HN: Is anybody using llama.cpp for production?
    11 points by HardikVala about 1 year ago | 1 comments
37. We Found a Heap Overflow in Llama.cpp's Tokenizer (pwno.io)
    9 points by retr0reg about 1 year ago | discuss
38. Show HN: I Built an Image Captioning Tool Using Llama.cpp (github.com)
    8 points by paradox460 9 months ago | 1 comments
39. Llama.cpp now has an official website: llama.app (llama.app)
    7 points by wronglebowski 3 months ago | 1 comments
40. DeepSeek-R1 speeds up llama.cpp code by x2 (github.com)
    6 points by roboboffin over 1 year ago | 3 comments
41. I patched llama.cpp to gain 20% prompt processing TPS. Help me make a PR
    6 points by i_am_rocoe 2 months ago | 2 comments
42. Apples to Apples: MLX vs. Llama.cpp for Gemma 4 12B on an M1 16GB (ziraph.com)
    6 points by ABS 3 months ago | 1 comments
43. Llama.cpp AI Performance with the GeForce RTX 5090 (www.phoronix.com)
    6 points by mfiguiere over 1 year ago | 1 comments
44. Ollama vs. Llama.cpp – Quick Benchmark (blawg.pages.dev)
    6 points by caveman23 about 2 months ago | discuss
45. Show HN: Run Llama.cpp In-Process from Java with Project Panama FFM (deemwar-products.github.io)
    6 points by deemwar 3 months ago | discuss
46. WebGPU support in llama.cpp (reeselevine.github.io)
    6 points by relivin 3 months ago | discuss
47. Llama.cpp performance breakthrough for multi-GPU setups (medium.com)
    6 points by epistasis 8 months ago | discuss
48. Llama.cpp: Deterministic Inference Mode (CUDA): RMSNorm, MatMul, Attention (github.com)
    6 points by diwank 12 months ago | discuss
49. Ask HN: 2x Arc A770 or 1x Radeon 7900 XTX for llama.cpp
    5 points by danielEM over 1 year ago | 5 comments
50. Show HN: I run 30B 22tok/s, 109tok/s not novel,6GB/16GB RAM overcoming llama.cpp (github.com)
    5 points by federicoTXTS about 1 month ago | discuss