Hackernews posts about Llama.cpp

1. Mistral Integration Improved in Llama.cpp (github.com)
   95 points by decide1000 19 days ago | 15 comments
2. Llama.cpp: Add GPT-OSS (github.com)
   35 points by atgctg 25 days ago | discuss
3. Tinker with LLMs in the privacy of your own home using Llama.cpp (www.theregister.com)
   5 points by rntn 6 days ago | discuss
4. How to run LLMs on PC at home using Llama.cpp (www.theregister.com)
   2 points by ibobev 4 days ago | discuss
5. Guide: Running GPT-OSS with Llama.cpp (github.com)
   2 points by homarp 9 days ago | discuss
6. Show HN: Spectre, a coding agent for llama.cpp servers (github.com)
   1 points by gavino 10 days ago | discuss
7. Show HN: A minimal Flask and Htmx and LangChain (with llama.cpp) interface (github.com)
   1 points by anon1253 26 days ago | discuss
8. Show HN: Lemonade: Run LLMs Locally with GPU and NPU Acceleration (github.com)
   15 points by ramkrishna2910 11 days ago | discuss
9. Show HN: I made PromptMask, a local LLM-based privacy filter for cloud LLMs (github.com)
   4 points by cxumol 4 days ago | discuss
10. Show HN: FlexLLama – Run multiple local LLMs at once with a simple dashboard (github.com)
    4 points by yazon 25 days ago | discuss
11. Modular LLM framework inspired by Linux – aiming for a one-GPU future
    2 points by openkame 4 days ago | 1 comments
12. Show HN: Paddler – open-source LLMOps platform for hosting AI in your own infra (github.com)
    2 points by mzagaj 15 days ago | discuss
13. Show HN: Tasklyst – A minimalist offline-first multiplatform productivity app (tasklyst.app)
    1 points by zapzap40 23 days ago | discuss
14. Vision Now Available in Llama.cpp (github.com)
    550 points by redman25 4 months ago | 104 comments
15. Llama.cpp guide – Running LLMs locally on any hardware, from scratch (steelph0enix.github.io)
    368 points by zarekr 9 months ago | 87 comments
16. Heap-overflowing Llama.cpp to RCE (retr0.blog)
    248 points by retr0reg 5 months ago | 54 comments
17. Llama.cpp supports Vulkan. why doesn't Ollama? (github.com)
    217 points by buyucu 7 months ago | 228 comments
18. Ollama violating llama.cpp license for over a year (github.com)
    202 points by Jabrov 4 months ago | 68 comments
19. Llama.cpp Now Supports Qwen2-VL (Vision Language Model) (github.com)
    155 points by BUFU 9 months ago | 50 comments
20. Show HN: LLaVaVision: An AI "Be My Eyes"-like web app with a llama.cpp backend (github.com)
    154 points by lxe almost 2 years ago | 19 comments
21. Show HN: Open-source load balancer for llama.cpp (github.com)
    151 points by mcharytoniuk about 1 year ago | 20 comments
22. Go library for in-process vector search and embeddings with llama.cpp (github.com)
    114 points by kelindar 10 months ago | 29 comments
23. Llama.cpp AI Performance with the GeForce RTX 5090 Review (www.phoronix.com)
    113 points by kristianp 6 months ago | 78 comments
24. Performance of llama.cpp on Apple Silicon A-series (github.com)
    100 points by mobilio over 1 year ago | 41 comments
25. Running Llama.cpp on AWS Instances (github.com)
    96 points by schappim almost 2 years ago | 10 comments
26. Llamanet: Zero-setup, zero-dependency OpenAI replacement powered by llama.cpp (github.com)
    45 points by cocktailpeanut about 1 year ago | 5 comments
27. 21.2× faster than llama.cpp? plus 40% memory usage reduction (arxiv.org)
    43 points by helloericsf about 1 year ago | 14 comments
28. Gemma Is Added to Llama.cpp (github.com)
    17 points by behnamoh over 1 year ago | discuss
29. LLaVA C++ server (based on llama.cpp) (github.com)
    14 points by trzy almost 2 years ago | 6 comments
30. Llama.cpp Now Part of the Nvidia RTX AI Toolkit (developer.nvidia.com)
    13 points by alanzhuly 11 months ago | 1 comments
31. Llama.cpp releases now ship with pre-built macOS binaries (twitter.com)
    12 points by schappim over 1 year ago | 1 comments
32. Grok-1 Support for Llama.cpp (github.com)
    11 points by schappim over 1 year ago | 2 comments
33. Ask HN: Is anybody using llama.cpp for production?
    11 points by HardikVala about 1 month ago | 1 comments
34. We Found a Heap Overflow in Llama.cpp's Tokenizer (pwno.io)
    9 points by retr0reg 2 months ago | discuss
35. Llama.cpp Working on Support for Llama3 (github.com)
    7 points by theolivenbaum over 1 year ago | discuss
36. DeepSeek-R1 speeds up llama.cpp code by x2 (github.com)
    6 points by roboboffin 7 months ago | 3 comments
37. Llama.cpp AI Performance with the GeForce RTX 5090 (www.phoronix.com)
    6 points by mfiguiere 7 months ago | 1 comments
38. llama.cpp now supports StarCoder model series (github.com)
    6 points by wsxiaoys almost 2 years ago | 1 comments
39. Ask HN: 2x Arc A770 or 1x Radeon 7900 XTX for llama.cpp
    5 points by danielEM 6 months ago | 5 comments
40. Llama.cpp: SOTA 2-bit quants (github.com)
    5 points by tosh over 1 year ago | discuss
41. Llama.MIA – fork of Llama.cpp with interpretability features (grgv.xyz)
    5 points by coolvision over 1 year ago | discuss
42. GitHub deletes popular llama.cpp fork without explanation (github.com)
    4 points by akawry about 1 month ago | 2 comments
43. Llama.cpp AI Performance with the GeForce RTX 5090 (www.phoronix.com)
    4 points by rubyn00bie 7 months ago | 2 comments