Hackernews posts about Llama.cpp

1. Llama.cpp supports Vulkan. why doesn't Ollama? (github.com)
   217 points by buyucu 23 days ago | 228 comments
2. DeepSeek-R1 speeds up llama.cpp code by x2 (github.com)
   6 points by roboboffin 26 days ago | 3 comments
3. Llama.cpp AI Performance with the GeForce RTX 5090 (www.phoronix.com)
   6 points by mfiguiere 27 days ago | 1 comments
4. Llama.cpp AI Performance with the GeForce RTX 5090 (www.phoronix.com)
   4 points by rubyn00bie 25 days ago | 2 comments
5. Llama's Paradox – Exploiting Llama.cpp (retr0.blog)
   4 points by todsacerdoti 17 days ago | 1 comments
6. Llama.cpp PR with 99% of code written by DeepSeek-R1 (github.com)
   4 points by zelag 27 days ago | discuss
7. Llama.cpp now supports tool calling (OpenAI-compatible) (github.com)
   3 points by ochafik 22 days ago | 1 comments
8. Stop Wasting Your Multi-GPU Setup with Llama.cpp (www.ahmadosman.com)
   2 points by rcarmo 15 days ago | discuss
9. Stop Wasting Your Multi-GPU Setup with Llama.cpp (www.ahmadosman.com)
   2 points by LorenDB 16 days ago | discuss
10. Llama.cpp AI Performance with the GeForce RTX 5090 (www.phoronix.com)
    2 points by shutty 26 days ago | discuss
11. Show HN: We're building a desktop app for browser-based AI agents (meha.ai)
    50 points by jawerty 22 days ago | 56 comments
12. Show HN: KTransformers:671B DeepSeek-R1 on a Single Machine-286 tokens/s Prefill (github.com)
    14 points by sssummer 13 days ago | discuss
13. Show HN: We're Building a Desktop App for Browser Agents (meha.ai)
    6 points by jawerty 27 days ago | 5 comments
14. Show HN: Autopen, token-tree text editor that runs LLMs and shows probabilities (github.com)
    4 points by msoloviev 18 days ago | discuss
15. Fact-checking DeepSeek hype with DeepSeek
    4 points by omega3 25 days ago | discuss
16. Show HN: Bodhi App – Local LLM Inference (getbodhi.app)
    1 points by anagri 16 days ago | discuss
17. Ollama are 'try[ing to] achieve vendor lock-in' (github.com)
    17 points by alexmorley 23 days ago | 5 comments
18. Ggml 2x WASM Speed with SIMD Optimization Using 99% DeekSeek-R1-Generated Code (github.com)
    7 points by bratao 27 days ago | discuss
19. Ggml: X2 speed for WASM by optimizing SIMD (github.com)
    1 points by btilly 26 days ago | 2 comments
20. Llama.cpp 30B runs with only 6GB of RAM now (github.com)
    1311 points by msoad almost 2 years ago | 414 comments
21. Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support (github.com)
    989 points by mrtksn almost 2 years ago | 284 comments
22. Llama.cpp: Full CUDA GPU Acceleration (github.com)
    728 points by gzer0 over 1 year ago | 310 comments
23. How Is LLaMa.cpp Possible? (finbarr.ca)
    685 points by birriel over 1 year ago | 227 comments
24. Llama.cpp guide – Running LLMs locally on any hardware, from scratch (steelph0enix.github.io)
    368 points by zarekr 3 months ago | 87 comments
25. LLama.cpp now has a web interface (github.com)
    328 points by xal over 1 year ago | 49 comments
26. Running LLaMA 7B on a 64GB M2 MacBook Pro with Llama.cpp (til.simonwillison.net)
    225 points by marban almost 2 years ago | 76 comments
27. Llama.rs – Rust port of llama.cpp for fast LLaMA inference on CPU (github.com)
    202 points by rrampage almost 2 years ago | 24 comments
28. Llama.cpp Now Supports Qwen2-VL (Vision Language Model) (github.com)
    155 points by BUFU 2 months ago | 50 comments
29. Show HN: LLaVaVision: An AI "Be My Eyes"-like web app with a llama.cpp backend (github.com)
    154 points by lxe over 1 year ago | 19 comments
30. Show HN: Open-source load balancer for llama.cpp (github.com)
    151 points by mcharytoniuk 9 months ago | 20 comments
31. Why MMAP in llama.cpp hides true memory usage (twitter.com)
    136 points by flurly almost 2 years ago | 98 comments
32. Llama.cpp can do 40 tok/s on M2 Max, 0% CPU usage, using all 38 GPU cores (twitter.com)
    123 points by samwillis over 1 year ago | 57 comments
33. Go library for in-process vector search and embeddings with llama.cpp (github.com)
    114 points by kelindar 4 months ago | 29 comments
34. Performance of llama.cpp on Apple Silicon A-series (github.com)
    100 points by mobilio about 1 year ago | 41 comments
35. llama.cpp: Roadmap May 2023 (github.com)
    97 points by tosh almost 2 years ago | 6 comments
36. Running Llama.cpp on AWS Instances (github.com)
    96 points by schappim about 1 year ago | 10 comments
37. Revert for jart’s llama.cpp MMAP miracles (github.com)
    86 points by mmoustafa almost 2 years ago | 86 comments
38. Llamanet: Zero-setup, zero-dependency OpenAI replacement powered by llama.cpp (github.com)
    45 points by cocktailpeanut 9 months ago | 5 comments
39. 21.2× faster than llama.cpp? plus 40% memory usage reduction (arxiv.org)
    43 points by helloericsf 9 months ago | 14 comments
40. Show HN: Llama.go – port of llama.cpp to pure Go (github.com)
    25 points by Ambix almost 2 years ago | 5 comments
41. WIP Llama.cpp Vulkan Implementations (github.com)
    24 points by brucethemoose2 over 1 year ago | 1 comments
42. Show HN: Grammar Generator App for Llama.cpp (grammar.intrinsiclabs.ai)
    19 points by aduffy over 1 year ago | 6 comments
43. Gemma Is Added to Llama.cpp (github.com)
    17 points by behnamoh about 1 year ago | discuss
44. LLaVA C++ server (based on llama.cpp) (github.com)
    14 points by trzy over 1 year ago | 6 comments
45. Llama.cpp Now Part of the Nvidia RTX AI Toolkit (developer.nvidia.com)
    13 points by alanzhuly 5 months ago | 1 comments
46. Llama.cpp releases now ship with pre-built macOS binaries (twitter.com)
    12 points by schappim 11 months ago | 1 comments
47. Grok-1 Support for Llama.cpp (github.com)
    11 points by schappim 11 months ago | 2 comments
48. LLaMA-rs: a Rust port of llama.cpp for fast LLaMA inference on CPU (github.com)
    8 points by darthdeus almost 2 years ago | discuss
49. Jlama (Java) outperforms llama.cpp in F32 Llama 7B Model (twitter.com)
    7 points by tjake over 1 year ago | 9 comments