Hackernews posts about Llama.cpp

1. Ask HN: Why use Ollama for Containerized on-prem PROD use?
   2 points by dcreater about 18 hours ago | discuss
2. Show HN: Traitorous Models- Reality Show with Open Source LLMs (github.com)
   1 points by michaelgiba 15 days ago | discuss
3. Show HN:Localapi.ai – Local AI Platform
   1 points by LocalAPIAI 27 days ago | discuss
4. Llama.cpp: Full CUDA GPU Acceleration (github.com)
   728 points by gzer0 almost 2 years ago | 310 comments
5. How Is LLaMa.cpp Possible? (finbarr.ca)
   685 points by birriel over 1 year ago | 227 comments
6. Llama.cpp guide – Running LLMs locally on any hardware, from scratch (steelph0enix.github.io)
   368 points by zarekr 5 months ago | 87 comments
7. LLama.cpp now has a web interface (github.com)
   328 points by xal almost 2 years ago | 49 comments
8. Heap-overflowing Llama.cpp to RCE (retr0.blog)
   248 points by retr0reg about 1 month ago | 54 comments
9. Llama.cpp supports Vulkan. why doesn't Ollama? (github.com)
   217 points by buyucu 3 months ago | 228 comments
10. Llama.cpp Now Supports Qwen2-VL (Vision Language Model) (github.com)
    155 points by BUFU 4 months ago | 50 comments
11. Show HN: LLaVaVision: An AI "Be My Eyes"-like web app with a llama.cpp backend (github.com)
    154 points by lxe over 1 year ago | 19 comments
12. Show HN: Open-source load balancer for llama.cpp (github.com)
    151 points by mcharytoniuk 11 months ago | 20 comments
13. Llama.cpp can do 40 tok/s on M2 Max, 0% CPU usage, using all 38 GPU cores (twitter.com)
    123 points by samwillis almost 2 years ago | 57 comments
14. Go library for in-process vector search and embeddings with llama.cpp (github.com)
    114 points by kelindar 6 months ago | 29 comments
15. Llama.cpp AI Performance with the GeForce RTX 5090 Review (www.phoronix.com)
    113 points by kristianp about 2 months ago | 78 comments
16. Performance of llama.cpp on Apple Silicon A-series (github.com)
    100 points by mobilio over 1 year ago | 41 comments
17. llama.cpp: Roadmap May 2023 (github.com)
    97 points by tosh almost 2 years ago | 6 comments
18. Running Llama.cpp on AWS Instances (github.com)
    96 points by schappim over 1 year ago | 10 comments
19. Llamanet: Zero-setup, zero-dependency OpenAI replacement powered by llama.cpp (github.com)
    45 points by cocktailpeanut 11 months ago | 5 comments
20. 21.2× faster than llama.cpp? plus 40% memory usage reduction (arxiv.org)
    43 points by helloericsf 11 months ago | 14 comments
21. WIP Llama.cpp Vulkan Implementations (github.com)
    24 points by brucethemoose2 almost 2 years ago | 1 comments
22. Show HN: Grammar Generator App for Llama.cpp (grammar.intrinsiclabs.ai)
    19 points by aduffy over 1 year ago | 6 comments
23. Gemma Is Added to Llama.cpp (github.com)
    17 points by behnamoh about 1 year ago | discuss
24. LLaVA C++ server (based on llama.cpp) (github.com)
    14 points by trzy over 1 year ago | 6 comments
25. Llama.cpp Now Part of the Nvidia RTX AI Toolkit (developer.nvidia.com)
    13 points by alanzhuly 7 months ago | 1 comments
26. Llama.cpp releases now ship with pre-built macOS binaries (twitter.com)
    12 points by schappim about 1 year ago | 1 comments
27. Grok-1 Support for Llama.cpp (github.com)
    11 points by schappim about 1 year ago | 2 comments
28. Jlama (Java) outperforms llama.cpp in F32 Llama 7B Model (twitter.com)
    7 points by tjake over 1 year ago | 9 comments
29. Llama.cpp Working on Support for Llama3 (github.com)
    7 points by theolivenbaum about 1 year ago | discuss
30. DeepSeek-R1 speeds up llama.cpp code by x2 (github.com)
    6 points by roboboffin 3 months ago | 3 comments
31. Llama.cpp AI Performance with the GeForce RTX 5090 (www.phoronix.com)
    6 points by mfiguiere 3 months ago | 1 comments
32. llama.cpp now supports StarCoder model series (github.com)
    6 points by wsxiaoys over 1 year ago | 1 comments
33. Show HN: LMQL becomes simpler and adds llama.cpp (lmql.ai)
    6 points by lbeurerkellner almost 2 years ago | discuss