Hackernews posts about Llama.cpp

1. Go library for in-process vector search and embeddings with llama.cpp (github.com)
   114 points by kelindar 25 days ago | 29 comments
2. callama: Call llama.cpp directly, either locally or remotely (github.com)
   2 points by behnamoh 16 days ago | discuss
3. Show HN: Open-Source Apple Intelligence Writing Tools for Windows and Linux (github.com)
   6 points by TechExpert2910 1 day ago | discuss
4. Llama.cpp 30B runs with only 6GB of RAM now (github.com)
   1311 points by msoad over 1 year ago | 414 comments
5. Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support (github.com)
   989 points by mrtksn over 1 year ago | 284 comments
6. Llama.cpp: Full CUDA GPU Acceleration (github.com)
   728 points by gzer0 over 1 year ago | 310 comments
7. How Is LLaMa.cpp Possible? (finbarr.ca)
   685 points by birriel over 1 year ago | 227 comments
8. LLama.cpp now has a web interface (github.com)
   328 points by xal over 1 year ago | 49 comments
9. Running LLaMA 7B on a 64GB M2 MacBook Pro with Llama.cpp (til.simonwillison.net)
   225 points by marban over 1 year ago | 76 comments
10. Llama.rs – Rust port of llama.cpp for fast LLaMA inference on CPU (github.com)
    202 points by rrampage over 1 year ago | 24 comments
11. Show HN: LLaVaVision: An AI "Be My Eyes"-like web app with a llama.cpp backend (github.com)
    154 points by lxe about 1 year ago | 19 comments
12. Show HN: Open-source load balancer for llama.cpp (github.com)
    151 points by mcharytoniuk 6 months ago | 20 comments
13. Why MMAP in llama.cpp hides true memory usage (twitter.com)
    136 points by flurly over 1 year ago | 98 comments
14. Llama.cpp can do 40 tok/s on M2 Max, 0% CPU usage, using all 38 GPU cores (twitter.com)
    123 points by samwillis over 1 year ago | 57 comments
15. Performance of llama.cpp on Apple Silicon A-series (github.com)
    100 points by mobilio 11 months ago | 41 comments
16. llama.cpp: Roadmap May 2023 (github.com)
    97 points by tosh over 1 year ago | 6 comments
17. Running Llama.cpp on AWS Instances (github.com)
    96 points by schappim 12 months ago | 10 comments
18. Revert for jart’s llama.cpp MMAP miracles (github.com)
    86 points by mmoustafa over 1 year ago | 86 comments
19. Llamanet: Zero-setup, zero-dependency OpenAI replacement powered by llama.cpp (github.com)
    45 points by cocktailpeanut 6 months ago | 5 comments
20. 21.2× faster than llama.cpp? plus 40% memory usage reduction (arxiv.org)
    43 points by helloericsf 5 months ago | 14 comments
21. Show HN: Llama.go – port of llama.cpp to pure Go (github.com)
    25 points by Ambix over 1 year ago | 5 comments
22. WIP Llama.cpp Vulkan Implementations (github.com)
    24 points by brucethemoose2 over 1 year ago | 1 comments
23. Show HN: Grammar Generator App for Llama.cpp (grammar.intrinsiclabs.ai)
    19 points by aduffy over 1 year ago | 6 comments
24. Gemma Is Added to Llama.cpp (github.com)
    17 points by behnamoh 9 months ago | discuss
25. LLaVA C++ server (based on llama.cpp) (github.com)
    14 points by trzy about 1 year ago | 6 comments
26. Llama.cpp Now Part of the Nvidia RTX AI Toolkit (developer.nvidia.com)
    13 points by alanzhuly about 2 months ago | 1 comments
27. Llama.cpp releases now ship with pre-built macOS binaries (twitter.com)
    12 points by schappim 8 months ago | 1 comments
28. Grok-1 Support for Llama.cpp (github.com)
    11 points by schappim 8 months ago | 2 comments
29. LLaMA-rs: a Rust port of llama.cpp for fast LLaMA inference on CPU (github.com)
    8 points by darthdeus over 1 year ago | discuss
30. Jlama (Java) outperforms llama.cpp in F32 Llama 7B Model (twitter.com)
    7 points by tjake over 1 year ago | 9 comments
31. Llama.cpp Working on Support for Llama3 (github.com)
    7 points by theolivenbaum 7 months ago | discuss
32. llama.cpp now supports StarCoder model series (github.com)
    6 points by wsxiaoys about 1 year ago | 1 comments
33. Show HN: LMQL becomes simpler and adds llama.cpp (lmql.ai)
    6 points by lbeurerkellner over 1 year ago | discuss