Hackernews posts about Llama.cpp
Related:
M2 Max
- Show HN: Local LLM Inference in Godot and Unity (github.com)
- How Is LLaMa.cpp Possible? (finbarr.ca)
- Vision Now Available in Llama.cpp (github.com)
- Llama.cpp guide – Running LLMs locally on any hardware, from scratch (steelph0enix.github.io)
- Heap-overflowing Llama.cpp to RCE (retr0.blog)
- Llama.cpp supports Vulkan. why doesn't Ollama? (github.com)
- Ollama violating llama.cpp license for over a year (github.com)
- Show HN: Open-source load balancer for llama.cpp (github.com)
- Llama.cpp AI Performance with the GeForce RTX 5090 Review (www.phoronix.com)
- Performance of llama.cpp on Apple Silicon A-series (github.com)
- Running Llama.cpp on AWS Instances (github.com)
- Show HN: Grammar Generator App for Llama.cpp (grammar.intrinsiclabs.ai)
- Gemma Is Added to Llama.cpp (github.com)
- LLaVA C++ server (based on llama.cpp) (github.com)
- Llama.cpp Now Part of the Nvidia RTX AI Toolkit (developer.nvidia.com)
- Grok-1 Support for Llama.cpp (github.com)
- Jlama (Java) outperforms llama.cpp in F32 Llama 7B Model (twitter.com)
- Llama.cpp Working on Support for Llama3 (github.com)
- DeepSeek-R1 speeds up llama.cpp code by x2 (github.com)
- Llama.cpp AI Performance with the GeForce RTX 5090 (www.phoronix.com)
- llama.cpp now supports StarCoder model series (github.com)
- Llama.http: A Dockerized, simple HTTP API for llama.cpp (hub.docker.com)
- Llama.cpp: SOTA 2-bit quants (github.com)