Hackernews posts about Llama.cpp
Related:
M2 Max
- Heap-overflowing Llama.cpp to RCE (retr0.blog)
- Llama.cpp AI Performance with the GeForce RTX 5090 Review (www.phoronix.com)
- Ollama vs. Llama.cpp (old.reddit.com)
- Show HN: 1.32 Petaflops hardware for local prototyping (www.autonomous.ai)
- Llama.cpp: Full CUDA GPU Acceleration (github.com)
- How Is LLaMa.cpp Possible? (finbarr.ca)
- Llama.cpp guide – Running LLMs locally on any hardware, from scratch (steelph0enix.github.io)
- LLama.cpp now has a web interface (github.com)
- Llama.cpp supports Vulkan. why doesn't Ollama? (github.com)
- Show HN: Open-source load balancer for llama.cpp (github.com)
- Performance of llama.cpp on Apple Silicon A-series (github.com)
- llama.cpp: Roadmap May 2023 (github.com)
- Running Llama.cpp on AWS Instances (github.com)
- Show HN: Llama.go – port of llama.cpp to pure Go (github.com)
- WIP Llama.cpp Vulkan Implementations (github.com)
- Show HN: Grammar Generator App for Llama.cpp (grammar.intrinsiclabs.ai)
- Gemma Is Added to Llama.cpp (github.com)
- LLaVA C++ server (based on llama.cpp) (github.com)
- Llama.cpp Now Part of the Nvidia RTX AI Toolkit (developer.nvidia.com)
- Grok-1 Support for Llama.cpp (github.com)
- Jlama (Java) outperforms llama.cpp in F32 Llama 7B Model (twitter.com)
- Llama.cpp Working on Support for Llama3 (github.com)
- DeepSeek-R1 speeds up llama.cpp code by x2 (github.com)
- Llama.cpp AI Performance with the GeForce RTX 5090 (www.phoronix.com)
- llama.cpp now supports StarCoder model series (github.com)
- Llama.http: A Dockerized, simple HTTP API for llama.cpp (hub.docker.com)