Hackernews posts about LlamaF

RSS feed for LlamaF

31
newBenchmarking Local LLM Servers: Llama.cpp, Llamafile, LM Studio, and Ollamablog.mozilla.ai
▲ 3angpt 17d 💬 2
32
newFaster prompt lookup drafting in llama.cppjadidbourbaki.github.io
▲ 89pptadversary 8d 💬 12
33
newFourier Analysis: Drawing Llamas with Circlesadekau.github.io
▲ 79cebert 11d 💬 11
34
newNew in Llama.cpp: Decision Modelshuggingface.co
▲ 6cuvinny 2d 💬 1
35
newExtract v2.5: Rebuilding extraction agents on LlamaParsewww.llamaindex.ai
▲ 5cheesyFish 3d discuss
36
newLLaMA Now Goes Faster on CPUsjustine.lol
▲ 4luu 2d 💬 3
37
newI got 2.2x more tokens per second from llama.cpp on Intel Arcgrigio.org
▲ 4grigio 7d discuss
38
newLlama.cpp Under the Hoodwww.cppdepend.com
▲ 4cppfirst 12d discuss
39
newTransformers now runs llama.cpp quantshuggingface.co
▲ 4mmis1000 12d discuss
40
newNew in Llama.cpp: Decision Modelshuggingface.co
▲ 3nreece 2d discuss
41
newShow HN: Jeva.cpp – a llama.cpp fork with JEV-compatible API for all LLMsgithub.com
▲ 3pragmatwice 7d discuss
42
newTurn any Llama-server into a jev system one endpointgithub.com
▲ 3khimaros 14d discuss
43
newSSD-Llama: SSD-Native Inference for Trillion-Parameter Moe on a Consumer PCarxiv.org
▲ 3AlmostCosmo79 16d discuss
44
newShow HN: Llama.cpp fork with 2-4x multiGPU speed for MoE models bigger than VRAMgithub.com
▲ 2neuralll 10d 💬 3
45
newAnyone using llama.cpp willing to test LlamaRack?github.com
▲ 2Vibecoder_29d 💬 3
46
newOpen-Source E2E FHE Implementation for Privacy-Preserving Llama 3 8B Inferencearxiv.org
▲ 2simonpure 7d discuss
47
newCustom Models in Oh My Pi: vLLM, Llama.cpp, SGLang and Moredoug.sh
▲ 2dougcalobrisi 9d discuss
48
newTransformers now runs llama.cpp quantshuggingface.co
▲ 2vertigoruntime 13d discuss
49
newLlama.cpp banned him for accidentally tagging in a fork PRgithub.com
▲ 1martianvoid 8d 💬 2
50
newShow HN: Reflex Engine Beats Both Llama.cpp and vLLM on Cold-Start to TTFTgithub.com
▲ 1leochong 5d discuss
51
newContextMemory – Markdown memory for your llama.cpp/vLLM servergithub.com
▲ 1vitorcastro78 6d discuss
52
newUsing Llama-cpp-Python grammars to generate JSONtil.simonwillison.net
▲ 1Bluestein 12d discuss
53
newBenchmark Llamacpp on Intel Panther Lake: Vulkan vs. SYCL vs. OpenVINO vs. CPUgrigio.org
▲ 1grigio 19d discuss
54
newGetting 50 GB/S Back from the Apple Neural Engineeiln.github.io
▲ 218eiln 25d 💬 36
55
newLaunch HN: Magnitude (YC S25) – Self-optimizing inference engine for agentsgithub.com
▲ 194anerli 4d 💬 99
56
newShow HN: DOOM in the kernel, or fibers in eBPFayles.github.io
▲ 53ayles 25d 💬 14
57
newShow HN: I built Otis, a minimal AI agent that runs local models out of the boxtriangllabs.ai
▲ 19petrenk0n 21d 💬 4
58
newShow HN: Jinfer – AI inference engine for the JVM. AI in a jarqxotic.ai
▲ 6mukel 20d 💬 1
59
newWhy human syntax breaks LLMs (and how to fix agentic coding)
▲ 5aslang 27d 💬 3
60
newShow HN: IttyBittyAI – Qwen2.5:0.5B running on a 2017 Asus smartphone
▲ 2spottedmarley 10d discuss