Hackernews posts about LLaMA

LLaMA is an AI model developed by Facebook that generates human-like text responses to user input.

RSS feed for LLaMA

Related:Facebook Meta Apple M1 Mac Mark Zuckerberg Cerebras Apache 2.0 Python 3.11 TinyLlama ChatGPT Stanford Alpaca

61
newLlama.cpp on a jailbroken PS5: run any GGUF model natively on the consolegithub.com
▲ 375Anon84 5d 💬 87
62
newFaster prompt lookup drafting in llama.cppjadidbourbaki.github.io
▲ 89pptadversary 25d 💬 12
63
newFourier Analysis: Drawing Llamas with Circlesadekau.github.io
▲ 79cebert 27d 💬 11
64
newLLaMA Now Goes Faster on CPUsjustine.lol
▲ 6luu 18d 💬 3
65
newNew in Llama.cpp: Decision Modelshuggingface.co
▲ 6cuvinny 19d 💬 1
66
newExtract v2.5: Rebuilding extraction agents on LlamaParsewww.llamaindex.ai
▲ 5cheesyFish 20d discuss
67
newSonicBoom – llama.cpp's own kernels, 14% faster decode via a graph compilergithub.com
▲ 4nalaginrut 8d discuss
68
newLlama.cpp and WebGPU = Client-side LLMs [video]www.youtube.com
▲ 4TriteJin 14d discuss
69
newI got 2.2x more tokens per second from llama.cpp on Intel Arcgrigio.org
▲ 4grigio 23d discuss
70
newLlama.cpp Under the Hoodwww.cppdepend.com
▲ 4cppfirst 28d discuss
71
newTransformers now runs llama.cpp quantshuggingface.co
▲ 4mmis1000 28d discuss
72
newJeyzma is TypeSafeAI minus $850M plus Go/TinyGo/llama.cpp in the browserjeyzma.com
▲ 3deadprogram 11d discuss
73
newAI Development on Windows: From PyTorch and Llama.cpp to Windows MLdevblogs.microsoft.com
▲ 3antimora 14d discuss
74
newNew in Llama.cpp: Decision Modelshuggingface.co
▲ 3nreece 18d discuss
75
newShow HN: Jeva.cpp – a llama.cpp fork with JEV-compatible API for all LLMsgithub.com
▲ 3pragmatwice 23d discuss
76
newShow HN: Llama.cpp fork with 2-4x multiGPU speed for MoE models bigger than VRAMgithub.com
▲ 2neuralll 26d 💬 3
77
newPS5LM: Llama.cpp on a jailbroken PS5, run any GGUF model natively on the consolegithub.com
▲ 2zdw 7d discuss
78
newKisoku 1.6B: LLM trained solo from scratch on a TPU grant, matches Llama 3.2 1Bgithub.com
▲ 20ARCH 12d discuss
79
newJava vLLM-like framework claim 90% perfomance of llamacpp inference on Nvidia HWwww.reddit.com
▲ 2mikepapadim 13d discuss
80
newMS announces DeepSeek V4 Flash and Nemotron locally, llama.cpp comes to Win MLpasqualepillitteri.it
▲ 2choult 14d discuss
81
newOpen-Source E2E FHE Implementation for Privacy-Preserving Llama 3 8B Inferencearxiv.org
▲ 2simonpure 24d discuss
82
newCustom Models in Oh My Pi: vLLM, Llama.cpp, SGLang and Moredoug.sh
▲ 2dougcalobrisi 25d discuss
83
newTransformers now runs llama.cpp quantshuggingface.co
▲ 2vertigoruntime 29d discuss
84
newLlama.cpp banned him for accidentally tagging in a fork PRgithub.com
▲ 1martianvoid 24d 💬 2
85
newShow HN: Llamachord – a Suzuki Omnichord simulator in the browserllamachord.com
▲ 1klolol 9d 💬 1
86
newShow HN: A layer on top llama.cpp enabling big MoE streaming on phone and laptopgithub.com
▲ 1HelldezNoBan 29h discuss
87
newIf llama.cpp enables MoE to activate multiple expertswww.openai-hub.com
▲ 1ConteMascetti71 6d discuss
88
newFine-tuned Llama 3.1 8B vs. Claude Sonnet 5 on 437 legal clausesreopenly.com
▲ 1dayoff 8d discuss
89
newAI Development on Windows: From PyTorch and Llama.cpp to Windows MLdevblogs.microsoft.com
▲ 1pjmlp 13d discuss
90
newShow HN: Reflex Engine Beats Both Llama.cpp and vLLM on Cold-Start to TTFTgithub.com
▲ 1leochong 21d discuss