Hackernews posts about Llama2

Llama2 is a large language model that has achieved impressive performance in natural language processing tasks, outperforming ChatGPT and other models in various benchmarks.

RSS feed for Llama2

Related:ChatGPT

31
newShow HN: DOOM in the kernel, or fibers in eBPFayles.github.io
▲ 53ayles 25d 💬 14
32
newShow HN: PicoLM v1.0-rc2 ("Yura Kana"). Run an LLM on Digital Unixgithub.com
▲ 1gabucino 11d discuss
33
newFaster prompt lookup drafting in llama.cppjadidbourbaki.github.io
▲ 89pptadversary 8d 💬 12
34
newFourier Analysis: Drawing Llamas with Circlesadekau.github.io
▲ 79cebert 11d 💬 11
35
newNew in Llama.cpp: Decision Modelshuggingface.co
▲ 6cuvinny 2d 💬 1
36
newExtract v2.5: Rebuilding extraction agents on LlamaParsewww.llamaindex.ai
▲ 5cheesyFish 3d discuss
37
newLLaMA Now Goes Faster on CPUsjustine.lol
▲ 4luu 2d 💬 3
38
newI got 2.2x more tokens per second from llama.cpp on Intel Arcgrigio.org
▲ 4grigio 7d discuss
39
newLlama.cpp Under the Hoodwww.cppdepend.com
▲ 4cppfirst 12d discuss
40
newTransformers now runs llama.cpp quantshuggingface.co
▲ 4mmis1000 12d discuss
41
newBenchmarking Local LLM Servers: Llama.cpp, Llamafile, LM Studio, and Ollamablog.mozilla.ai
▲ 3angpt 17d 💬 2
42
newNew in Llama.cpp: Decision Modelshuggingface.co
▲ 3nreece 2d discuss
43
newShow HN: Jeva.cpp – a llama.cpp fork with JEV-compatible API for all LLMsgithub.com
▲ 3pragmatwice 6d discuss
44
newTurn any Llama-server into a jev system one endpointgithub.com
▲ 3khimaros 14d discuss
45
newSSD-Llama: SSD-Native Inference for Trillion-Parameter Moe on a Consumer PCarxiv.org
▲ 3AlmostCosmo79 16d discuss
46
newShow HN: Llama.cpp fork with 2-4x multiGPU speed for MoE models bigger than VRAMgithub.com
▲ 2neuralll 9d 💬 3
47
newAnyone using llama.cpp willing to test LlamaRack?github.com
▲ 2Vibecoder_29d 💬 3
48
newOpen-Source E2E FHE Implementation for Privacy-Preserving Llama 3 8B Inferencearxiv.org
▲ 2simonpure 7d discuss
49
newCustom Models in Oh My Pi: vLLM, Llama.cpp, SGLang and Moredoug.sh
▲ 2dougcalobrisi 9d discuss
50
newTransformers now runs llama.cpp quantshuggingface.co
▲ 2vertigoruntime 13d discuss
51
newLlama.cpp banned him for accidentally tagging in a fork PRgithub.com
▲ 1martianvoid 8d 💬 2
52
newShow HN: Reflex Engine Beats Both Llama.cpp and vLLM on Cold-Start to TTFTgithub.com
▲ 1leochong 5d discuss
53
newContextMemory – Markdown memory for your llama.cpp/vLLM servergithub.com
▲ 1vitorcastro78 6d discuss
54
newUsing Llama-cpp-Python grammars to generate JSONtil.simonwillison.net
▲ 1Bluestein 12d discuss
55
newBenchmark Llamacpp on Intel Panther Lake: Vulkan vs. SYCL vs. OpenVINO vs. CPUgrigio.org
▲ 1grigio 19d discuss
56
newGetting 50 GB/S Back from the Apple Neural Engineeiln.github.io
▲ 218eiln 25d 💬 36
57
newLaunch HN: Magnitude (YC S25) – Self-optimizing inference engine for agentsgithub.com
▲ 194anerli 4d 💬 99
58
newShow HN: I built Otis, a minimal AI agent that runs local models out of the boxtriangllabs.ai
▲ 19petrenk0n 21d 💬 4
59
newShow HN: Jinfer – AI inference engine for the JVM. AI in a jarqxotic.ai
▲ 6mukel 20d 💬 1
60
newWhy human syntax breaks LLMs (and how to fix agentic coding)
▲ 5aslang 27d 💬 3