Hackernews posts about Llama3

1. 31
   

   newOpen-Source E2E FHE Implementation for Privacy-Preserving Llama 3 8B Inferencearxiv.org

   ▲ 2simonpure7ddiscusssavesaved
2. 32
   

   newGetting 50 GB/S Back from the Apple Neural Engineeiln.github.io

   ▲ 218eiln25d💬 36savesaved
3. 33
   

   newEcholeak Beaten - almosthuggingface.co

   ▲ 2Apollo_R6ddiscusssavesaved
4. 34
   

   newFaster prompt lookup drafting in llama.cppjadidbourbaki.github.io

   ▲ 89pptadversary8d💬 12savesaved
5. 35
   

   newFourier Analysis: Drawing Llamas with Circlesadekau.github.io

   ▲ 79cebert11d💬 11savesaved
6. 36
   

   newNew in Llama.cpp: Decision Modelshuggingface.co

   ▲ 6cuvinny2d💬 1savesaved
7. 37
   

   newExtract v2.5: Rebuilding extraction agents on LlamaParsewww.llamaindex.ai

   ▲ 5cheesyFish3ddiscusssavesaved
8. 38
   

   newLLaMA Now Goes Faster on CPUsjustine.lol

   ▲ 4luu2d💬 3savesaved
9. 39
   

   newI got 2.2x more tokens per second from llama.cpp on Intel Arcgrigio.org

   ▲ 4grigio7ddiscusssavesaved
10. 40
    

    newLlama.cpp Under the Hoodwww.cppdepend.com

    ▲ 4cppfirst12ddiscusssavesaved
11. 41
    

    newTransformers now runs llama.cpp quantshuggingface.co

    ▲ 4mmis100012ddiscusssavesaved
12. 42
    

    newBenchmarking Local LLM Servers: Llama.cpp, Llamafile, LM Studio, and Ollamablog.mozilla.ai

    ▲ 3angpt17d💬 2savesaved
13. 43
    

    newNew in Llama.cpp: Decision Modelshuggingface.co

    ▲ 3nreece2ddiscusssavesaved
14. 44
    

    newShow HN: Jeva.cpp – a llama.cpp fork with JEV-compatible API for all LLMsgithub.com

    ▲ 3pragmatwice6ddiscusssavesaved
15. 45
    

    newTurn any Llama-server into a jev system one endpointgithub.com

    ▲ 3khimaros14ddiscusssavesaved
16. 46
    

    newSSD-Llama: SSD-Native Inference for Trillion-Parameter Moe on a Consumer PCarxiv.org

    ▲ 3AlmostCosmo7916ddiscusssavesaved
17. 47
    

    newShow HN: Llama.cpp fork with 2-4x multiGPU speed for MoE models bigger than VRAMgithub.com

    ▲ 2neuralll9d💬 3savesaved
18. 48
    

    newAnyone using llama.cpp willing to test LlamaRack?github.com

    ▲ 2Vibecoder_29d💬 3savesaved
19. 49
    

    newCustom Models in Oh My Pi: vLLM, Llama.cpp, SGLang and Moredoug.sh

    ▲ 2dougcalobrisi9ddiscusssavesaved
20. 50
    

    newTransformers now runs llama.cpp quantshuggingface.co

    ▲ 2vertigoruntime13ddiscusssavesaved
21. 51
    

    newLlama.cpp banned him for accidentally tagging in a fork PRgithub.com

    ▲ 1martianvoid8d💬 2savesaved
22. 52
    

    newShow HN: Reflex Engine Beats Both Llama.cpp and vLLM on Cold-Start to TTFTgithub.com

    ▲ 1leochong5ddiscusssavesaved
23. 53
    

    newContextMemory – Markdown memory for your llama.cpp/vLLM servergithub.com

    ▲ 1vitorcastro786ddiscusssavesaved
24. 54
    

    newUsing Llama-cpp-Python grammars to generate JSONtil.simonwillison.net

    ▲ 1Bluestein12ddiscusssavesaved
25. 55
    

    newBenchmark Llamacpp on Intel Panther Lake: Vulkan vs. SYCL vs. OpenVINO vs. CPUgrigio.org

    ▲ 1grigio19ddiscusssavesaved
26. 56
    

    newLaunch HN: Magnitude (YC S25) – Self-optimizing inference engine for agentsgithub.com

    ▲ 194anerli4d💬 99savesaved
27. 57
    

    newShow HN: DOOM in the kernel, or fibers in eBPFayles.github.io

    ▲ 53ayles25d💬 14savesaved
28. 58
    

    newShow HN: I built Otis, a minimal AI agent that runs local models out of the boxtriangllabs.ai

    ▲ 19petrenk0n21d💬 4savesaved
29. 59
    

    newShow HN: Jinfer – AI inference engine for the JVM. AI in a jarqxotic.ai

    ▲ 6mukel20d💬 1savesaved
30. 60
    

    newWhy human syntax breaks LLMs (and how to fix agentic coding)

    ▲ 5aslang27d💬 3savesaved

· edit