Hackernews posts about VLLM

1. 01
   

   newSpeculative Decoding in vLLM on AMD GPUsvllm.ai

   ▲ 145ankitg1228d💬 53savesaved
2. 02
   

   newSelf-hosted inference orchestrators compared: LocalAI, exo, GPUStack, vLLMwww.nexlab.net

   ▲ 13nextime14d💬 7savesaved
3. 03
   

   newWatermarking in vLLMvllm.ai

   ▲ 3eatonphil10ddiscusssavesaved
4. 04
   

   newKeeping vLLM's Prefix Cache Warm Between Agent Turnsdoug.sh

   ▲ 3dougcalobrisi16ddiscusssavesaved
5. 05
   

   newvLLM 0.29.0: Model Runner V2 is now the defaultgithub.com

   ▲ 3joshcsimmons26ddiscusssavesaved
6. 06
   

   newGlq a port trellis quantization of large language models as a vLLM plugingithub.com

   ▲ 2acd24d💬 1savesaved
7. 07
   

   newCustom Models in Oh My Pi: vLLM, Llama.cpp, SGLang and Moredoug.sh

   ▲ 2dougcalobrisi9ddiscusssavesaved
8. 08
   

   newvLLM Architecture, Memory and Benchmarks Deep Divewww.g-ftech.com

   ▲ 2gfactor_ai13ddiscusssavesaved
9. 09
   

   newServing LLMs on Tenstorrent Hardware: Inside the vLLM TT Pluginvllm.ai

   ▲ 2ankitg1224ddiscusssavesaved
10. 10
    

    newHow to build a Jev-style classifier with DiffusionGemma and vLLMmedium.com

    ▲ 1teleforce7d💬 2savesaved
11. 11
    

    newShow HN: InferPilot – the vLLM doctor that tells you when fp8 won't helpgithub.com

    ▲ 1poojithdevan4ddiscusssavesaved
12. 12
    

    newShow HN: Reflex Engine Beats Both Llama.cpp and vLLM on Cold-Start to TTFTgithub.com

    ▲ 1leochong5ddiscusssavesaved
13. 13
    

    newContextMemory – Markdown memory for your llama.cpp/vLLM servergithub.com

    ▲ 1vitorcastro786ddiscusssavesaved
14. 14
    

    newRun Decision Models on vLLM and Red Hat AI Using DiffusionGemmadevelopers.redhat.com

    ▲ 1thebeardisred6ddiscusssavesaved
15. 15
    

    newWhat one vLLM replica on an L40 can carry and how it failspercentes.ai

    ▲ 1itsveems9ddiscusssavesaved
16. 16
    

    newHardware-Agnostic Models in vLLMpytorch.org

    ▲ 1matt_d11ddiscusssavesaved
17. 17
    

    newvLLM: Jev-like mode for the DiffusionGemma modelgithub.com

    ▲ 1mmastrac18ddiscusssavesaved
18. 18
    

    newShow HN: Self-adjusting vLLM at production scaletwitter.com

    ▲ 1dmitriisn19ddiscusssavesaved
19. 19
    

    newLaunch HN: Magnitude (YC S25) – Self-optimizing inference engine for agentsgithub.com

    ▲ 194anerli4d💬 99savesaved
20. 20
    

    newTurning GLM-5.3-Flash into a Jev-like decision modelwww.privatemode.ai

    ▲ 138flxflx8d💬 59savesaved
21. 21
    

    newShow HN: Nari Qwen3-TTS and Qwen3-ASR – High accuracy, low latency and costnarilabs.com

    ▲ 92toebee20d💬 31savesaved
22. 22
    

    newShow HN: Recursant, the agent-aware model router built for hybrid workloadsgithub.com

    ▲ 1hestefisk10hdiscusssavesaved
23. 23
    

    newShow HN: MaskShift – a maximalist coding agent with zero NPM dependenciesgithub.com

    ▲ 1Nafeeur28ddiscusssavesaved
24. 24
    

    newDecision 2.0: our newest decision modelstwitter.com

    ▲ 3thedima15hdiscusssavesaved
25. 25
    

    newYou Who Forsake the Lord: William T. Vollmann's four-volume spook showthebaffler.com

    ▲ 4cocacola115ddiscusssavesaved
26. 26
    

    newTesting 8 VLMs on a single 3090 GPUwww.reddit.com

    ▲ 3thinkevolve15ddiscusssavesaved
27. 27
    

    newShow HN: Textsnap – CPU OCR in <1 seconds/page, with VLM fallbackgithub.com

    ▲ 2mrkn14ddiscusssavesaved
28. 28
    

    newShow HN: Textsnap – CPU OCR in <1 seconds/page, with VLM fallback for hard pagesgithub.com

    ▲ 2mrkn15ddiscusssavesaved
29. 29
    

    newClassify 6700 pages for $1 with a Jev-compatible VLM APItwitter.com

    ▲ 2fzysingularity6ddiscusssavesaved
30. 30
    

    newShow HN: LoongForge-Train LLMs, VLMs, diffusion and embodied models, fastergithub.com

    ▲ 2nullnonenilNULL19ddiscusssavesaved

· edit