Smart News

Hackernews posts about VLLM

RSS feed for VLLM
  1. 31
    Speculative Decoding in vLLM on AMD GPUsvllm.ai
    ▲ 145ankitg1228d💬 53
  2. 32
    Self-hosted inference orchestrators compared: LocalAI, exo, GPUStack, vLLMwww.nexlab.net
    ▲ 13nextime14d💬 7
  3. 33
    Watermarking in vLLMvllm.ai
    ▲ 3eatonphil10ddiscuss
  4. 34
    Keeping vLLM's Prefix Cache Warm Between Agent Turnsdoug.sh
    ▲ 3dougcalobrisi16ddiscuss
  5. 35
    vLLM 0.29.0: Model Runner V2 is now the defaultgithub.com
    ▲ 3joshcsimmons26ddiscuss
  6. 36
    Glq a port trellis quantization of large language models as a vLLM plugingithub.com
    ▲ 2acd25d💬 1
  7. 37
    Custom Models in Oh My Pi: vLLM, Llama.cpp, SGLang and Moredoug.sh
    ▲ 2dougcalobrisi9ddiscuss
  8. 38
    vLLM Architecture, Memory and Benchmarks Deep Divewww.g-ftech.com
    ▲ 2gfactor_ai13ddiscuss
  9. 39
    Serving LLMs on Tenstorrent Hardware: Inside the vLLM TT Pluginvllm.ai
    ▲ 2ankitg1224ddiscuss
  10. 40
    How to build a Jev-style classifier with DiffusionGemma and vLLMmedium.com
    ▲ 1teleforce7d💬 2
  11. 41
    Show HN: InferPilot – the vLLM doctor that tells you when fp8 won't helpgithub.com
    ▲ 1poojithdevan4ddiscuss
  12. 42
    Show HN: Reflex Engine Beats Both Llama.cpp and vLLM on Cold-Start to TTFTgithub.com
    ▲ 1leochong5ddiscuss
  13. 43
    ContextMemory – Markdown memory for your llama.cpp/vLLM servergithub.com
    ▲ 1vitorcastro786ddiscuss
  14. 44
    Run Decision Models on vLLM and Red Hat AI Using DiffusionGemmadevelopers.redhat.com
    ▲ 1thebeardisred6ddiscuss
  15. 45
    What one vLLM replica on an L40 can carry and how it failspercentes.ai
    ▲ 1itsveems9ddiscuss
  16. 46
    Hardware-Agnostic Models in vLLMpytorch.org
    ▲ 1matt_d11ddiscuss
  17. 47
    vLLM: Jev-like mode for the DiffusionGemma modelgithub.com
    ▲ 1mmastrac18ddiscuss
  18. 48
    Show HN: Self-adjusting vLLM at production scaletwitter.com
    ▲ 1dmitriisn19ddiscuss
  19. 49
    Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agentsgithub.com
    ▲ 194anerli4d💬 99
  20. 50
    Turning GLM-5.3-Flash into a Jev-like decision modelwww.privatemode.ai
    ▲ 138flxflx8d💬 59
  21. 51
    Show HN: Nari Qwen3-TTS and Qwen3-ASR – High accuracy, low latency and costnarilabs.com
    ▲ 92toebee20d💬 31
  22. 52
    Show HN: Recursant, the agent-aware model router built for hybrid workloadsgithub.com
    ▲ 1hestefisk10hdiscuss
  23. 53
    Show HN: MaskShift – a maximalist coding agent with zero NPM dependenciesgithub.com
    ▲ 1Nafeeur28ddiscuss
  24. 54
    Decision 2.0: our newest decision modelstwitter.com
    ▲ 3thedima16hdiscuss
  25. 55
    You Who Forsake the Lord: William T. Vollmann's four-volume spook showthebaffler.com
    ▲ 4cocacola115ddiscuss
  26. 56
    Testing 8 VLMs on a single 3090 GPUwww.reddit.com
    ▲ 3thinkevolve15ddiscuss
  27. 57
    Show HN: Textsnap – CPU OCR in <1 seconds/page, with VLM fallbackgithub.com
    ▲ 2mrkn14ddiscuss
  28. 58
    Show HN: Textsnap – CPU OCR in <1 seconds/page, with VLM fallback for hard pagesgithub.com
    ▲ 2mrkn15ddiscuss
  29. 59
    Classify 6700 pages for $1 with a Jev-compatible VLM APItwitter.com
    ▲ 2fzysingularity6ddiscuss
  30. 60
    Show HN: LoongForge-Train LLMs, VLMs, diffusion and embodied models, fastergithub.com
    ▲ 2nullnonenilNULL19ddiscuss
More stories →

Keyboard shortcuts

j / k
next / previous story
o or Enter
open the story
c
open the comments
s
save for later
h
history & saved stories
?
show this help