Hackernews posts about VLLM

1. Surpassing vLLM with a Generated Inference Stack (infinity.inc)
   62 points by lukebechtel 28 days ago | 22 comments
2. vLLM introduces memory optimizations for long-context inference (github.com)
   5 points by addisud 3 days ago | discuss
3. Show HN: Llmtop – Htop for LLM Inference Clusters (vLLM, SGLang, Ollama, llama) (github.com)
   5 points by rpotluri 20 days ago | discuss
4. Show HN: vLLM Studio – A macOS app for using vLLM models (github.com)
   4 points by ahmedriad1 17 days ago | 4 comments
5. 1M Tokens/s: Scaling Qwen 3.5 27B on 96 B200 GPUs with vLLM (medium.com)
   3 points by m4r1k 11 days ago | discuss
6. vLLM Semantic Router v0.2 Athena: ClawOS, Model Refresh, and the System Brain (vllm.ai)
   3 points by mariuz 28 days ago | discuss
7. Go-LLM-proxy – Lightweight LLM aggregator (vLLM, Llama-server) (go-llm-proxy.com)
   2 points by yatesdr 5 days ago | 3 comments
8. Show HN: A single CLI to manage llama.cpp/vLLM/Ollama models (github.com)
   2 points by everlier 25 days ago | 1 comments
9. A simple L7 proxy for vLLM that manages LoRA adapter storage via NVMes (github.com)
   2 points by shayonj 30 days ago | discuss
10. VibePod adds Ollama/vLLM back end support for Claude Code and Codex (vibepod.dev)
    1 points by nezhar 20 days ago | discuss
11. Heaps do lie: debugging a memory leak in vLLM (mistral.ai)
    1 points by shiftingleft 20 days ago | discuss
12. Show HN: sllm – Split a GPU node with other developers, unlimited tokens (sllm.cloud)
    184 points by jrandolf 3 days ago | 98 comments
13. Launch HN: IonRouter (YC W26) – High-throughput, low-cost inference (ionrouter.io)
    72 points by vshah1016 26 days ago | 37 comments
14. Show HN: LLM-Gateway – Zero-Trust LLM Gateway (github.com)
    7 points by michaelquigley 11 days ago | 1 comments
15. Show HN: Yapit – PDF and webpage reader with TTS that doesn't suck (github.com)
    5 points by MaxWolf-01 1 day ago | 1 comments
16. Show HN: Lukan – An open-source agentic workstation in a single Rust binary (lukan.ai)
    3 points by enzovn 20 days ago | discuss
17. Show HN: Llamactl – Self-hosted LLM manager with OpenAI-compatible routing (github.com)
    2 points by lordmathis 21 days ago | discuss
18. Show HN: NVFP4 on Desktop Blackwell – 122B MoE on a Single RTX PRO 6000 31 tok/s
    2 points by jcartu 29 days ago | discuss
19. Show HN: SiMM – Distributed KV Cache for the Long-Context and Agent Era (github.com)
    1 points by SherryWong 25 days ago | 1 comments
20. The case for Model-as-a-Service over self-managed inference
    1 points by hpcaitech about 9 hours ago | discuss
21. Show HN: I over-engineered a home security camera that uses an LLM and talks (github.com)
    1 points by thecal 30 days ago | discuss
22. Show HN: AlertMole – I stopped checking the internet, it now checks for me (alertmole.com)
    1 points by carlesonielfa 30 days ago | discuss
23. Voice cloning at 37.6x real time (github.com)
    4 points by Jransom110 6 days ago | discuss
24. The Last Contract: William T. Vollmann's Battle to Publish an Epic (2025) (www.metropolitanreview.org)
    36 points by benbreen 12 days ago | 9 comments
25. Reka Edge – 7B fast, efficient VLM (open-weights) (huggingface.co)
    8 points by kwajiehao 27 days ago | 1 comments
26. Using a local VLM to organize my screenshots folder (jspann.me)
    3 points by jspann 4 days ago | 1 comments
27. Mlx-VLM: Fast Local VLMs and Omni Models on Apple Silicon with MLX (github.com)
    2 points by salkahfi 3 days ago | discuss
28. Training VLM for Computer Use (www.tzafon.ai)
    2 points by publius_ 22 days ago | discuss
29. Benchmarking LLMs/VLMs on document parsing, extraction, VQA (nanonets.com)
    1 points by vitaelabitur 19 days ago | discuss
30. Launch HN: Kita (YC W26) – Automate credit review in emerging markets
    55 points by rheamalhotra1 21 days ago | 14 comments