Hackernews posts about VLLM

1. Inside vLLM: Anatomy of a High-Throughput LLM Inference System (2025) (www.aleksagordic.com)
   151 points by sebg 14 days ago | 10 comments
2. Kimi K3 on vLLM: Up to 370 Tokens/sec (vllm.ai)
   7 points by wskwon 25 days ago | discuss
3. A production-grade OCR pipeline on Kubernetes with vLLM and Rust (github.com)
   7 points by mtrofficus 28 days ago | discuss
4. Show HN: Kvcachescope – Why Nvidia-smi is blind to vLLM KV cache leaks (github.com)
   4 points by nesh23 6 days ago | discuss
5. vLLM Recipes (recipes.vllm.ai)
   4 points by kristianpaul 17 days ago | discuss
6. Show HN: Proxima serves 4x more requests with no hardware change on vLLM (github.com)
   3 points by pythongiant 10 days ago | 1 comments
7. vLLM Running Natively on Windows with ROCm for AMD RDNA2 (RX 6000) (github.com)
   2 points by esseba-dev about 11 hours ago | discuss
8. Native vLLM and ROCm 7.15 for RX 6000 (RDNA2) on Windows 11 – 26 Tflops FP16 (github.com)
   2 points by esseba-dev 3 days ago | discuss
9. C++ Version of vLLM (github.com)
   2 points by jacquesm 14 days ago | discuss
10. Inferact vLLM creators are hiring (twitter.com)
    1 points by aaqaishtyaq 10 days ago | discuss
11. vLLM Serving Experiments on H100s – config beats the baseline on p95 TTFT,ITL (efficientagent.substack.com)
    1 points by bnayak25 11 days ago | discuss
12. LettuceDetect v2 in Semantic Router: Gen. Hallucination Detection vLLM Endpoint (vllm-sr.ai)
    1 points by matt_d 14 days ago | discuss
13. Show HN: Cactus Hybrid: We taught Gemma 4 to know when it's wrong (github.com)
    191 points by HenryNdubuaku 29 days ago | 44 comments
14. Show HN: Cuts Long Horizon Inference Costs by 50% via external KV Cache Offload (github.com)
    22 points by arnav__1 26 days ago | discuss
15. Show HN: ExANS – Lossless KV cache compression at 622 GB/s on H100 (www.theopenlake.com)
    15 points by arnav__1 15 days ago | discuss
16. Show HN: NanoRL – RL training for LLMs in ~1,800 lines (github.com)
    11 points by alex000kim 8 days ago | discuss
17. Ask HN: Are there any production LLM pipeline setups to learn from?
    6 points by atif089 9 days ago | discuss
18. Show HN: Jixp, a Lisp DSL for describing Jax neural nets (github.com)
    6 points by baileywickham 28 days ago | discuss
19. New OllamaMQ v0.3.0
    5 points by chleba 2 days ago | discuss
20. Show HN: Gainz.fast – Local Inference, Faster (gainz.fast)
    1 points by carsenk 17 days ago | discuss
21. The Inference Engine Guide for K3 Deployment (twitter.com)
    2 points by gmays 16 days ago | 1 comments
22. Show HN: I put a $2.43 necklace on 3 outfits. VLMs priced it at $19 to $104 (github.com)
    18 points by BrianneLee011 24 days ago | 24 comments
23. Search over the Visual World: off-the-shelf VLMs beat video embeddings (arxiv.org)
    6 points by ashu_trv 9 days ago | 2 comments
24. Show HN: ThinkingType, an eval measuring if fonts change VLM judgments (github.com)
    3 points by bwuckner-sf 9 days ago | 1 comments
25. Fluent – Voice computer use agent for Windows (VLM and accessibility tree) (fluentforall.com)
    2 points by jasonmatthews 21 days ago | 1 comments
26. Ask HN: How do you develop more deterministic LLM pipelines?
    3 points by sky2224 7 days ago | discuss
27. Testing Gemini 3.5 Flash Lite for human detection in home surveillance (romanuk.org)
    8 points by mromanuk 28 days ago | 3 comments
28. Run GLM-OCR, DeepSeek-OCR-2, Dots.mocr with an OpenAI Compatible API (www.vlm.run)
    6 points by fzysingularity 1 day ago | 1 comments
29. The Best Way to Make Your (Small) Vision Language Model Smarter (loganbolton.github.io)
    2 points by septisum 3 days ago | discuss
30. Show HN: I redesigned my self-hosted data manager's UI (4k stars, v2 (github.com)
    2 points by volmarg_reiso 17 days ago | discuss