Hackernews posts about VLLM

1. 67% Cost Savings with PD Disaggregation Using Ray and vLLM on AMD MI325X (www.anyscale.com)
   4 points by robertnishihara 21 days ago | discuss
2. Breaking the Ice: Analyzing Cold Start Latency in vLLM (arxiv.org)
   4 points by matt_d 26 days ago | discuss
3. vLLM Recipes (recipes.vllm.ai)
   3 points by kristianpaul 13 days ago | discuss
4. petite-vllm Part 2: KV Cache & Paged Attention (kristenmcintosh.dev)
   3 points by matt_d 17 days ago | discuss
5. Profile(v2.1.4) physics-aware optimizer for vLLM (31→470 tok/s on A100) (github.com)
   3 points by jungledesh 18 days ago | discuss
6. AKM-CLR – pre-inference governance for vLLM-style LLM serving (github.com)
   2 points by akili2805 1 day ago | discuss
7. AMD contributes their GPU support to tiny-vLLM (github.com)
   2 points by yu3zhou4 7 days ago | discuss
8. Sors: a Rust proxy that reorders prompts to maximize vLLM prefix cache hits (github.com)
   2 points by flaccount 20 days ago | discuss
9. Monitoring LLM Inference with Prometheus and Grafana (vLLM, TGI, Llama.cpp) (www.glukhov.org)
   2 points by nryoo 22 days ago | discuss
10. Automatic Prefix Caching – vLLM (docs.vllm.ai)
    1 points by ankitg12 4 days ago | discuss
11. ImpactArbiter – A PyTorch autograd trap for LLM-generated vLLM/SGLang invariants (github.com)
    1 points by maniksundar 24 days ago | discuss
12. Launch HN: Parsewise (YC P25) – Reason Across Documents with an API
    56 points by gergelycsegzi 5 days ago | 54 comments
13. Show HN: Morph Reflexes – Multi-head classifiers for agent traces
    20 points by bhaktatejas922 6 days ago | 2 comments
14. Show HN: ParseHawk – 100% Local Document AI with API, CLI, and Web UI (github.com)
    8 points by francisrafal 12 days ago | 4 comments
15. Story of How Im Running an Unlimited $6/Month AI Provider on 4x RTX 3090s
    8 points by yolo-auto 23 days ago | 3 comments
16. How to become an AI infrastructure engineer?
    2 points by akrisanov 16 days ago | 1 comments
17. AMD Strix Halo RDMA Cluster Setup Guide (github.com)
    232 points by jakogut 9 days ago | 87 comments
18. Micro-Agent: Beat Frontier Models with Collaboration Inside Model API (vllm.ai)
    81 points by matt_d 7 days ago | 22 comments
19. High Performance Distributed Inference with Ray Serve LLM (www.anyscale.com)
    3 points by robertnishihara 18 days ago | discuss
20. OCR'ing 100k pages with open-source VLMs on Modal (www.redspring.xyz)
    9 points by patrickdevivo 11 days ago | discuss
21. Show HN: Valmis, an OpenClaw alternative built for work, with security in mind (github.com)
    3 points by wayneshng 6 days ago | discuss
22. Show HN: VLMs Can Respond Twice as Fast Without Losing Quality (github.com)
    2 points by trykhlieb 16 days ago | 2 comments
23. How to evaluate multimodal VLMs for your video use case (labs.videodb.io)
    1 points by notTechy 10 days ago | discuss
24. VLMs cannot automate construction takeoff. The data is not in the drawings (andrewngo.dev)
    1 points by andrewngo 17 days ago | discuss
25. Show HN: I built an open-source alternative to Claude Cowork (github.com)
    39 points by wayneshng 5 days ago | 8 comments
26. Show HN: Visual Agents with Code Mode (www.vlm.run)
    8 points by visioninmyblood 19 days ago | 1 comments
27. Show HN: VQAScore – open eval metric/reward model, now for text-to-video (github.com)
    1 points by linzhiqiu 27 days ago | discuss
28. SpaceX: The First $100T Company? (twitter.com)
    3 points by skenderbeg 26 days ago | discuss
29. Statement regarding recent discussions on Donut Battery (www.donutlab.com)
    3 points by velmu 26 days ago | 3 comments
30. What's Next for Fresh? (github.com)
    3 points by velmu 28 days ago | discuss