Hackernews posts about VLLM

Nano-vLLM: How a vLLM-style inference engine works (neutree.ai)

271 points by yz-yu 19 days ago | 28 comments
Inferact: A New Company from the Creators of vLLM ($150M Seed) (inferact.ai)

4 points by shenli3514 30 days ago | discuss
New inference engine faster than vLLM, SGLang, TRT-LLM (layerscale.ai)

2 points by logotype 2 days ago | 3 comments
Vulnerabilities in 45 Open Source Projects (vLLM, Langfuse, Phase, NocoDB) (www.kolega.dev)

2 points by jfaganel99 10 days ago | 2 comments
Inference startup Inferact lands $150M to commercialize vLLM (techcrunch.com)

2 points by mellosouls 28 days ago | 1 comments
Ollama vs. vLLM: When to Start Scaling Your Local AI Stack (www.sitepoint.com)

2 points by mrnobody_67 3 days ago | discuss
Why vLLM Scales: Paging the KV-Cache for Faster LLM Inference (akrisanov.com)

2 points by akrisanov 25 days ago | discuss
Inside vLLM: Anatomy of a High-Throughput LLM Inference System (www.aleksagordic.com)

1 points by mellosouls 28 days ago | 1 comments
How a vLLM-style inference engine works: The model part (neutree.ai)

1 points by yz-yu 15 days ago | discuss
Using Nsight Compute to profile kernels in vLLM without creating repro scripts (blog.ncompass.tech)

1 points by adiraja 18 days ago | discuss
vLLM multi-turn conversations design (github.com)

1 points by CCs 30 days ago | discuss
Ask HN: What's the current best local/open speech-to-speech setup?

265 points by dsrtslnd23 29 days ago | 71 comments
Show HN: Fine-tuned Qwen2.5-7B on 100 films for probabilistic story graphs (cinegraphs.ai)

101 points by graphpilled 13 days ago | 20 comments
Show HN: Blink-Edit – Cursor-style next-edit predictions for Neovim (local LLMs) (github.com)

6 points by atemyipod 25 days ago | discuss
Show HN: NSED is public – Mixture-of-Models to Hit SOTA using self-hosted AI (github.com)

3 points by t_peersky 2 days ago | discuss
Is there a platform for devs to share repositories in hopes of OSS contributors?

2 points by anshyyy 20 days ago | 1 comments
Show HN: Deploy HuggingFace models to Spaces with one command (pypi.org)

2 points by Facingsouth 2 days ago | discuss
Show HN: We let GPT OSS 120B write and run Python and ARC AGI 2 jumped 4x (github.com)

2 points by steinsgate 10 days ago | discuss
Show HN: A Kubernetes Operator to Validate Jupyter Notebooks in MLOps (github.com)

2 points by takinosh 14 days ago | discuss
Show HN: CoolWulf AI – A personal AI assistant built in Go, optimized for macOS (coolwulfai.com)

1 points by coolwulf 4 days ago | 1 comments
Show HN: I built a CLI to arbitrage GPU prices across 10 clouds (pypi.org)

1 points by Facingsouth 4 days ago | discuss
Show HN: LLM-schema-guard – Rust proxy enforcing JSON schemas on LLM outputs (github.com)

1 points by iCeGaming 25 days ago | discuss
Show HN: Python SDK for RamaLama AI Containers (github.com)

1 points by ersatz_username 26 days ago | discuss
Constant 14ms attention: 512→524K tokens (24.5x faster than FlashAttention) (github.com)

1 points by luxiedge 16 days ago | 1 comments
GPT-OSS-20B-Vision: First Community VLM for GPT-OSS, Trained on a DGX Spark (huggingface.co)

4 points by vkaufmann 1 day ago | 1 comments
Show HN: I built Aegis AI – An Agentic Home Security w/ GPT+Local VLM on Mac/PC (www.sharpai.org)

1 points by simbaz 1 day ago | 1 comments
Show HN: Ask your LLM traces what went wrong (vLLora) (vllora.dev)

1 points by mrun1729 25 days ago | 1 comments
Show HN: VLM Inference Engine in Rust (mixpeek.com)

1 points by Beefin 26 days ago | 1 comments
Show HN: A/B test your own VLMs for document parsing (Self-hosted Arena) (github.com)

1 points by matthew624 1 day ago | discuss
Running local LLMs and VLMs on the Arduino UNO Q with yzma (projecthub.arduino.cc)

1 points by deadprogram 2 days ago | discuss