Hackernews posts about gguf

1. Show HN: Quant Picker – which GGUF file fits your model and machine (vettedconsumer.com)
   20 points by ermantrout 8 days ago | discuss
2. Choosing a GGUF Model: K-Quants, IQ Variants, and Legacy Formats (kaitchup.substack.com)
   4 points by theanonymousone 1 day ago | discuss
3. GGUF vs. MLX when to choose what when running Local LLMs (muhammadraza.me)
   4 points by mr_o47 17 days ago | discuss
4. Ollama v0.30.0-rc23: "directly support llama.cpp" & "compatibility with GGUF" (github.com)
   3 points by theanonymousone 27 days ago | discuss
5. Model Card: unsloth/GLM-5.2-GGUF (huggingface.co)
   2 points by recroad 4 days ago | discuss
6. GGUF vs. GPTQ vs. AWQ: The Plain-English Guide to LLM Quantization (vettedconsumer.com)
   2 points by ermantrout 11 days ago | discuss
7. GGUF vs. GPTQ vs. AWQ: The Plain-English Guide to LLM Quantization (vettedconsumer.com)
   2 points by ermantrout 15 days ago | discuss
8. Launch HN: General Instinct (YC P26) – Frontier models on edge devices
   63 points by guanming0717 16 days ago | 16 comments
9. Ask HN: What's the best LLM model that on a 24 GB VRAM GPU?
   3 points by max93 10 days ago | 3 comments
10. Show HN: Kintsugi – a local-first safety net for AI agents and humans (github.com)
    1 points by arr0wassass1n 5 days ago | discuss
11. Gemma 4 12B appears in Hugging Face (huggingface.co)
    3 points by theanonymousone 18 days ago | discuss
12. Largest scorpion revealed from 415M-year-old fossils (www.manchester.ac.uk)
    5 points by gnufx 18 days ago | discuss
13. Unsloth Dynamic 2.0 GGUFs (unsloth.ai)
    237 points by tosh 4 months ago | 68 comments
14. What's in a GGUF, besides the weights – and what's still missing? (nobodywho.ooo)
    195 points by bashbjorn about 1 month ago | 58 comments
15. Ollama and gguf (github.com)
    173 points by indigodaddy 10 months ago | 91 comments
16. MDST Engine: run GGUF models in the browser with WebGPU/WASM (mdst.app)
    33 points by vmirnv 4 months ago | 12 comments
17. Ollama can run any GGUF Model on Hugging Face Hub now (huggingface.co)
    15 points by djhu9 over 1 year ago | 1 comments
18. Show HN: Llama.cpp Tutorial 2026: Run GGUF Models Locally on CPU and GPU
    13 points by anju-kushwaha 2 months ago | 4 comments
19. Run Qwen 2.5 Family and Other LMs in GGUF Format from HF Locally (github.com)
    11 points by unseenmars almost 2 years ago | 1 comments
20. Benchmark GGUF model with ONE line of code (github.com)
    6 points by alanzhuly over 1 year ago | 1 comments
21. Qwen3.5 GGUF Benchmarks (unsloth.ai)
    5 points by tosh 4 months ago | discuss
22. How to manipulate running LLM outputs via GGUF page cache poisoning (github.com)
    4 points by piotrbednarsalt 3 months ago | 1 comments
23. Choosing a GGUF Model: K-Quants, IQ Variants, and Legacy Formats (kaitchup.substack.com)
    4 points by theanonymousone 5 months ago | discuss
24. Show HN: Run Unsloth Dynamic GGUFs using Docker model runner (github.com)
    3 points by ericcurtin 7 months ago | 1 comments
25. Tq-KV – Rust implementation of TurboQuant that works on GGUF models
    3 points by onurgokyildiz 3 months ago | discuss
26. Show HN: Host any GGUF model in one command (github.com)
    3 points by gauravvij137 3 months ago | discuss
27. GGML GGUF File Format Vulnerabilities (www.databricks.com)
    3 points by eatonphil 4 months ago | discuss
28. Unsloth Dynamic GGUFs DeepSeek (671B) outperforms SOTA models (docs.unsloth.ai)
    3 points by frainfreeze 9 months ago | discuss
29. Unsloth Dynamic 2.0 GGUFs (docs.unsloth.ai)
    3 points by serialx 11 months ago | discuss
30. DeepSeek-R1 on iPhone? (DeepSeek-R1-Distill-Qwen-1.5B-GGUF) (huggingface.co)
    3 points by ralphsebastian over 1 year ago | discuss
31. Show HN: Shimmytok – Pure Rust GGUF tokenizer (no C++, no extra files) (github.com)
    2 points by MKuykendall 5 months ago | 2 comments
32. Why MLX Quantized Models Underperform Unsloth GGUF (twitter.com)
    2 points by tosh 3 months ago | discuss
33. Unsloth Dynamic v.20 GGUFs (unsloth.ai)
    2 points by tosh about 1 year ago | discuss
34. LostRuins/koboldcpp: Run GGUF models easily with a KoboldAI UI (github.com)
    2 points by palmfacehn over 1 year ago | discuss
35. Show HN: SmolChat – Running any GGUF SLMs locally, on-device in Android (github.com)
    2 points by shubham0204 over 1 year ago | discuss
36. A guide to model quantization in fine-tuning (and how to pick the right GGUF) (www.siquick.com)
    1 points by siquick 2 months ago | discuss
37. Gemma 4 31B GGUF quants ranked by KL divergence (localbench.substack.com)
    1 points by blacktulip 3 months ago | discuss
38. Show HN: WayInfer – Native GGUF engine that runs models larger than your RAM
    1 points by ahmedm24 3 months ago | discuss
39. Qwen3.5-35B-A3B-GGUF from Unsloth (huggingface.co)
    1 points by vincirufus 4 months ago | discuss
40. Unsloth improvements to gguf tool calling for Qwen3 (huggingface.co)
    1 points by dhorthy 11 months ago | discuss
41. Show HN: Explainer/docs for GGUF quantization (unofficial) (github.com)
    1 points by irt24 11 months ago | discuss
42. Unsloth Dynamic v2.0 GGUFs (unsloth.ai)
    1 points by kevinsimper about 1 year ago | discuss