Hackernews posts about gguf

1. Unsloth Dynamic 2.0 GGUFs (unsloth.ai)
   237 points by tosh 21 days ago | 68 comments
2. Qwen3.5 GGUF Benchmarks (unsloth.ai)
   5 points by tosh 21 days ago | discuss
3. How to manipulate running LLM outputs via GGUF page cache poisoning (github.com)
   4 points by piotrbednarsalt 12 days ago | 1 comments
4. Qwen3.5-35B-A3B-GGUF from Unsloth (huggingface.co)
   1 points by vincirufus 20 days ago | discuss
5. Show HN: Duplicate 3 layers in a 24B LLM, logical deduction .22→.76. No training (github.com)
   252 points by xlayn 2 days ago | 82 comments
6. Show HN: ZSE – Open-source LLM inference engine with 3.9s cold starts (github.com)
   58 points by zyoralabs 23 days ago | 9 comments
7. Show HN: Off Grid: On-device AI-web browsing, tools vision,image,voice–3x faster
   12 points by ali_chherawalla 24 days ago | 5 comments
8. Show HN: Unsloth Studio - Local Fine-tuning, Chat UI (github.com)
   8 points by danielhanchen 4 days ago | 2 comments
9. Show HN: Xybrid – run LLM and speech locally in your app (no back end, Rust) (github.com)
   6 points by theGlenn 3 days ago | 2 comments
10. Show HN: A single CLI to manage llama.cpp/vLLM/Ollama models (github.com)
    2 points by everlier 7 days ago | 1 comments
11. Show HN: HF-agents, CLI extension to find the best model/quant for your hardware (github.com)
    2 points by clmnt 2 days ago | discuss
12. Sumi – Open-source voice-to-text with local AI polishing
    2 points by alkd 12 days ago | discuss
13. Show HN: I wrote an LLM inference engine in pure Go – 48 tok/s zero dependencies (github.com)
    2 points by computerex 14 days ago | discuss
14. A small tool I made for local LLMs: LLM-neofetch-plus
    1 points by HFerrahoglu 24 days ago | 2 comments
15. Off Grid: On-device AI-web browsing, tools, vision, image gen, voice – 3x faster
    1 points by ali_chherawalla 24 days ago | 1 comments
16. Show HN: Qwodel – An open-source unified pipeline for LLM quantization
    1 points by kinderasteroid 9 days ago | discuss
17. Show HN: Go LLM inference with a Vulkan GPU back end that beats Ollama's CUDA (github.com)
    1 points by computerex 13 days ago | discuss
18. Show HN: Courtyard – Open-source macOS app for local MLX fine-tuning Text (github.com)
    1 points by tuwenbo0120 24 days ago | discuss
19. Show HN: We Gave an LLM Adventure Engine a Body, Now It Feels Exhausted (mycelialmirror.medium.com)
    1 points by oopismcgoopis 24 days ago | discuss
20. Show HN: Ledgr – Offline finance tracker with local LLM categorization
    1 points by humanji 28 days ago | discuss
21. Ollama and gguf (github.com)
    173 points by indigodaddy 7 months ago | 91 comments
22. MDST Engine: run GGUF models in the browser with WebGPU/WASM (mdst.app)
    33 points by vmirnv about 1 month ago | 12 comments
23. Ollama can run any GGUF Model on Hugging Face Hub now (huggingface.co)
    15 points by djhu9 over 1 year ago | 1 comments
24. Run Qwen 2.5 Family and Other LMs in GGUF Format from HF Locally (github.com)
    11 points by unseenmars over 1 year ago | 1 comments
25. Benchmark GGUF model with ONE line of code (github.com)
    6 points by alanzhuly over 1 year ago | 1 comments
26. Choosing a GGUF Model: K-Quants, IQ Variants, and Legacy Formats (kaitchup.substack.com)
    4 points by theanonymousone 2 months ago | discuss
27. Show HN: Run Unsloth Dynamic GGUFs using Docker model runner (github.com)
    3 points by ericcurtin 4 months ago | 1 comments
28. GGML GGUF File Format Vulnerabilities (www.databricks.com)
    3 points by eatonphil about 1 month ago | discuss
29. Unsloth Dynamic GGUFs DeepSeek (671B) outperforms SOTA models (docs.unsloth.ai)
    3 points by frainfreeze 6 months ago | discuss
30. Unsloth Dynamic 2.0 GGUFs (docs.unsloth.ai)
    3 points by serialx 8 months ago | discuss
31. DeepSeek-R1 on iPhone? (DeepSeek-R1-Distill-Qwen-1.5B-GGUF) (huggingface.co)
    3 points by ralphsebastian about 1 year ago | discuss
32. Show HN: Shimmytok – Pure Rust GGUF tokenizer (no C++, no extra files) (github.com)
    2 points by MKuykendall 2 months ago | 2 comments
33. Unsloth Dynamic v.20 GGUFs (unsloth.ai)
    2 points by tosh 11 months ago | discuss
34. LostRuins/koboldcpp: Run GGUF models easily with a KoboldAI UI (github.com)
    2 points by palmfacehn about 1 year ago | discuss
35. Show HN: SmolChat – Running any GGUF SLMs locally, on-device in Android (github.com)
    2 points by shubham0204 over 1 year ago | discuss
36. Unsloth improvements to gguf tool calling for Qwen3 (huggingface.co)
    1 points by dhorthy 8 months ago | discuss
37. Show HN: Explainer/docs for GGUF quantization (unofficial) (github.com)
    1 points by irt24 8 months ago | discuss
38. Unsloth Dynamic v2.0 GGUFs (unsloth.ai)
    1 points by kevinsimper 11 months ago | discuss
39. Phi-4 GGUF (huggingface.co)
    1 points by tosh over 1 year ago | discuss
40. Benchmark GGUF models with a one line of code (github.com)
    1 points by mountainview over 1 year ago | discuss
41. Benchmark GGUF models with a ONE line of code (github.com)
    1 points by jinqueeny over 1 year ago | discuss
42. Adding Hugging Face GGUF Model to RecurseChat (medium.com)
    1 points by xyc almost 2 years ago | discuss
43. GGUF implementation in C as a library and a tools CLI program (github.com)
    1 points by zerojames almost 2 years ago | discuss
44. Show HN: Cactus – Ollama for Smartphones (github.com)
    231 points by HenryNdubuaku 8 months ago | 82 comments
45. Show HN: Moltis – AI assistant with memory, tools, and self-extending skills (www.moltis.org)
    131 points by fabienpenso about 1 month ago | 52 comments
46. Show HN: Off Grid – Run AI text, image gen, vision offline on your phone (github.com)
    124 points by ali_chherawalla about 1 month ago | 66 comments
47. Show HN: Open Codex – OpenAI Codex CLI with open-source LLMs (github.com)
    106 points by codingmoh 11 months ago | 37 comments
48. Show HN: Hyperparam: OSS tools for exploring datasets locally in the browser (hyperparam.app)
    77 points by platypii 11 months ago | 21 comments
49. Show HN: Local LLM Notepad – run a GPT-style model from a USB stick (github.com)
    40 points by davidye324 9 months ago | 9 comments
50. Show HN: Gene – a Lisp-like language built around a generic "Gene" data type (github.com)
    36 points by gcao 3 months ago | discuss