Hackernews posts about gguf

1. Show HN: Run Unsloth Dynamic GGUFs using Docker model runner (github.com)
   3 points by ericcurtin 26 days ago | 1 comments
2. Show HN: GPULlama3.java Llama Compilied to PTX/OpenCL Now Integrated in Quarkus
   24 points by mikepapadim 4 days ago | 6 comments
3. Show HN: Docker Model Runner Integrates vLLM for High-Throughput Inference (github.com)
   7 points by ericcurtin 25 days ago | 1 comments
4. Show HN: G023's OllamaMan – Web-based OS for managing Ollama servers (github.com)
   3 points by g023 1 day ago | discuss
5. Show HN: Small hardware box that runs local LLMs and exposes an OpenAI API (axis-one-psi.vercel.app)
   2 points by mjupp1 27 days ago | discuss
6. Show HN: Guftaguu – Anonymous Chat and Real-Time Games (No Login Required) (guftaguu.vercel.app)
   2 points by SeeYouInHelL 3 days ago | 2 comments
7. Show HN: Guftaguu – Anonymous Chat and Real-Time Games (No Login Required) (guftaguu.vercel.app)
   2 points by SeeYouInHelL 4 days ago | discuss
8. Stroke scientists gather more evidence for presence of 'gut-brain axis' (www.manchester.ac.uk)
   2 points by gnufx 21 days ago | discuss
9. A Modest Proposal (1729) (www.gutenberg.org)
   1 points by guffins 6 days ago | discuss
10. GGUF, the Long Way Around (vickiboykis.com)
    249 points by Tomte almost 2 years ago | 30 comments
11. Ollama and gguf (github.com)
    173 points by indigodaddy 4 months ago | 91 comments
12. Ollama can run any GGUF Model on Hugging Face Hub now (huggingface.co)
    15 points by djhu9 about 1 year ago | 1 comments
13. Run Qwen 2.5 Family and Other LMs in GGUF Format from HF Locally (github.com)
    11 points by unseenmars about 1 year ago | 1 comments
14. Benchmark GGUF model with ONE line of code (github.com)
    6 points by alanzhuly about 1 year ago | 1 comments
15. Unsloth Dynamic GGUFs DeepSeek (671B) outperforms SOTA models (docs.unsloth.ai)
    3 points by frainfreeze 3 months ago | discuss
16. Unsloth Dynamic 2.0 GGUFs (docs.unsloth.ai)
    3 points by serialx 5 months ago | discuss
17. DeepSeek-R1 on iPhone? (DeepSeek-R1-Distill-Qwen-1.5B-GGUF) (huggingface.co)
    3 points by ralphsebastian 11 months ago | discuss
18. Unsloth Dynamic v.20 GGUFs (unsloth.ai)
    2 points by tosh 8 months ago | discuss
19. LostRuins/koboldcpp: Run GGUF models easily with a KoboldAI UI (github.com)
    2 points by palmfacehn 11 months ago | discuss
20. Show HN: SmolChat – Running any GGUF SLMs locally, on-device in Android (github.com)
    2 points by shubham0204 about 1 year ago | discuss
21. HuggingFace adds special support for GGUF (twitter.com)
    2 points by tosh almost 2 years ago | discuss
22. GGUFs quants can punch above their weights now (old.reddit.com)
    2 points by dTal almost 2 years ago | discuss
23. GGUF File Format (github.com)
    2 points by warkanlock almost 2 years ago | discuss
24. LlamaEdge 0.2.9 released. Now works with Hugging Face's 3000 GGUF models (twitter.com)
    1 points by 3Sophons almost 2 years ago | 1 comments
25. Unsloth improvements to gguf tool calling for Qwen3 (huggingface.co)
    1 points by dhorthy 5 months ago | discuss
26. Show HN: Explainer/docs for GGUF quantization (unofficial) (github.com)
    1 points by irt24 5 months ago | discuss
27. Unsloth Dynamic v2.0 GGUFs (unsloth.ai)
    1 points by kevinsimper 8 months ago | discuss
28. Phi-4 GGUF (huggingface.co)
    1 points by tosh about 1 year ago | discuss
29. Benchmark GGUF models with a one line of code (github.com)
    1 points by mountainview about 1 year ago | discuss
30. Benchmark GGUF models with a ONE line of code (github.com)
    1 points by jinqueeny about 1 year ago | discuss
31. Adding Hugging Face GGUF Model to RecurseChat (medium.com)
    1 points by xyc over 1 year ago | discuss
32. GGUF implementation in C as a library and a tools CLI program (github.com)
    1 points by zerojames over 1 year ago | discuss
33. Show HN: I made an app to use local AI as daily driver (recurse.chat)
    637 points by xyc almost 2 years ago | 237 comments
34. Show HN: Cactus – Ollama for Smartphones (github.com)
    231 points by HenryNdubuaku 5 months ago | 82 comments
35. Show HN: Open Codex – OpenAI Codex CLI with open-source LLMs (github.com)
    106 points by codingmoh 8 months ago | 37 comments
36. Show HN: Hyperparam: OSS tools for exploring datasets locally in the browser (hyperparam.app)
    77 points by platypii 8 months ago | 21 comments
37. Show HN: Local LLM Notepad – run a GPT-style model from a USB stick (github.com)
    40 points by davidye324 6 months ago | 9 comments
38. Show HN: Fine-tuned Llama 3.2 3B to match 70B models for local transcripts (bilawal.net)
    31 points by phantompeace 4 months ago | 8 comments
39. Show HN: Bodhi App – Run Open Source/Weights HuggingFace LLMs Locally (github.com)
    21 points by anagri over 1 year ago | 13 comments