Hackernews posts about gguf

1. Choosing a GGUF Model: K-Quants, IQ Variants, and Legacy Formats (kaitchup.substack.com)
   4 points by theanonymousone 24 days ago | discuss
2. Show HN: Shimmytok – Pure Rust GGUF tokenizer (no C++, no extra files) (github.com)
   2 points by MKuykendall 21 days ago | 2 comments
3. I scanned 2,500 Hugging Face models for malware/issues. Here is the data (github.com)
   23 points by arseniibr 13 days ago | 19 comments
4. Show HN: Blink-Edit – Cursor-style next-edit predictions for Neovim (local LLMs) (github.com)
   6 points by atemyipod 8 days ago | discuss
5. Show HN: Revibing nanochat's inference model in C++ with ggml (github.com)
   5 points by makechan 24 days ago | discuss
6. Show HN: Python SDK for RamaLama AI Containers (github.com)
   1 points by ersatz_username 8 days ago | discuss
7. Show HN: Structured data extraction using local quantized LLMs (github.com)
   1 points by nxank4 10 days ago | discuss
8. Stop trusting torch.load() – I built a tool to scan AI models for RCE (github.com)
   1 points by arseniibr 20 days ago | discuss
9. Hermit-AI – An offline, privacy-first RAG chatbot for ZIM files
   1 points by ImDelivered 25 days ago | discuss
10. The proposed design of the digital euro: A critical analysis (link.springer.com)
    4 points by gnufx 21 days ago | discuss
11. 443M-year-old fossils reveal early vertebrate eyes (www.manchester.ac.uk)
    2 points by gnufx 7 days ago | discuss
12. Umping giants: Fossils show giant prehistoric kangaroos could still hop (www.manchester.ac.uk)
    2 points by gnufx 11 days ago | discuss
13. Show HN: Coreview – PR Changes Walkthroughs
    1 points by ggurgone 5 days ago | discuss
14. Show HN: A Docker Sandbox alternative for local AI Agents (www.npmjs.com)
    1 points by ggurgone 14 days ago | discuss
15. GGUF, the Long Way Around (vickiboykis.com)
    249 points by Tomte almost 2 years ago | 30 comments
16. Ollama and gguf (github.com)
    173 points by indigodaddy 6 months ago | 91 comments
17. Ollama can run any GGUF Model on Hugging Face Hub now (huggingface.co)
    15 points by djhu9 over 1 year ago | 1 comments
18. Run Qwen 2.5 Family and Other LMs in GGUF Format from HF Locally (github.com)
    11 points by unseenmars over 1 year ago | 1 comments
19. Benchmark GGUF model with ONE line of code (github.com)
    6 points by alanzhuly over 1 year ago | 1 comments
20. Show HN: Run Unsloth Dynamic GGUFs using Docker model runner (github.com)
    3 points by ericcurtin 3 months ago | 1 comments
21. Unsloth Dynamic GGUFs DeepSeek (671B) outperforms SOTA models (docs.unsloth.ai)
    3 points by frainfreeze 5 months ago | discuss
22. Unsloth Dynamic 2.0 GGUFs (docs.unsloth.ai)
    3 points by serialx 6 months ago | discuss
23. DeepSeek-R1 on iPhone? (DeepSeek-R1-Distill-Qwen-1.5B-GGUF) (huggingface.co)
    3 points by ralphsebastian about 1 year ago | discuss
24. Unsloth Dynamic v.20 GGUFs (unsloth.ai)
    2 points by tosh 9 months ago | discuss
25. LostRuins/koboldcpp: Run GGUF models easily with a KoboldAI UI (github.com)
    2 points by palmfacehn about 1 year ago | discuss
26. Show HN: SmolChat – Running any GGUF SLMs locally, on-device in Android (github.com)
    2 points by shubham0204 about 1 year ago | discuss
27. HuggingFace adds special support for GGUF (twitter.com)
    2 points by tosh almost 2 years ago | discuss
28. Unsloth improvements to gguf tool calling for Qwen3 (huggingface.co)
    1 points by dhorthy 6 months ago | discuss
29. Show HN: Explainer/docs for GGUF quantization (unofficial) (github.com)
    1 points by irt24 7 months ago | discuss
30. Unsloth Dynamic v2.0 GGUFs (unsloth.ai)
    1 points by kevinsimper 9 months ago | discuss
31. Phi-4 GGUF (huggingface.co)
    1 points by tosh about 1 year ago | discuss
32. Benchmark GGUF models with a one line of code (github.com)
    1 points by mountainview over 1 year ago | discuss
33. Benchmark GGUF models with a ONE line of code (github.com)
    1 points by jinqueeny over 1 year ago | discuss
34. Adding Hugging Face GGUF Model to RecurseChat (medium.com)
    1 points by xyc over 1 year ago | discuss
35. GGUF implementation in C as a library and a tools CLI program (github.com)
    1 points by zerojames over 1 year ago | discuss
36. Show HN: I made an app to use local AI as daily driver (recurse.chat)
    637 points by xyc almost 2 years ago | 237 comments
37. Show HN: Cactus – Ollama for Smartphones (github.com)
    231 points by HenryNdubuaku 7 months ago | 82 comments
38. Show HN: Open Codex – OpenAI Codex CLI with open-source LLMs (github.com)
    106 points by codingmoh 10 months ago | 37 comments
39. Show HN: Hyperparam: OSS tools for exploring datasets locally in the browser (hyperparam.app)
    77 points by platypii 9 months ago | 21 comments
40. Show HN: Local LLM Notepad – run a GPT-style model from a USB stick (github.com)
    40 points by davidye324 7 months ago | 9 comments
41. Show HN: Gene – a Lisp-like language built around a generic "Gene" data type (github.com)
    36 points by gcao about 1 month ago | discuss
42. Show HN: Fine-tuned Llama 3.2 3B to match 70B models for local transcripts (bilawal.net)
    31 points by phantompeace 5 months ago | 8 comments
43. Show HN: GPULlama3.java Llama Compilied to PTX/OpenCL Now Integrated in Quarkus
    24 points by mikepapadim about 2 months ago | 6 comments
44. Show HN: Bodhi App – Run Open Source/Weights HuggingFace LLMs Locally (github.com)
    21 points by anagri over 1 year ago | 13 comments