Hackernews posts about MMLU

1. Show HN: Arch-Router – Aligning LLM Routing with Human Preferences (arxiv.org)
   1 points by honorable_coder 16 days ago | discuss
2. Marshall McLuhan Was Right (slate.com)
   5 points by laurex 14 days ago | discuss
3. Show HN: Bring Your Video to Life with MMAudio AI (mmaudio.app)
   2 points by kangfeibo 9 days ago | discuss
4. Actions/runner: safe_sleep.sh rarely hangs indefinitely (github.com)
   5 points by mlugg 2 days ago | discuss
5. UptimeEye – Flow monitoring instead of API monitoring (uptimeeye.com)
   2 points by mmueller_io 7 days ago | 1 comments
6. Pushing Boundaries with Claude Code (www.wordfence.com)
   2 points by mmaunder 11 days ago | discuss
7. XMLUI (blog.jonudell.net)
   620 points by mpweiher 29 days ago | 333 comments
8. SHOW HN:A New 34B Open Source LLM, Astonishing 78 Score in MMLU (GPT-4 MMLU:83) (github.com)
   21 points by liuxiaopai over 1 year ago | 5 comments
9. New medical LLM beats Med-PaLM-2, GPT-4 on MMLU benchmarks (huggingface.co)
   16 points by samjulien about 1 year ago | 2 comments
10. SmartGPT: Major Benchmark Broken – 89.0% on MMLU and Exam Errors [video] (www.youtube.com)
    4 points by pps almost 2 years ago | 5 comments
11. Errors in the MMLU: The Deep Learning Benchmark Is Wrong Surprisingly Often (derenrich.medium.com)
    3 points by kristianp almost 2 years ago | discuss
12. Death of MMLU? Revealing the Sensitivity and Instability of LLM Leaderboards (arxiv.org)
    2 points by hishamyahya over 1 year ago | 1 comments
13. Show HN: Run MMLU benchmark on any LLM endpoint (mmlu.borgcloud.ai)
    2 points by lostmsu 4 months ago | discuss
14. LLM Comparison/Test: 25 SOTA LLMs (Including QwQ) Through 59 MMLU-Pro CS Runs (huggingface.co)
    2 points by ororm 9 months ago | discuss
15. Multilingual MMLU Dataset from OpenAI (OpenAI/Mmmlu) (huggingface.co)
    2 points by ekojs 11 months ago | discuss
16. New Phi-3 Models (3B, 7B,14B), including 128k vision with impressive MMLU scores (twitter.com)
    2 points by brianjking about 1 year ago | discuss
17. Tiny tweaks to tests like MMLU can shuffle model rankings (twitter.com)
    2 points by tosh over 1 year ago | discuss
18. Yi-34B, 76.3 on MMLU, Apache 2.0 (huggingface.co)
    2 points by Leary almost 2 years ago | discuss
19. Errors in the MMLU: The Deep Learning Benchmark Is Wrong Surprisingly Often (derenrich.medium.com)
    2 points by brokensegue almost 2 years ago | discuss
20. MMLU-Pro: Advanced edition of MMLU & new Leaderboard (huggingface.co)
    1 points by nopinsight over 1 year ago | 1 comments
21. Gemini Benchmark – MMLU (compared with GPT-4-turbo, Mixtral) (hub.zenoml.com)
    1 points by zurfer over 1 year ago | 1 comments
22. iAsk Pro LLM achieves 93.89% on MMLU, beats GPT-4o and Claude 3.5 Sonnet (iask.ai)
    1 points by fariszr 12 months ago | discuss
23. MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Bench (huggingface.co)
    1 points by Morinee about 1 year ago | discuss
24. Multitask Language Understanding (MMLU) on Helm (crfm.stanford.edu)
    1 points by tosh over 1 year ago | discuss
25. OLMo 1.7–7B: A 24 point improvement on MMLU (blog.allenai.org)
    1 points by tosh over 1 year ago | discuss
26. MMLU Benchmark Broken (www.youtube.com)
    1 points by explosion-s almost 2 years ago | discuss
27. Show HN: AutoThink – Boosts local LLM performance with adaptive reasoning
    397 points by codelion 3 months ago | 68 comments
28. Show HN: Arch-Router – 1.5B model for LLM routing by preferences, not benchmarks
    66 points by adilhafeez about 2 months ago | 15 comments
29. Show HN: BenchFlow – run AI benchmarks as an API (github.com)
    24 points by xdotli 5 months ago | 1 comments
30. Show HN: QwQ-32B APIs – o1 like reasoning at 1% the cost
    17 points by ozgune 7 months ago | 3 comments
31. Show HN: Open-source study to measure end user satisfaction levels with LLMs (open-llm-initiative.com)
    12 points by sparacha 12 months ago | 2 comments
32. Show HN: I built the LLM Comparison Tool I wish existed (llm-stats.com)
    7 points by JonathanChavez 8 months ago | 3 comments
33. Show HN: 1.5B LLM routing model that aligns to preferences, not leaderboards (huggingface.co)
    4 points by honorable_coder about 1 month ago | discuss
34. Show HN: MALLM – A Multi-Agent Framework for Task Solving (github.com)
    4 points by jpwahle about 2 months ago | discuss
35. Show HN: LLM Benchmarking Suite (github.com)
    2 points by Dhyaneesh 5 months ago | discuss
36. Show HN: OptiLLMBench – Test how inference optimization tricks scale up LLMs
    2 points by codelion 6 months ago | discuss
37. Ask HN: Are LLMs getting better, how can you tell?
    1 points by ahamilton454 7 months ago | 1 comments