Hackernews posts about MMLU

1. Ask HN: AI innovation outside big tech is over. Debate me
   4 points by carlosfm 16 days ago | 7 comments
2. Perceptually lossless (talking head) video compression at 22kbit/s (mlumiste.com)
   225 points by skandium 16 days ago | 140 comments
3. Amphion: An open-source audio, music, and speech generation toolkit (github.com)
   92 points by lapnect 27 days ago | 2 comments
4. Flux server and web-front end (github.com)
   1 points by orbiterlab 16 days ago | discuss
5. Keeping Users Happy When LLMs Suck – Slides from Arize Observe (docs.google.com)
   1 points by mmoustafa 2 days ago | discuss
6. SHOW HN:A New 34B Open Source LLM, Astonishing 78 Score in MMLU (GPT-4 MMLU:83) (github.com)
   21 points by liuxiaopai about 1 year ago | 5 comments
7. New medical LLM beats Med-PaLM-2, GPT-4 on MMLU benchmarks (huggingface.co)
   16 points by samjulien 4 months ago | 2 comments
8. RedPajama-Incite-7B-Instruct Outperforms LLaMA on MMLU (twitter.com)
   9 points by vipulved over 1 year ago | 1 comments
9. SmartGPT: Major Benchmark Broken – 89.0% on MMLU and Exam Errors [video] (www.youtube.com)
   4 points by pps about 1 year ago | 5 comments
10. Errors in the MMLU: The Deep Learning Benchmark Is Wrong Surprisingly Often (derenrich.medium.com)
    3 points by kristianp about 1 year ago | discuss
11. Death of MMLU? Revealing the Sensitivity and Instability of LLM Leaderboards (arxiv.org)
    2 points by hishamyahya 10 months ago | 1 comments
12. Multilingual MMLU Dataset from OpenAI (OpenAI/Mmmlu) (huggingface.co)
    2 points by ekojs 2 months ago | discuss
13. New Phi-3 Models (3B, 7B,14B), including 128k vision with impressive MMLU scores (twitter.com)
    2 points by brianjking 6 months ago | discuss
14. Tiny tweaks to tests like MMLU can shuffle model rankings (twitter.com)
    2 points by tosh 10 months ago | discuss
15. Yi-34B, 76.3 on MMLU, Apache 2.0 (huggingface.co)
    2 points by Leary about 1 year ago | discuss
16. Errors in the MMLU: The Deep Learning Benchmark Is Wrong Surprisingly Often (derenrich.medium.com)
    2 points by brokensegue over 1 year ago | discuss
17. MMLU Benchmark (Multi-Task Language Understanding) (paperswithcode.com)
    2 points by ZeljkoS over 1 year ago | discuss
18. MMLU-Pro: Advanced edition of MMLU & new Leaderboard (huggingface.co)
    1 points by nopinsight 6 months ago | 1 comments
19. Gemini Benchmark – MMLU (compared with GPT-4-turbo, Mixtral) (hub.zenoml.com)
    1 points by zurfer 10 months ago | 1 comments
20. iAsk Pro LLM achieves 93.89% on MMLU, beats GPT-4o and Claude 3.5 Sonnet (iask.ai)
    1 points by fariszr 3 months ago | discuss
21. MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Bench (huggingface.co)
    1 points by Morinee 6 months ago | discuss
22. Multitask Language Understanding (MMLU) on Helm (crfm.stanford.edu)
    1 points by tosh 7 months ago | discuss
23. OLMo 1.7–7B: A 24 point improvement on MMLU (blog.allenai.org)
    1 points by tosh 7 months ago | discuss
24. MMLU Benchmark Broken (www.youtube.com)
    1 points by explosion-s about 1 year ago | discuss
25. Show HN: Open-source study to measure end user satisfaction levels with LLMs (open-llm-initiative.com)
    12 points by sparacha 3 months ago | 2 comments
26. The most widely used benchmarks for evaluating LLMs
    1 points by kavaivaleri 7 months ago | 1 comments
27. Are new LLM models trained on old benchmarks?
    1 points by rand0mwalk 5 months ago | discuss
28. Evaluation Platform for LLMs
    1 points by Dheemanthreddy 9 months ago | discuss
29. What's Going on with the Open LLM Leaderboard? (huggingface.co)
    40 points by tim_sw over 1 year ago | 2 comments
30. Overview of All Major LLM Benchmarks (www.confident-ai.com)
    1 points by 3d27 8 months ago | discuss
31. 789 KB Linux Without MMU on RISC-V (popovicu.com)
    166 points by yarapavan about 1 year ago | 34 comments
32. Marshall McLuhan on surveillance and identity in the electric age (1977) [video] (twitter.com)
    108 points by llimos almost 2 years ago | 32 comments
33. Marshall McLuhan explains the future of ads and the internet in 1966 (paleofuture.com)
    41 points by 082349872349872 almost 2 years ago | 16 comments
34. MMU-less systems and FDPIC (maskray.me)
    39 points by todsacerdoti 9 months ago | 4 comments
35. My McLuhan Lecture on Enshittification (pluralistic.net)
    12 points by ojbyrne 10 months ago | 1 comments