Skip to content
This page is not translated yet — showing the original. We never ship machine translation as a placeholder.
Needs a toolchainMIT Tested
LM Evaluation Harness

LM Evaluation Harness

In one line:LM Evaluation Harness 是一个开源的大模型评测框架,能在本地模型上跑 MMLU 等标准基准。

LM Evaluation Harness 是一个开源的大模型评测框架,能在本地模型上跑 MMLU 等标准基准。

Official source

We host and mirror nothing — the official page is the source of truth.

Official icon for LM Evaluation Harness EleutherAIhttps://github.com/EleutherAI/lm-evaluation-harnessOpen official page
Official sourceYou are leaving AIWorksWell for EleutherAI. That site is not under our control; its content, privacy and security are its own responsibility. Please judge for yourself.

Install prompt

Copy it, paste it into your AI (Claude Code, Codex, ChatGPT…), and it installs and verifies for you.

42 lines
我需要你帮我在我的机器上安装并运行一个软件。

【软件信息】
名称:LM Evaluation Harness
用途:LM Evaluation Harness 是一个开源的大模型评测框架,能在本地模型上跑 MMLU 等标准基准。
官方来源:https://github.com/EleutherAI/lm-evaluation-harness
许可:MIT
Scroll inside the box with your mouse wheel — copying still gives you the full prompt1100 chars

Copy → paste into your own AI → it installs for you

Contact the original author (EleutherAI)

Bugs in the software itself go to the author's own official channel — that is where they actually receive them. We pass things on; we do not answer for the author.

Install failed?

Paste the raw error — once triaged and verified it is written back here, so the next person's AI avoids it. No login needed.

About this entry

它是什么

LM Evaluation Harness 是开源的大模型评测框架,覆盖大量标准基准。来源:https://github.com/EleutherAI/lm-evaluation-harnesshttps://github.com/EleutherAI/lm-evaluation-harness

怎么用起来

「用 lm-eval-harness 在本地模型上跑 MMLU 和 GSM8K,给出分数与显存占用。」来源:https://github.com/EleutherAI/lm-evaluation-harnesshttps://github.com/EleutherAI/lm-evaluation-harness

以上坑来自 https://github.com/EleutherAI/lm-evaluation-harnesshttps://github.com/EleutherAI/lm-evaluation-harness 与官方文档。

来源与署名

Mentioned from:https://github.com/EleutherAI/lm-evaluation-harnesshttps://github.com/EleutherAI/lm-evaluation-harness · 原作者 EleutherAI(MIT)。

Summary for AI

LM Evaluation Harness 是 EleutherAI 的评测框架,用于自己复现模型的基准分数,而不是直接采信他人给出的结果。

A self-contained answer paragraph — this is the part AI search quotes. · Page reviewed 2026-10-06

FAQ

为什么要自己跑评测?

不同报告的设置不一致,自跑才能保证同一口径下可比。

怎么用?

命令行运行,具体命令见官方文档。

Pitfalls / known issues

All recorded from real installs, and injected into the prompt above.

  • •不同版本的结果不可直接比较,记录版本号。
  • •部分任务要额外下载数据集,注意网络与磁盘。

You might also like

We store, mirror and repackage nothing. Every install path points to the author’s own official page.

Nothing here has been reviewed by an app store. Judge the source and licence yourself; you install at your own risk.