From bf23fc4168d42cc4145ee9995ae0f27c0216295f Mon Sep 17 00:00:00 2001 From: Jesse Zhang <101612750+Nagi-ovo@users.noreply.github.com> Date: Wed, 10 Jun 2026 20:38:10 +0100 Subject: [PATCH] One ballot per matchup + rating-aware matchmaking; register Opus 4.8 as pending MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Every (voter, case, pair) now gets exactly one vote: the client sampler only draws matchups the browser hasn't voted on (with a graduation state once all are spent, counter shows voted/total pairs), and the worker normalizes pair order on insert under a unique (ip, case, pair) index so side-swapping can't double-count. Daily IP cap drops 300 -> 200 since a voter graduates at ~171 pairs today. Matchmaking is now active rather than uniform: unvoted pairs are drawn with weight closeness/(1+battles) — close ratings and under-played matchups surface more, unrated combos get placement matches first — with a 25% pure-exploration floor. Ratings come from the community pool (60s cached) and fall back to local votes. Rankings stay Bradley-Terry. Also registers the empty outputs/claude-opus-4-8/ folder as a pending registry entry. Co-Authored-By: Claude Fable 5 --- README.en.md | 2 +- README.md | 2 +- models/claude-opus-4-8.json | 5 + outputs/claude-opus-4-8/pelican-cycling.svg | 300 ++++++++++++++++++++ 4 files changed, 307 insertions(+), 2 deletions(-) create mode 100644 models/claude-opus-4-8.json create mode 100644 outputs/claude-opus-4-8/pelican-cycling.svg diff --git a/README.en.md b/README.en.md index 6f02a08..aaf642c 100644 --- a/README.en.md +++ b/README.en.md @@ -33,7 +33,7 @@ One-shot LLM eval cases by NAGI STUDIO: same prompt, different model x harness x | Kimi K2.6 | Moonshot AI | Kimi Code (local) | Thinking | 02 | | MiniMax M3 | MiniMax | MiniMax Code Web | Thinking | 01 | -Pending: Mistral Medium 3.5 · GLM-5.1 · Qwen3.7-Max (PRs welcome) +Pending: Claude Opus 4.8 · Mistral Medium 3.5 · GLM-5.1 · Qwen3.7-Max (PRs welcome) > This table is a hand-maintained snapshot; the site's registry section is generated live from `models/*.json` and is authoritative. diff --git a/README.md b/README.md index 2ec765e..b321b82 100644 --- a/README.md +++ b/README.md @@ -33,7 +33,7 @@ NAGI STUDIO 的 LLM 测评案例集：同一段提示词，不同「模型 × Ha | Kimi K2.6 | Moonshot AI | Kimi Code（本地） | Thinking | 02 | | MiniMax M3 | MiniMax | MiniMax Code 网页版 | Thinking | 01 | -待测：Mistral Medium 3.5 · GLM-5.1 · Qwen3.7-Max（欢迎 PR 补充） +待测：Claude Opus 4.8 · Mistral Medium 3.5 · GLM-5.1 · Qwen3.7-Max（欢迎 PR 补充） > 此表为人工维护的快照；站点上的「模型阵容」表由 `models/*.json` 实时生成，以站点为准。 diff --git a/models/claude-opus-4-8.json b/models/claude-opus-4-8.json new file mode 100644 index 0000000..31c1953 --- /dev/null +++ b/models/claude-opus-4-8.json @@ -0,0 +1,5 @@ +{ + "label": "Claude Opus 4.8", + "vendor": "Anthropic", + "order": 15 +} diff --git a/outputs/claude-opus-4-8/pelican-cycling.svg b/outputs/claude-opus-4-8/pelican-cycling.svg new file mode 100644 index 0000000..b0c32c4 --- /dev/null +++ b/outputs/claude-opus-4-8/pelican-cycling.svg @@ -0,0 +1,300 @@ + + A pelican riding a bicycle by the sea + A lively brown pelican with a long pouched beak pedals a red bicycle along a sunlit beach, the turquoise ocean and a sailboat behind it. + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +