Commit Graph
17 Commits
Author SHA1 Message Date
Jesse ZhangandClaude Fable 5 8acf16262f Rename Claude Code combination ids to the -cc suffix; refresh the Opus 4.8 mythos build
claude-fable-5-code -> claude-fable-5-cc, claude-opus-4-8 ->
claude-opus-4-8-cc (the entry id doubles as the outputs/ folder name).
The Opus mythos-craft artifact is a newer build of the same one-shot
provenance.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 23:07:51 +01:00
Jesse ZhangandClaude Fable 5 42efab56e2 Register the Opus 4.8 mythos-craft run (Claude Code, Max)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 22:42:31 +01:00
Jesse ZhangandClaude Fable 5 bf23fc4168 One ballot per matchup + rating-aware matchmaking; register Opus 4.8 as pending
Every (voter, case, pair) now gets exactly one vote: the client sampler
only draws matchups the browser hasn't voted on (with a graduation state
once all are spent, counter shows voted/total pairs), and the worker
normalizes pair order on insert under a unique (ip, case, pair) index so
side-swapping can't double-count. Daily IP cap drops 300 -> 200 since a
voter graduates at ~171 pairs today.

Matchmaking is now active rather than uniform: unvoted pairs are drawn
with weight closeness/(1+battles) — close ratings and under-played
matchups surface more, unrated combos get placement matches first — with
a 25% pure-exploration floor. Ratings come from the community pool (60s
cached) and fall back to local votes. Rankings stay Bradley-Terry.

Also registers the empty outputs/claude-opus-4-8/ folder as a pending
registry entry.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 20:38:10 +01:00
Jesse ZhangandClaude Fable 5 844ab3b63f Split LpIuma's AI Studio Gemini runs into their own combinations; add PR template; register Kimi mythos run
Per PR #2's description those two pelicans were generated in Google AI
Studio, not AntiGravity — they move to gemini-3-1-pro-aistudio and
gemini-3-5-flash-aistudio entries (harness Google AI Studio, High).
XA2333's unknown-environment runs stay where they were, disclaimed in
their notes. Adds a bilingual PR template asking for harness/effort/
one-shot info up front, and registers the new Kimi K2.6 mythos-craft
artifact (16 combinations ran).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 19:10:55 +01:00
Jesse ZhangandClaude Fable 5 b7d3badc72 Add four pelican runs: Fable 5 (Claude Code), Grok Build, Kimi K2.6, MiniMax M3
Kimi K2.6 (Kimi Code, local) and MiniMax M3 (MiniMax Code web, Thinking
mode) graduate from pending to ran — 14 combinations ran. Harness icon
rules added for Kimi/MiniMax; READMEs and OG count updated.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 18:24:32 +01:00
Jesse ZhangandClaude Fable 5 b008398b82 Register the Claude Code x Fable 5 Max combination as its own entry
The minecraft.html artifact is Fable 5 Max run inside Claude Code — a
different harness from the existing Claude Web App entry, so per the
model x harness x effort architecture it becomes a new combination
(claude-fable-5-code) rather than a variant. The validator now also
rejects loose files under outputs/<id>/ that no run declares, which is
how this artifact briefly slipped into the repo unregistered. OG count
refreshed (11 -> 12 ran).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 16:56:45 +01:00
Jesse ZhangandClaude Fable 5 4da51805b3 Rename the Codex CLI entry's model label back to GPT-5.5
There is no "GPT-5.5 Codex" model — Codex is the harness. The entry is
GPT-5.5 run in Codex CLI at xhigh effort, which the harness and effort
fields already record; READMEs and code comments updated to match.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 16:35:13 +01:00
Jesse ZhangandClaude Fable 5 2e03012b74 Add GPT-5.5 Pro pelican run
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 13:07:50 +01:00
Jesse ZhangandDuJiabao 50ff7f945d Contributor credits, SVG prefetch, integrate Xiaomi MiMo from PR #4
- Runs gain a contributor field (GitHub username); the site renders an
  avatar chip linked to their profile next to each run's notes, and CI
  validates the field. All existing runs are attributed.
- SVG variants of a case are prefetched during idle time, so switching
  model tabs swaps images without a network hiccup.
- Xiaomi MiMo v2.5 Pro (Claude Code, max effort) integrated from PR #4
  with both case runs and provenance notes; README registry tables
  updated.

Co-authored-by: DuJiabao <Jiabao.du@Yunzhisun.com>
2026-06-10 13:03:01 +01:00
e87ef7e70f Integrate community pelican runs from PRs #2 and #3; run variants
A combination can now ship multiple versions of the same case:
runs.<case-id> accepts an array, each extra variant naming its own
file; the viewer grows a RUN 01/02 switcher and validation enforces
distinct files plus a provenance note per variant.

Integrated content, attributed to their authors:
- Gemini 3.1 Pro + 3.5 Flash pelican runs from both PRs, shown as two
  variants each (PR #2's Google AI Studio runs first, PR #3's second)
- Doubao Seed 2.0 Pro / Mini pelican runs (folders renamed to the
  dash-only convention)
- GPT-5.5 Codex pelican run

Co-authored-by: lpluma <liuyz2023@mails.jlu.edu.cn>
Co-authored-by: XA2333 <97206278+XA2333@users.noreply.github.com>
2026-06-10 12:09:09 +01:00
e2f03163de Add DeepSeek V4 Pro runs for both cases (#1)
- mythos-craft.html: 3D Minecraft-style voxel world with Perlin noise
  terrain, 12 block types, 4 mythic structures, procedural textures
- pelican-cycling.svg: Pelican riding bicycle by the sea scene
- Update cases.ts: status pending -> ran, add bilingual run notes

Co-authored-by: DuJiabao <Jiabao.du@Yunzhisun.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 11:41:05 +01:00
Jesse ZhangandClaude Fable 5 cd2af84f34 Viewer polish, cursor fix, Grok rename + W/S fix, Composer G teleport
Site:
- Cursor follower fades out over iframes (it froze on top of running
  artifacts since iframes swallow pointer events) and when the pointer
  leaves the window
- HTML viewer: full-bleed width on xl screens (up to 90rem), height
  capped to 100dvh-10rem so the frame plus its action row always fits
  the viewport (big iframes ate wheel events and trapped page scroll),
  fullscreen button (overlay + footer action), and Run now auto-aligns
  the frame below the fixed header

Artifacts:
- grok-build: W/S were inverted against the forward vector (W walked
  backward); model label renamed to Grok Build
- composer-2-5: added G-key cycle teleport to its three generated
  landmarks (elven tower, dragon temple, sky ruins) with a start-screen
  hint - they were previously only reachable on foot; ground landmarks
  arrive 10 blocks out facing the structure, sky ruins land on the deck

Run notes updated accordingly.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 00:34:24 +01:00
Jesse ZhangandClaude Fable 5 37f4c8ae86 Fix Gemini 3.5 Flash atlas flip and GPT-5.5 xhigh movement mirror
- gemini-3-5-flash: ATLAS_COORDS and the canvas tiles share a top-origin
  row convention, but default flipY=true mirrored sampling (row r read
  row 3-r): grass tops became purple crystal, sides hit the alpha-holed
  portal/leaves tiles (the "transparent blocks"). flipY=false, 1 line.
- gpt-5-5-xhigh: movement Z component sign-flipped against the -Z
  camera convention, mirroring all motion across the X axis (A/D
  swapped facing +-X). Negated Z, 1 line.

Run notes now carry full provenance: GPT-5.5 Pro Extended Pro, Codex
CLI (no skills) for xhigh, AntiGravity high for both Geminis, and the
local Grok Build TUI.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 00:20:53 +01:00
Jesse ZhangandClaude Fable 5 54896103d8 Add GPT-5.5 Pro/xhigh and Gemini 3.5 Flash runs; fix three artifacts
Surgical fixes (originals preserved in history), each documented in the
per-model run notes as: where the bug is, pre-fix behavior, root cause,
with the shown build being the fixed one:
- grok-build: 0xAETHER invalid hex literal killed the script at parse
  time (pure black screen); atlas flipY mismatch made near terrain
  sample undrawn black texels. 2 lines.
- composer-2-5: horizontal movement multiplied dt twice, walking at
  ~1/60 design speed and making biomes effectively unreachable. 1 line.
- gpt-5-5-pro: 8x2 atlas rows swapped by default flipY, grass became
  obsidian and leaves/sand sampled undrawn slots. 1 line.

Gemini 3.5 Flash added as-is (color/transparency analysis next).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 00:12:24 +01:00
Jesse ZhangandClaude Fable 5 f0869f0670 Add Gemini 3.1 Pro, Grok and Composer 2.5 runs for Mythos Craft
Folders renamed to the outputs/<model-id>/<case-id>.html convention
(grok-build per request); model ids normalized to dash-only so they
double as folder names. Gemini 3.1 Pro, Grok and Composer 2.5 flip to
ran status with tabs wired up.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09 23:50:48 +01:00
Jesse ZhangandClaude Fable 5 1e41d35e88 Move to bench.nagi.fun with simplified URL scheme
- Vite base '/' and root favicon for the custom domain
- Artifact paths normalized to outputs/<model-id>/<case-id>.<ext>
  (pelican SVG renamed); RUNS now derives the path by convention,
  with an optional file override
- Deep links: #<case-id> anchors a case, #<case-id>:<model-id> also
  preselects the model tab; tab clicks replaceState the hash so the
  current view is always shareable
- README documents the URL scheme and the legacy github.io 301s

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09 22:53:35 +01:00
Jesse ZhangandClaude Fable 5 06ba93a94b Initial release: NAGI BENCH eval showcase
One-shot LLM eval cases with a bilingual (zh/EN) showcase site:
Vite + React + Tailwind v4 + GSAP, built with bun, deployed to
GitHub Pages. Ships two Claude Fable 5 Max cases (Mythos Craft
voxel game, pelican-by-the-sea SVG) with placeholder slots for
GPT-5.1, Gemini 3 Pro, DeepSeek V3.2 and Qwen3 Max.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09 22:20:15 +01:00