Commit Graph
13 Commits
Author SHA1 Message Date
Jesse ZhangandClaude Fable 5 b7d3badc72 Add four pelican runs: Fable 5 (Claude Code), Grok Build, Kimi K2.6, MiniMax M3
Kimi K2.6 (Kimi Code, local) and MiniMax M3 (MiniMax Code web, Thinking
mode) graduate from pending to ran — 14 combinations ran. Harness icon
rules added for Kimi/MiniMax; READMEs and OG count updated.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 18:24:32 +01:00
Jesse ZhangandClaude Fable 5 b008398b82 Register the Claude Code x Fable 5 Max combination as its own entry
The minecraft.html artifact is Fable 5 Max run inside Claude Code — a
different harness from the existing Claude Web App entry, so per the
model x harness x effort architecture it becomes a new combination
(claude-fable-5-code) rather than a variant. The validator now also
rejects loose files under outputs/<id>/ that no run declares, which is
how this artifact briefly slipped into the repo unregistered. OG count
refreshed (11 -> 12 ran).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 16:56:45 +01:00
Jesse ZhangandClaude Fable 5 4da51805b3 Rename the Codex CLI entry's model label back to GPT-5.5
There is no "GPT-5.5 Codex" model — Codex is the harness. The entry is
GPT-5.5 run in Codex CLI at xhigh effort, which the harness and effort
fields already record; READMEs and code comments updated to match.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 16:35:13 +01:00
Jesse ZhangandClaude Fable 5 2e03012b74 Add GPT-5.5 Pro pelican run
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 13:07:50 +01:00
Jesse ZhangandDuJiabao 50ff7f945d Contributor credits, SVG prefetch, integrate Xiaomi MiMo from PR #4
- Runs gain a contributor field (GitHub username); the site renders an
  avatar chip linked to their profile next to each run's notes, and CI
  validates the field. All existing runs are attributed.
- SVG variants of a case are prefetched during idle time, so switching
  model tabs swaps images without a network hiccup.
- Xiaomi MiMo v2.5 Pro (Claude Code, max effort) integrated from PR #4
  with both case runs and provenance notes; README registry tables
  updated.

Co-authored-by: DuJiabao <Jiabao.du@Yunzhisun.com>
2026-06-10 13:03:01 +01:00
e87ef7e70f Integrate community pelican runs from PRs #2 and #3; run variants
A combination can now ship multiple versions of the same case:
runs.<case-id> accepts an array, each extra variant naming its own
file; the viewer grows a RUN 01/02 switcher and validation enforces
distinct files plus a provenance note per variant.

Integrated content, attributed to their authors:
- Gemini 3.1 Pro + 3.5 Flash pelican runs from both PRs, shown as two
  variants each (PR #2's Google AI Studio runs first, PR #3's second)
- Doubao Seed 2.0 Pro / Mini pelican runs (folders renamed to the
  dash-only convention)
- GPT-5.5 Codex pelican run

Co-authored-by: lpluma <liuyz2023@mails.jlu.edu.cn>
Co-authored-by: XA2333 <97206278+XA2333@users.noreply.github.com>
2026-06-10 12:09:09 +01:00
e2f03163de Add DeepSeek V4 Pro runs for both cases (#1)
- mythos-craft.html: 3D Minecraft-style voxel world with Perlin noise
  terrain, 12 block types, 4 mythic structures, procedural textures
- pelican-cycling.svg: Pelican riding bicycle by the sea scene
- Update cases.ts: status pending -> ran, add bilingual run notes

Co-authored-by: DuJiabao <Jiabao.du@Yunzhisun.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 11:41:05 +01:00
Jesse ZhangandClaude Fable 5 cd2af84f34 Viewer polish, cursor fix, Grok rename + W/S fix, Composer G teleport
Site:
- Cursor follower fades out over iframes (it froze on top of running
  artifacts since iframes swallow pointer events) and when the pointer
  leaves the window
- HTML viewer: full-bleed width on xl screens (up to 90rem), height
  capped to 100dvh-10rem so the frame plus its action row always fits
  the viewport (big iframes ate wheel events and trapped page scroll),
  fullscreen button (overlay + footer action), and Run now auto-aligns
  the frame below the fixed header

Artifacts:
- grok-build: W/S were inverted against the forward vector (W walked
  backward); model label renamed to Grok Build
- composer-2-5: added G-key cycle teleport to its three generated
  landmarks (elven tower, dragon temple, sky ruins) with a start-screen
  hint - they were previously only reachable on foot; ground landmarks
  arrive 10 blocks out facing the structure, sky ruins land on the deck

Run notes updated accordingly.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 00:34:24 +01:00
Jesse ZhangandClaude Fable 5 37f4c8ae86 Fix Gemini 3.5 Flash atlas flip and GPT-5.5 xhigh movement mirror
- gemini-3-5-flash: ATLAS_COORDS and the canvas tiles share a top-origin
  row convention, but default flipY=true mirrored sampling (row r read
  row 3-r): grass tops became purple crystal, sides hit the alpha-holed
  portal/leaves tiles (the "transparent blocks"). flipY=false, 1 line.
- gpt-5-5-xhigh: movement Z component sign-flipped against the -Z
  camera convention, mirroring all motion across the X axis (A/D
  swapped facing +-X). Negated Z, 1 line.

Run notes now carry full provenance: GPT-5.5 Pro Extended Pro, Codex
CLI (no skills) for xhigh, AntiGravity high for both Geminis, and the
local Grok Build TUI.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 00:20:53 +01:00
Jesse ZhangandClaude Fable 5 54896103d8 Add GPT-5.5 Pro/xhigh and Gemini 3.5 Flash runs; fix three artifacts
Surgical fixes (originals preserved in history), each documented in the
per-model run notes as: where the bug is, pre-fix behavior, root cause,
with the shown build being the fixed one:
- grok-build: 0xAETHER invalid hex literal killed the script at parse
  time (pure black screen); atlas flipY mismatch made near terrain
  sample undrawn black texels. 2 lines.
- composer-2-5: horizontal movement multiplied dt twice, walking at
  ~1/60 design speed and making biomes effectively unreachable. 1 line.
- gpt-5-5-pro: 8x2 atlas rows swapped by default flipY, grass became
  obsidian and leaves/sand sampled undrawn slots. 1 line.

Gemini 3.5 Flash added as-is (color/transparency analysis next).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 00:12:24 +01:00
Jesse ZhangandClaude Fable 5 f0869f0670 Add Gemini 3.1 Pro, Grok and Composer 2.5 runs for Mythos Craft
Folders renamed to the outputs/<model-id>/<case-id>.html convention
(grok-build per request); model ids normalized to dash-only so they
double as folder names. Gemini 3.1 Pro, Grok and Composer 2.5 flip to
ran status with tabs wired up.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09 23:50:48 +01:00
Jesse ZhangandClaude Fable 5 1e41d35e88 Move to bench.nagi.fun with simplified URL scheme
- Vite base '/' and root favicon for the custom domain
- Artifact paths normalized to outputs/<model-id>/<case-id>.<ext>
  (pelican SVG renamed); RUNS now derives the path by convention,
  with an optional file override
- Deep links: #<case-id> anchors a case, #<case-id>:<model-id> also
  preselects the model tab; tab clicks replaceState the hash so the
  current view is always shareable
- README documents the URL scheme and the legacy github.io 301s

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09 22:53:35 +01:00
Jesse ZhangandClaude Fable 5 06ba93a94b Initial release: NAGI BENCH eval showcase
One-shot LLM eval cases with a bilingual (zh/EN) showcase site:
Vite + React + Tailwind v4 + GSAP, built with bun, deployed to
GitHub Pages. Ships two Claude Fable 5 Max cases (Mythos Craft
voxel game, pelican-by-the-sea SVG) with placeholder slots for
GPT-5.1, Gemini 3 Pro, DeepSeek V3.2 and Qwen3 Max.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09 22:20:15 +01:00