Commit Graph
15 Commits
Author SHA1 Message Date
Jesse ZhangandClaude Fable 5 52135f4084 Enlarge reading type; add brand icons and per-run metadata chips
- Bump body text across the registry and case sections (notes, prompts,
  tabs, table cells) one size up for readability; SVG viewer no longer
  uses the full-bleed breakout and caps at a smaller height (HTML keeps
  the big frame).
- Brand icons for model, vendor and harness via @lobehub/icons-static-svg
  (zero-dep static assets; deliberately not the @lobehub/icons React
  package, whose peers pull in antd). Mono SVGs are currentColor so they
  follow the theme. Mapping lives in site/src/lib/brands.tsx, derived
  from the strings contributors already fill in models/*.json.
- Case pages now show Harness (with icon) and Effort chips next to the
  contributor chip; registry harness column is labeled 运行环境(Harness).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 13:44:16 +01:00
Jesse ZhangandClaude Fable 5 2e03012b74 Add GPT-5.5 Pro pelican run
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 13:07:50 +01:00
Jesse ZhangandDuJiabao 50ff7f945d Contributor credits, SVG prefetch, integrate Xiaomi MiMo from PR #4
- Runs gain a contributor field (GitHub username); the site renders an
  avatar chip linked to their profile next to each run's notes, and CI
  validates the field. All existing runs are attributed.
- SVG variants of a case are prefetched during idle time, so switching
  model tabs swaps images without a network hiccup.
- Xiaomi MiMo v2.5 Pro (Claude Code, max effort) integrated from PR #4
  with both case runs and provenance notes; README registry tables
  updated.

Co-authored-by: DuJiabao <Jiabao.du@Yunzhisun.com>
2026-06-10 13:03:01 +01:00
Jesse ZhangandClaude Fable 5 6e76858aad Model x harness x effort registry; bigger top-bar controls
Each entry is now explicitly a model x harness x effort combination:
models/*.json gains harness and effort fields, GPT-5.5 xhigh is
relabeled GPT-5.5 Codex (the harness distinguishes it from GPT-5.5
Pro), and the scrolling marquee is replaced by a readable registry
table (model / vendor / harness / effort / runs, pending rows dimmed)
with an explainer on the model-vs-harness relationship.

Top bar controls enlarged: segmented zh/EN switch and bordered 36px
icon buttons. README rewritten Chinese-first with a hand-maintained
registry snapshot table; README.en.md mirrors it.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 12:09:09 +01:00
e87ef7e70f Integrate community pelican runs from PRs #2 and #3; run variants
A combination can now ship multiple versions of the same case:
runs.<case-id> accepts an array, each extra variant naming its own
file; the viewer grows a RUN 01/02 switcher and validation enforces
distinct files plus a provenance note per variant.

Integrated content, attributed to their authors:
- Gemini 3.1 Pro + 3.5 Flash pelican runs from both PRs, shown as two
  variants each (PR #2's Google AI Studio runs first, PR #3's second)
- Doubao Seed 2.0 Pro / Mini pelican runs (folders renamed to the
  dash-only convention)
- GPT-5.5 Codex pelican run

Co-authored-by: lpluma <liuyz2023@mails.jlu.edu.cn>
Co-authored-by: XA2333 <97206278+XA2333@users.noreply.github.com>
2026-06-10 12:09:09 +01:00
Jesse ZhangandClaude Fable 5 80817b8a2b Data-only contributions: per-model JSON registry, validation, PR CI
Contributors no longer touch site code. Model registration moves from
cases.ts literals to repo-root models/<model-id>.json files (filename =
model id = outputs/ folder); cases move to cases.json; cases.ts now just
derives MODELS/RUNS via import.meta.glob. Parallel PRs stop conflicting
because each model owns its own file.

scripts/validate-data.ts runs inside `bun run build` and a new PR CI
workflow: dash-only ids, required bilingual provenance note per run,
declared artifacts must exist, no orphan outputs/ dirs.

Also: run notes render whitespace-pre-wrap (multi-line notes, idea from
PR #2), README contribution guide rewritten around the JSON template,
CLAUDE.md updated, OG card refreshed for the DeepSeek merge.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 11:48:18 +01:00
e2f03163de Add DeepSeek V4 Pro runs for both cases (#1)
- mythos-craft.html: 3D Minecraft-style voxel world with Perlin noise
  terrain, 12 block types, 4 mythic structures, procedural textures
- pelican-cycling.svg: Pelican riding bicycle by the sea scene
- Update cases.ts: status pending -> ran, add bilingual run notes

Co-authored-by: DuJiabao <Jiabao.du@Yunzhisun.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 11:41:05 +01:00
Jesse ZhangandClaude Fable 5 6f710ad413 Ignore local agent skills and skills lockfile
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 03:09:02 +01:00
Jesse ZhangandClaude Fable 5 cd2af84f34 Viewer polish, cursor fix, Grok rename + W/S fix, Composer G teleport
Site:
- Cursor follower fades out over iframes (it froze on top of running
  artifacts since iframes swallow pointer events) and when the pointer
  leaves the window
- HTML viewer: full-bleed width on xl screens (up to 90rem), height
  capped to 100dvh-10rem so the frame plus its action row always fits
  the viewport (big iframes ate wheel events and trapped page scroll),
  fullscreen button (overlay + footer action), and Run now auto-aligns
  the frame below the fixed header

Artifacts:
- grok-build: W/S were inverted against the forward vector (W walked
  backward); model label renamed to Grok Build
- composer-2-5: added G-key cycle teleport to its three generated
  landmarks (elven tower, dragon temple, sky ruins) with a start-screen
  hint - they were previously only reachable on foot; ground landmarks
  arrive 10 blocks out facing the structure, sky ruins land on the deck

Run notes updated accordingly.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 00:34:24 +01:00
Jesse ZhangandClaude Fable 5 37f4c8ae86 Fix Gemini 3.5 Flash atlas flip and GPT-5.5 xhigh movement mirror
- gemini-3-5-flash: ATLAS_COORDS and the canvas tiles share a top-origin
  row convention, but default flipY=true mirrored sampling (row r read
  row 3-r): grass tops became purple crystal, sides hit the alpha-holed
  portal/leaves tiles (the "transparent blocks"). flipY=false, 1 line.
- gpt-5-5-xhigh: movement Z component sign-flipped against the -Z
  camera convention, mirroring all motion across the X axis (A/D
  swapped facing +-X). Negated Z, 1 line.

Run notes now carry full provenance: GPT-5.5 Pro Extended Pro, Codex
CLI (no skills) for xhigh, AntiGravity high for both Geminis, and the
local Grok Build TUI.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 00:20:53 +01:00
Jesse ZhangandClaude Fable 5 54896103d8 Add GPT-5.5 Pro/xhigh and Gemini 3.5 Flash runs; fix three artifacts
Surgical fixes (originals preserved in history), each documented in the
per-model run notes as: where the bug is, pre-fix behavior, root cause,
with the shown build being the fixed one:
- grok-build: 0xAETHER invalid hex literal killed the script at parse
  time (pure black screen); atlas flipY mismatch made near terrain
  sample undrawn black texels. 2 lines.
- composer-2-5: horizontal movement multiplied dt twice, walking at
  ~1/60 design speed and making biomes effectively unreachable. 1 line.
- gpt-5-5-pro: 8x2 atlas rows swapped by default flipY, grass became
  obsidian and leaves/sand sampled undrawn slots. 1 line.

Gemini 3.5 Flash added as-is (color/transparency analysis next).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 00:12:24 +01:00
Jesse ZhangandClaude Fable 5 f0869f0670 Add Gemini 3.1 Pro, Grok and Composer 2.5 runs for Mythos Craft
Folders renamed to the outputs/<model-id>/<case-id>.html convention
(grok-build per request); model ids normalized to dash-only so they
double as folder names. Gemini 3.1 Pro, Grok and Composer 2.5 flip to
ran status with tabs wired up.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09 23:50:48 +01:00
Jesse ZhangandClaude Fable 5 1e41d35e88 Move to bench.nagi.fun with simplified URL scheme
- Vite base '/' and root favicon for the custom domain
- Artifact paths normalized to outputs/<model-id>/<case-id>.<ext>
  (pelican SVG renamed); RUNS now derives the path by convention,
  with an optional file override
- Deep links: #<case-id> anchors a case, #<case-id>:<model-id> also
  preselects the model tab; tab clicks replaceState the hash so the
  current view is always shareable
- README documents the URL scheme and the legacy github.io 301s

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09 22:53:35 +01:00
Jesse ZhangandClaude Fable 5 642bceb493 Serve from custom domain bench.nagi.fun (base: /)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09 22:46:10 +01:00
Jesse ZhangandClaude Fable 5 06ba93a94b Initial release: NAGI BENCH eval showcase
One-shot LLM eval cases with a bilingual (zh/EN) showcase site:
Vite + React + Tailwind v4 + GSAP, built with bun, deployed to
GitHub Pages. Ships two Claude Fable 5 Max cases (Mythos Craft
voxel game, pelican-by-the-sea SVG) with placeholder slots for
GPT-5.1, Gemini 3 Pro, DeepSeek V3.2 and Qwen3 Max.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09 22:20:15 +01:00