Commit Graph
9 Commits
Author SHA1 Message Date
e2f03163de Add DeepSeek V4 Pro runs for both cases (#1)
- mythos-craft.html: 3D Minecraft-style voxel world with Perlin noise
  terrain, 12 block types, 4 mythic structures, procedural textures
- pelican-cycling.svg: Pelican riding bicycle by the sea scene
- Update cases.ts: status pending -> ran, add bilingual run notes

Co-authored-by: DuJiabao <Jiabao.du@Yunzhisun.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 11:41:05 +01:00
Jesse ZhangandClaude Fable 5 6f710ad413 Ignore local agent skills and skills lockfile
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 03:09:02 +01:00
Jesse ZhangandClaude Fable 5 cd2af84f34 Viewer polish, cursor fix, Grok rename + W/S fix, Composer G teleport
Site:
- Cursor follower fades out over iframes (it froze on top of running
  artifacts since iframes swallow pointer events) and when the pointer
  leaves the window
- HTML viewer: full-bleed width on xl screens (up to 90rem), height
  capped to 100dvh-10rem so the frame plus its action row always fits
  the viewport (big iframes ate wheel events and trapped page scroll),
  fullscreen button (overlay + footer action), and Run now auto-aligns
  the frame below the fixed header

Artifacts:
- grok-build: W/S were inverted against the forward vector (W walked
  backward); model label renamed to Grok Build
- composer-2-5: added G-key cycle teleport to its three generated
  landmarks (elven tower, dragon temple, sky ruins) with a start-screen
  hint - they were previously only reachable on foot; ground landmarks
  arrive 10 blocks out facing the structure, sky ruins land on the deck

Run notes updated accordingly.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 00:34:24 +01:00
Jesse ZhangandClaude Fable 5 37f4c8ae86 Fix Gemini 3.5 Flash atlas flip and GPT-5.5 xhigh movement mirror
- gemini-3-5-flash: ATLAS_COORDS and the canvas tiles share a top-origin
  row convention, but default flipY=true mirrored sampling (row r read
  row 3-r): grass tops became purple crystal, sides hit the alpha-holed
  portal/leaves tiles (the "transparent blocks"). flipY=false, 1 line.
- gpt-5-5-xhigh: movement Z component sign-flipped against the -Z
  camera convention, mirroring all motion across the X axis (A/D
  swapped facing +-X). Negated Z, 1 line.

Run notes now carry full provenance: GPT-5.5 Pro Extended Pro, Codex
CLI (no skills) for xhigh, AntiGravity high for both Geminis, and the
local Grok Build TUI.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 00:20:53 +01:00
Jesse ZhangandClaude Fable 5 54896103d8 Add GPT-5.5 Pro/xhigh and Gemini 3.5 Flash runs; fix three artifacts
Surgical fixes (originals preserved in history), each documented in the
per-model run notes as: where the bug is, pre-fix behavior, root cause,
with the shown build being the fixed one:
- grok-build: 0xAETHER invalid hex literal killed the script at parse
  time (pure black screen); atlas flipY mismatch made near terrain
  sample undrawn black texels. 2 lines.
- composer-2-5: horizontal movement multiplied dt twice, walking at
  ~1/60 design speed and making biomes effectively unreachable. 1 line.
- gpt-5-5-pro: 8x2 atlas rows swapped by default flipY, grass became
  obsidian and leaves/sand sampled undrawn slots. 1 line.

Gemini 3.5 Flash added as-is (color/transparency analysis next).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 00:12:24 +01:00
Jesse ZhangandClaude Fable 5 f0869f0670 Add Gemini 3.1 Pro, Grok and Composer 2.5 runs for Mythos Craft
Folders renamed to the outputs/<model-id>/<case-id>.html convention
(grok-build per request); model ids normalized to dash-only so they
double as folder names. Gemini 3.1 Pro, Grok and Composer 2.5 flip to
ran status with tabs wired up.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09 23:50:48 +01:00
Jesse ZhangandClaude Fable 5 1e41d35e88 Move to bench.nagi.fun with simplified URL scheme
- Vite base '/' and root favicon for the custom domain
- Artifact paths normalized to outputs/<model-id>/<case-id>.<ext>
  (pelican SVG renamed); RUNS now derives the path by convention,
  with an optional file override
- Deep links: #<case-id> anchors a case, #<case-id>:<model-id> also
  preselects the model tab; tab clicks replaceState the hash so the
  current view is always shareable
- README documents the URL scheme and the legacy github.io 301s

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09 22:53:35 +01:00
Jesse ZhangandClaude Fable 5 642bceb493 Serve from custom domain bench.nagi.fun (base: /)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09 22:46:10 +01:00
Jesse ZhangandClaude Fable 5 06ba93a94b Initial release: NAGI BENCH eval showcase
One-shot LLM eval cases with a bilingual (zh/EN) showcase site:
Vite + React + Tailwind v4 + GSAP, built with bun, deployed to
GitHub Pages. Ships two Claude Fable 5 Max cases (Mythos Craft
voxel game, pelican-by-the-sea SVG) with placeholder slots for
GPT-5.1, Gemini 3 Pro, DeepSeek V3.2 and Qwen3 Max.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09 22:20:15 +01:00