Commit Graph
77 Commits
Author SHA1 Message Date
Jesse ZhangandClaude Opus 4.8 3d5bf6967c Normalize artifact filenames and register new runs (#17)
Rename all output artifacts to their canonical case-id names
(mythos-craft.html / pelican-cycling.svg / skeleton-watch.html, with
-2 suffixes for variants) and drop the now-redundant "file" overrides
from the corresponding models/*.json runs.

Register new Claude Code runs for Opus 4.6 and 4.7 (new model JSONs),
add the GPT-5.5 Pro skeleton-watch run, and regenerate the README
registry tables. Remove stray .DS_Store files from outputs/.

Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-18 23:36:38 +01:00
Jesse ZhangandClaude Opus 4.8 dd67d6fda5 Add Step 3.7 Flash runs (mythos-craft, pelican-cycling)
Step 3.7 Flash (StepFun) via Claude Code · High, one-shot. The mythos-craft
Write tool call failed during generation, so the model's output was saved into
the HTML by hand (code unmodified) — documented in the run note. Registry
tables regenerated; validation passes.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-18 22:03:52 +01:00
OHCJ099 13da28bd8e Add MiMo v2.5 Pro UltraSpeed runs (mythos-craft, pelican-cycling)
Registers MiMo v2.5 Pro UltraSpeed (Xiaomi, Web · Default) with two one-shot variants each for mythos-craft and pelican-cycling. Verified: SVGs render, both Three.js voxel games run, schema validates, README tables synced (zh+en).
2026-06-16 20:20:34 +01:00
Nagi-ovoandCodex b07823f4be Fix GLM-5.2 mythos startup
Co-authored-by: Codex <codex@openai.com>
2026-06-14 23:53:18 +01:00
Nagi-ovoandCodex f9a44ec74e Fix GLM-5 Turbo mythos startup
Co-authored-by: Codex <codex@openai.com>
2026-06-14 23:48:10 +01:00
Nagi-ovoandCodex 2bcb1409c4 Update registry for GLM-5 Turbo variant
Co-authored-by: Codex <codex@openai.com>
2026-06-14 23:31:20 +01:00
Nagi-ovoandCodex ce906b7f02 Add GLM-5 Turbo mythos variant
Co-authored-by: Codex <codex@openai.com>
2026-06-14 23:30:53 +01:00
Nagi-ovoandCodex 9f899eaeba Add GLM-5 Turbo mythos artifact
Co-authored-by: Codex <codex@openai.com>
2026-06-14 22:54:20 +01:00
Nagi-ovoandCodex 08f2fb4b7d Add GLM-5 Turbo pelican artifact
Co-authored-by: Codex <codex@openai.com>
2026-06-14 22:49:09 +01:00
Nagi-ovoandCodex bfeba2bfbd Add GLM-5.2 pelican artifacts
Co-authored-by: Codex <codex@openai.com>
2026-06-14 22:35:12 +01:00
Nagi-ovoandCodex 2b85907eb3 Add Claude Haiku 4.5 artifacts
Co-authored-by: Codex <codex@openai.com>
2026-06-14 06:54:22 +01:00
Nagi-ovoandCodex 00226c3e70 Add Claude Sonnet 4.6 pelican variants
Co-authored-by: Codex <codex@openai.com>
2026-06-14 06:30:44 +01:00
Nagi-ovoandCodex c0d9952c28 Add Gemini 3.1 Pro Cursor pelican artifact
Co-authored-by: Codex <codex@openai.com>
2026-06-14 01:32:04 +01:00
Nagi-ovoandCodex ac63b84938 Add GPT-5.4 Codex mythos artifact
Co-authored-by: Codex <codex@openai.com>
2026-06-14 01:20:59 +01:00
Nagi-ovoandCodex 508d601dd3 Add MiniMax M2.7 pelican artifact
Co-authored-by: Codex <codex@openai.com>
2026-06-14 01:16:44 +01:00
Nagi-ovoandCodex 6db97658b2 Generate registry tables from data
Co-authored-by: Codex <codex@openai.com>
2026-06-14 01:11:56 +01:00
Nagi-ovoandCodex a7b5d09658 Add M3 and K2.7 pelican variants
Co-authored-by: Codex <codex@openai.com>
2026-06-14 01:06:12 +01:00
Nagi-ovoandCodex f5d1f373c5 Add GPT-5.4 Codex pelican variants
Co-authored-by: Codex <codex@openai.com>
2026-06-14 01:01:49 +01:00
Nagi-ovoandCodex 4ceb49d8e1 Add Claude Sonnet 4.6 pelican artifact
Co-authored-by: Codex <codex@openai.com>
2026-06-14 00:57:37 +01:00
Nagi-ovoandCodex f2208a562d Add Grok 4.3 pelican artifact
Co-authored-by: Codex <codex@openai.com>
2026-06-14 00:42:47 +01:00
Nagi-ovoandCodex 9391a32015 Clarify Cursor CLI provenance
Co-authored-by: Codex <codex@openai.com>
2026-06-14 00:35:10 +01:00
Nagi-ovoandCodex 4a5aad4a35 Add new Cursor artifacts
Co-authored-by: Codex <codex@openai.com>
2026-06-14 00:31:16 +01:00
Jesse Zhang 7a1571f46b Remove empty artifacts from Cursor runs 2026-06-14 00:16:49 +01:00
Jesse Zhang cb79f09c88 Fix Cursor run contributor handles 2026-06-13 20:52:31 +01:00
Jesse Zhang 3936cd26af Add Cursor runs for Claude and Gemini models 2026-06-13 19:24:46 +01:00
Jesse ZhangandClaude Opus 4.8 9bc21c2ace Add GLM-5.2 as a pending model
Zhipu AI's GLM-5.2 listed alongside GLM-5.1 as awaiting a contribution (no
runs yet). Added to both README pending lines.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-13 14:43:15 +01:00
Jesse ZhangandClaude Opus 4.8 8ece6b8941 README: Kimi K2.7-Code now 02 runs (mythos-craft added via #11)
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-13 14:32:18 +01:00
b6b60b6e1e feat: add Kimi K2.7-Code mythos-craft run (#11)
* feat: add Kimi K2.7-Code mythos-craft run

* Move Kimi K2.7-Code mythos-craft to its artifactDir path

Conform the new run to the model/harness artifact layout merged into main
(outputs/kimi-k2-7-code/kimi-code-thinking/). Validates: Data OK, 25 models.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

---------

Co-authored-by: OHCJ099 <OHCJ099@users.noreply.github.com>
Co-authored-by: Jesse Zhang <101612750+Nagi-ovo@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-13 14:31:27 +01:00
Jesse Zhang a12017f31e Reorganize artifacts by model and harness 2026-06-13 12:59:01 +01:00
Jesse ZhangandClaude Opus 4.8 4027ba94c2 README: add Kimi K2.7-Code row to both registry tables
PR #9 added models/kimi-k2-7-code.json but not the README snapshot rows; sync
both zh + en tables (Moonshot AI · Kimi Code · Thinking · 01).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-13 11:59:00 +01:00
Junchao MaoandClaude Opus 4.8 4f37651620 Add Opus 4.8 (Claude Code) v2 runs for both cases (#10)
Second-version artifacts for claude-opus-4-8-cc, generated one-shot:
- pelican-cycling-2.svg: hand-authored seaside SVG of a pelican on a bicycle
- mythos-craft-2.html: Three.js voxel world (Perlin terrain, WASD + mouse
  look, break/place, marble temple + crystal spires + floating isle)

Registers both as file-keyed array variants with bilingual provenance
notes; contributor OHMFOHS. Passes scripts/validate-data.ts.

Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-13 11:55:13 +01:00
Jesse ZhangandClaude Opus 4.8 5f6a44aff7 Qwen3.7-Max: use the red-bike pelican variant
Swap pelican-cycling.svg to the red-bicycle one-shot version (with a pelican
side-profile study inset); drop the blue-bike variant so only the red one and
its matching mythos-craft.html remain. Note updated to mention the inset.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-13 11:52:38 +01:00
Jesse ZhangandClaude Opus 4.8 f21944db77 Add Qwen3.7-Max (Qoder) runs for both cases
One-shot, unmodified outputs for Qwen3.7-Max (Alibaba) run in Qoder, default
thinking; contributor Nagi-ovo.

- outputs/qwen3-7-max/mythos-craft.html — Three.js voxel world (chunked
  terrain, first-person controls, break/place, fantasy structures).
- outputs/qwen3-7-max/pelican-cycling.svg — hand-authored seaside SVG, pelican
  on a bicycle with a side-profile study inset.

Filenames normalized to the canonical case ids and the folder renamed to match
the model id (qwen3-7-max). Moved out of Pending in both README registries.
Validates: Data OK, 25 models.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-13 11:43:21 +01:00
OHCJ099andOHCJ099 70b13fcee2 feat: add Kimi K2.7-Code under Kimi Code (#9)
Co-authored-by: OHCJ099 <OHCJ099@users.noreply.github.com>
2026-06-13 10:06:25 +01:00
Jesse ZhangandClaude Opus 4.8 dc9ad36359 Register Mistral Medium 3.5 × Vibe (Thinking)
Two one-shot runs generated in the Vibe web app (Mistral's renamed
Le Chat, Thinking enabled), contributed by Nagi-ovo.

mythos-craft is a fixed build (1 line changed): the world synchronously
built the full RENDER_DISTANCE=4 ring (9x9 = 81 chunks) on load, each
chunk doing an O(voxels x structures) linear scan over mythStructures
for all 16x16x128 voxels, so the main thread froze before the first
frame and the page never opened. RENDER_DISTANCE 4 -> 1 (a 3x3 = 9-chunk
first-screen load) lets it open at 60fps; terrain/visuals/gameplay are
the model's original output, otherwise unmodified. pelican-cycling is
unmodified. Both documented in the run notes; READMEs updated.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-12 23:53:16 +01:00
OHCJ099andOHCJ099 f4f4530797 feat: add Nex-N2-Pro under Claude Code (#8)
* feat: add Nex-N2-Pro under Claude Code

* feat: add pelican-cycling SVG run for Nex-N2-Pro

---------

Co-authored-by: OHCJ099 <OHCJ099@users.noreply.github.com>
2026-06-12 10:31:48 +01:00
Jesse ZhangandClaude Opus 4.8 9b58bac621 Composer 2.5 Cursor "Fast": effort is Default, not a thinking budget
Cursor's Composer "Fast" is a serving tier (lower latency, higher cost, same
model intelligence) — not a reasoning-effort level. Drop the Fast/effort framing
entirely: effort is Default, notes just state a plain one-shot Composer 2.5 run.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-11 22:40:31 +01:00
Jesse ZhangandClaude Opus 4.8 df5a53a6b6 Composer 2.5 Fast: label is "Composer 2.5", "Fast" is the effort
The Cursor "Fast" run was registered as label "Composer 2.5 Fast" with effort
"Max" — contradictory, and it baked the speed mode into the model name. Per the
model x harness x effort convention (cf. the Grok Build TUI entry), the label is
just "Composer 2.5" and Fast is the effort, so it sits next to the Cursor · Max
entry as a thinking-budget comparison. Fixed the run notes to match, and synced
both README registry tables (which had also missed the Cursor · High Claude
Fable 5 entry from the prior merge).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-11 21:32:36 +01:00
驱不散的雾andCursor db5b9beb14 Register Claude Fable 5 × Cursor (High) (#7)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-11 20:24:48 +01:00
驱不散的雾andCursor 6fbf660b49 Register Composer 2.5 Fast × Cursor (Max) (#6)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-11 20:24:44 +01:00
Jesse ZhangandClaude Fable 5 44ebf586aa README: unlock the board at 3 total votes (was 3 per case)
Match the site change — the community leaderboard now unlocks after 3 votes
in any mix of cases, not 3 in each.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-11 20:01:08 +01:00
Jesse ZhangandClaude Fable 5 816fe537c3 README: add an AI-agent contribution callout to both languages
A blockquote at the top of the contributing section, addressed to coding
agents: states the unit (Agent = model × harness) and the id convention,
names the two current cases with cases.json as the verbatim-prompt source,
and explains how to find open slots from cases.json + models/*.json (and the
Registry "Runs" column) so it stays correct as contributions land.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-11 16:11:04 +01:00
Jesse ZhangandClaude Fable 5 0facc860b3 Set Composer 2.5 (Grok Build TUI) effort to Default, not blank
A missing effort reads as Max by the repo's "effort defaults to max"
convention; this run was the harness default, so set it explicitly to
"Default" and surface it in both README registry rows.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-11 16:00:39 +01:00
Jesse ZhangandClaude Fable 5 1857323b57 Frame the eval unit as an Agent (Model + Harness) in both READMEs
Lead the model-vs-harness section with the equation Model + Harness =
Agent (English equation + Chinese gloss): a model is just weights; wrapped
in a harness it becomes an agent that does the work, and that agent is the
unit this bench evaluates. Effort is reframed as a parameter of the agent.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-11 15:22:17 +01:00
Jesse ZhangandClaude Fable 5 debe4105a8 Register Composer 2.5 × Grok Build TUI; fix its MythiCraft enter-world crash
New Agent composer-2-5-grok-build (Composer 2.5 model in the Grok Build TUI
harness, contributor Nagi-ovo), two runs: mythos-craft + pelican-cycling.

mythos-craft fix (1 line): the WOOD block defines only top+side faces (no
bottom), but the atlas builder requests top/side/bottom for every block.
Fetching WOOD's bottom read t.bottom.image off undefined and threw a
TypeError at the top level of initTextures(), aborting init before the
"enter world" click listener attached — so clicking the start button did
nothing. getFaceImage now falls back to an existing face when one is
missing (bottom→top, the correct ring end-grain for a log). Verified in
headless Chrome: click now fires requestPointerLock and the overlay hides.

Artifacts renamed to the case-id convention; README registry rows synced
(Composer 2.5 now 3 runs across Cursor + Grok Build TUI).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-11 15:04:13 +01:00
Jesse ZhangandClaude Fable 5 c335473d93 Strip MiMo's embedded model name from its artifacts (blind-Arena identity leak)
MiMo v2.5 Pro's one-shot outputs wrote the model name into the browser
title, an on-screen "Generated by MiMo v2.5 Pro" caption, a console log
(mythos-craft.html) and a watermark text at the bottom of the SVG
(pelican-cycling.svg), which would reveal its identity during blind
Arena voting. Removed those identity strings; generation logic untouched.
Documented the surgical fix in both run notes. MiMo was the only entry
with a visible model-name leak.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-11 14:31:19 +01:00
Jesse ZhangandClaude Fable 5 48a8f54c6f Add social badges to the READMEs
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-11 00:08:54 +01:00
Jesse ZhangandClaude Fable 5 80a97bfe21 Regroup the registry tables by model, matching the site
One row per model with its harness x effort combinations listed
together; generated from models/*.json.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 23:54:55 +01:00
Jesse ZhangandClaude Fable 5 8acf16262f Rename Claude Code combination ids to the -cc suffix; refresh the Opus 4.8 mythos build
claude-fable-5-code -> claude-fable-5-cc, claude-opus-4-8 ->
claude-opus-4-8-cc (the entry id doubles as the outputs/ folder name).
The Opus mythos-craft artifact is a newer build of the same one-shot
provenance.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 23:07:51 +01:00
Jesse ZhangandClaude Fable 5 b42022e8ce Keep CLAUDE.md local-only
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 22:43:23 +01:00