Commit Graph
32 Commits
Author SHA1 Message Date
Jesse Zhang cb79f09c88 Fix Cursor run contributor handles 2026-06-13 20:52:31 +01:00
Jesse Zhang 3936cd26af Add Cursor runs for Claude and Gemini models 2026-06-13 19:24:46 +01:00
Jesse ZhangandClaude Opus 4.8 9bc21c2ace Add GLM-5.2 as a pending model
Zhipu AI's GLM-5.2 listed alongside GLM-5.1 as awaiting a contribution (no
runs yet). Added to both README pending lines.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-13 14:43:15 +01:00
b6b60b6e1e feat: add Kimi K2.7-Code mythos-craft run (#11)
* feat: add Kimi K2.7-Code mythos-craft run

* Move Kimi K2.7-Code mythos-craft to its artifactDir path

Conform the new run to the model/harness artifact layout merged into main
(outputs/kimi-k2-7-code/kimi-code-thinking/). Validates: Data OK, 25 models.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

---------

Co-authored-by: OHCJ099 <OHCJ099@users.noreply.github.com>
Co-authored-by: Jesse Zhang <101612750+Nagi-ovo@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-13 14:31:27 +01:00
Jesse Zhang a12017f31e Reorganize artifacts by model and harness 2026-06-13 12:59:01 +01:00
Junchao MaoandClaude Opus 4.8 4f37651620 Add Opus 4.8 (Claude Code) v2 runs for both cases (#10)
Second-version artifacts for claude-opus-4-8-cc, generated one-shot:
- pelican-cycling-2.svg: hand-authored seaside SVG of a pelican on a bicycle
- mythos-craft-2.html: Three.js voxel world (Perlin terrain, WASD + mouse
  look, break/place, marble temple + crystal spires + floating isle)

Registers both as file-keyed array variants with bilingual provenance
notes; contributor OHMFOHS. Passes scripts/validate-data.ts.

Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-13 11:55:13 +01:00
Jesse ZhangandClaude Opus 4.8 5f6a44aff7 Qwen3.7-Max: use the red-bike pelican variant
Swap pelican-cycling.svg to the red-bicycle one-shot version (with a pelican
side-profile study inset); drop the blue-bike variant so only the red one and
its matching mythos-craft.html remain. Note updated to mention the inset.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-13 11:52:38 +01:00
Jesse ZhangandClaude Opus 4.8 f21944db77 Add Qwen3.7-Max (Qoder) runs for both cases
One-shot, unmodified outputs for Qwen3.7-Max (Alibaba) run in Qoder, default
thinking; contributor Nagi-ovo.

- outputs/qwen3-7-max/mythos-craft.html — Three.js voxel world (chunked
  terrain, first-person controls, break/place, fantasy structures).
- outputs/qwen3-7-max/pelican-cycling.svg — hand-authored seaside SVG, pelican
  on a bicycle with a side-profile study inset.

Filenames normalized to the canonical case ids and the folder renamed to match
the model id (qwen3-7-max). Moved out of Pending in both README registries.
Validates: Data OK, 25 models.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-13 11:43:21 +01:00
OHCJ099andOHCJ099 70b13fcee2 feat: add Kimi K2.7-Code under Kimi Code (#9)
Co-authored-by: OHCJ099 <OHCJ099@users.noreply.github.com>
2026-06-13 10:06:25 +01:00
Jesse ZhangandClaude Opus 4.8 dc9ad36359 Register Mistral Medium 3.5 × Vibe (Thinking)
Two one-shot runs generated in the Vibe web app (Mistral's renamed
Le Chat, Thinking enabled), contributed by Nagi-ovo.

mythos-craft is a fixed build (1 line changed): the world synchronously
built the full RENDER_DISTANCE=4 ring (9x9 = 81 chunks) on load, each
chunk doing an O(voxels x structures) linear scan over mythStructures
for all 16x16x128 voxels, so the main thread froze before the first
frame and the page never opened. RENDER_DISTANCE 4 -> 1 (a 3x3 = 9-chunk
first-screen load) lets it open at 60fps; terrain/visuals/gameplay are
the model's original output, otherwise unmodified. pelican-cycling is
unmodified. Both documented in the run notes; READMEs updated.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-12 23:53:16 +01:00
OHCJ099andOHCJ099 f4f4530797 feat: add Nex-N2-Pro under Claude Code (#8)
* feat: add Nex-N2-Pro under Claude Code

* feat: add pelican-cycling SVG run for Nex-N2-Pro

---------

Co-authored-by: OHCJ099 <OHCJ099@users.noreply.github.com>
2026-06-12 10:31:48 +01:00
Jesse ZhangandClaude Opus 4.8 9b58bac621 Composer 2.5 Cursor "Fast": effort is Default, not a thinking budget
Cursor's Composer "Fast" is a serving tier (lower latency, higher cost, same
model intelligence) — not a reasoning-effort level. Drop the Fast/effort framing
entirely: effort is Default, notes just state a plain one-shot Composer 2.5 run.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-11 22:40:31 +01:00
Jesse ZhangandClaude Opus 4.8 df5a53a6b6 Composer 2.5 Fast: label is "Composer 2.5", "Fast" is the effort
The Cursor "Fast" run was registered as label "Composer 2.5 Fast" with effort
"Max" — contradictory, and it baked the speed mode into the model name. Per the
model x harness x effort convention (cf. the Grok Build TUI entry), the label is
just "Composer 2.5" and Fast is the effort, so it sits next to the Cursor · Max
entry as a thinking-budget comparison. Fixed the run notes to match, and synced
both README registry tables (which had also missed the Cursor · High Claude
Fable 5 entry from the prior merge).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-11 21:32:36 +01:00
驱不散的雾andCursor db5b9beb14 Register Claude Fable 5 × Cursor (High) (#7)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-11 20:24:48 +01:00
驱不散的雾andCursor 6fbf660b49 Register Composer 2.5 Fast × Cursor (Max) (#6)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-11 20:24:44 +01:00
Jesse ZhangandClaude Fable 5 0facc860b3 Set Composer 2.5 (Grok Build TUI) effort to Default, not blank
A missing effort reads as Max by the repo's "effort defaults to max"
convention; this run was the harness default, so set it explicitly to
"Default" and surface it in both README registry rows.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-11 16:00:39 +01:00
Jesse ZhangandClaude Fable 5 debe4105a8 Register Composer 2.5 × Grok Build TUI; fix its MythiCraft enter-world crash
New Agent composer-2-5-grok-build (Composer 2.5 model in the Grok Build TUI
harness, contributor Nagi-ovo), two runs: mythos-craft + pelican-cycling.

mythos-craft fix (1 line): the WOOD block defines only top+side faces (no
bottom), but the atlas builder requests top/side/bottom for every block.
Fetching WOOD's bottom read t.bottom.image off undefined and threw a
TypeError at the top level of initTextures(), aborting init before the
"enter world" click listener attached — so clicking the start button did
nothing. getFaceImage now falls back to an existing face when one is
missing (bottom→top, the correct ring end-grain for a log). Verified in
headless Chrome: click now fires requestPointerLock and the overlay hides.

Artifacts renamed to the case-id convention; README registry rows synced
(Composer 2.5 now 3 runs across Cursor + Grok Build TUI).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-11 15:04:13 +01:00
Jesse ZhangandClaude Fable 5 c335473d93 Strip MiMo's embedded model name from its artifacts (blind-Arena identity leak)
MiMo v2.5 Pro's one-shot outputs wrote the model name into the browser
title, an on-screen "Generated by MiMo v2.5 Pro" caption, a console log
(mythos-craft.html) and a watermark text at the bottom of the SVG
(pelican-cycling.svg), which would reveal its identity during blind
Arena voting. Removed those identity strings; generation logic untouched.
Documented the surgical fix in both run notes. MiMo was the only entry
with a visible model-name leak.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-11 14:31:19 +01:00
Jesse ZhangandClaude Fable 5 8acf16262f Rename Claude Code combination ids to the -cc suffix; refresh the Opus 4.8 mythos build
claude-fable-5-code -> claude-fable-5-cc, claude-opus-4-8 ->
claude-opus-4-8-cc (the entry id doubles as the outputs/ folder name).
The Opus mythos-craft artifact is a newer build of the same one-shot
provenance.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 23:07:51 +01:00
Jesse ZhangandClaude Fable 5 42efab56e2 Register the Opus 4.8 mythos-craft run (Claude Code, Max)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 22:42:31 +01:00
Jesse ZhangandClaude Fable 5 5694580fe4 Confirm Opus 4.8 provenance (Claude Code, Max); fresh Turnstile token per sync batch
Turnstile tokens are single-use — the old implementation memoized one
token forever, so every batch after the first would fail verification.
Each sync now runs a fresh invisible challenge, and vote syncing is
debounced 2.5s so rapid ballots coalesce into one batch + one challenge.
OG count 16 -> 17 ran.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 20:50:24 +01:00
Jesse ZhangandClaude Fable 5 4e4f801f1f Register the Opus 4.8 pelican (provenance TBD); ignore wrangler local state
The artifact landed unregistered which would fail CI's loose-file check;
note marks harness/effort as to-be-confirmed. worker/.wrangler/ cache is
local tooling and leaves the repo.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 20:39:03 +01:00
Jesse ZhangandClaude Fable 5 bf23fc4168 One ballot per matchup + rating-aware matchmaking; register Opus 4.8 as pending
Every (voter, case, pair) now gets exactly one vote: the client sampler
only draws matchups the browser hasn't voted on (with a graduation state
once all are spent, counter shows voted/total pairs), and the worker
normalizes pair order on insert under a unique (ip, case, pair) index so
side-swapping can't double-count. Daily IP cap drops 300 -> 200 since a
voter graduates at ~171 pairs today.

Matchmaking is now active rather than uniform: unvoted pairs are drawn
with weight closeness/(1+battles) — close ratings and under-played
matchups surface more, unrated combos get placement matches first — with
a 25% pure-exploration floor. Ratings come from the community pool (60s
cached) and fall back to local votes. Rankings stay Bradley-Terry.

Also registers the empty outputs/claude-opus-4-8/ folder as a pending
registry entry.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 20:38:10 +01:00
Jesse ZhangandClaude Fable 5 532985fbc3 Correct Kimi Code effort to Thinking; standardize worker docs on bunx
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 20:13:54 +01:00
Jesse ZhangandClaude Fable 5 844ab3b63f Split LpIuma's AI Studio Gemini runs into their own combinations; add PR template; register Kimi mythos run
Per PR #2's description those two pelicans were generated in Google AI
Studio, not AntiGravity — they move to gemini-3-1-pro-aistudio and
gemini-3-5-flash-aistudio entries (harness Google AI Studio, High).
XA2333's unknown-environment runs stay where they were, disclaimed in
their notes. Adds a bilingual PR template asking for harness/effort/
one-shot info up front, and registers the new Kimi K2.6 mythos-craft
artifact (16 combinations ran).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 19:10:55 +01:00
Jesse ZhangandClaude Fable 5 b7d3badc72 Add four pelican runs: Fable 5 (Claude Code), Grok Build, Kimi K2.6, MiniMax M3
Kimi K2.6 (Kimi Code, local) and MiniMax M3 (MiniMax Code web, Thinking
mode) graduate from pending to ran — 14 combinations ran. Harness icon
rules added for Kimi/MiniMax; READMEs and OG count updated.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 18:24:32 +01:00
Jesse ZhangandClaude Fable 5 b008398b82 Register the Claude Code x Fable 5 Max combination as its own entry
The minecraft.html artifact is Fable 5 Max run inside Claude Code — a
different harness from the existing Claude Web App entry, so per the
model x harness x effort architecture it becomes a new combination
(claude-fable-5-code) rather than a variant. The validator now also
rejects loose files under outputs/<id>/ that no run declares, which is
how this artifact briefly slipped into the repo unregistered. OG count
refreshed (11 -> 12 ran).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 16:56:45 +01:00
Jesse ZhangandClaude Fable 5 4da51805b3 Rename the Codex CLI entry's model label back to GPT-5.5
There is no "GPT-5.5 Codex" model — Codex is the harness. The entry is
GPT-5.5 run in Codex CLI at xhigh effort, which the harness and effort
fields already record; READMEs and code comments updated to match.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 16:35:13 +01:00
Jesse ZhangandClaude Fable 5 2e03012b74 Add GPT-5.5 Pro pelican run
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 13:07:50 +01:00
Jesse ZhangandDuJiabao 50ff7f945d Contributor credits, SVG prefetch, integrate Xiaomi MiMo from PR #4
- Runs gain a contributor field (GitHub username); the site renders an
  avatar chip linked to their profile next to each run's notes, and CI
  validates the field. All existing runs are attributed.
- SVG variants of a case are prefetched during idle time, so switching
  model tabs swaps images without a network hiccup.
- Xiaomi MiMo v2.5 Pro (Claude Code, max effort) integrated from PR #4
  with both case runs and provenance notes; README registry tables
  updated.

Co-authored-by: DuJiabao <Jiabao.du@Yunzhisun.com>
2026-06-10 13:03:01 +01:00
e87ef7e70f Integrate community pelican runs from PRs #2 and #3; run variants
A combination can now ship multiple versions of the same case:
runs.<case-id> accepts an array, each extra variant naming its own
file; the viewer grows a RUN 01/02 switcher and validation enforces
distinct files plus a provenance note per variant.

Integrated content, attributed to their authors:
- Gemini 3.1 Pro + 3.5 Flash pelican runs from both PRs, shown as two
  variants each (PR #2's Google AI Studio runs first, PR #3's second)
- Doubao Seed 2.0 Pro / Mini pelican runs (folders renamed to the
  dash-only convention)
- GPT-5.5 Codex pelican run

Co-authored-by: lpluma <liuyz2023@mails.jlu.edu.cn>
Co-authored-by: XA2333 <97206278+XA2333@users.noreply.github.com>
2026-06-10 12:09:09 +01:00
Jesse ZhangandClaude Fable 5 80817b8a2b Data-only contributions: per-model JSON registry, validation, PR CI
Contributors no longer touch site code. Model registration moves from
cases.ts literals to repo-root models/<model-id>.json files (filename =
model id = outputs/ folder); cases move to cases.json; cases.ts now just
derives MODELS/RUNS via import.meta.glob. Parallel PRs stop conflicting
because each model owns its own file.

scripts/validate-data.ts runs inside `bun run build` and a new PR CI
workflow: dash-only ids, required bilingual provenance note per run,
declared artifacts must exist, no orphan outputs/ dirs.

Also: run notes render whitespace-pre-wrap (multi-line notes, idea from
PR #2), README contribution guide rewritten around the JSON template,
CLAUDE.md updated, OG card refreshed for the DeepSeek merge.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 11:48:18 +01:00