shuiyuPyLab/nagi-bench
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
144 Commits 2 Branches 0 Tags
add-spark-x2-pelican-cycling
Commit Graph
144 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
shuiyu67 adccd71f04 fix: move artifact to two-level artifactDir path 2026-07-18 07:54:45 +08:00
shuiyu67 79f6fcb41b fix: remove emojis from pelican-cycling SVG 2026-07-18 00:49:20 +08:00
shuiyu67 07c124c8e0 feat: add Spark X2 pelican-cycling run 2026-07-18 00:42:34 +08:00
Jesse Zhang 6580a7e931 Reorder cases: Turf War (04) before CS Dust2 (05)
CI / validate (push) Canceled after 0s
Details
CI / sync-registry (push) Canceled after 0s
Details
CI / trigger-site-rebuild (push) Canceled after 0s
Details
2026-07-17 02:31:20 +01:00
github-actions[bot] 65b4d476a1 chore: sync README registry [skip ci] 2026-07-17 00:46:52 +00:00
Jesse ZhangandClaude Opus 4.8 bf0cb78d19 validate-data: handle agent-kind cases (turf-war) 
Port the agent-kind skip + agentName check from the site validator so
turf-war runs (private policy, no public artifact) pass instead of erroring.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-17 01:46:31 +01:00
Jesse ZhangandClaude Opus 4.8 63570b1e6e Add Kimi K3 (Kimi Code, Max) — mythos, pelican, turf-war 蚕食 
Turf-war agent registered (policy stays private on the referee side).
Diagnosis: legal + fuel-safe but weak, loses ~3:1 to baseline (318:1045).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-17 01:22:54 +01:00
Jesse ZhangandClaude Opus 4.8 5e154e2309 Add Inkling (Thinking Machines Lab, Tinker Web xHigh) — mythos-craft + pelican 
One-shot, unmodified.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-16 15:54:23 +01:00
Jesse ZhangandClaude Opus 4.8 f2919d801b Add Kimi K3 (Kimi Web Max) mythos-craft run 
One-shot, unmodified.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-16 15:39:38 +01:00
Jesse Zhang 4b2a9e0173 Register Gemini 3.1 Pro (AntiGravity) turf-war run (寒冰王座) — mid-tier, even with baseline 2026-07-14 17:05:30 +01:00
Jesse Zhang 1c4e949930 Register Fable 5 CC Max turf-war run (地头蛇) — solid strong performer 2026-07-14 17:01:56 +01:00
Jesse Zhang 0d4baeeae4 Register Fable 5 CC xhigh turf-war run (画地为牢) — aggressive, opposite of the High turtle 2026-07-14 15:41:20 +01:00
Jesse Zhang 1f084eb34f turf-war prompt: agents write to a file, not 'output' — reword the chatbox-flavored line 2026-07-14 14:50:24 +01:00
Jesse Zhang 33e69b253e turf-war prompt: revert to incremental file-writing (per-response max_tokens is independent per edit; one giant write hits the cap incl. thinking tokens) 2026-07-14 14:31:09 +01:00
Jesse Zhang 52996604bf turf-war prompt: write policy in one compact pass (no incremental rewrites, no giant tables) to avoid output-token-limit failures 2026-07-14 14:27:59 +01:00
Jesse Zhang 90500bb8d6 Register Sonnet 5 CC Max (卷地风); add precise root-cause diagnosis to underperformer notes (Terra/Opus-xhigh/Fable-high) 2026-07-14 13:52:28 +01:00
Jesse Zhang e215627e68 Register three Claude turf-war runs: Fable 5 CC High, Opus 4.8 CC Max/xhigh (self-named) 2026-07-14 12:40:01 +01:00
Jesse Zhang 7d9dd07cc6 turf-war prompt: file-capable harnesses build the file incrementally (avoid single-output truncation on long policies); still no test runs 2026-07-14 12:04:12 +01:00
Jesse Zhang d3b92ccee8 turf-war: Terra did self-name — register agentName 拓荒狐 2026-07-14 03:46:13 +01:00
Jesse Zhang 2a024a9dc8 Register three turf-war runs: GPT-5.6-Sol (Codex CLI max/xhigh), GPT-5.6-Terra (Codex CLI xhigh) 
Policies stay private per case rules; maintainer-executed one-shot runs.
 2026-07-14 03:34:46 +01:00
Jesse Zhang ce9fd8bafe turf-war prompt: opponents are other Agents (model x harness), not 'AI models' 2026-07-14 03:19:40 +01:00
Jesse Zhang 43a70bd651 turf-war prompt: maintainer-filled [This run] line (model x harness x effort, target filename) 2026-07-14 03:09:38 +01:00
Jesse Zhang 9cd85bad21 turf-war prompt: deliver a file (save turf-war.js in file-capable harnesses, print content otherwise) 2026-07-14 03:07:30 +01:00
Jesse Zhang 5c2a55bbb2 turf-war prompt: agents name themselves (fun name, <=5 chars zh / one short word en) 2026-07-14 03:00:28 +01:00
Jesse Zhang 379ab28279 turf-war prompt: forbid web search / skills / external tools / test runs (world-knowledge only) 2026-07-14 02:55:04 +01:00
Jesse Zhang 6dccc35cd8 Turf War is maintainer-run: no artifact PRs, policies stay private (anti-scouting); README case list updated to five cases 2026-07-14 02:50:27 +01:00
Jesse Zhang 50fb9978dc Add case 05 Turf War (kind: agent) + agent-case contribution guide 
One-shot JS policy agents battle head-to-head on a 40x40 grid; ranked by
objective wins (Bradley-Terry), refereed server-side. Inspired by Jiayi
Weng's Learning Beyond Gradients.
 2026-07-14 02:24:07 +01:00
github-actions[bot] 1142b7dfde chore: sync README registry [skip ci] 2026-07-13 23:08:59 +00:00
Jesse ZhangandClaude Opus 4.8 e3a60756f9 chore: regroup registry order by vendor 
GLM-5.1 -> 120 (beside GLM-5.2/Turbo), DeepSeek V4 Flash -> 90.5 (beside V4-Pro), Nex-AGI -> 65 (out of the xAI block).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-14 00:08:28 +01:00
Jesse ZhangandClaude Opus 4.8 cbfce3b7cc feat: add cs-dust2 React case with two model takes + react kind support 
New case cs-dust2 (kind:react): a from-scratch React + three.js 5v5 Dust2 FPS.
Two takes registered: Claude Fable 5 / Claude Code / High (with a hand fix for a
64Hz fixed-step firing bug on high-refresh displays) and Claude Opus 4.8 /
Claude Code / Max (dust2-arena, one-shot). React cases commit source only; the
single file is built from source at deploy time. validate-data.ts now accepts a
React project directory as the declared artifact. AGENTS.md rewritten
English-only with React-case, bare-harness (no skills/plugins) and
artifact-anonymity rules.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-14 00:08:28 +01:00
github-actions[bot] c4cc293748 chore: sync README registry [skip ci] 2026-07-13 13:04:58 +00:00
_‭⁧HachiMahiro哈基寻⁧‭ e166e31d92 feat(gem3.1proais):add Gemini 3.1 Pro AiStudio High skeleton-watch benchmark (#33) 
* Add files via upload

* Update contributor information in JSON file

* Change contributor and update notes in JSON file

Updated contributor name and modified notes for clarity.
 2026-07-13 14:04:30 +01:00
Chang ZhouandAv1dity 7475999bff feat: Add DeepSeek V4 Flash with Claude Code Max run mythos-craft (#34) 
* feat: Add DeepSeek V4 Flash Claude Code Max run mythos-craft

* feat: Remove emoji from UI-bound artifact text

* feat: Remove emoji completely

---------

Co-authored-by: Av1dity <av1dity@users.noreply.github.com>
 2026-07-13 14:04:27 +01:00
github-actions[bot] a1802f0baf chore: sync README registry [skip ci] 2026-07-09 23:38:19 +00:00
Jesse ZhangandClaude Opus 4.8 5d52843621 fix: order GPT-5.5 Pro below GPT-5.6 (newest-first within OpenAI) 
GPT-5.5 Pro sat at order 20, above the GPT-5.6 entries, breaking the
newest-first grouping used elsewhere. Move it to 29.8 so the OpenAI block
reads 5.6 -> 5.5 -> 5.4 -> 5.3 -> 5.2.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-10 00:37:57 +01:00
github-actions[bot] 64c033c5a7 chore: sync README registry [skip ci] 2026-07-09 22:09:38 +00:00
Jesse ZhangandClaude Opus 4.8 b8ed871bc0 docs: document multi-take variant arrays in AGENTS.md 
Explain when runs.<case> becomes an array (same model x harness x effort,
several takes), the distinct-descriptive-file rule, the index.html trap,
and per-variant contributor.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-09 23:09:15 +01:00
Jesse ZhangandClaude Opus 4.8 64609bd6c8 feat: add GPT-5.6-Terra and alternate takes for GPT-5.6-Sol 
New model gpt-5-6-terra (Codex CLI, ultra): mythos-craft, pelican-cycling,
skeleton-watch (one-shot, unmodified).

gpt-5-6-sol-ultra gains alternate one-shot variants for existing cases:
mythos-craft 'Block Era', two more pelican SVGs, and a cleanly completed
skeleton-watch 'Calibre 01' kept alongside the interruption-recovered
AURELIUS S-01. Extra variants attributed to Nagi-ovo.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-09 23:09:15 +01:00
github-actions[bot] 97e9a860a1 chore: sync README registry [skip ci] 2026-07-09 19:24:14 +00:00
mintcolorandDuJiabao e14d6cd59f feat: add Grok 4.5 benchmark results (#31) 
Co-authored-by: DuJiabao <Jiabao.du@Yunzhisun.com>
 2026-07-09 20:23:47 +01:00
ZidongChen25 807bdac433 feat: add GPT-5.6-Sol benchmark results (#32) 2026-07-09 20:23:36 +01:00
github-actions[bot] 2192d05ac8 chore: sync README registry [skip ci] 2026-07-06 23:26:03 +00:00
lupan-luand卢盼 ffdd06626f feat: add skeleton-watch and pelican-cycling for Gemini 3.1 Pro × Gemini Web × Deep Think (#30) 
Co-authored-by: 卢盼 <lupan@lupandeMac-Studio.local>
 2026-07-07 00:25:40 +01:00
github-actions[bot] ada382b2dc chore: sync README registry [skip ci] 2026-07-03 21:43:24 +00:00
lupan-luand卢盼 47a02cb481 feat: add Gemini 3.1 Pro × Gemini Web × Deep Think for mythos-craft (#29) 
Co-authored-by: 卢盼 <lupan@lupandeMac-Studio.local>
 2026-07-03 22:43:04 +01:00
github-actions[bot] 6c87c23963 chore: sync README registry [skip ci] 2026-07-02 16:15:51 +00:00
BaiLin-William 1a6b884f75 contrib: MiMo V2.5 (High) all cases 
Adds MiMo V2.5 (High) MiMo Code artifacts for mythos-craft, pelican-cycling, and skeleton-watch. Maintainer-adjusted skeleton-watch visible calibre label to avoid blind Arena identity leakage.
 2026-07-02 17:15:27 +01:00
Jesse Zhang acb27270f0 docs: scope Codex review for benchmark artifacts 2026-07-02 17:08:18 +01:00
github-actions[bot] c726210500 chore: sync README registry [skip ci] 2026-07-02 01:00:01 +00:00
Jesse Zhang 5823fed8e1 Add Claude Fable 5 Claude Code xhigh skeleton-watch run 2026-07-02 01:59:34 +01:00