shuiyuPyLab/nagi-bench
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Split LpIuma's AI Studio Gemini runs into their own combinations; add PR template; register Kimi mythos run

Browse Source 
Per PR #2's description those two pelicans were generated in Google AI
Studio, not AntiGravity — they move to gemini-3-1-pro-aistudio and
gemini-3-5-flash-aistudio entries (harness Google AI Studio, High).
XA2333's unknown-environment runs stay where they were, disclaimed in
their notes. Adds a bilingual PR template asking for harness/effort/
one-shot info up front, and registers the new Kimi K2.6 mythos-craft
artifact (16 combinations ran).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
Jesse ZhangandClaude Fable 5 committed 2026-06-10 19:10:55 +01:00
1 parent b7d3badc72
commit 844ab3b63f
11 files changed
+1689 -38
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

README.en.md
+5 -3
View File
@@ -20,15 +20,17 @@ One-shot LLM eval cases by NAGI STUDIO: same prompt, different model x harness x
| Claude Fable 5 | Anthropic | Claude Code | Max | 02 |
| GPT-5.5 Pro | OpenAI | ChatGPT Web | Extended Pro | 02 |
| GPT-5.5 | OpenAI | Codex CLI (no skills) | xhigh | 02 |
| Gemini 3.1 Pro | Google | AntiGravity | High | 03 |
| Gemini 3.5 Flash | Google | AntiGravity | High | 03 |
| Gemini 3.1 Pro | Google | AntiGravity | High | 02 |
| Gemini 3.1 Pro | Google | Google AI Studio | High | 01 |
| Gemini 3.5 Flash | Google | AntiGravity | High | 02 |
| Gemini 3.5 Flash | Google | Google AI Studio | High | 01 |
| Grok Build | xAI | Grok Build TUI (local) | Max | 02 |
| Composer 2.5 | Cursor | Cursor | Max | 01 |
| DeepSeek-V4-Pro | DeepSeek | Claude Code | Max | 02 |
| Doubao Seed 2.0 Pro | ByteDance | Doubao Web | Pro Mode | 01 |
| Doubao Seed 2.0 Mini | ByteDance | Doubao Web | Fast Mode | 01 |
| MiMo v2.5 Pro | Xiaomi | Claude Code | Max | 02 |
| Kimi K2.6 | Moonshot AI | Kimi Code (local) | Default | 01 |
| Kimi K2.6 | Moonshot AI | Kimi Code (local) | Default | 02 |
| MiniMax M3 | MiniMax | MiniMax Code Web | Thinking | 01 |
Pending: Mistral Medium 3.5 · GLM-5.1 · Qwen3.7-Max (PRs welcome)