Split LpIuma's AI Studio Gemini runs into their own combinations; add PR template; register Kimi mythos run
Per PR #2's description those two pelicans were generated in Google AI Studio, not AntiGravity — they move to gemini-3-1-pro-aistudio and gemini-3-5-flash-aistudio entries (harness Google AI Studio, High). XA2333's unknown-environment runs stay where they were, disclaimed in their notes. Adds a bilingual PR template asking for harness/effort/ one-shot info up front, and registers the new Kimi K2.6 mythos-craft artifact (16 combinations ran). Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
1 parent
b7d3badc72
commit
844ab3b63f
11 files changed
+1677
-26
No files matched your search
@@ -0,0 +1,18 @@
|
|||||||
|
<!-- 感谢贡献!只需两类文件:outputs/<model-id>/<case-id>.<ext> + models/<model-id>.json -->
|
||||||
|
<!-- Thanks for contributing! Only two kinds of files: the artifact + the JSON registration. -->
|
||||||
|
|
||||||
|
## 产出说明 / Run info
|
||||||
|
|
||||||
|
- 模型 / Model:
|
||||||
|
- 运行环境 / Harness(如 ChatGPT Web、Claude Code、Google AI Studio、本地 CLI…):
|
||||||
|
- 思考配额 / Thinking effort(如 Max、High、Extended Pro、Thinking…):
|
||||||
|
- 是否一次生成 / One-shot? (是/否;若有修复请在 note 里说明 / if fixed, document it in the note)
|
||||||
|
|
||||||
|
## 自查 / Checklist
|
||||||
|
|
||||||
|
- [ ] `models/<model-id>.json` 中 `harness` 与 `effort` 已如实填写(站点据此生成 metadata 与品牌 icon)
|
||||||
|
- [ ] 每条 run 的 `note` 双语(zh + en)填写了上面的来历信息 / bilingual `note` documents the provenance above
|
||||||
|
- [ ] `contributor` 是我的 GitHub 用户名 / `contributor` is my GitHub username
|
||||||
|
- [ ] 同一模型在不同 Harness 或思考配额下是**新建一个 JSON 条目**,不是塞进现有条目 / a different harness or effort = a NEW json entry, not a variant
|
||||||
|
|
||||||
|
<!-- CI 会跑数据校验 + 构建;规则详见 README「贡献一个模型产出」。 -->
|
||||||
+5
-3
@@ -20,15 +20,17 @@ One-shot LLM eval cases by NAGI STUDIO: same prompt, different model x harness x
|
|||||||
| Claude Fable 5 | Anthropic | Claude Code | Max | 02 |
|
| Claude Fable 5 | Anthropic | Claude Code | Max | 02 |
|
||||||
| GPT-5.5 Pro | OpenAI | ChatGPT Web | Extended Pro | 02 |
|
| GPT-5.5 Pro | OpenAI | ChatGPT Web | Extended Pro | 02 |
|
||||||
| GPT-5.5 | OpenAI | Codex CLI (no skills) | xhigh | 02 |
|
| GPT-5.5 | OpenAI | Codex CLI (no skills) | xhigh | 02 |
|
||||||
| Gemini 3.1 Pro | Google | AntiGravity | High | 03 |
|
| Gemini 3.1 Pro | Google | AntiGravity | High | 02 |
|
||||||
| Gemini 3.5 Flash | Google | AntiGravity | High | 03 |
|
| Gemini 3.1 Pro | Google | Google AI Studio | High | 01 |
|
||||||
|
| Gemini 3.5 Flash | Google | AntiGravity | High | 02 |
|
||||||
|
| Gemini 3.5 Flash | Google | Google AI Studio | High | 01 |
|
||||||
| Grok Build | xAI | Grok Build TUI (local) | Max | 02 |
|
| Grok Build | xAI | Grok Build TUI (local) | Max | 02 |
|
||||||
| Composer 2.5 | Cursor | Cursor | Max | 01 |
|
| Composer 2.5 | Cursor | Cursor | Max | 01 |
|
||||||
| DeepSeek-V4-Pro | DeepSeek | Claude Code | Max | 02 |
|
| DeepSeek-V4-Pro | DeepSeek | Claude Code | Max | 02 |
|
||||||
| Doubao Seed 2.0 Pro | ByteDance | Doubao Web | Pro Mode | 01 |
|
| Doubao Seed 2.0 Pro | ByteDance | Doubao Web | Pro Mode | 01 |
|
||||||
| Doubao Seed 2.0 Mini | ByteDance | Doubao Web | Fast Mode | 01 |
|
| Doubao Seed 2.0 Mini | ByteDance | Doubao Web | Fast Mode | 01 |
|
||||||
| MiMo v2.5 Pro | Xiaomi | Claude Code | Max | 02 |
|
| MiMo v2.5 Pro | Xiaomi | Claude Code | Max | 02 |
|
||||||
| Kimi K2.6 | Moonshot AI | Kimi Code (local) | Default | 01 |
|
| Kimi K2.6 | Moonshot AI | Kimi Code (local) | Default | 02 |
|
||||||
| MiniMax M3 | MiniMax | MiniMax Code Web | Thinking | 01 |
|
| MiniMax M3 | MiniMax | MiniMax Code Web | Thinking | 01 |
|
||||||
|
|
||||||
Pending: Mistral Medium 3.5 · GLM-5.1 · Qwen3.7-Max (PRs welcome)
|
Pending: Mistral Medium 3.5 · GLM-5.1 · Qwen3.7-Max (PRs welcome)
|
||||||
|
|||||||
@@ -20,15 +20,17 @@ NAGI STUDIO 的 LLM 测评案例集:同一段提示词,不同「模型 × Ha
|
|||||||
| Claude Fable 5 | Anthropic | Claude Code | Max | 02 |
|
| Claude Fable 5 | Anthropic | Claude Code | Max | 02 |
|
||||||
| GPT-5.5 Pro | OpenAI | ChatGPT 网页版 | Extended Pro | 02 |
|
| GPT-5.5 Pro | OpenAI | ChatGPT 网页版 | Extended Pro | 02 |
|
||||||
| GPT-5.5 | OpenAI | Codex CLI(无 skill) | xhigh | 02 |
|
| GPT-5.5 | OpenAI | Codex CLI(无 skill) | xhigh | 02 |
|
||||||
| Gemini 3.1 Pro | Google | AntiGravity | High | 03 |
|
| Gemini 3.1 Pro | Google | AntiGravity | High | 02 |
|
||||||
| Gemini 3.5 Flash | Google | AntiGravity | High | 03 |
|
| Gemini 3.1 Pro | Google | Google AI Studio | High | 01 |
|
||||||
|
| Gemini 3.5 Flash | Google | AntiGravity | High | 02 |
|
||||||
|
| Gemini 3.5 Flash | Google | Google AI Studio | High | 01 |
|
||||||
| Grok Build | xAI | Grok Build TUI(本地) | Max | 02 |
|
| Grok Build | xAI | Grok Build TUI(本地) | Max | 02 |
|
||||||
| Composer 2.5 | Cursor | Cursor | Max | 01 |
|
| Composer 2.5 | Cursor | Cursor | Max | 01 |
|
||||||
| DeepSeek-V4-Pro | DeepSeek | Claude Code | Max | 02 |
|
| DeepSeek-V4-Pro | DeepSeek | Claude Code | Max | 02 |
|
||||||
| Doubao Seed 2.0 Pro | ByteDance | 豆包网页版 | 超能模式 | 01 |
|
| Doubao Seed 2.0 Pro | ByteDance | 豆包网页版 | 超能模式 | 01 |
|
||||||
| Doubao Seed 2.0 Mini | ByteDance | 豆包网页版 | 快速模式 | 01 |
|
| Doubao Seed 2.0 Mini | ByteDance | 豆包网页版 | 快速模式 | 01 |
|
||||||
| MiMo v2.5 Pro | Xiaomi | Claude Code | Max | 02 |
|
| MiMo v2.5 Pro | Xiaomi | Claude Code | Max | 02 |
|
||||||
| Kimi K2.6 | Moonshot AI | Kimi Code(本地) | Default | 01 |
|
| Kimi K2.6 | Moonshot AI | Kimi Code(本地) | Default | 02 |
|
||||||
| MiniMax M3 | MiniMax | MiniMax Code 网页版 | Thinking | 01 |
|
| MiniMax M3 | MiniMax | MiniMax Code 网页版 | Thinking | 01 |
|
||||||
|
|
||||||
待测:Mistral Medium 3.5 · GLM-5.1 · Qwen3.7-Max(欢迎 PR 补充)
|
待测:Mistral Medium 3.5 · GLM-5.1 · Qwen3.7-Max(欢迎 PR 补充)
|
||||||
|
|||||||
@@ -0,0 +1,16 @@
|
|||||||
|
{
|
||||||
|
"label": "Gemini 3.1 Pro",
|
||||||
|
"vendor": "Google",
|
||||||
|
"harness": "Google AI Studio",
|
||||||
|
"effort": "High",
|
||||||
|
"order": 42,
|
||||||
|
"runs": {
|
||||||
|
"pelican-cycling": {
|
||||||
|
"note": {
|
||||||
|
"zh": "在 Google AI Studio 以 Gemini 3.1 Pro Preview High(最高思考强度)一次生成。",
|
||||||
|
"en": "Generated in Google AI Studio on Gemini 3.1 Pro Preview High (max thinking effort) in one shot."
|
||||||
|
},
|
||||||
|
"contributor": "LpIuma"
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -12,15 +12,7 @@
|
|||||||
},
|
},
|
||||||
"contributor": "Nagi-ovo"
|
"contributor": "Nagi-ovo"
|
||||||
},
|
},
|
||||||
"pelican-cycling": [
|
"pelican-cycling": {
|
||||||
{
|
|
||||||
"note": {
|
|
||||||
"zh": "在 Google AI Studio 以 Gemini 3.1 Pro Preview High(最高思考强度)一次生成。",
|
|
||||||
"en": "Generated in Google AI Studio on Gemini 3.1 Pro Preview High (max thinking effort) in one shot."
|
|
||||||
},
|
|
||||||
"contributor": "LpIuma"
|
|
||||||
},
|
|
||||||
{
|
|
||||||
"file": "pelican-cycling-2.svg",
|
"file": "pelican-cycling-2.svg",
|
||||||
"note": {
|
"note": {
|
||||||
"zh": "由社区 PR #3(Codex 工作流)提交,提交者未注明运行环境与思考档位。",
|
"zh": "由社区 PR #3(Codex 工作流)提交,提交者未注明运行环境与思考档位。",
|
||||||
@@ -28,6 +20,5 @@
|
|||||||
},
|
},
|
||||||
"contributor": "XA2333"
|
"contributor": "XA2333"
|
||||||
}
|
}
|
||||||
]
|
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
@@ -0,0 +1,16 @@
|
|||||||
|
{
|
||||||
|
"label": "Gemini 3.5 Flash",
|
||||||
|
"vendor": "Google",
|
||||||
|
"harness": "Google AI Studio",
|
||||||
|
"effort": "High",
|
||||||
|
"order": 52,
|
||||||
|
"runs": {
|
||||||
|
"pelican-cycling": {
|
||||||
|
"note": {
|
||||||
|
"zh": "在 Google AI Studio 以 Gemini 3.5 Flash High(最高思考强度)一次生成。",
|
||||||
|
"en": "Generated in Google AI Studio on Gemini 3.5 Flash High (max thinking effort) in one shot."
|
||||||
|
},
|
||||||
|
"contributor": "LpIuma"
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -12,15 +12,7 @@
|
|||||||
},
|
},
|
||||||
"contributor": "Nagi-ovo"
|
"contributor": "Nagi-ovo"
|
||||||
},
|
},
|
||||||
"pelican-cycling": [
|
"pelican-cycling": {
|
||||||
{
|
|
||||||
"note": {
|
|
||||||
"zh": "在 Google AI Studio 以 Gemini 3.5 Flash High(最高思考强度)一次生成。",
|
|
||||||
"en": "Generated in Google AI Studio on Gemini 3.5 Flash High (max thinking effort) in one shot."
|
|
||||||
},
|
|
||||||
"contributor": "LpIuma"
|
|
||||||
},
|
|
||||||
{
|
|
||||||
"file": "pelican-cycling-2.svg",
|
"file": "pelican-cycling-2.svg",
|
||||||
"note": {
|
"note": {
|
||||||
"zh": "由社区 PR #3(Codex 工作流)提交,提交者未注明运行环境与思考档位。",
|
"zh": "由社区 PR #3(Codex 工作流)提交,提交者未注明运行环境与思考档位。",
|
||||||
@@ -28,6 +20,5 @@
|
|||||||
},
|
},
|
||||||
"contributor": "XA2333"
|
"contributor": "XA2333"
|
||||||
}
|
}
|
||||||
]
|
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
@@ -5,6 +5,13 @@
|
|||||||
"harness": "Kimi Code",
|
"harness": "Kimi Code",
|
||||||
"effort": "Default",
|
"effort": "Default",
|
||||||
"runs": {
|
"runs": {
|
||||||
|
"mythos-craft": {
|
||||||
|
"note": {
|
||||||
|
"zh": "在本地以 Kimi Code(harness)运行 Kimi K2.6 一次生成,本页为未经修改的原始产出。",
|
||||||
|
"en": "Generated in one shot by Kimi K2.6 running locally in Kimi Code; unmodified original output."
|
||||||
|
},
|
||||||
|
"contributor": "Nagi-ovo"
|
||||||
|
},
|
||||||
"pelican-cycling": {
|
"pelican-cycling": {
|
||||||
"note": {
|
"note": {
|
||||||
"zh": "在本地以 Kimi Code(harness)运行 Kimi K2.6 一次生成。",
|
"zh": "在本地以 Kimi Code(harness)运行 Kimi K2.6 一次生成。",
|
||||||
|
|||||||
File renamed without changes.
|
Before Width: | Height: | Size: 24 KiB After Width: | Height: | Size: 24 KiB |
File renamed without changes.
|
Before Width: | Height: | Size: 20 KiB After Width: | Height: | Size: 20 KiB |
File diff suppressed because it is too large.
Load diff
Reference in new issue
Block a user