Split LpIuma's AI Studio Gemini runs into their own combinations; add PR template; register Kimi mythos run
Per PR #2's description those two pelicans were generated in Google AI Studio, not AntiGravity — they move to gemini-3-1-pro-aistudio and gemini-3-5-flash-aistudio entries (harness Google AI Studio, High). XA2333's unknown-environment runs stay where they were, disclaimed in their notes. Adds a bilingual PR template asking for harness/effort/ one-shot info up front, and registers the new Kimi K2.6 mythos-craft artifact (16 combinations ran). Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
1 parent
b7d3badc72
commit
844ab3b63f
11 files changed
+1689
-38
No files matched your search
@@ -0,0 +1,18 @@
|
||||
<!-- 感谢贡献!只需两类文件:outputs/<model-id>/<case-id>.<ext> + models/<model-id>.json -->
|
||||
<!-- Thanks for contributing! Only two kinds of files: the artifact + the JSON registration. -->
|
||||
|
||||
## 产出说明 / Run info
|
||||
|
||||
- 模型 / Model:
|
||||
- 运行环境 / Harness(如 ChatGPT Web、Claude Code、Google AI Studio、本地 CLI…):
|
||||
- 思考配额 / Thinking effort(如 Max、High、Extended Pro、Thinking…):
|
||||
- 是否一次生成 / One-shot? (是/否;若有修复请在 note 里说明 / if fixed, document it in the note)
|
||||
|
||||
## 自查 / Checklist
|
||||
|
||||
- [ ] `models/<model-id>.json` 中 `harness` 与 `effort` 已如实填写(站点据此生成 metadata 与品牌 icon)
|
||||
- [ ] 每条 run 的 `note` 双语(zh + en)填写了上面的来历信息 / bilingual `note` documents the provenance above
|
||||
- [ ] `contributor` 是我的 GitHub 用户名 / `contributor` is my GitHub username
|
||||
- [ ] 同一模型在不同 Harness 或思考配额下是**新建一个 JSON 条目**,不是塞进现有条目 / a different harness or effort = a NEW json entry, not a variant
|
||||
|
||||
<!-- CI 会跑数据校验 + 构建;规则详见 README「贡献一个模型产出」。 -->
|
||||
+5
-3
@@ -20,15 +20,17 @@ One-shot LLM eval cases by NAGI STUDIO: same prompt, different model x harness x
|
||||
| Claude Fable 5 | Anthropic | Claude Code | Max | 02 |
|
||||
| GPT-5.5 Pro | OpenAI | ChatGPT Web | Extended Pro | 02 |
|
||||
| GPT-5.5 | OpenAI | Codex CLI (no skills) | xhigh | 02 |
|
||||
| Gemini 3.1 Pro | Google | AntiGravity | High | 03 |
|
||||
| Gemini 3.5 Flash | Google | AntiGravity | High | 03 |
|
||||
| Gemini 3.1 Pro | Google | AntiGravity | High | 02 |
|
||||
| Gemini 3.1 Pro | Google | Google AI Studio | High | 01 |
|
||||
| Gemini 3.5 Flash | Google | AntiGravity | High | 02 |
|
||||
| Gemini 3.5 Flash | Google | Google AI Studio | High | 01 |
|
||||
| Grok Build | xAI | Grok Build TUI (local) | Max | 02 |
|
||||
| Composer 2.5 | Cursor | Cursor | Max | 01 |
|
||||
| DeepSeek-V4-Pro | DeepSeek | Claude Code | Max | 02 |
|
||||
| Doubao Seed 2.0 Pro | ByteDance | Doubao Web | Pro Mode | 01 |
|
||||
| Doubao Seed 2.0 Mini | ByteDance | Doubao Web | Fast Mode | 01 |
|
||||
| MiMo v2.5 Pro | Xiaomi | Claude Code | Max | 02 |
|
||||
| Kimi K2.6 | Moonshot AI | Kimi Code (local) | Default | 01 |
|
||||
| Kimi K2.6 | Moonshot AI | Kimi Code (local) | Default | 02 |
|
||||
| MiniMax M3 | MiniMax | MiniMax Code Web | Thinking | 01 |
|
||||
|
||||
Pending: Mistral Medium 3.5 · GLM-5.1 · Qwen3.7-Max (PRs welcome)
|
||||
|
||||
@@ -20,15 +20,17 @@ NAGI STUDIO 的 LLM 测评案例集:同一段提示词,不同「模型 × Ha
|
||||
| Claude Fable 5 | Anthropic | Claude Code | Max | 02 |
|
||||
| GPT-5.5 Pro | OpenAI | ChatGPT 网页版 | Extended Pro | 02 |
|
||||
| GPT-5.5 | OpenAI | Codex CLI(无 skill) | xhigh | 02 |
|
||||
| Gemini 3.1 Pro | Google | AntiGravity | High | 03 |
|
||||
| Gemini 3.5 Flash | Google | AntiGravity | High | 03 |
|
||||
| Gemini 3.1 Pro | Google | AntiGravity | High | 02 |
|
||||
| Gemini 3.1 Pro | Google | Google AI Studio | High | 01 |
|
||||
| Gemini 3.5 Flash | Google | AntiGravity | High | 02 |
|
||||
| Gemini 3.5 Flash | Google | Google AI Studio | High | 01 |
|
||||
| Grok Build | xAI | Grok Build TUI(本地) | Max | 02 |
|
||||
| Composer 2.5 | Cursor | Cursor | Max | 01 |
|
||||
| DeepSeek-V4-Pro | DeepSeek | Claude Code | Max | 02 |
|
||||
| Doubao Seed 2.0 Pro | ByteDance | 豆包网页版 | 超能模式 | 01 |
|
||||
| Doubao Seed 2.0 Mini | ByteDance | 豆包网页版 | 快速模式 | 01 |
|
||||
| MiMo v2.5 Pro | Xiaomi | Claude Code | Max | 02 |
|
||||
| Kimi K2.6 | Moonshot AI | Kimi Code(本地) | Default | 01 |
|
||||
| Kimi K2.6 | Moonshot AI | Kimi Code(本地) | Default | 02 |
|
||||
| MiniMax M3 | MiniMax | MiniMax Code 网页版 | Thinking | 01 |
|
||||
|
||||
待测:Mistral Medium 3.5 · GLM-5.1 · Qwen3.7-Max(欢迎 PR 补充)
|
||||
|
||||
@@ -0,0 +1,16 @@
|
||||
{
|
||||
"label": "Gemini 3.1 Pro",
|
||||
"vendor": "Google",
|
||||
"harness": "Google AI Studio",
|
||||
"effort": "High",
|
||||
"order": 42,
|
||||
"runs": {
|
||||
"pelican-cycling": {
|
||||
"note": {
|
||||
"zh": "在 Google AI Studio 以 Gemini 3.1 Pro Preview High(最高思考强度)一次生成。",
|
||||
"en": "Generated in Google AI Studio on Gemini 3.1 Pro Preview High (max thinking effort) in one shot."
|
||||
},
|
||||
"contributor": "LpIuma"
|
||||
}
|
||||
}
|
||||
}
|
||||
@@ -12,22 +12,13 @@
|
||||
},
|
||||
"contributor": "Nagi-ovo"
|
||||
},
|
||||
"pelican-cycling": [
|
||||
{
|
||||
"note": {
|
||||
"zh": "在 Google AI Studio 以 Gemini 3.1 Pro Preview High(最高思考强度)一次生成。",
|
||||
"en": "Generated in Google AI Studio on Gemini 3.1 Pro Preview High (max thinking effort) in one shot."
|
||||
},
|
||||
"contributor": "LpIuma"
|
||||
"pelican-cycling": {
|
||||
"file": "pelican-cycling-2.svg",
|
||||
"note": {
|
||||
"zh": "由社区 PR #3(Codex 工作流)提交,提交者未注明运行环境与思考档位。",
|
||||
"en": "Contributed via community PR #3 (a Codex workflow); the submitter did not specify the runtime or effort level."
|
||||
},
|
||||
{
|
||||
"file": "pelican-cycling-2.svg",
|
||||
"note": {
|
||||
"zh": "由社区 PR #3(Codex 工作流)提交,提交者未注明运行环境与思考档位。",
|
||||
"en": "Contributed via community PR #3 (a Codex workflow); the submitter did not specify the runtime or effort level."
|
||||
},
|
||||
"contributor": "XA2333"
|
||||
}
|
||||
]
|
||||
"contributor": "XA2333"
|
||||
}
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,16 @@
|
||||
{
|
||||
"label": "Gemini 3.5 Flash",
|
||||
"vendor": "Google",
|
||||
"harness": "Google AI Studio",
|
||||
"effort": "High",
|
||||
"order": 52,
|
||||
"runs": {
|
||||
"pelican-cycling": {
|
||||
"note": {
|
||||
"zh": "在 Google AI Studio 以 Gemini 3.5 Flash High(最高思考强度)一次生成。",
|
||||
"en": "Generated in Google AI Studio on Gemini 3.5 Flash High (max thinking effort) in one shot."
|
||||
},
|
||||
"contributor": "LpIuma"
|
||||
}
|
||||
}
|
||||
}
|
||||
@@ -12,22 +12,13 @@
|
||||
},
|
||||
"contributor": "Nagi-ovo"
|
||||
},
|
||||
"pelican-cycling": [
|
||||
{
|
||||
"note": {
|
||||
"zh": "在 Google AI Studio 以 Gemini 3.5 Flash High(最高思考强度)一次生成。",
|
||||
"en": "Generated in Google AI Studio on Gemini 3.5 Flash High (max thinking effort) in one shot."
|
||||
},
|
||||
"contributor": "LpIuma"
|
||||
"pelican-cycling": {
|
||||
"file": "pelican-cycling-2.svg",
|
||||
"note": {
|
||||
"zh": "由社区 PR #3(Codex 工作流)提交,提交者未注明运行环境与思考档位。",
|
||||
"en": "Contributed via community PR #3 (a Codex workflow); the submitter did not specify the runtime or effort level."
|
||||
},
|
||||
{
|
||||
"file": "pelican-cycling-2.svg",
|
||||
"note": {
|
||||
"zh": "由社区 PR #3(Codex 工作流)提交,提交者未注明运行环境与思考档位。",
|
||||
"en": "Contributed via community PR #3 (a Codex workflow); the submitter did not specify the runtime or effort level."
|
||||
},
|
||||
"contributor": "XA2333"
|
||||
}
|
||||
]
|
||||
"contributor": "XA2333"
|
||||
}
|
||||
}
|
||||
}
|
||||
@@ -5,6 +5,13 @@
|
||||
"harness": "Kimi Code",
|
||||
"effort": "Default",
|
||||
"runs": {
|
||||
"mythos-craft": {
|
||||
"note": {
|
||||
"zh": "在本地以 Kimi Code(harness)运行 Kimi K2.6 一次生成,本页为未经修改的原始产出。",
|
||||
"en": "Generated in one shot by Kimi K2.6 running locally in Kimi Code; unmodified original output."
|
||||
},
|
||||
"contributor": "Nagi-ovo"
|
||||
},
|
||||
"pelican-cycling": {
|
||||
"note": {
|
||||
"zh": "在本地以 Kimi Code(harness)运行 Kimi K2.6 一次生成。",
|
||||
|
||||
File renamed without changes.
|
Before Width: | Height: | Size: 24 KiB After Width: | Height: | Size: 24 KiB |
File renamed without changes.
|
Before Width: | Height: | Size: 20 KiB After Width: | Height: | Size: 20 KiB |
File diff suppressed because it is too large.
Load diff
Reference in new issue
Block a user