commit 06ba93a94b4e11328811cea33e0d4226ad46b7b0 Author: Jesse Zhang <101612750+Nagi-ovo@users.noreply.github.com> Date: Tue Jun 9 22:20:15 2026 +0100 Initial release: NAGI BENCH eval showcase One-shot LLM eval cases with a bilingual (zh/EN) showcase site: Vite + React + Tailwind v4 + GSAP, built with bun, deployed to GitHub Pages. Ships two Claude Fable 5 Max cases (Mythos Craft voxel game, pelican-by-the-sea SVG) with placeholder slots for GPT-5.1, Gemini 3 Pro, DeepSeek V3.2 and Qwen3 Max. Co-Authored-By: Claude Fable 5 diff --git a/.github/workflows/deploy.yml b/.github/workflows/deploy.yml new file mode 100644 index 0000000..9957b4f --- /dev/null +++ b/.github/workflows/deploy.yml @@ -0,0 +1,42 @@ +name: Deploy site to GitHub Pages + +on: + push: + branches: [main] + workflow_dispatch: + +permissions: + contents: read + pages: write + id-token: write + +concurrency: + group: pages + cancel-in-progress: true + +jobs: + build: + runs-on: ubuntu-latest + steps: + - uses: actions/checkout@v4 + - uses: oven-sh/setup-bun@v2 + - name: Install dependencies + run: bun install --frozen-lockfile + working-directory: site + - name: Build + run: bun run build + working-directory: site + - uses: actions/configure-pages@v5 + - uses: actions/upload-pages-artifact@v3 + with: + path: site/dist + + deploy: + needs: build + runs-on: ubuntu-latest + environment: + name: github-pages + url: ${{ steps.deployment.outputs.page_url }} + steps: + - id: deployment + uses: actions/deploy-pages@v4 diff --git a/.gitignore b/.gitignore new file mode 100644 index 0000000..fb58e4a --- /dev/null +++ b/.gitignore @@ -0,0 +1,4 @@ +.DS_Store +node_modules/ +dist/ +site/public/outputs/ diff --git a/README.md b/README.md new file mode 100644 index 0000000..7c62926 --- /dev/null +++ b/README.md @@ -0,0 +1,36 @@ +# NAGI BENCH + +NAGI STUDIO 的 LLM 测评案例集：同一段提示词，不同模型，一次生成、不许返工，并排对比它们交出的可运行作品。 + +One-shot LLM eval cases by NAGI STUDIO: same prompt, different models, one attempt and no retries — a side-by-side record of the runnable artifacts they ship. + +**Live site:** https://nagi-studio.github.io/nagi-bench/ + +## 结构 / Structure + +``` +outputs// 模型产出原文件（HTML / SVG），按模型分目录 +site/ 展示站点（Vite + React + Tailwind v4 + GSAP，bun 驱动） +site/src/data/cases.ts 案例定义：双语提示词、模型列表、产出文件映射 +.github/workflows/deploy.yml GitHub Pages 自动部署 +``` + +## 本地开发 / Development + +```bash +cd site +bun install +bun run dev # 同步 outputs/ 并启动 http://localhost:5173/nagi-bench/ +bun run build # 类型检查 + 产物构建（输出到 site/dist） +``` + +## 添加案例或模型 / Adding a case or model + +1. 把产出文件放进 `outputs//`。 +2. 在 `site/src/data/cases.ts` 里登记： + - 新模型：加入 `MODELS`（`status: 'ran' | 'pending'`）。 + - 新案例：加入 `CASES`（中英双语 `title` / `tagline` / `prompt`）。 + - 产出映射：在 `OUTPUTS` 里把案例 id 对应到模型 id 与文件路径。 +3. 推送到 `main`，GitHub Actions 自动构建并部署。 + +Drop the artifact into `outputs//`, register it in `site/src/data/cases.ts` (model in `MODELS`, case in `CASES` with bilingual prompts, file path in `OUTPUTS`), then push to `main` — GitHub Actions deploys automatically. diff --git a/outputs/claude-fable-5/mythos-craft.html b/outputs/claude-fable-5/mythos-craft.html new file mode 100644 index 0000000..6a4ddc4 --- /dev/null +++ b/outputs/claude-fable-5/mythos-craft.html @@ -0,0 +1,1505 @@ + + + + + +MYTHOS CRAFT · 神话境界 + + + + + + +

神话境界

MYTHOS · CRAFT

铸造世界中 … 0%

+ +

X: @Nag1ovo

+ + + + + diff --git a/outputs/claude-fable-5/pelican_cycling_by_the_sea.svg b/outputs/claude-fable-5/pelican_cycling_by_the_sea.svg new file mode 100644 index 0000000..1658b55 --- /dev/null +++ b/outputs/claude-fable-5/pelican_cycling_by_the_sea.svg @@ -0,0 +1,177 @@ + \ No newline at end of file