Commit Graph
6 Commits
Author SHA1 Message Date
shuiyu1123 fc5e2a4dc1 delete test file 2026-07-09 07:38:52 +00:00
shuiyu1123 d287de8ed2 update data/expanded_distilled.json via distill_expand 2026-07-09 07:38:32 +00:00
shuiyu1123 723829d38c create test 2026-07-09 07:37:14 +00:00
shuiyu1123 6c7c1d38a1 update data/expanded_distilled.json via distill_expand 2026-07-09 06:44:26 +00:00
shuiyu1123 eb7717e9ce feat: add new general distill script, merged dataset v3 (977K pairs), legacy vocab_v2 2026-06-18 17:56:40 +00:00
shuiyu1123 231af72de9 大整理: 仓库重组 + 新词表 + 新README
- 清理仓库: 删除所有废弃的generate_*脚本和旧版数据文件
- 目录重组:
  - data/       → 训练数据
  - scripts/    → 数据生成脚本
  - templates/  → Web UI
- 重命名:
  - train_v2.py  → train.py
  - vocab_v3.json → vocab.json (BPE, 6.8k tokens)
- 更新 train.py 指向新词表路径
- 重写 README.md 完整文档
- 更新 .gitignore
2026-06-18 11:17:30 +00:00