 shuiyu1123
|
6dbc1405c6
|
云端训练脚本 + 新词表 + gen_pretrain优化
|
2026-06-21 02:00:43 +00:00 |
|
|
shuiyu1123
|
16458aea92
|
feat: Astron 5并发API + 修复蒸馏P2/P3 + 两阶段训练脚本 + 持续蒸馏守护
- api_correction.py: 嵌入 Astron key, max_workers=5, 修复 batch_convert/multi_temp 返回空列表bug
- scripts/api_correction.py: 同步更新
- train_max.py: 两阶段训练(预训练+角色对齐), Warmup+Cosine, 分层LR, AMP
- distill_daemon.py: 持续蒸馏守护脚本, 15大类种子话题, 5并发
|
2026-06-21 02:00:43 +00:00 |
|
|
shuiyu1123
|
70abc8e7ff
|
fix: 同步移除硬编码API key
|
2026-06-20 13:56:46 +00:00 |
|
|
shuiyu1123
|
2ba1ee3416
|
fix: scripts API同步
|
2026-06-20 13:24:49 +00:00 |
|
|
cnb.cEr0mSxFAFA
|
a88c47e273
|
feat: v1.3-lite-flash 训练代码 + 新词表(vocab_size=47725)
- 用 CharTokenizer.build_vocab 从 977K 数据生成词表 (vocab_size=47725)
- train_cnb.py: batch=224 + accum=2 (等效448) + AMP + torch.compile
- build_vocab.py: 词表生成脚本
- vocab_full.json: 含特殊token完整词表
- 模型 41.85M参数, L40 GPU训练
|
2026-06-19 10:34:37 +08:00 |
|
|
shuiyu1123
|
ffb5825407
|
fix: correct vocab_size to max_id+1 (was len(vocab))
|
2026-06-18 18:43:47 +00:00 |
|
|
shuiyu1123
|
456c443e9c
|
feat: add CNB cloud training config (GPU Dockerfile + .cnb.yml + train_cnb.py)
|
2026-06-18 18:09:59 +00:00 |
|
|
shuiyu1123
|
eb7717e9ce
|
feat: add new general distill script, merged dataset v3 (977K pairs), legacy vocab_v2
|
2026-06-18 17:56:40 +00:00 |
|
|
shuiyu1123
|
231af72de9
|
大整理: 仓库重组 + 新词表 + 新README
- 清理仓库: 删除所有废弃的generate_*脚本和旧版数据文件
- 目录重组:
- data/ → 训练数据
- scripts/ → 数据生成脚本
- templates/ → Web UI
- 重命名:
- train_v2.py → train.py
- vocab_v3.json → vocab.json (BPE, 6.8k tokens)
- 更新 train.py 指向新词表路径
- 重写 README.md 完整文档
- 更新 .gitignore
|
2026-06-18 11:17:30 +00:00 |
|