shuiyuPyLab/xiaoli-llm-chat
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

添加v3词表 (BPE, 6.8k tokens, 666k数据训练)

Browse Source 
- 从666k条训练数据自动学习
- 5812单字 + 1000高频词组
- 编码效率提升33%
- 含小狸特色词组: 捉迷藏/冰淇淋/为什么等
This commit is contained in:
shuiyu1123 committed 2026-06-17 14:31:25 +00:00
1 parent aead65192e
commit 6e0ced4772
1 file changed
+3
Download Patch File Download Diff File Expand all files Collapse all files
vocab_v3.json
+3
View File
@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cd80a63aa00c80a755c7e0cb4d91263bedbaccaf66fd3b12428017b4230ecbe9
size 106005