From 6e0ced4772dbee6a6716eb1e7e1b80bbf6703e58 Mon Sep 17 00:00:00 2001 From: shuiyu1123 Date: Wed, 17 Jun 2026 14:31:25 +0000 Subject: [PATCH] =?UTF-8?q?=E6=B7=BB=E5=8A=A0v3=E8=AF=8D=E8=A1=A8=20(BPE,?= =?UTF-8?q?=206.8k=20tokens,=20666k=E6=95=B0=E6=8D=AE=E8=AE=AD=E7=BB=83)?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit - 从666k条训练数据自动学习 - 5812单字 + 1000高频词组 - 编码效率提升33% - 含小狸特色词组: 捉迷藏/冰淇淋/为什么等 --- vocab_v3.json | 3 +++ 1 file changed, 3 insertions(+) create mode 100644 vocab_v3.json diff --git a/vocab_v3.json b/vocab_v3.json new file mode 100644 index 0000000..b932bca --- /dev/null +++ b/vocab_v3.json @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cd80a63aa00c80a755c7e0cb4d91263bedbaccaf66fd3b12428017b4230ecbe9 +size 106005