更新README:旨在最小设备上运行的闲聊心理治疗模型
This commit is contained in:
1 parent
d962c768a5
commit
7f27812efd
2 files changed
+42
-57
No files matched your search
+21
-28
@@ -1,36 +1,29 @@
|
||||
# xiaoli-llm-chat
|
||||
|
||||
#### Description
|
||||
小狸AI - 自研中文对话大模型
|
||||
XiaoliAI - A casual chat & psychological therapy model designed to run on the smallest devices.
|
||||
|
||||
#### Software Architecture
|
||||
Software architecture description
|
||||
A from-scratch domain-specific Transformer. No pre-trained base model, no fine-tuning, no alignment — train it and talk to it directly.
|
||||
|
||||
#### Installation
|
||||
#### Features
|
||||
- **Ultra-lightweight**: 13M params, ~20MB footprint
|
||||
- **From Scratch**: Not based on LLaMA/GPT or any backbone
|
||||
- **Ready to Use**: No SFT / RLHF needed
|
||||
- **Safe by Design**: Data-embedded alignment, no harmful outputs
|
||||
- **Emotional Companion**: Built for conversation, not general tasks
|
||||
|
||||
1. xxxx
|
||||
2. xxxx
|
||||
3. xxxx
|
||||
#### Tech Stack
|
||||
- Architecture: Causal Decoder-Only Transformer (RoPE + RMSNorm + SwiGLU)
|
||||
- Tokenizer: Character-level (3236 vocab)
|
||||
- Training: Custom QA data + Astron API distillation
|
||||
|
||||
#### Instructions
|
||||
#### Use Cases
|
||||
- Child emotional companionship
|
||||
- Lightweight psychological support
|
||||
- IoT / Embedded offline chat
|
||||
- Privacy-focused local conversation
|
||||
|
||||
1. xxxx
|
||||
2. xxxx
|
||||
3. xxxx
|
||||
|
||||
#### Contribution
|
||||
|
||||
1. Fork the repository
|
||||
2. Create Feat_xxx branch
|
||||
3. Commit your code
|
||||
4. Create Pull Request
|
||||
|
||||
|
||||
#### Gitee Feature
|
||||
|
||||
1. You can use Readme\_XXX.md to support different languages, such as Readme\_en.md, Readme\_zh.md
|
||||
2. Gitee blog [blog.gitee.com](https://blog.gitee.com)
|
||||
3. Explore open source project [https://gitee.com/explore](https://gitee.com/explore)
|
||||
4. The most valuable open source project [GVP](https://gitee.com/gvp)
|
||||
5. The manual of Gitee [https://gitee.com/help](https://gitee.com/help)
|
||||
6. The most popular members [https://gitee.com/gitee-stars/](https://gitee.com/gitee-stars/)
|
||||
#### Performance
|
||||
- Memory: ~20MB
|
||||
- Inference: Real-time on CPU (no GPU needed)
|
||||
- Runs on: Raspberry Pi, phones, smartwatches, low-end PCs
|
||||
@@ -1,37 +1,29 @@
|
||||
# xiaoli-llm-chat
|
||||
|
||||
#### 介绍
|
||||
小狸AI - 自研中文对话大模型
|
||||
小狸AI - 旨在最小设备上运行的闲聊心理治疗模型
|
||||
|
||||
#### 软件架构
|
||||
软件架构说明
|
||||
从零训练的特化 Transformer,不依赖任何预训练模型,无需微调对齐,训练完可直接对话。
|
||||
|
||||
#### 模型特点
|
||||
- **超轻量**: 仅 13M 参数,约 20MB 占用
|
||||
- **从零训练**: 不基于 LLaMA/GPT 等任何基座,权重完全随机初始化
|
||||
- **开箱即用**: 无需 SFT / RLHF,训练完即可对话
|
||||
- **安全可控**: 数据内嵌对齐,天然不输出违规内容
|
||||
- **闲聊陪伴**: 专注情感价值,不追求通用能力
|
||||
|
||||
#### 安装教程
|
||||
#### 技术栈
|
||||
- 架构: Causal Decoder-Only Transformer (RoPE + RMSNorm + SwiGLU)
|
||||
- 分词: 字符级词表(3236 tokens)
|
||||
- 训练: 自建问答数据 + Astron API 蒸馏
|
||||
|
||||
1. xxxx
|
||||
2. xxxx
|
||||
3. xxxx
|
||||
#### 使用场景
|
||||
- 儿童情感陪伴
|
||||
- 轻量级心理倾诉
|
||||
- IoT / 嵌入式设备离线对话
|
||||
- 隐私安全的本地聊天
|
||||
|
||||
#### 使用说明
|
||||
|
||||
1. xxxx
|
||||
2. xxxx
|
||||
3. xxxx
|
||||
|
||||
#### 参与贡献
|
||||
|
||||
1. Fork 本仓库
|
||||
2. 新建 Feat_xxx 分支
|
||||
3. 提交代码
|
||||
4. 新建 Pull Request
|
||||
|
||||
|
||||
#### 特技
|
||||
|
||||
1. 使用 Readme\_XXX.md 来支持不同的语言,例如 Readme\_en.md, Readme\_zh.md
|
||||
2. Gitee 官方博客 [blog.gitee.com](https://blog.gitee.com)
|
||||
3. 你可以 [https://gitee.com/explore](https://gitee.com/explore) 这个地址来了解 Gitee 上的优秀开源项目
|
||||
4. [GVP](https://gitee.com/gvp) 全称是 Gitee 最有价值开源项目,是综合评定出的优秀开源项目
|
||||
5. Gitee 官方提供的使用手册 [https://gitee.com/help](https://gitee.com/help)
|
||||
6. Gitee 封面人物是一档用来展示 Gitee 会员风采的栏目 [https://gitee.com/gitee-stars/](https://gitee.com/gitee-stars/)
|
||||
#### 性能
|
||||
- 内存占用: ~20MB
|
||||
- 推理速度: CPU 实时(无需 GPU)
|
||||
- 可运行平台: 树莓派、手机、手表、低端PC
|
||||
Reference in new issue
Block a user