shuiyu1123
91db488ad4
- 移除 generate_diverse_answers.py（多样化回答已废止） - 更新 generate_fresh_qa.py（目标50万条新问答） - 更新 generate_multiturn.py（6~12轮长对话，目标50万） - 更新 regenerate_all_high_temp.py（独立保存，不追加训练集） - 更新 .gitignore（忽略新输出目录） - 所有API Key改为环境变量读取
xiaoli-llm-chat
Description
XiaoliAI - A casual chat & psychological therapy model designed to run on the smallest devices.
A from-scratch domain-specific Transformer. No pre-trained base model, no fine-tuning, no alignment — train it and talk to it directly.
Features
- Ultra-lightweight: 13M params, ~20MB footprint
- From Scratch: Not based on LLaMA/GPT or any backbone
- Ready to Use: No SFT / RLHF needed
- Safe by Design: Data-embedded alignment, no harmful outputs
- Emotional Companion: Built for conversation, not general tasks
Tech Stack
- Architecture: Causal Decoder-Only Transformer (RoPE + RMSNorm + SwiGLU)
- Tokenizer: Character-level (3236 vocab)
- Training: Custom QA data + Astron API distillation
Use Cases
- Child emotional companionship
- Lightweight psychological support
- IoT / Embedded offline chat
- Privacy-focused local conversation
Performance
- Memory: ~20MB
- Inference: Real-time on CPU (no GPU needed)
- Runs on: Raspberry Pi, phones, smartwatches, low-end PCs