xiaoli-llm-chat
Description
XiaoliAI - A casual chat & psychological therapy model designed to run on the smallest devices.
A from-scratch domain-specific Transformer. No pre-trained base model, no fine-tuning, no alignment — train it and talk to it directly.
Features
- Ultra-lightweight: 13M params, ~20MB footprint
- From Scratch: Not based on LLaMA/GPT or any backbone
- Ready to Use: No SFT / RLHF needed
- Safe by Design: Data-embedded alignment, no harmful outputs
- Emotional Companion: Built for conversation, not general tasks
Tech Stack
- Architecture: Causal Decoder-Only Transformer (RoPE + RMSNorm + SwiGLU)
- Tokenizer: Character-level (3236 vocab)
- Training: Custom QA data + Astron API distillation
Use Cases
- Child emotional companionship
- Lightweight psychological support
- IoT / Embedded offline chat
- Privacy-focused local conversation
Performance
- Memory: ~20MB
- Inference: Real-time on CPU (no GPU needed)
- Runs on: Raspberry Pi, phones, smartwatches, low-end PCs