# xiaoli-llm-chat

#### Description
XiaoliAI - A casual chat & psychological therapy model designed to run on the smallest devices.

A from-scratch domain-specific Transformer. No pre-trained base model, no fine-tuning, no alignment — train it and talk to it directly.

#### Features
- **Ultra-lightweight**: 13M params, ~20MB footprint
- **From Scratch**: Not based on LLaMA/GPT or any backbone
- **Ready to Use**: No SFT / RLHF needed
- **Safe by Design**: Data-embedded alignment, no harmful outputs
- **Emotional Companion**: Built for conversation, not general tasks

#### Tech Stack
- Architecture: Causal Decoder-Only Transformer (RoPE + RMSNorm + SwiGLU)
- Tokenizer: Character-level (3236 vocab)
- Training: Custom QA data + Astron API distillation

#### Use Cases
- Child emotional companionship
- Lightweight psychological support
- IoT / Embedded offline chat
- Privacy-focused local conversation

#### Performance
- Memory: ~20MB
- Inference: Real-time on CPU (no GPU needed)
- Runs on: Raspberry Pi, phones, smartwatches, low-end PCs