29 lines
1.0 KiB
Markdown
29 lines
1.0 KiB
Markdown
# xiaoli-llm-chat
|
|
|
|
#### Description
|
|
XiaoliAI - A casual chat & psychological therapy model designed to run on the smallest devices.
|
|
|
|
A from-scratch domain-specific Transformer. No pre-trained base model, no fine-tuning, no alignment — train it and talk to it directly.
|
|
|
|
#### Features
|
|
- **Ultra-lightweight**: 13M params, ~20MB footprint
|
|
- **From Scratch**: Not based on LLaMA/GPT or any backbone
|
|
- **Ready to Use**: No SFT / RLHF needed
|
|
- **Safe by Design**: Data-embedded alignment, no harmful outputs
|
|
- **Emotional Companion**: Built for conversation, not general tasks
|
|
|
|
#### Tech Stack
|
|
- Architecture: Causal Decoder-Only Transformer (RoPE + RMSNorm + SwiGLU)
|
|
- Tokenizer: Character-level (3236 vocab)
|
|
- Training: Custom QA data + Astron API distillation
|
|
|
|
#### Use Cases
|
|
- Child emotional companionship
|
|
- Lightweight psychological support
|
|
- IoT / Embedded offline chat
|
|
- Privacy-focused local conversation
|
|
|
|
#### Performance
|
|
- Memory: ~20MB
|
|
- Inference: Real-time on CPU (no GPU needed)
|
|
- Runs on: Raspberry Pi, phones, smartwatches, low-end PCs |