xiaoli-llm-chat/README.en.md

xiaoli-llm-chat

Description

XiaoliAI - A casual chat & psychological therapy model designed to run on the smallest devices.

A from-scratch domain-specific Transformer. No pre-trained base model, no fine-tuning, no alignment — train it and talk to it directly.

Features

• Ultra-lightweight: 13M params, ~20MB footprint
• From Scratch: Not based on LLaMA/GPT or any backbone
• Ready to Use: No SFT / RLHF needed
• Safe by Design: Data-embedded alignment, no harmful outputs
• Emotional Companion: Built for conversation, not general tasks

Tech Stack

• Architecture: Causal Decoder-Only Transformer (RoPE + RMSNorm + SwiGLU)
• Tokenizer: Character-level (3236 vocab)
• Training: Custom QA data + Astron API distillation

Use Cases

• Child emotional companionship
• Lightweight psychological support
• IoT / Embedded offline chat
• Privacy-focused local conversation

Performance

• Memory: ~20MB
• Inference: Real-time on CPU (no GPU needed)
• Runs on: Raspberry Pi, phones, smartwatches, low-end PCs