Why local?
Why run AI locally?
Local AI is useful when you want privacy, repeatable costs and direct control over models. Instead of sending prompts to a hosted API, your PC runs inference and stores outputs locally.
- Privacy: prompts, code, images and outputs can stay on your computer.
- No metering: once the app and models are installed, you are not charged per prompt.
- Model choice: swap models depending on speed, quality and hardware.
- Offline work: chat and agent workflows can run without an internet connection after setup.
Steps
How to run AI locally with Saient
- Download Saient. Install the Linux or Windows build from the homepage.
- Choose a GGUF model. Smaller quantized models run on less memory. Larger models need more VRAM or RAM.
- Load the model. Put the model in the Saient models folder or select it in the app.
- Use the tools. Chat with the model, ask the local AI agent to work in a project, or use image and video generation studios.
- Iterate locally. Keep prompts, files and outputs on your disk.
An NVIDIA GPU is recommended for speed, but local AI can still run on CPU with smaller models and more patience.
Tools
What you can run locally in Saient
Start with one model, then expand into a full local AI workshop.
Saient brings chat, agents, image generation, video generation, vision, TTS and LoRA tools into a single desktop app.