Local AI guide

How to run AI locally on your own PC.

Running AI locally means the model, prompts and outputs stay on your machine. With Saient, you can load GGUF chat models, use a local agent and run creative tools from one desktop app.

Why local?

Why run AI locally?

Local AI is useful when you want privacy, repeatable costs and direct control over models. Instead of sending prompts to a hosted API, your PC runs inference and stores outputs locally.

  • Privacy: prompts, code, images and outputs can stay on your computer.
  • No metering: once the app and models are installed, you are not charged per prompt.
  • Model choice: swap models depending on speed, quality and hardware.
  • Offline work: chat and agent workflows can run without an internet connection after setup.
Steps

How to run AI locally with Saient

  1. Download Saient. Install the Linux or Windows build from the homepage.
  2. Choose a GGUF model. Smaller quantized models run on less memory. Larger models need more VRAM or RAM.
  3. Load the model. Put the model in the Saient models folder or select it in the app.
  4. Use the tools. Chat with the model, ask the local AI agent to work in a project, or use image and video generation studios.
  5. Iterate locally. Keep prompts, files and outputs on your disk.
An NVIDIA GPU is recommended for speed, but local AI can still run on CPU with smaller models and more patience.
Tools

What you can run locally in Saient

Start with one model, then expand into a full local AI workshop.

Saient brings chat, agents, image generation, video generation, vision, TTS and LoRA tools into a single desktop app.