Skip to content

AI Models

Local AI concepts

How local inference differs from cloud.

Local inference

A local model runs on your own computer. Your prompt and content are processed on-device, without being sent to a cloud provider.

Trade-offs

  • Privacy: data stays on your device.
  • Capability: limited by your memory and compute.
  • Cost: uses your hardware rather than paid cloud usage.