LocalAI
LocalAI
Official siteRunning a tool locally can give more control over data, but brings hardware, configuration and maintenance needs. Separate the model, interface and any external services that may be enabled.

Try a model without sending a document to a remote service.
Search internal documents with access controls you understand.
Set up a reversible environment for testing several models.
Verify what genuinely works offline.
Measure memory use, speed and quality on your own hardware.
Inspect licences, updates and outbound connections for each component.
These active services are starting points from the directory. Editorial highlighting and score order this selection; they do not replace a trial on your own task.
LocalAI
Official siteOllama · US
Official sitevLLM Project
Official siteLM Studio · US
Official siteDocker · US
Official siteOpen WebUI · US
Official siteSGLang
Official siteJan AI · US
Official siteApple · US
Official site