LocalAI
A good choice when you want one self-hosted endpoint that replaces several hosted APIs, including speech and image models, without needing a GPU to get started. It rewards people who are comfortable with Docker and model configuration. If you only want to chat with a model on a laptop, a desktop app such as LM Studio or Jan is simpler.
Pros
- MIT-licensed with a large and very active GitHub project
- One API covers language, voice, vision, image and video models
- Swappable engines including llama.cpp, vLLM and MLX
- CPU-first design tested in CI, with GPU backends optional
Cons
- No company, support plan or SLA is described on the site
- Setup and model configuration take more effort than a desktop app
- Windows is not listed among the main install options