Welcome to your LocalAI

The powerful FOSS alternative to OpenAI, Claude, and more

Documentation Model Gallery Import Model

Operations in Progress

Installed Models

3 models ready to use

ibm-granite.granite-4.0-1b icon

ibm-granite.granite-4.0-1b

llama-cpp
Chat
Edit
qwen3-0.6b icon

qwen3-0.6b

llama-cpp
Chat
Edit
qwen3-vl-2b-thinking icon

qwen3-vl-2b-thinking

llama-cpp
Chat
Edit

Installed Backends

3 backends ready to use

cpu-llama-cpp

User Installed
Alias: llama-cpp
Installed: 2025-11-05T11:49:47+01:00
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /var/www/localai/backends/cpu-llama-cpp/run.sh

llama-cpp

User Installed
Alias: llama-cpp
Installed: 2025-11-05T11:49:47+01:00
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /var/www/localai/backends/cpu-llama-cpp/run.sh

localai@llama-cpp

User Installed Meta
Installed: 2025-11-05T11:49:47+01:00
Meta backend for: cpu-llama-cpp
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /var/www/localai/backends/cpu-llama-cpp/run.sh