Host Machine Models

Use GGUF models stored on your computer's local disk.

Overview

Host machine models are GGUF models stored on your computer (not on the Docket USB). This is useful when:

• You have large models that won't fit on the USB
• You want faster loading from an SSD
• You already have a collection of GGUF models

Adding Host Models

Step 1: Open the Models Page

1. Click Models in the sidebar
2. Select the Local Models tab

Step 2: Add a Model

1. Click Add Model
2. Use the file browser to select a .gguf file
3. The model is added to your registry

Step 3: Load and Use

1. Select the model
2. Click Load
3. Start chatting

How It Works

• Model files stay on your computer's disk
• Docket remembers the file path
• The model is loaded through llama-server

Machine-Specific

Host models are tied to the specific computer:

• Adding a model on your desktop won't make it appear on your laptop
• The registry tracks which hostname added each model
• If you move the file, you'll need to update the path

Managing Host Models

Rename a Model

1. Click on the model
2. Click Rename
3. Enter a new display name

Update Path

If you move a model file:

1. Click on the model
2. Click Edit Path
3. Browse to the new location

Remove from Registry

1. Click on the model
2. Click Remove

note

Removing a model from Docket does not delete the file from your computer.

llama-server Fallback

Docket uses a fallback chain to find llama-server:

1. Docket USB — Built-in llama-server on the USB drive
2. Custom Path — A path you configure in settings
3. System PATH — llama-server available system-wide

This means you can use host models even when:

• The Docket USB is not connected
• You want to use your own llama-server build

Set Custom llama-server Path

1. Go to Settings
2. Find llama-server Path
3. Enter the path to your llama-server executable

Availability Tracking

Docket checks if host model files still exist:

• Available — File exists at the registered path
• Unavailable — File not found (moved or deleted)

If a model shows as unavailable:

• Check if the file was moved
• Update the path if needed
• Remove the model if you deleted the file

Tips

• Store models on an SSD for fastest loading
• Use descriptive names when adding models
• Keep track of where you store model files
• Regularly check model availability if you reorganize files

Limitations

• Only GGUF format is supported
• One model can be loaded at a time (same as USB models)
• File must be accessible when you want to load the model