One-Command Install of a Lightweight Local LLM with Tool and Search Access

[rebelC0der]

Overview

I propose adding support for a small, fast local model (e.g., 4–7 GB Voxtype-style LLM) in Omarchy Linux via Ollama/Opencode. This model would act as a system assistant, capable of:

• Fixing and changing system configurations.
• Running tasks and creating jobs automatically.
• Executing scripts or commands directly.
• Calling tools and managing workflows in real time.

One-Command Install

The setup should be fully automated with a single command:

omarchy-llm install

This would handle:

• Downloading and installing the local LLM.
• Setting up Opencode/Ollama integration.
• Enabling optional web queries via MCP-powered Brave Search.

Enhancements

• Optimized VRAM Usage: The model should be small enough to fit in system VRAM while leaving room for caching and a context window, ensuring fast and responsive execution.
• Hybrid Web Access: Queries Brave Search for free while keeping core operations fully local.

Benefits

• Local control & privacy: All critical system operations stay on-device.
• Fast and responsive: Optimized model ensures near-instant execution.
• Powerful automation: Scripts, tasks, and system management can be handled safely.
• Simple deployment: One-command install makes it easy for both beginners and advanced users.