A truly natural scripting language

Input text from speech in any Linux window, the lean, fast and accurate way, using whisper.cpp OFFLINE. Speak with local LLMs via llama.cpp.

Newer GUI version available at https://github.com/Michael-Sebero/PrivateGPT4Linux

Run llama.cpp in a GPU accelerated Docker container

run ollama & gguf easily with a single command

This shell script installs a GUI version of privateGPT for Linux.

Run Ollama on AMD Ryzen 7 5800H CPU with integrated GPU AMD ATI Radeon Vega (gfx90c) with optimizations

Zsh-centric command-line interface for interacting with local Large Language Models (LLMs). Chat directly on the command line with non-contiguous command line calls.

Docker image for LLaVA: Large Language and Vision Assistant

Uncensored AI: An open-source, unrestricted LLaMA 2 model for free and raw AI interactions.

Complete AI automation stack optimized for Mac Mini M4, but can work in multiple machine configurations. Features n8n workflows, Ollama with Llama 3.2, Open WebUI, LiteLLM proxy, and MCP integration. Production-ready with automated backups, security, and family-safe configuration for you to learn more about AI at home.

This is a Bash script to automatically launch llama-server, detects available .gguf models, and selects GPU layers based on your free VRAM.

Containerized LLM for any use-case big or small

A shell script to automatically update or build llama.cpp with optimal GPU support. Supports cross-platform, smart architecture detection, safe updates, and easy installation. Choose fast binary downloads or custom source builds for maximum performance.

deploy service at https://localhost:11434 with ollama

Fish shell function that provides convenient shortcuts for interacting with AI models through GitHub CLI

German alpaca finetune converted to GGML format (compatible with llama.cpp).

Installing Ollama locally on a Linux system allows you to easily set up and run the program in your own environment, even if you do not have a stable internet connection. 😉

Container for LLaMA-Factory