# Llmash

> ollama like local llm interface, optimized to run most models 2-4x faster, even faster than vllm most of the time (tables below) - omgitsbase/llmash

- **Website:** https://github.com/omgitsbase/llmash
- **Pricing:** unknown
- **Categories:** Developer Tools, Design
- **Tags:** developer-tools, design, infrastructure
- **Platforms:** Windows, CLI
- **Last verified:** 2026-09-10
- **Canonical page:** https://linkrena.com/tools/llmash

## About

An Ollama-compatible server and command line for Windows, built on llama.cpp.

It serves your GGUF files through llama-server and keeps Ollama's commands, API and model store, so anything already pointed at Ollama keeps working. What it changes is the llama.cpp settings, picked per model at launch.

Nothing needs to be installed first: the installer fetches the llama.cpp build for your GPU, puts llmash on your PATH, and starts the server. With no NVIDIA card it takes the Vulkan or CPU build instead, and models load into system RAM, which works but is slower.

Ollama's store is found and used as it is. A folder of GGUFs from llama.cpp or LM Studio is one command away:

It reads the folder where it is, subfolders included, and says how many models it found. Nothing is copied, downloaded or deleted, and rm will not touch it. llmash models shows what is being read. It is the same setting as OLLAMA_MODELS , which llmash takes the way Ollama does, pointed at either kind of folder.

One GPU, an RTX PRO 6000 Blackwell with 96 GB: same prompts, 4-bit weights in each engine's own format, every backend run as it comes with no hand tuning. Your numbers will differ.

Tokens per second while generating, median of three runs, excluding model load and prompt processing.

The server owns the model store, starts and stops llama-server processes, and decides how long each one stays resident.

## Related tools

- [Derive](https://linkrena.com/tools/derive): Review and approval for work made by AI agents.
- [Spore](https://linkrena.com/tools/spore): Run open-weight models on hardware you already own, reach them from any device, and tap a distributed network when you need more.
- [Conductai](https://linkrena.com/tools/conductai): AI agent governance for teams.
- [Splatit](https://linkrena.com/tools/splatit): An Splatoon server recreation in C++ with a focus on user friendliness and ease of hosting.
- [phpEZ](https://linkrena.com/tools/phpez): Tiny PHP framework. Contribute to QcFe/phpEZ development by creating an account on GitHub.
- [The Simpsons Hit and Run](https://linkrena.com/tools/the-simpsons-hit-and-run): Modern Windows version of The Simpsons: Hit & Run, based on the original leaked source code from 2003 - xaskasdf/The-Simpsons-Hit-and-Run