We want to hear from you!

[njbrake]

1. Why did you choose llamafile in the first place?
2. What features do you rely on most?
3. Why are you still using it? (Or, perhaps more tellingly, why did you move to another tool?)
4. What would make llamafile more useful for your work?

[ricardosantos79]

1. lightweight terminal interaction, just put the executable in the same directory as the gguf/models and its ready to use!
2. lightweight terminal chat
3. new models compatibility

• ability to load system prompt from a file.
• ability save/load chat history into a file.

[DarklinuxFr]

It's a standard.
Internal security management, in compliance with ISO/NIS2/SBOM.
I wouldn't mind a multilingual GUI manager.

[kaiwalyajoshi]

We were interested in Llamafile due to the improvements it offered with CPU only inferencing.

It's still not that easy to find GPUs and you'd have to deal with various licensing issues with a well known GPU provider.

As Llamafile upstreamed its improvements to Llama.cpp, we started using Llama.cpp instead as activity had died down here.

Llamafile is still much easier to deploy and use and we're happy to use and contribute what we can here.

[rmusser01]

1. Single file inference that's cross-platform
2. Cosmopolitan wrapper; Multi-platform single binary llama.cpp
3. Single file inference that's cross-platform; It's used as a 'simple' choice in https://github.com/rmusser01/tldw_server as a backend inference option.
4. Continuing to act as a single binary wrapper for llama-server. The ability to rely on a single binary for inference without having to worry about platform specifics for non-technical users is huge

[RobViren]

I like it for use cases like games where I want to use LLMs. It allows me to distribute without needing to know hardly anything about the environment where it is being deployed.

[si-open]

Please make program or hacking echo for assistent.
I need only few options:

• give me a cook idea from ingredients
• what is thime and setup time (for example tell me after 2 day about my meeting)
• count (for example what is 2+7 or 21 day after today)
• send my text to file, remember my text, send message to other person, agent, etc.

all offline, all on my local computer/device (like a mycroft). all in my language