Discussions

• 6 You must be logged in to vote

  💡

  We want to hear from you!

  njbrake started Oct 29, 2025 in Ideas

  

  

  

  

  6
• 1 You must be logged in to vote

  💡

  KV Split for lllamafile cli options patch to make llm inference on mac silicon 3X faster

  creativeautomaton started Jul 6, 2025 in Ideas

  

  

  2
• 1 You must be logged in to vote

  🙏

  Model name for Python API endpoint

  hkcowboy asked Sep 8, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💡

  LocalScore add warning with not supported cuda versions and documentation add

  marcorobiati started Sep 5, 2025 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💡

  [Feature Request] Please add the capability for live voice chat

  ParvizRzayev started Aug 27, 2025 in Ideas

  

  

  0
• 1 You must be logged in to vote

  🙏

  llava-v1.5-7b-q4.llamafile on Ubuntu 24.04

  Ivan2getdmodelz asked Aug 26, 2025 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💡

  Add support for LFM2 1.2B

  evangineer started Jul 28, 2025 in Ideas

  

  

  1
• 1 You must be logged in to vote

  🙏

  File size difference

  niutech asked Jul 24, 2025 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  💡

  Possibility to disable thinking mode for thinking models

  saddy001 started Jun 6, 2025 in Ideas

  

  

  1
• 1 You must be logged in to vote

  💡

  set language

  lykamspam started Jun 3, 2025 in Ideas

  

  

  0
• 1 You must be logged in to vote

  🙏

  EOS token detection

  vadi2 asked Jun 1, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Well-known llamafile locations

  vadi2 asked Jun 1, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Reporting Vulnerability

  awaiting response

  laurian19 asked Apr 3, 2025 in Q&A · Unanswered

  

  

  2
• 6 You must be logged in to vote

  💬

  Lots of CPU benchmarks

  Djip007 started May 26, 2024 in General

  

  

  

  

  65
• 3 You must be logged in to vote

  🙏

  Llama.cpp version used by llamafile

  Propfend asked Mar 29, 2025 in Q&A · Answered

  

  

  

  

  7
• 1 You must be logged in to vote

  💡

  Automated reviews with coderabbit.ai

  reneleonhardt started Apr 21, 2025 in Ideas

  

  

  0
• 3 You must be logged in to vote

  💡

  Building up-to-date llama.cpp with Cosmopolitan

  BradHutchings started Mar 17, 2025 in Ideas

  

  

  4
• 1 You must be logged in to vote

  💬

  please help v2 Server

  shootdiem started Mar 20, 2025 in General

  

  

  2
• 1 You must be logged in to vote

  🙌

  llama-server-one: Single executable for multiple platforms. Similar to llamafile, with latest llama.cpp changes.

  BradHutchings started Mar 24, 2025 in Show and tell

  

  

  0
• 4 You must be logged in to vote

  💬

  Function Calling/Tool use support

  ansarizafar started Nov 23, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  Very confused with the documentation and leveraging llama.cpp features

  TFWol asked Mar 12, 2025 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Trouble with installing and using llamafile

  ricardoguedes0 asked Mar 11, 2025 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How do I specify host to 0.0.0.0 when I want to use server V2?

  stonez56 asked Feb 16, 2025 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Request for Token ID in /completion Response？

  Rin313 asked Feb 13, 2025 in Q&A · Unanswered

  

  

  0
• 4 You must be logged in to vote

  🙏

  Why is llamafile seemingly slower than ollama on my system for the same model and same query ?

  bdutta asked Nov 11, 2024 in Q&A · Unanswered

  

  

  

  

  5