Discussions

• 1 You must be logged in to vote

  🙏

  LLama.Batched.CannotSampleRequiresInferenceException: 'Must call Infer() before sampling from this Conversation'

  ikuzono asked Oct 1, 2025 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Help strange out put

  ikuzono asked Sep 24, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  can i load session add message

  ikuzono asked Sep 20, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  .NET MAUI (Windows) inference 9× slower than WinForms using LLamaSharp

  mfsigauravk asked Sep 11, 2025 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  LLamaSharp, Unity and GPU

  footh asked Feb 21, 2025 in Q&A · Answered

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  Context Questions

  ikuzono asked Sep 4, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Can (bert) classifier models be used?

  SerialKicked asked Sep 4, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Struggling to Structure Multi-Faceted Prompts Without Issues Using LlamaSharp → llama.cpp → LLaMA-3.1

  CharlieMunzer started Aug 27, 2025 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  Is CUDA Toolkit a Prerequisite?

  ievgeniilarin asked Feb 2, 2025 in Q&A · Unanswered

  

  

  

  

  4
• 1 You must be logged in to vote

  💬

  Output performance with different GPUs

  aropb started Apr 23, 2025 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  Question on how to work with ChatSession and KernelMemory together

  nicholusi2021 asked Jun 13, 2024 in Q&A · Unanswered

  

  

  

  

  5
• 1 You must be logged in to vote

  🙏

  Issue with BatchedExecutor and cancelling inference

  iejeecee asked Apr 18, 2025 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  LLamaSharp Web not working anymore?

  hswlab asked Feb 2, 2025 in Q&A · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  💬

  LLamasharp Versions

  hswlab started Apr 3, 2025 in General

  

  

  2
• 1 You must be logged in to vote

  💡

  Is there a way to integrate LLamaSharp to the latest .NET AI-templates from Microsoft?

  aezendc started Mar 30, 2025 in Ideas

  

  

  1
• 1 You must be logged in to vote

  💡

  Add adapter classes for Microsoft.Extensions.AI

  Nukepayload2 started Dec 24, 2024 in Ideas

  

  

  2
• 1 You must be logged in to vote

  🙏

  What do I do when I run out of KV cache, but the conversation RequiresInference?

  lostmsu asked Apr 2, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  I'm totally new to using AI, and recently bought an RTX 4060 as secondary GPU for stuff like this

  Deus-nsf asked Mar 30, 2025 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Phi-4-mini-instruct model throws access violation

  skolby42 asked Mar 27, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  What's the difference between ChatSession and Interactive Executor?

  weirdyang asked Mar 3, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to run the Llama.Web Project?

  weirdyang asked Feb 19, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to set Repetition penalty?

  vijaysridhara asked Feb 17, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Why is my Deepseek 2 responding multiple times

  vijaysridhara asked Feb 17, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Is there a way to have the LLM timeout or to cancel a request before the LLM starts to respond?

  nicholusi2021 asked Aug 29, 2024 in Q&A · Unanswered

  

  

  

  

  4
• 1 You must be logged in to vote

  💬

  Code Questions About the LlamaSharp Project

  n-ate started Feb 9, 2025 in General

  

  

  2