Skip to content

Large and multiple pdf files limit, word files incompatibility with models' context length constraints #45

Description

@abhijit4law

Have you checked that your issue isn't already filed?

  • I read through FAQ and searched through the past issues, none of which addressed my issue.
  • Yes, I have checked that this issue isn't already filed.

Bug description

Arena is for compative performance of various State Of The Art models in real user world, but users on Arena WEBUI suffer from Large and multiple pdf files low limit, docx files incompatibility as well as models' context length constraints. Most of the AI models on Arena WEBUI do not even possess pdf reading ability. Hence, the benchmarks on Arena may suffer from true benchmark battle between /among SOTA AI models. I humbly request Arena WEBUI developer team to fix this bug and upgrade it for its efficiency and reliability.

How to reproduce the bug

Arena is for compative performance of various State Of The Art models in real user world, but users on Arena WEBUI suffer from Large and multiple pdf files low limit, docx files incompatibility as well as models' context length constraints. Most of the AI models on Arena WEBUI do not even possess pdf reading ability. Hence, the benchmarks on Arena may suffer from true benchmark battle between /among SOTA AI models. I humbly request Arena WEBUI developer team to fix this bug and upgrade it for its efficiency and reliability.

Error messages and logs

Arena is for compative performance of various State Of The Art models in real user world, but users on Arena WEBUI suffer from Large and multiple pdf files low limit, docx files incompatibility as well as models' context length constraints. Most of the AI models on Arena WEBUI do not even possess pdf reading ability. Hence, the benchmarks on Arena may suffer from true benchmark battle between /among SOTA AI models. I humbly request Arena WEBUI developer team to fix this bug and upgrade it for its efficiency and reliability.

What operating system are you using?

Windows, Not applicable (e.g. you're using GitHub Pages or other hosting)

Where are you seeing the problem on?

Deployed site

More info

Arena is for compative performance of various State Of The Art models in real user world, but users on Arena WEBUI suffer from Large and multiple pdf files low limit, docx files incompatibility as well as models' context length constraints. Most of the AI models on Arena WEBUI do not even possess pdf reading ability. Hence, the benchmarks on Arena may suffer from true benchmark battle between /among SOTA AI models. I humbly request Arena WEBUI developer team to fix this bug and upgrade it for its efficiency and reliability.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions