Skip to content

feat(api): cap request output tokens - #1533

Open
sufubao wants to merge 3 commits into
ModelTC:mainfrom
sufubao:kill-long-out
Open

feat(api): cap request output tokens#1533
sufubao wants to merge 3 commits into
ModelTC:mainfrom
sufubao:kill-long-out

Conversation

@sufubao

@sufubao sufubao commented Sep 1, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • add --max-request-output-tokens as the default and hard output-token limit
  • apply the cap centrally across OpenAI, TGI, and native APIs
  • document the option in English and Chinese

Tests

  • PYTHONPATH=. pytest -q test/test_api/test_max_request_output_tokens.py test/test_api/test_seed_validation.py
  • CLI parsing for hyphenated and underscored option names
  • git diff --check
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

1 participant