PR Agent invocation fails due to OpenAI Inference error #2055
Description
Git provider
Azure
System Info
Deployment type: CI, via Azure DevOps
Bug details
Unfortunately, when trying to run the PR agent in CI (Azure DevOps), it fails with the following log output:
2025-10-07 21:50:53.726 | INFO | pr_agent.git_providers.git_provider:get_user_description:83 - Existing description was not generated by the pr-agent
2025-10-07 21:50:53.732 | INFO | pr_agent.tools.pr_description:run:83 - Generating a PR description for pr_id: My-Systems/MailDispatcher/177
2025-10-07 21:50:53.900 | INFO | pr_agent.git_providers.azuredevops_provider:get_diff_files:373 - Invalid files: []
2025-10-07 21:50:53.938 | INFO | pr_agent.algo.pr_processing:get_pr_diff:63 - PR main language: yaml
2025-10-07 21:50:53.941 | INFO | pr_agent.algo.pr_processing:get_pr_diff:74 - Tokens: 1341, total tokens under limit: 32000, returning full diff.
Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new
LiteLLM.Info: If you need to debug this error, use `litellm.set_verbose=True'.
2025-10-07 21:50:53.958 | WARNING | pr_agent.algo.ai_handlers.litellm_ai_handler:chat_completion:218 - Error during OpenAI inference:
Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new
LiteLLM.Info: If you need to debug this error, use `litellm.set_verbose=True'.
2025-10-07 21:50:53.961 | WARNING | pr_agent.algo.ai_handlers.litellm_ai_handler:chat_completion:218 - Error during OpenAI inference:
Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new
LiteLLM.Info: If you need to debug this error, use `litellm.set_verbose=True'.
The invocation in CI looks like this (almost completely copied from documentation):
- script: |
echo "Running PR Agent action step"
# Construct PR_URL
PR_URL="${SYSTEM_COLLECTIONURI}${SYSTEM_TEAMPROJECT}/_git/${BUILD_REPOSITORY_NAME}/pullrequest/${SYSTEM_PULLREQUEST_PULLREQUESTID}"
echo "PR_URL=$PR_URL"
# Extract organization URL from System.CollectionUri
ORG_URL=$(echo "$(System.CollectionUri)" | sed 's/\/$//') # Remove trailing slash if present
echo "Organization URL: $ORG_URL"
export azure_devops__org="$ORG_URL"
export config__git_provider="azure"
pip install pr-agent
pr-agent --pr_url="$PR_URL" describe
pr-agent --pr_url="$PR_URL" review
pr-agent --pr_url="$PR_URL" improve
env:
openai__key: $(OPENAI_KEY)
azure_devops__pat: $(AZURE_DEVOPS_PAT)
displayName: 'Perform PR review'
Unfortunately, the error message does not go into details on where the issue may come from.