fix(prebuilt): add timeout parameter to ToolNode for async tool execution#6973
Open
Br1an (Br1an67) wants to merge 1 commit intolangchain-ai:mainfrom
Open
fix(prebuilt): add timeout parameter to ToolNode for async tool execution#6973Br1an (Br1an67) wants to merge 1 commit intolangchain-ai:mainfrom
Br1an (Br1an67) wants to merge 1 commit intolangchain-ai:mainfrom
Conversation
…tion When tools involve network calls (e.g. MCP servers with sse_read_timeout), ToolNode.ainvoke() can hang indefinitely if the underlying transport times out silently. This adds an optional `timeout` parameter that wraps each individual tool coroutine with `asyncio.wait_for`, ensuring that hanging tool calls are cancelled and handled gracefully. When a tool exceeds the timeout: - If handle_tool_errors is enabled (default), returns a ToolMessage with status='error' and a descriptive message - If handle_tool_errors is False, raises TimeoutError The timeout applies per-tool-call, so in parallel execution fast tools still complete successfully even if slow ones time out. Closes langchain-ai#6412
7 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description: When tools involve network calls (e.g., MCP servers with
sse_read_timeout),ToolNode.ainvoke()can hang indefinitely if the underlying transport times out silently without propagating the exception. This adds an optionaltimeoutparameter (in seconds) that wraps each individual async tool coroutine withasyncio.wait_for, ensuring that hanging tool calls are cancelled and handled gracefully.When a tool exceeds the timeout:
handle_tool_errorsis enabled (default): returns aToolMessagewithstatus="error"and a descriptive messagehandle_tool_errorsisFalse: raisesTimeoutErrorThe timeout applies per-tool-call, so in parallel execution fast tools still complete successfully even if slow ones time out. When no
timeoutis specified, behavior is unchanged (full backward compatibility).Example usage:
Issue: Closes #6412
Dependencies: None