We dont have possibility to increase read timeout for request to model. For example Amazon Bedrock return read timeout if we have large context. Can you add this attribute?
Comment From: ashakirin
Bedrock API supports two kind of timeouts (ClientOverrideConfiguration): 1) Timeout for whole API interaction: amount of time to allow the client to complete the execution of an API call. * This timeout covers the entire client execution except for marshalling. This includes request handler execution, * all HTTP requests including retries, unmarshalling, etc. This value should always be positive, if present.
This timeout is already configurable via spring.ai.bedrock.aws.timeout (default 5 min)
2) Attempt timeout: timeout for each individual attempt: it is not configurable and not used for now.
@lameroot: doesn't the api call timeout (1) spring.ai.bedrock.aws.timeout resolve the read issue?
Comment From: ilayaperumalg
@ashakirin Thanks for the suggestion. @lameroot Please check if you can resolve the issue with the spring.ai.bedrock.aws.timeout and re-open if you still see the issue. Closing the issue for now.