Spring AI Max tool calls / Max internalCall limit

Please do a quick search on GitHub issues first, the feature you are about to request might have already been requested.

Expected Behavior

When using multiple tools, the model can sometimes get caught in an infinite loop due to the nature of the prompt. This can be avoided by limiting the max number of tools calls.

Current Behavior

There is no way to put a limit on max recursion depth on internal call or provide a limit on tool calls.

Context

Comment From: lambochen

I'm also encountering the same issue and am trying to resolve it. Wait a moment, I'll submit my solution and PR.

Comment From: TonyJeans

I use a manual method to call the tools in order to control the maximum number of times.

ToolCallingManager toolCallingManager = DefaultToolCallingManager.builder().build();
ChatMemory chatMemory = MessageWindowChatMemory.builder().build();
String conversationId = UUID.randomUUID().toString();

ChatOptions chatOptions = ToolCallingChatOptions.builder()
    .toolCallbacks(ToolCallbacks.from(new MathTools()))
    .internalToolExecutionEnabled(false)
    .build();
Prompt prompt = new Prompt(
        List.of(new SystemMessage("You are a helpful assistant."), new UserMessage("What is 6 * 8?")),
        chatOptions);
chatMemory.add(conversationId, prompt.getInstructions());

Prompt promptWithMemory = new Prompt(chatMemory.get(conversationId), chatOptions);
ChatResponse chatResponse = chatModel.call(promptWithMemory);
chatMemory.add(conversationId, chatResponse.getResult().getOutput());
int count= 0;
while (chatResponse.hasToolCalls() && count< 3) {
    ToolExecutionResult toolExecutionResult = toolCallingManager.executeToolCalls(promptWithMemory,
            chatResponse);
    chatMemory.add(conversationId, toolExecutionResult.conversationHistory()
        .get(toolExecutionResult.conversationHistory().size() - 1));
    promptWithMemory = new Prompt(chatMemory.get(conversationId), chatOptions);
    chatResponse = chatModel.call(promptWithMemory);
    chatMemory.add(conversationId, chatResponse.getResult().getOutput());
    count++;
}

UserMessage newUserMessage = new UserMessage("What did I ask you earlier?");
chatMemory.add(conversationId, newUserMessage);

ChatResponse newResponse = chatModel.call(new Prompt(chatMemory.get(conversationId)));