Expected Behavior
Currently, we cannot use structured outputs with Google Gemini models through Vertex. This is supported and would be extremely beneficial. We allow customers to define the output that they want the want to output in so we would want to pass this through to the API.
Current Behavior
We are currently including additional prompting to get Gemini to behave how the user wants, but there are times where this output is still not enforced.
Context
https://cloud.google.com/vertex-ai/generative-ai/docs/multimodal/control-generated-output