Hi there,
Microsoft has added support for structured output in Azure AI OpenAI SDK beta 1.0.0-beta12. It's pretty similar to the feature in the original OpenAI endpoint. Please see https://github.com/Azure/azure-sdk-for-java/blob/azure-ai-openai_1.0.0-beta.12/sdk/openai/azure-ai-openai/src/samples/java/com/azure/ai/openai/StructuredOutputsResponseFormat.java for example usage.
It would be great if this could be incorporated into Spring AI. Right now the requestFormat here is still limited to JSON and TEXT (see here).
Thanks in advance and kind regards, Philipp
Comment From: nwflte
+1