I'am trying to use AzureOpenAiChatClient. When I'am using the stream() method, I can not get info about input and output tokens. It seems all is 0. But i can get from the callI() method.
Comment From: markpollack
Thanks, will investigate.
Comment From: markpollack
Here is a recent community discussion on this topic. It isn't supported in the microsoft SDK, so until it is made available, there isn't anything we can do here. https://learn.microsoft.com/en-us/answers/questions/1805363/azure-openai-streaming-token-usage
Comment From: Showjib3
Ok, thank you 发自我的 iPhone在 2024年10月7日，23:24，Mark Pollack @.***> 写道： Here is a recent community discussion on this topic. It isn't supported in the microsoft SDK, so until it is made available, there isn't anything we can do here. https://learn.microsoft.com/en-us/answers/questions/1805363/azure-openai-streaming-token-usage
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: @.***>