Please do a quick search on GitHub issues first, there might be already a duplicate issue for the one you are about to create. If the bug is trivial, just go ahead and create the issue. Otherwise, please take a few moments and fill in the following sections:
Bug description The openai interface interfaces with siliconflow, using the stream model to return a bunch of null values, followed by a \n\n, before returning the correct content
Environment JDK21+SpringBoot 3
Steps to reproduce
Expected behavior A clear and concise description of what you expected to happen.
Minimal Complete Reproducible example
Comment From: markpollack
I don't see what is the issue here. Quite often with openai api compatible models, there can be an issue with compatibility. It looks like this model is returning null values or \n\n
as a value.