Please do a quick search on GitHub issues first, there might be already a duplicate issue for the one you are about to create. If the bug is trivial, just go ahead and create the issue. Otherwise, please take a few moments and fill in the following sections:

Bug description The openai interface interfaces with siliconflow, using the stream model to return a bunch of null values, followed by a \n\n, before returning the correct content

Environment JDK21+SpringBoot 3

Steps to reproduce

Expected behavior A clear and concise description of what you expected to happen.

Minimal Complete Reproducible example

Image

Comment From: markpollack

I don't see what is the issue here. Quite often with openai api compatible models, there can be an issue with compatibility. It looks like this model is returning null values or \n\n as a value.