- For example the OllamaOptions class contains Ollama options properties as well as non-model related options such as
format
,model
,keep-alive
used for call request creation. Later are filtered out explicitly before the request is made. - Similarly the Function Calling related properties are added to the corresponding ModelXOptions but marked as @JsonIgnore so they again are filtered before passing the options to the call. ...
A proper separation for model
and request
sub-category in the ModelXOptions would make the management cleaner and easier.
Comment From: markpollack
Perhaps this is a way to also address haivng different timeouts specified as the restclient configuraiton level