Expected Behavior We need a way to pass headers via AnthropicChatOptions.
AnthropicChatOptions.builder().httpHeaders(...).build(),
Current Behavior
Currently we cannot elegantly modify Http Headers for Anthropic (apart from using HttpInterceptors). However, we have a way to do it if it is OpenAI through OpenAiChatOptions
Context Our enterprise has a wrapper on top Anthropic LLM and we need to pass few additional headers and we have no way to do it today.
Comment From: avanathan
cc: @tzolov
Comment From: dev-jonghoonpark
@avanathan I'm curious, what can be set through headers? (I don't know much about the Anthropic API.)
Comment From: tzolov
@avanathan , your suggestion makes sense. Anthropic uses the http-headers (https://docs.anthropic.com/en/api/messages#parameter-anthropic-beta) for various config options.
Comment From: avanathan
Great! Thanks for sharing @tzolov