[OPIK-3361] [BE] Add audio_url support for custom LLM models (#4396)
frostbyte_neo
发布于
2025-12-09 15:31:35 +00:00
- [OPIK-3361] [BE] Add audio_url support for custom LLM models
- Add AudioUrl class mirroring VideoUrl structure
- Add AUDIO_URL to OpikContentType enum
- Add audioUrl field to OpikContent and LlmAsJudgeMessageContent
- Add addAudioUrl() builder method to OpikUserMessage
- Handle AudioContent in OpikOpenAiChatModel for multimodal messages
- Add audio_url case in OnlineScoringEngine for online scoring
- Add audio_url handling in OpenAiMessageJsonDeserializer for request parsing
- Update LlmProviderLangChainMapper and GeminiLangChainMapper
- Add Qwen Omni pattern to ModelCapabilities for multimodal support
- Add serialization tests for OpikUserMessage and LlmAsJudgeMessage
- Update test data manufacturer for audio_url content
- Revision 2: Update Javadoc comments to include audio_url support
下载附件