-
[OPIK-3202] [BE] Add Gemini video support for chat completions and online scoring (#4207)
frostbyte_neo 发布于
2025-11-25 13:56:40 +00:00 - [OPIK-3202] [BE] Add Gemini video support for chat completions and online scoring
Implemented Gemini-specific video handling to support video URLs in both chat
completions API and online scoring (LLM-as-Judge) workflows. Gemini treats video
content as images, requiring conversion from VIDEO_URL to ImageContent.Changes:
- Created OpikGeminiChatModel to wrap GoogleAiGeminiChatModel for online scoring
- Created GeminiLangChainMapper for Gemini-specific message conversion
- Updated GeminiClientGenerator to use OpikGeminiChatModel wrapper
- Updated LlmProviderGemini to use GeminiLangChainMapper
- Added comprehensive tests covering all conversion scenarios (9 tests)
- Reverted package-lock.json to fix frontend loading issues
Implements OPIK-3202: Add Gemini video support
- Update apps/opik-backend/src/main/java/com/comet/opik/domain/llm/langchain4j/OpikGeminiChatModel.java
Co-authored-by: Copilot 175728472+Copilot@users.noreply.github.com
Co-authored-by: Copilot 175728472+Copilot@users.noreply.github.com
下载附件