发布

  • Add option to support any/self-hosted OpenAI compatible completion endpoints (vLLM) on Playground (#2449)

    frostbyte_neo 发布于 2025-07-07 14:20:42 +00:00

    • feat: add vllm to frontend

    • Integrated VLLM and fixed issues

    • feat: added vllm provider support in backend

    • fix: vllm form schema

    • debug vllm ai provider methods

    • fix: vllm provider details

    • feat: add dynamic models list from vllm server for frontend

    • fix: vllm backend implementation

    • chore: cleanup

    • refactor: resolve comments

    • feat: use vllm substring to validate model

    • fix: ManageAIProviderDialog fallback to old url method

    • generalize vLLM to all providers that support OpenAI API

    • code style fixes

    • making models list manully input by the user

    • fixed custom llm prefix in the model name

    • backend - fix prefix

    • post merge origin/main fixes

    • fix update provider api key to work on the backend

      • add custom provider support on FE
    • remove LocalProvider support on FE
      • small UI adjustments
      • fix url param name
      • fix data structure to API calls
      • fix APi key validation and some text description
      • fix icon
      • fix provider error skip
      • small UI fixes
    • fix online scoring prefix issue

    • fix error handling

      • fix logic into model select popup to present label, instead of value
    • patch update failing test

    • patch update failing test green

    • empty api key test coverage

    • spotless

    • allow blank api key for custom llm

    • refactor

    • fixes after merging origin/main

    • fix reading provider api key when api key is null

    • spotless

    • Update apps/opik-frontend/src/components/pages-shared/llm/PromptModelSelect/PromptModelSelect.tsx

    Co-authored-by: Copilot 175728472+Copilot@users.noreply.github.com

    • Update apps/opik-frontend/src/components/pages-shared/llm/ManageAIProviderDialog/ManageAIProviderDialog.tsx

    Co-authored-by: Copilot 175728472+Copilot@users.noreply.github.com

    • fix lint error

    • pr comments - empty rollback for nullable api key


    Co-authored-by: Ido Berkovich ido@comet.com
    Co-authored-by: andrii.dudar fanat.web@gmail.com
    Co-authored-by: Copilot 175728472+Copilot@users.noreply.github.com

    下载附件