github-featured / comet-ml--opik

发布

0 发布 8,340 Git 标签

RSS 订阅源
  • 1.0.2 18cb086caa
    比较

    OPIK-224 [SDK] Create new LLM eval metric - G-eval (#402)

    frostbyte_neo 发布于 2024-10-28 15:03:09 +00:00

    • OPIK-224 [SDK] Create new LLM eval metric - G-eval

    • rename old project name in docstrings

    • extend base opik model class

    • add litellm model

    • extend base opik model class

    • update litellm model

    • migrate to litellm in models factory (now langchain is optional)

    • add support of model response format messages for langchain

    • calc g-eval with probabilities

    • post-merge fix

    • add lazy initialization fo LLM's chain of thought

    • use gpt-4o model by default

    下载附件