github-featured / vibrantlabsai--ragas

发布

0 发布 90 Git 标签

RSS 订阅源
  • v0.1.15 d58dc01001
    比较

    [FIX] - Fix for summarization edge case (#1201)

    frostbyte_neo 发布于 2024-08-27 09:39:05 +00:00

    This PR adds a fix for the issue mentioned in #1108

    However I have a points to discuss @shahules786 :

    • I had added conciseness_score to penalize long summaries, but I also
      do not want to promote very very short and skimpy summaries, need to
      find a middle ground.
    • Is averaging a good way to combine QA_score and
      conciseness_score?
    • Ranking based metrics to measure quality of summarization (as
      mentioned by shahul in the above issue)

    Given the conclusions we reach based on these discussion points, I will
    push more commits, let's keep this PR open till we resolve these points.

    Co-authored-by: Shahules786 Shahules786@gmail.com

    下载附件