github-featured / vibrantlabsai--ragas

发布

0 发布 90 Git 标签

RSS 订阅源
  • v0.1.16 fe379a1c97
    比较

    feat (experimental) added new prompt and metric into `ragas.experimental` (#1240)

    frostbyte_neo 发布于 2024-09-03 06:08:05 +00:00

    you can use it like

    from ragas.experimental.metrics import FaithfulnessExperimental
from ragas.metrics import faithfulness
from ragas import evaluate


f = FaithfulnessExperimental(llm=LangchainLLMWrapper(gpt4o))
faithfulness.llm = LangchainLLMWrapper(gpt4o)

# row = amnesty_qa["eval"][0]
# await f.ascore(row)
# await faithfulness.ascore(row)

r = evaluate(
    amnesty_qa["eval"].select(range(10)),
    metrics=[f, faithfulness],
    raise_exceptions=True,
    callbacks=[]
)
    下载附件