github-featured / shishirpatil--gorilla

发布

0 发布 8 Git 标签

RSS 订阅源
  • v1.1 3850c2b622
    比较

    [BFCL] Relocate Formatting Instructions and Function Documentation to System Prompt (#593)

    frostbyte_neo 发布于 2024-08-25 04:08:09 +00:00

    Previously, formatting instructions and function documentation were
    included in the user prompt when interacting with models in prompting
    mode. However, these details are better suited for the system prompt,
    where they can more effectively guide the model's behaviour. This PR
    updates the model prompting process by moving the formatting
    instructions and function documentation to the system prompt, ensuring
    they are appropriately positioned for optimal model performance.

    This will affect the leaderboard score.

    Also in this PR:

    1. Update the model handlers to record the processed prompt/message and
      tools (if FC mode) in the result file when inference. This helps to
      identify if there are any issues with the pre-processing phase.
    2. Fix 6 dataset issues: irrelevance_49, live_irrelevance_157-18-1, live_simple_79-40-0, live_parallel_0-0-0, live_parallel_4-1-0, live_parallel_5-2-0
    下载附件