github-featured / mudler--localai

发布

0 发布 177 Git 标签

RSS 订阅源
  • v2.13.0 c9451cb604
    比较

    Bump oneapi-basekit, optimum and openvino (#2139)

    frostbyte_neo 发布于 2024-04-26 14:20:43 +00:00

    • Bump oneapi-basekit, optimum and openvino

    • Changed PERFORMANCE HINT to CUMULATIVE_THROUGHPUT

    Minor latency change for first token but about 10-15% speedup on token generation.

    下载附件