github-featured / mlc-ai--mlc-llm

发布

v0.19.dev0 385cef2585

比较
[Model] Add support for OLMo architecture (#3046)

frostbyte_neo 发布于 2024-12-14 01:38:19 +00:00 | 203 次提交在此版本后已推送到 main

This PR add support for OLMo architecture.

Additional support: add support for clip-qkv.

Test: already tested on android(pixel 4) and cuda(setting tensor_parallel_shrads=2)
下载附件
- 源代码 (ZIP)
- 源代码 (TAR.GZ)