 zhaode.wzd
|
f31132f9d7
|
[Sync] Update MNN to 3.3.1 and Sync Internal Improvements
- Version: Upgrade to 3.3.1.
- LLM: Refactor with Transformer-like config/model/tokenizer; optimize Tokenizer load speed; enhance KV Cache (mmap, disk storage, prefix cache); fix LoRA and VL model bugs.
- CPU/SME: Support SME/SME2 instructions and mixed NEON/SME multi-threading; optimize RVV intrinsics and FP32 depth-wise kernels.
- Metal/OpenCL: Support Metal KV Cache mmap and GPU family identification; refactor OpenCL Loop operators and fix offset bugs.
- QNN/Android: Optimize QNN build/conversion; update Reranker API; fix Android packaging and SO loading issues.
- General: Fix compilation for Arm32/Win/MinGW; update gitignore and expose public symbols; revert StrideSliceWrite behavior.
|
2025-12-19 09:45:24 +08:00 |
|