数据集 / Kwai-Keye/Keye-VL-1_5-8B

Kwai-Keye/Keye-VL-1_5-8B 已完整同步

Kwai Keye-VL 1.5

Keye-VL-1.5 is a cutting-edge Multimodal Large Language Model (MLLM) that addresses fundamental challenges in video comprehension. It features a novel Slow-Fast video encoding strategy, a progressive four-stage pre-training methodology to extend context length up to 128K tokens, and a comprehensive post-training pipeline focusing on reasoning enhancement and human preference alignment. The model demonstrates significant improvements in video understanding tasks and maintains competitive performance on general multimodal benchmarks.

🔥 News

  • 2025.08.28 🌟 We are excited to introduce Kwai Keye-VL-1.5, a more powerful version! By incorporating innovative Slow-Fast Video Encoding strategy, new LongCoT Cold-Start data pipeline, and advanced RL training strategies, Keye-VL-1.5 reaches new heights in video understanding, image comprehension, and reasoning capabilities. Plus, it now supports an extended context length of up to 128k tokens for handling longer conversations and complex tasks. Stay tuned for more groundbreaking innovations!
  • 2025.07.08 🌟 Keye-VL is supported by swift and vLLM. Feel free to use it without hesitation!
  • 2025.07.03 🌟 We are excited to announce the release of our comprehensive technical report! You can read it now at arxiv.
  • 2025.06.26 🌟 We are very proud to launch Kwai Keye-VL, a cutting-edge multimodal large language model meticulously crafted by the Kwai Keye Team at Kuaishou. As a cornerstone AI product within Kuaishou's advanced technology ecosystem, Keye excels in video understanding, visual perception, and reasoning tasks, setting new benchmarks in performance. Our team is working tirelessly to push the boundaries of what's possible, so stay tuned for more exciting updates!

Contents

  • Kwai Keye-VL 1.5
    • 🔥 News
    • 📐 Quick Start
      • Preprocess and Inference
        • Install
        • Keye-VL-1.5 Inference
        • Deployment
          • Install
          • Offline Inference
          • Online Serving
      • Evaluation
    • 👀 Architecture and Training Strategy
      • 🌟 Pre-Train
      • 🌟 Post-Train
    • 📈 Experimental Results
    • ✒️ Citation
    • Acknowledgement

📐 Quick Start

Preprocess and Inference

See keye-vl-utils/README.md for details. Keye-vl-utils contains a set of helper functions for processing and integrating visual language information with Keye Series Model.

Install

pip install --upgrade keye-vl-utils==1.5.2 -i https://pypi.org/simple

Keye-VL-1.5 Inference

from transformers import AutoModel, AutoTokenizer, AutoProcessor
from keye_vl_utils import process_vision

36 个文件

浏览文件

数据集版权信息

本数据集的许可证为 Apache License 2.0。如有违反相关条款，请联系 WEHUB，我们将及时处理。 查看许可证