Multimodal models with leading performance.
AI & ML interests
Large Language Models
Recent Activity
View all activity
Papers
Hybrid Linear Attention Done Right: Efficient Distillation and Effective Architectures for Extremely Long Contexts
InfLLM-V2: Dense-Sparse Switchable Attention for Seamless Short-to-Long Adaptation
The first On-device Agent Model Series: Deep Search Exploration and Deep Report Generation.
MiniCPM4: Ultra-Efficient LLMs on End Devices
Extrapolating RLVR to General Domains without Verifiers
UltraLM, UltraRM and UltraCM.
Advancing LLM Reasoning Generalists with Preference Trees
Embedding, re-ranking, generation -- the cornerstone of RAG.
NOSA: Native and Offloadable Sparse Attention
The MiniCPM family of LLMs and VLLMs.
The collection of open-source models that adopt Ultra Series datasets for training
CPM-Bee series models.
Parsing-free RAG supported by VLMs
-
VisRAG 2.0: Evidence-Guided Multi-Image Reasoning in Visual Retrieval-Augmented Generation
Paper • 2510.09733 • Published • 5 -
VisRAG: Vision-based Retrieval-augmented Generation on Multi-modality Documents
Paper • 2410.10594 • Published • 29 -
openbmb/EVisRAG-7B
8B • Updated • 463 • 4 -
openbmb/EVisRAG-3B
4B • Updated • 101 • 1
Multimodal models with leading performance.
NOSA: Native and Offloadable Sparse Attention
The first On-device Agent Model Series: Deep Search Exploration and Deep Report Generation.
MiniCPM4: Ultra-Efficient LLMs on End Devices
The MiniCPM family of LLMs and VLLMs.
Extrapolating RLVR to General Domains without Verifiers
The collection of open-source models that adopt Ultra Series datasets for training
UltraLM, UltraRM and UltraCM.
CPM-Bee series models.
Advancing LLM Reasoning Generalists with Preference Trees
Parsing-free RAG supported by VLMs
-
VisRAG 2.0: Evidence-Guided Multi-Image Reasoning in Visual Retrieval-Augmented Generation
Paper • 2510.09733 • Published • 5 -
VisRAG: Vision-based Retrieval-augmented Generation on Multi-modality Documents
Paper • 2410.10594 • Published • 29 -
openbmb/EVisRAG-7B
8B • Updated • 463 • 4 -
openbmb/EVisRAG-3B
4B • Updated • 101 • 1
Embedding, re-ranking, generation -- the cornerstone of RAG.