LLM-Drop/BAGEL-MoE-7B-GEN-32to16
Text-to-Image ā¢ Updated ā¢ 3 ā¢ 4
AI & ML interests
Efficient and adaptive foundation models across language and multimodal intelligence.
Papers
Demystifying When Pruning Works via Representation Hierarchies
Making Large Language Models Efficient Dense Retrievers