How Good Are Low-bit Quantized LLaMA3 Models? An Empirical Study
Paper
• 2404.14047 • Published
• 45
Chengtao Lv
mack-williams
·
AI & ML interests
Efficient AI
Recent Activity
liked
a model about 5 hours ago
lightx2v/Self-Forcing-NVFP4 updated
a model 2 days ago
mack-williams/SF-NVFP4 published
a model 2 days ago
mack-williams/SF-NVFP4 Organizations
authored 8 papers 23 days ago
A Survey of Low-bit Large Language Models: Basics, Systems, and Algorithms
Paper
• 2409.16694 • Published
QVGen: Pushing the Limit of Quantized Video Generative Models
Paper
• 2505.11497 • Published
• 4
DB-LLM: Accurate Dual-Binarization for Efficient LLMs
Paper
• 2402.11960 • Published
• 3
LinVideo: A Post-Training Framework towards O(n) Attention in Efficient Video Generation
Paper
• 2510.08318 • Published
Light Forcing: Accelerating Autoregressive Video Diffusion via Sparse Attention
Paper
• 2602.04789 • Published
• 3
PTQ4SAM: Post-Training Quantization for Segment Anything
Paper
• 2405.03144 • Published
LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit
Paper
• 2405.06001 • Published