Oleg Kibirev

catplusplus's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 7 days ago

VLLM + MTP + NVFP4 doesn't work

👀 1

1

#16 opened 7 days ago by

catplusplus

New activity in nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 12 days ago

Run on DGX Spark

14

#14 opened 13 days ago by

LimeemiL

New activity in nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 13 days ago

Doesn't work with latest vllm, even tried to recompile vLLM and transformers from git

➕ 1

4

#8 opened 17 days ago by

catplusplus

New activity in nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 14 days ago

All this talk about NVFP4 - why is it dog slow?

13

#13 opened 15 days ago by

josephbreda

New activity in nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 15 days ago

NVFP4 cannot be loaded in SGLang

4

#12 opened 15 days ago by

mratsim

New activity in nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 16 days ago

vLLM MTP unusable on RTX 6000 Pro, as spec decoding consumes 20GB+ VRAM at start-up, causing OOM

5

#9 opened 16 days ago by

lsmc

New activity in llmfan46/Qwen3.5-35B-A3B-heretic-v2 25 days ago

Made NVFP4 version

#3 opened 25 days ago by

catplusplus

Got better even though the higher KLD!

👍 4

3

#2 opened 25 days ago by

FORNAX20

New activity in llmfan46/Qwen3.5-35B-A3B-heretic-v1 26 days ago

Any revision plan?

6

#2 opened 27 days ago by

Lck0427

Made catplusplus/Qwen3.5-35B-A3B-heretic-NVFP4 for Blackwell users

1

#3 opened 26 days ago by

catplusplus

Made catplusplus/Qwen3.5-35B-A3B-heretic-NVFP4 for Blackwell users

1

#3 opened 26 days ago by

catplusplus

New activity in llmfan46/Qwen3.5-35B-A3B-heretic-v1 27 days ago

Any revision plan?

6

#2 opened 27 days ago by

Lck0427