ElliotGao

tclf90's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in QuantTrio/Qwen3.6-35B-A3B-AWQ about 3 hours ago

Any plans for a calibration-based AWQ build for better long-context stability?

1

#6 opened about 15 hours ago by

hyunw55

New activity in QuantTrio/Qwen3.6-35B-A3B-AWQ about 12 hours ago

PPLX or KLD, or other benchmark

1

#4 opened 1 day ago by

HenkTenk

New activity in QuantTrio/GLM-5-AWQ 14 days ago

[Request] Great work! Do you have plans to also create GLM-5.1-AWQ?

🤗 1

7

#6 opened 14 days ago by

ag1988

New activity in QuantTrio/Qwen3.5-122B-A10B-AWQ 14 days ago

CUDA version 13?

1

#1 opened 16 days ago by

pathosethoslogos

New activity in QuantTrio/gemma-4-31B-it-AWQ 14 days ago

Request for awq of the gemma 4 26B A4B MoE

5

#1 opened 16 days ago by

rks2302

New activity in QuantTrio/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-AWQ 18 days ago

AWQ 4/5/6-bit request for Qwopus3.5-27B-v3

🚀❤️ 3

3

#2 opened 19 days ago by

0xburakcelik

New activity in QuantTrio/Qwen3.5-27B-AWQ 22 days ago

AWQ 4-bit version of this Opus-Distilled-v2 model?

9

#5 opened 23 days ago by

0xburakcelik

New activity in QuantTrio/Qwen3.5-27B-AWQ about 1 month ago

--max-model-len 32768 seems a bit too small for agent use cases ?

3

#3 opened about 1 month ago by

edwarddukewu

New activity in QuantTrio/MiniMax-M2-AWQ about 1 month ago

Install & run QuantTrio/MiniMax-M2-AWQ easily using llmpm

👍 1

1

#8 opened about 1 month ago by

sarthak-saxena

New activity in QuantTrio/Qwen3.5-27B-AWQ about 2 months ago

My personal vLLM launch cmd on my old personal 2x3090 workstation

7

#1 opened about 2 months ago by

tclf90

New activity in QuantTrio/Qwen3.5-35B-A3B-AWQ about 2 months ago

Can't get vLLM running on 1xRTX 4090

3

#1 opened about 2 months ago by

slyfox1186

New activity in cyankiwi/Qwen3.5-27B-AWQ-4bit about 2 months ago

Easy to fall into infinite loop

👍 1

7

#2 opened about 2 months ago by

dwaynedu

New activity in QuantTrio/GLM-5-AWQ about 2 months ago

GLM-5-AWQ vLLM 部署指南

👍 1

2

#2 opened about 2 months ago by

CharlesChen2023

Great work

5

#1 opened about 2 months ago by

JoeyHwong

New activity in QuantTrio/Qwen3.5-35B-A3B-AWQ about 2 months ago

How run this model on Sglang?

1

#2 opened about 2 months ago by

Salvadori

New activity in QuantTrio/Qwen3.5-397B-A17B-AWQ about 2 months ago

Anyone else getting only exclamation marks?

15

#3 opened about 2 months ago by

Halbin

QuantTrio/Qwen3.5-397B-A17B-AWQ reponse is !

8

#5 opened about 2 months ago by

duyuting

GPTQ int4-int8 mixed

2

#4 opened about 2 months ago by

darkstar3537

New activity in QuantTrio/GLM-4.7-Flash-AWQ 3 months ago

--max-model-len 32768 ?

1

#1 opened 3 months ago by

pathosethoslogos

New activity in QuantTrio/DeepSeek-V3.2-AWQ 4 months ago

The model startup using vllm failed.

10

#5 opened 4 months ago by

beausoft