Post
2,978
i am BEGGING you people to stop shoving everything in the GGUF Hole and ship w4a8/w6a8 models for ComfyUI. Comfy has bespoke kernels for these! They're fast everywhere!
4 bits should be treated as the floor for DiT weights, if you really need 3 bits or lower you should just use a different model!
Also stop shilling nvfp4 you animals!!!
4 bits should be treated as the floor for DiT weights, if you really need 3 bits or lower you should just use a different model!
Also stop shilling nvfp4 you animals!!!
- 8 replies
