The fastest decode and prefill for 4-bit Qwen3.8-27B on one RTX 3090 that preserves the model's intelligence
Languages
5
Total size
1.5 MB
Primary language
Python
LanguageSizeShare
Python
1.4 MB93%
Shell
70 kB5%
Docker
18 kB1%
Nix
9.8 kB<1%
C
8.5 kB<1%