SVDQuant: 4-Bit Quantization Powers 12B Flux on a 16GB 4090 GPU with 3x Speedup

📅 2024-11-09    ⚓ Hacker News    🌐 Source    🖼️ Load Image