The most prestigious law school admissions discussion board in the world.
|
 |
 
|
I can't use more than 80gb VRAM now
| Dan Bilzerian | 05/27/26 |
Poast new message in this thread
Date: May 27th, 2026 7:52 PM Author: Dan Bilzerian 48gb is enough to run Qwen3.6 27b Q8 with full context window, and 32gb is enough to run Qwen-VL. I have at least 48gb VRAM doing nothing. If I pooled it all together I still couldn't run anything better than Qwen 3.6 27b Q8. It's fucked up. There are no 70b models anymore, just 27b or 9648347b (http://www.autoadmit.com/thread.php?thread_id=5869534&forum_id=2#49904459) |