\
  The most prestigious law school admissions discussion board in the world.
BackRefresh Options Favorite

Local LLM you can run on a Macbook hoses Gemini at coding

It's a 20gb model so you won't be running it on anything wit...
https://imgur.com/a/o2g8xYK
  05/12/25


Poast new message in this thread



Reply Favorite

Date: May 12th, 2025 5:41 PM
Author: https://imgur.com/a/o2g8xYK


It's a 20gb model so you won't be running it on anything with less than 32gb to throw at it. But it's only a matter of time until quantized models match it, and/or we see more consumer hardware with 32gb of VRAM or unified RAM.

https://youtu.be/YG6s4t9vaiw?t=40



(http://www.autoadmit.com/thread.php?thread_id=5724176&forum_id=2:#48924947)