\
  The most prestigious law school admissions discussion board in the world.
BackRefresh Options Favorite

we can't ban open source AI so we'll remove the ability to run it locally

...
Misunderstood Patrolman
  12/17/25
are you talking about the RAM shortage
disturbing bawdyhouse
  12/17/25
GPUs, RAM, SSDs
Misunderstood Patrolman
  12/17/25
it's over
startled lodge
  12/17/25
...
Frozen insanely creepy office legend
  12/17/25
if i flicked nickels at your deformed oblong skull what kind...
Frum sapphire stock car windowlicker
  12/17/25
why don't you "ping" your pencil neck you weird li...
Misunderstood Patrolman
  12/17/25
my neck is huge faggot how bout i rape you with it? show arm...
Frum sapphire stock car windowlicker
  12/17/25
lol what a fag
Misunderstood Patrolman
  12/17/25
the commercial hardware rugpull happening right now is extre...
startled lodge
  12/17/25
...
Misunderstood Patrolman
  12/17/25
seriously this shit is very concerning i thought this wou...
startled lodge
  12/17/25
NSAM was right
Misunderstood Patrolman
  12/17/25
name a time NSAM was wrong, chud
racy cruel-hearted rigpig
  12/17/25
...
Misunderstood Patrolman
  12/17/25
I’m on full fucking tilt rn
Frozen insanely creepy office legend
  12/17/25
This is exactly why I set up a local lm studio, ollama and m...
racy cruel-hearted rigpig
  12/17/25
18000
Misunderstood Patrolman
  12/17/25
how's the performance?
Stimulating Vengeful Church Digit Ratio
  12/17/25
completely fine on 30B, shit after
racy cruel-hearted rigpig
  12/17/25
...
Misunderstood Patrolman
  12/17/25
Is it a Mac? How many GBs of ram do you use?
Aphrodisiac factory reset button fat ankles
  12/17/25
im on a 5090 w a 9950X3D but im currently in the process of ...
racy cruel-hearted rigpig
  12/17/25
how tf do you get a bunch of gpus for free
startled lodge
  12/17/25
Large company upgrading and throwing them away and I just to...
racy cruel-hearted rigpig
  12/17/25
i literally just found out about Big-Tiger-Gemma and its by ...
racy cruel-hearted rigpig
  12/17/25
how large is the database? how does this work? facebook scra...
Stimulating Vengeful Church Digit Ratio
  12/17/25
here are the normie instructions for low iq mos https://l...
racy cruel-hearted rigpig
  12/17/25
i poast on a laptop. i'm just curious.
Stimulating Vengeful Church Digit Ratio
  12/17/25
...
startled lodge
  12/17/25
LM Studio pushes glitchy, unoptimized models. Ollama curates...
Heady Disgusting Hissy Fit
  12/17/25
thanks NSAM, if you read the first line you'd see "h...
racy cruel-hearted rigpig
  12/17/25
also they all pull them from huggingface so no clue wtf idio...
racy cruel-hearted rigpig
  12/17/25
thought this would be NSAM
Supple Mad Cow Disease
  12/17/25
...
Misunderstood Patrolman
  12/17/25
...
bright marvelous kitty cat
  12/17/25
...
brilliant sneaky criminal station
  12/17/25
this whole thread sounds like nsam talking to himself.
fuchsia kitchen karate
  12/17/25
...
Frozen insanely creepy office legend
  12/17/25
...
primrose hell
  12/17/25
...
Misunderstood Patrolman
  12/17/25
i agree this is some really concerning shit ricky i'm not ev...
startled lodge
  12/17/25
...
Frozen insanely creepy office legend
  12/17/25
...
Misunderstood Patrolman
  12/17/25
...
startled lodge
  12/17/25
...
bright marvelous kitty cat
  12/17/25
I was lucky I built my 5070 Ti, 48gb RAM build recently but ...
disturbing bawdyhouse
  12/17/25
...
Frozen insanely creepy office legend
  12/17/25
You need 24gb VRAM to do inference. 16gb isn't enough. Howev...
Heady Disgusting Hissy Fit
  12/17/25
I waited on my RTX pro 6000 and now I'm pissed
primrose hell
  12/17/25


Poast new message in this thread



Reply Favorite

Date: December 17th, 2025 9:16 AM
Author: Misunderstood Patrolman



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516104)



Reply Favorite

Date: December 17th, 2025 1:26 PM
Author: disturbing bawdyhouse

are you talking about the RAM shortage

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516818)



Reply Favorite

Date: December 17th, 2025 1:31 PM
Author: Misunderstood Patrolman

GPUs, RAM, SSDs



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516836)



Reply Favorite

Date: December 17th, 2025 1:32 PM
Author: startled lodge

it's over

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516841)



Reply Favorite

Date: December 17th, 2025 1:36 PM
Author: Frozen insanely creepy office legend



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516856)



Reply Favorite

Date: December 17th, 2025 9:22 AM
Author: Frum sapphire stock car windowlicker

if i flicked nickels at your deformed oblong skull what kind of noise would it make

like a "ping" or would it be more of a squelch

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516121)



Reply Favorite

Date: December 17th, 2025 9:25 AM
Author: Misunderstood Patrolman

why don't you "ping" your pencil neck you weird little freak



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516133)



Reply Favorite

Date: December 17th, 2025 9:40 AM
Author: Frum sapphire stock car windowlicker

my neck is huge faggot how bout i rape you with it? show armpit

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516174)



Reply Favorite

Date: December 17th, 2025 9:52 AM
Author: Misunderstood Patrolman

lol what a fag

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516208)



Reply Favorite

Date: December 17th, 2025 9:23 AM
Author: startled lodge

the commercial hardware rugpull happening right now is extremely radicalizing

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516126)



Reply Favorite

Date: December 17th, 2025 9:24 AM
Author: Misunderstood Patrolman



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516127)



Reply Favorite

Date: December 17th, 2025 9:44 AM
Author: startled lodge

seriously this shit is very concerning

i thought this would happen at some point in the future but it's happening already. things are accelerating very fast

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516186)



Reply Favorite

Date: December 17th, 2025 11:25 AM
Author: Misunderstood Patrolman

NSAM was right

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516456)



Reply Favorite

Date: December 17th, 2025 11:29 AM
Author: racy cruel-hearted rigpig

name a time NSAM was wrong, chud

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516465)



Reply Favorite

Date: December 17th, 2025 11:33 AM
Author: Misunderstood Patrolman



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516483)



Reply Favorite

Date: December 17th, 2025 1:09 PM
Author: Frozen insanely creepy office legend

I’m on full fucking tilt rn

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516748)



Reply Favorite

Date: December 17th, 2025 9:27 AM
Author: racy cruel-hearted rigpig

This is exactly why I set up a local lm studio, ollama and my own custom build that uses publicly available llms

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516143)



Reply Favorite

Date: December 17th, 2025 9:28 AM
Author: Misunderstood Patrolman

18000

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516147)



Reply Favorite

Date: December 17th, 2025 9:41 AM
Author: Stimulating Vengeful Church Digit Ratio

how's the performance?

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516178)



Reply Favorite

Date: December 17th, 2025 9:45 AM
Author: racy cruel-hearted rigpig

completely fine on 30B, shit after

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516189)



Reply Favorite

Date: December 17th, 2025 9:52 AM
Author: Misunderstood Patrolman



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516210)



Reply Favorite

Date: December 17th, 2025 11:58 AM
Author: Aphrodisiac factory reset button fat ankles

Is it a Mac? How many GBs of ram do you use?

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516550)



Reply Favorite

Date: December 17th, 2025 12:04 PM
Author: racy cruel-hearted rigpig

im on a 5090 w a 9950X3D but im currently in the process of making a pretty powerful frankenstein machine with a bunch of gpus i got free

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516564)



Reply Favorite

Date: December 17th, 2025 12:06 PM
Author: startled lodge

how tf do you get a bunch of gpus for free

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516570)



Reply Favorite

Date: December 17th, 2025 12:10 PM
Author: racy cruel-hearted rigpig

Large company upgrading and throwing them away and I just took them. All are pretty powerful on their own.

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516583)



Reply Favorite

Date: December 17th, 2025 11:57 AM
Author: racy cruel-hearted rigpig

i literally just found out about Big-Tiger-Gemma and its by far the best unchained/uncensored LLM ive found yet

holy shit this thing just helped me remove all shadows in an online game and its completely undetectable

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516548)



Reply Favorite

Date: December 17th, 2025 1:08 PM
Author: Stimulating Vengeful Church Digit Ratio

how large is the database? how does this work? facebook scraped data legally and illegally, transformed them into matrices, and now they're available to anyone?

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516746)



Reply Favorite

Date: December 17th, 2025 1:13 PM
Author: racy cruel-hearted rigpig

here are the normie instructions for low iq mos

https://lmstudio.ai/

+

https://huggingface.co/TheDrummer/Big-Tiger-Gemma-27B-v1

also if you cant answer these questions on your own you probably dont even have a strong enough setup to begin with

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516771)



Reply Favorite

Date: December 17th, 2025 1:20 PM
Author: Stimulating Vengeful Church Digit Ratio

i poast on a laptop. i'm just curious.

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516803)



Reply Favorite

Date: December 17th, 2025 1:29 PM
Author: startled lodge



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516824)



Reply Favorite

Date: December 17th, 2025 1:38 PM
Author: Heady Disgusting Hissy Fit

LM Studio pushes glitchy, unoptimized models. Ollama curates so you only get optimized models. You can connect to an Ollama server with OpenWebUI or AnythingLLM and do whatever

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516871)



Reply Favorite

Date: December 17th, 2025 1:39 PM
Author: racy cruel-hearted rigpig

thanks NSAM, if you read the first line you'd see

"here are the normie instructions for low iq mos"

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516880)



Reply Favorite

Date: December 17th, 2025 1:41 PM
Author: racy cruel-hearted rigpig

also they all pull them from huggingface so no clue wtf idiocy ur talking about

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516888)



Reply Favorite

Date: December 17th, 2025 9:40 AM
Author: Supple Mad Cow Disease

thought this would be NSAM

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516175)



Reply Favorite

Date: December 17th, 2025 9:49 AM
Author: Misunderstood Patrolman



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516200)



Reply Favorite

Date: December 17th, 2025 9:58 AM
Author: bright marvelous kitty cat



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516223)



Reply Favorite

Date: December 17th, 2025 9:58 AM
Author: brilliant sneaky criminal station



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516226)



Reply Favorite

Date: December 17th, 2025 1:30 PM
Author: fuchsia kitchen karate

this whole thread sounds like nsam talking to himself.

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516830)



Reply Favorite

Date: December 17th, 2025 1:11 PM
Author: Frozen insanely creepy office legend



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516759)



Reply Favorite

Date: December 17th, 2025 1:11 PM
Author: primrose hell



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516762)



Reply Favorite

Date: December 17th, 2025 1:12 PM
Author: Misunderstood Patrolman



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516764)



Reply Favorite

Date: December 17th, 2025 1:12 PM
Author: startled lodge

i agree this is some really concerning shit ricky i'm not even playing around

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516765)



Reply Favorite

Date: December 17th, 2025 1:16 PM
Author: Frozen insanely creepy office legend



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516788)



Reply Favorite

Date: December 17th, 2025 1:17 PM
Author: Misunderstood Patrolman



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516792)



Reply Favorite

Date: December 17th, 2025 1:25 PM
Author: startled lodge



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516814)



Reply Favorite

Date: December 17th, 2025 1:29 PM
Author: bright marvelous kitty cat



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516825)



Reply Favorite

Date: December 17th, 2025 1:34 PM
Author: disturbing bawdyhouse

I was lucky I built my 5070 Ti, 48gb RAM build recently but that is pretty weak for LLMs afaik

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516849)



Reply Favorite

Date: December 17th, 2025 1:35 PM
Author: Frozen insanely creepy office legend



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516851)



Reply Favorite

Date: December 17th, 2025 7:49 PM
Author: Heady Disgusting Hissy Fit

You need 24gb VRAM to do inference. 16gb isn't enough. However, unless you are coding there's little reason to go above 24gb. The reason coding can use more VRAM is because going through each iteration of the code generates long context windows. If you run out of context window the AI will forget what it was doing earlier. This is also why you can't run 15gb models on 16gb of VRAM. The context windows spills into system RAM and slows everything down

48gb VRAM lets you do more with image and video generation, but will not give you measurable gains in inference. You can put bigger models on the system but they probably won't give you better results.

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49517900)



Reply Favorite

Date: December 17th, 2025 1:36 PM
Author: primrose hell

I waited on my RTX pro 6000 and now I'm pissed

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2#49516855)