The most prestigious law school admissions discussion board in the world.
|
 |
 
|
My Whatsapp group with BIGTECH bros is >> xo these days
| Stirring learning disabled hominid scourge upon the earth | 04/28/26 |
| Stirring learning disabled hominid scourge upon the earth | 04/28/26 |
| Maroon spectacular office | 04/28/26 |
| Maroon spectacular office | 04/28/26 |
| Stirring learning disabled hominid scourge upon the earth | 04/29/26 |
| garnet jet-lagged lodge idea he suggested | 04/29/26 |
| Stirring learning disabled hominid scourge upon the earth | 04/29/26 |
| Stirring learning disabled hominid scourge upon the earth | 04/29/26 |
| Stirring learning disabled hominid scourge upon the earth | 04/29/26 |
| Stirring learning disabled hominid scourge upon the earth | 04/29/26 |
| Swollen Shrine | 04/29/26 |
| Stirring learning disabled hominid scourge upon the earth | 05/03/26 |
| garnet jet-lagged lodge idea he suggested | 05/13/26 |
| Stirring learning disabled hominid scourge upon the earth | 05/13/26 |
| Jet theater | 05/14/26 |
| Pink deranged hissy fit | 05/14/26 |
| Buck-toothed Cruise Ship Hairy Legs | 05/14/26 |
| Stirring learning disabled hominid scourge upon the earth | 05/26/26 |
| Stirring learning disabled hominid scourge upon the earth | 05/26/26 |
| Stirring learning disabled hominid scourge upon the earth | 05/28/26 |
Poast new message in this thread
Date: April 28th, 2026 11:49 PM Author: Stirring learning disabled hominid scourge upon the earth It's invite only and everything is AI related and it's 180 (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2most#49850251) |
Date: April 28th, 2026 11:50 PM Author: Stirring learning disabled hominid scourge upon the earth Some CEOdood just poasted this
"so I ran some more math, and newer Xeon machines (Grand Rapids etc) with 1.5TB of RAM (MRDIMM - more throughput than DDR5) can deal with more concurrent users on MoE models like Kimi 2.6 and GLM 5.1 with longer context windows (>200k) though with reduced tok/sec/user for about 1/4-1/5 of the price of B200x8 or 2x(H100x8).
That means that some of my "batching" theories, assuming I can prove dedicated kernels on AMX and AVX512, means that headless coding agents that don't have a human following them, that runs in the background can be executed on said models in a MUCH cheaper way.
running a first test on Grand Rapids CPUs (only managed to get 16 CPUs - GCP won't give me quota).
You would think with the amount of models being downloaded, most clouds should benefit from a proxy for those the same way they do for linux packages..."
|
 |
Date: April 28th, 2026 11:52 PM Author: Maroon spectacular office CEO bragging about doing setup steps on the max settings
wtf is Grand Rapids Michigan CPU |
|
Date: April 28th, 2026 11:50 PM Author: Maroon spectacular office You posted this exact thread last week
Provide updated screenshots or gtfo |
|
Date: April 29th, 2026 12:48 AM Author: Stirring learning disabled hominid scourge upon the earth I can't tell what these people are saying a lot of the time and redacting shit is tedious
https://i.imgur.com/F6Nwlsl.png |
|
Date: April 29th, 2026 12:06 AM Author: garnet jet-lagged lodge idea he suggested Sounds douchey but potentially interesting. More douchey tho. (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2most#49850281) |
|
Date: April 29th, 2026 12:32 AM Author: Stirring learning disabled hominid scourge upon the earth Speaking as a VC, I will tell you that I hope you aren’t using VC money to buy off brand GPUs. We wall know that the most valuable AI startups use NVIDIA(tm). I have a special relationship with them, actually so we can get you to the front of the queue. (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2most#49850306) |
|
Date: April 29th, 2026 12:37 AM Author: Stirring learning disabled hominid scourge upon the earth i have a couple of "code parser in the sampling loop" + "code parser controlled KV cache endpoints" experiments that are pretty promising, also in the context of CPU inference. I don't really have time nor knowledge to properly explore them, but if someone is interested here, I feel this can unlock some pretty interesting idea to keep smaller models on track and just in general exploit the massive power that comes with controlling the inference end to end. I did a couple of experiments and my ideas do work (very messy repo: https://github.com/REDACTED), if someone is interested in a chat. (I think small local models + custom inference harness + tools optimized on trace analysis / GEPA-like/autoresearch loops are potentially competitive with much much much larger models for a fair amount of the "lower level but token consuming" tasks in the context of coding. roughly the idea is that if you have a AST parser + compiler/interpreter in the loop, you can do the following things: - flag syntax errors (obv) + easily gaslight the model into thinking it wrote them correctly - autocomplete a set of patterns to save on inference compute by just prefilling the completion - rewind the cache / inference pointer (not sure what the proper name is) to semantically meaningful points (say, function starts) - insert // docstrings that help the model along for trickier APIs - for certain types of functions / unit tests, run the unit tests right after the code was generated, parallelizing with inference, and you can easily rewind - on CPU, where you are memory constrained (I guess it's the same on GPUs but I haven't done GPGPU stuff since 2012), you can run speculative loops / split the code writing across multiple cores and then merge
All of these things mostly benefit from it being tailored to your own codebase / being RL-optimized to your codebase through transcript analysis, so model providers who are more reliant on batching similar jobloads and often are "too fast" for this kind of trickery won't really benefit from it. |
|
Date: April 29th, 2026 12:40 AM Author: Stirring learning disabled hominid scourge upon the earth At the NVIDIA conf last year, I ran into a liquid cooled server rack vendor I have seen since I was a gothling and set up sun gear in datacenters to pay for fangs and leather jackets. I said “I thought you retired”. He said “no, we’re doing it all one last time. this time for real money”. (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2most#49850314) |
|
Date: April 29th, 2026 1:21 AM Author: Stirring learning disabled hominid scourge upon the earth https://i.imgur.com/IIch0AM.png (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2most#49850376) |
|
Date: April 29th, 2026 1:38 AM Author: Swollen Shrine Whoa, nice! (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2most#49850406) |
|
Date: May 3rd, 2026 10:00 PM Author: Stirring learning disabled hominid scourge upon the earth https://i.imgur.com/HMesAbG.png (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2most#49862913) |
|
Date: May 13th, 2026 11:38 PM Author: garnet jet-lagged lodge idea he suggested INSUFFERABLE (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2most#49884675) |
|
Date: May 13th, 2026 11:22 PM Author: Stirring learning disabled hominid scourge upon the earth 🤣🤣🤣https://www.hiddendoor.co/world/interview-gauntlet-883562 (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2most#49884664) |
|
Date: May 14th, 2026 8:57 AM Author: Jet theater get me an invite (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2most#49884939) |
|
Date: May 14th, 2026 9:27 AM Author: Pink deranged hissy fit *laughing at the absurdity of this entire premise* (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2most#49884988) |
|
Date: May 14th, 2026 9:40 AM Author: Buck-toothed Cruise Ship Hairy Legs JJC? Is that you lil bro? Welcum back (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2most#49885027) |
|
Date: May 26th, 2026 11:44 PM Author: Stirring learning disabled hominid scourge upon the earth https://i.imgur.com/XhXzJwi.jpeg (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2most#49903462) |
|
Date: May 26th, 2026 11:48 PM Author: Stirring learning disabled hominid scourge upon the earth https://rosmine.ai/2026/05/18/fixing-llm-writing-with-distribution-fine-tuning/ (http://www.autoadmit.com/thread.php?thread_id=5861511&forum_id=2most#49903484) |
|
Date: May 28th, 2026 7:07 PM Author: Stirring learning disabled hominid scourge upon the earth Of shit this got taken down!
Here's a backup
https://web.archive.org/web/20260522230330/https://rosmine.ai/2026/05/18/fixing-llm-writing-with-distribution-fine-tuning/ |