Opus 4.5 is disgustingly good
| Violent brunch | 11/29/25 | | mewling parlor | 11/29/25 | | Violent brunch | 11/29/25 | | Provocative spruce tattoo | 11/29/25 | | Narrow-minded electric mad cow disease | 11/29/25 | | Violent brunch | 11/29/25 | | chartreuse ungodly jew knife | 11/29/25 | | excitant incel | 12/07/25 | | Light ladyboy mental disorder | 12/07/25 | | chartreuse ungodly jew knife | 11/30/25 | | excitant incel | 12/07/25 | | copper set | 12/07/25 | | 180 sinister casino codepig | 12/07/25 | | Spectacular Sandwich Pit | 12/07/25 | | .,.,...,..,.,.,:,,:,...,:::,...,:,.,.:..:. | 12/21/25 | | Patel Philippe | 12/21/25 | | ,.,....,..,.,.,,,,..,..,.,..,.,.,.,... | 12/21/25 |
Poast new message in this thread
Date: December 21st, 2025 12:59 PM
Author: .,.,...,..,.,.,:,,:,...,:::,...,:,.,.:..:.
Opus 4.5 is up to 4 hours and 49 minutes on the METR time horizon task. this benchmark measures the task length (in terms of human work time) that models can do with SWE/AI research type projects. big increase over 5.1 max, which was 2 hours 53 minutes and faster than the overall trend of doubling every 7 months. with any luck, models will be capable of substantially automating AI research before 2030 and set off an intelligence explosion.
https://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/
(http://www.autoadmit.com/thread.php?thread_id=5804093&forum_id=2/en-en#49527643) |
 |
Date: December 21st, 2025 1:53 PM
Author: ,.,....,..,.,.,,,,..,..,.,..,.,.,.,...
They are always claiming this for new model releases and no objective evidence ever materializes for it. It’s almost certainly a psychological bias rather than reality. There is substantial variation in how models respond to a particular problem just based on how they are prompted. It’s hard for a user to reliably measure model capabilities over time based on intuition alone.
(http://www.autoadmit.com/thread.php?thread_id=5804093&forum_id=2/en-en#49527743) |
|
|