Fuck AI

No idea why OP did it, but for me it demonstrates that the claims of techbros that these LLMs are working on a reasoning level comparable to PhD, is wildly exaggerated. It puts into question if spending literal trillions of dollars for this crap is a good idea, when 250 billion (inflation adjusted) could build the large hadron collider, or a meager 25 billion a year could prevent world hunger.

When paying humans less for their work is your goal, no amount of computing power is too much to not justify the cost

While it's easy to demonstrate it falling at "real work", most of those examples only can be understood by people familiar with the niche.

So this is basically showing failure on what "should" be their turf. A strong point of the LLMs is supposed to be milquetoast stuff like this, where pretty much this verbatim sort of content should have appeared over and over and over in the training content.

For the supposed best of the best, worthy of billions upon billions directly and even more indirectly, this is just a way to be extra embarrassing.

The kicker is when the tech bros get confronted repeatedly with the same exact dodgy behavior, they just smile and laugh. Watched a WSJ video about a vending machine experiment by anthropic that would have just been brutally embarrassing but the company rep just laughed it off. Not when the usual "we will fix that right away" ir even "you used it wrong" just a general attitude that screened "it doesn't even matter, everyone is going to give us money anyway"