Opus 5.0 drives incoherence into the stratosphere

latentsea

I did a grep for load-bearing in our codebase and it now appears hundreds of times. I'm actively starting to hate Opus because of this shite. It's just infuriating to read now.

ArtRichards

Basically every decision or summary I now ask "Help me understand better, please explain in plain-language with examples." Works with 5.6 sol also, when you're deep in the weeds. I rationalize this as the models attempting to compress as much into the fewest tokens, though the choice of words often doesn't make sense to me, going back to read the original after, its often there. It definitely feels like a different sort of 'Machine Language' though xD

jgbuddy

Just instruct it not to do these things

jonstaab

This is so funny to read. I ended up creating a /cleanup-prose skill I run after every command

cobolcomesback

I’m a bit flabbergasted that an Anthropic engineer did reply to this issue, however their reply which they used Claude to write, and even includes some classic ‘Claude-isms’ , claims they didn’t see any of the patterns being complained about. Read the room Anthropic. Maybe don’t use AI to reply to a thread complaining about how AI output is hard to read.

hnarayanan

This drives me insane! To combat it, I maintain a list of banned words and phrases. Claude mostly follows this (but sometimes ignores it). blast radius, land, landed, lands, spine, earned its keep, grammar, spike, cutover, bake, seams, honest, honestly, honesty, long pole, long poles, register, grain, dissolve, floor, ladder, dear, seal, sealed, in anger, resent, amazing, incredible, perfect, sprint, epic, story points, stand-up, retro, grooming, robust, comprehensive, rigorous, surgical, elegant, systematic, dive, deep-dive, delve, unpack, leverage, streamline, surface, it's worth noting, to be clear, importantly, that said, the moment, in one breath, the thing itself, here's the thing, not just X but Y, not X it's Y, em-dashes

onraglanroad

Sounds like it's been infected with the MBAs. I've seen it in many companies. I don't think there's a vaccine yet.

itopaloglu83

I frequently find myself instructing Opus 5 to stop overcomplicating things. It just wants to talk jargon heavy and add unnecessary noise to the conversation. I wonder it’s related to text watermarking somehow.

ajmurmann

It also has developed a tendency to make numbered lists and then refer to the number instead of explaining. Multiple times each hour so I have to ask what "disposition 7" or "AC6" is even though I keep telling it to instead use a few words like "our goal of confirming observations from images with the user first" instead of "AC6"

fluidcruft

I have been wondering if this language drift is related to increased use of AI generated text to train the next models.

Therenas

Yeah I basically have to delete or rewrite any code comments Opus puts in, they are super wordy and circular. Plus, and this is what bothers me most: it refers to issues/explanations that came up in my chat with it, but which are completely contextless as a code comment. Stuff like 'this addresses edge case X', which is true but which you wouldn‘t ever put into a comment because it‘s so minor, and if you did bring it up you normally mention five other similar edge cases.

geodel

Can't all this wait until Anthropic get listed at $2Tn valuation. They promise to fix all of this and more. Please for time being fix your code issues manually and let them concentrate on marketing and exchange listing.

recursivedoubts

I have created a be-terse plugin that appends > respond tersely in Simplified Technical English to every prompt to deal w/claudes insanity: https://github.com/bigskysoftware/be-terse*

ahsillyme

I find the language less impervious than has been suggested generally, but that it's reasoning is astonishingly, unbelievably bad. Not sure why the focus has been only on language, am I the only one seeing this?

drtournier

I wonder how much it is related to the invisible watermarking

anonzzzies

we don't read it, we only review the resulting code. works fine and the quality is good.

UltraSane

I asked Opus how to sort images by embedding and it used the word Seriation which I had to look up. It is the correct word to use in the context but pretty obscure.

thisisauserid

It's almost like transformers generate output using some sort of guided prediction! How do they expect us to bring our capricious demands to fruition reliably?

b1gTekken

Turns out tech people are not the only literates to use text based systems. Why should Anthropic, a company out to capture eyeballs of billions care about 450 point score in a single Reddit thread. That metric is p-hacking... found a number but not necessarily one that isn't subsumed by others. Tech bros among the proletariat may recite the (arbitrarily chosen to begin with) proper spoken/written traditions but end of day they're a minority of the real populace. Just another generation of overly dogmatic, over specialized linguists, like preachers. Riding a single track career for decades, externalizing all kinds of useful effort and thought; wonder what the occurrence of dementia will be in Millennials over time due to obsession with eventually replaced technical languages while lacking depth in manual self sufficiency skills. I am going to predict relative to prior generations more of them become demented as they become more codependent and decoupled from a world that's language has changed. They will lack that real world grounding that comes with deep and wide muscle memory based skills. (Oh no an inconsequential social credit score as marked by complete randos who are materially irrelevant to reality; just validating their biases and gripping tighter causing more of reality to squeeze between their fingers; little cognitive fascists set upon a uniform social narrative just like the biology of religious nutters; turns out physcial norms impact 100% typical biology of software engineers)

aamargulies

I was playing around with Opus 5.0, experimenting with creative writing tasks and this came out of one of the characters' mouths: "... and the reason he was doing this — the reason, the entire load-bearing reason, the twelve thousand dollars a school and the girls of the Karakoram ... " The em-dash. The 'load-bearing'. Other than that, Opus 5.0 is actually not bad as a writer.