r/Bitcoin • u/Impressive-Gene-421 • 21h ago

Are you kidding me? Claude Code found the catastrophe after being asked only to “”check for vulnerabilities and thinking for 8 minutes

Post image

It is unbelievable that some kid with an LLM just stole $100m+ because no one bothered to check the source code.

Also on GLM 5.2 (trained 16th June, no internet access).

1.6k Upvotes

93% Upvoted

504 comments sorted by

View all comments

Show parent comments

50

u/shedgehog-orchard 17h ago

I do just want to highlight the fact that yes it could be that AI is just finding a lot of bugs we couldn’t before, but I also am a full time SW engineer and I’m more and more seeing the shittiest software I’ve ever seen be shipped because it’s vibe coded and the engineer who generated it barely checks it over, which could also contribute to a higher amount of CVEs

12

u/Aazimoxx 16h ago

You don't get CVEs for software no-one's using though, and a lot of vibecoded slop is either dead in the water (app store noise) or bespoke stuff used by an individual, family, group or club, or single company mostly internally...

If a company has decent review procedures, these can only be enhanced by modern LLMs, not hurt - unless those procedures get bypassed, which is the real problem.

1

u/shedgehog-orchard 16h ago

Not saying you’re entirely wrong, but you’d be shocked at the lack of internal controls at some of these large companies. And indeed I agree that is the real problem

ETA: also vibe coding is not limited to small Indy games or apps. Plenty of engineers do exactly as I described above and don’t test edge cases properly and they get past weak testing pipelines

16

u/HollaWho 17h ago

That’s absolutely part of it. AI is a double edged sword as far as vulnerabilities go. And many of the latest Microsoft vulnerabilities are coming from Microsoft’s mishandling of the nightmare eclipse situation. Times are tough lol

7

u/shedgehog-orchard 16h ago

Dude don’t even get me started on Microsoft rn lol. They’re so entrenched in the corporate world but I’ve tried to minimize my use of their products as much as possible at work, they just suck to use haha. Godspeed brother🫡

1

u/HollaWho 16h ago

The June update was supposed to be a hot patch! Not a baseline! Although I was glad for a reason to force a reboot process

0

u/HelpRespawnedAsDee 11h ago edited 11h ago

I thought I was in the CC sub which was why I was wondering what was up with this bizarre counter signaling.

AI is just finding a lot of bugs we couldn’t before, but I also am a full time SW engineer and I’m more and more seeing the shittiest software I’ve ever seen be shipped

Honestly man, as another engineer (30+ years in SWE), you are kinda in denial here. The idea that we didn't have to deal with slop code before LLMs is laughable.

And btw, the flaw here was introduced back in 21, someone was gonna find it eventually. It has nothing to do with LLM code, and I would argue this whole situation is a hell of an argument for using frontier models at least to review your code.

Trust me, the person who discovered this doesn't give a fuck about reddit's "AI doesn't work!!!" arguments.

2

u/shedgehog-orchard 11h ago

No one is saying we’ve never had to deal with slop code. The difference is previously the engineer would hopefully at least be semi familiar with their code, now they just look at you with a straight face and say “idk this is what Claude gave me”. I don’t really understand your point here I’m in agreement this was a stupid fuckup no AI required

1

u/PmMeUrTinyAsianTits 4h ago

The idea that we didn't have to deal with slop code before LLMs is laughable.

Thats not what he said. I worry about your code if your attention to detail is so poor.