I Lost $3 in 20 Minutes
I took AI for the ultimate test.
I asked it to search my code base for bugs
I took a lot of pride in this code, all hand rolled, by the sweat of my brow. It was mine and it was good.
AI found 15 bugs
I was devastated
So I went to the first bug, and asked for a unit test. It produced a unit test in mere moments.
I ran the tests and saw it. A broken test. Property test of undefined. Rookie error
Ashamed, but determined I set forth to fix these bugs as penance. So I cracked open Vscode getting ready to edit this typescript script
But... The code seemed correct. Weird.
So I checked the test, Claude faked bad data. The setup could never happen
Wtf
It's a lie, the whole thing.
I checked every bug AI found. Every line item was not a bug. Everyone of them just some condition that cannot exist due to asserts or previous if statements
What an amazing $3s and 20 minutes spent
Normally when I waste time at least I learn something