Things AI Is Genuinely Bad at That Nobody in Tech Wants to Admit
Things AI Is Genuinely Bad at That Nobody in Tech Wants to Admit I spent eleven minutes last Tuesday watching ChatGPT confidently explain how to fix a plumbing issue that would have flooded my bathroom. The instructions were clear, well-formatted, and completely wrong about which valve to turn first. This wasn't a hallucination in the traditional sense — the AI wasn't making up facts. It just had no idea what "wrong" meant in a context where water pressure and pipe age actually matter. The Confidence Problem Is Worse Than the Accuracy Problem Everyone in AI circles talks about hallucinations. Models making up citations, inventing court cases, fabricating statistics. That's real, and it's a problem. But here's what two years of daily testing taught me that nobody mentions at conferences: the stuff AI gets subtly wrong is far more dangerous than the stuff it gets obviously wrong. When ChatGPT invents a fake Supreme Court case, you catch it. W...