|
A developer using Cursor, the AI coding assistant, ran into a routine account question and did what most people do now: he asked the support bot instead of a human. The bot, an AI agent the company had named Sam, told him Cursor had just introduced a new policy limiting each subscription to a single device. It sounded plausible enough. Companies tighten license terms all the time, and the answer was delivered with the same flat confidence any real support agent uses. The policy did not exist. Sam had invented it.By the time anyone at Cursor noticed, the fabricated rule had already spread across Hacker News and Reddit. Developers who relied on using Cursor across a laptop and a desktop assumed the company had quietly broken something they depended on, and several began cancelling their subscriptions in protest of a restriction nobody had actually imposed. Cursor's co-founder Michael Truell eventually had to step into the Reddit thread himself and correct the record in public, confirming there was no such policy and that the answer had come from a support bot getting it plainly wrong. Sam did not make a mistake in the way a tired engineer makes a mistake. Sam did exactly what it was built to do: answer immediately, in a confident tone, without waiting for anyone to check. That is precisely the problem. The bot saved Cursor a few minutes of a human writing a careful, accurate response. It cost the company a public correction, a founder's afternoon, and a stretch of user trust that took real effort to rebuild. This is not an isolated embarrassment. It is becoming a pattern serious enough that courts have started weighing in. In May 2026, two rulings landed within weeks of each other in Germany. The Higher Regional Court of Hamm held that a company is legally responsible for whatever its chatbot says, hallucinations included, because the court now treats the bot's output as the company's own statement rather than some independent third party's error. Shortly after, a Munich court barred Google from publishing false claims through its AI Overviews feature, ruling that Google itself was the source of the false statement rather than a neutral platform simply passing along someone else's content. The excuse "the AI said it, not us" has now failed as a legal defence on more than one continent. Put plainly: the golden rule of AI is that you should not use it to save yourself time by wasting someone else's. Sam saved a few seconds per query and generated hours of cleanup for developers, moderators, and Cursor's own team. That trade only looks good if you are the one who benefited from the shortcut and never have to see the bill. Speed that is not yours to spend The instinct to reach for AI is usually about protecting your own time, and there is nothing wrong with that on its own. The trouble starts when the time being saved is yours and the time being lost belongs to someone else. An engineer who ships an AI-generated pull request without reviewing it closely has saved themselves an hour. The reviewer who now has to reverse-engineer logic the author never actually understood inherits that hour, usually with interest. Before you let AI answer for you, whether in code, in a support channel, or in a document, it is worth asking who picks up the difference if it is wrong. Confidence is not the same as correctness Sam never hedged. It stated the fake device policy the same way it would have stated a true one, because a language model has no internal signal that distinguishes a confident guess from a verified fact. The same failure shows up in AI-drafted incident postmortems that read as authoritative but were never checked against the actual logs, or design documents that sound finished but were never actually reasoned through by a person. Fluent prose is not the same thing as a correct answer, and the more convincing the tone, the more damage a wrong answer can do before anyone questions it. Someone always pays for the shortcut If the person taking the shortcut does not pay for it, someone downstream does. In Cursor's case, that was the users who cancelled in good faith and the team that had to walk the story back in public. In an engineering org, it is usually the on-call engineer paged for an incident nobody bothered to verify before escalating, or the teammate reading a summary generated in thirty seconds that takes them an hour to untangle. The cost of the shortcut does not disappear when you take it. It just moves to whoever is standing downstream of you. AI will keep making you faster but the question worth sitting with is who is paying for that speed when the output is wrong, and whether you would still take the shortcut if you were the one footing the bill instead of the one saving the time. Until next time, Kayode |
Join 1k+ other forward-thinking professionals who receive the weekly newsletter, where I provide actionable strategies, insights and tools to escape the grind and build influential, future-proof careers. Sign up to get a FREE copy of my 5-Stage playbook to multiply your impact and build a career that AI can't replace.
In June 2024, a former OpenAI researcher named Leopold Aschenbrenner published a 165-page essay arguing that the coming age of artificial intelligence would demand an enormous build-out of physical infrastructure. Chips, memory, electricity and data centers would all be needed in quantities the world had not planned for. He then turned that argument into a hedge fund called Situational Awareness, and the fund bought the thesis heavily, owning the companies that supply the AI boom while...
In the autumn of 1903, most sensible people would have bet on Samuel Langley. He was Secretary of the Smithsonian Institution, holder of a contract from the United States War Department, and the beneficiary of a research budget that dwarfed anything his rivals could muster. He had engineers, publicity and by the standards of the day, everything a man could want in a race to conquer the air. On October 7th his flying machine, a 54-foot contraption launched by catapult from a houseboat on the...
In the late 1800s, a young man named Charles Schwab took a job as a day laborer in one of Andrew Carnegie's steel plants. The work was unglamorous. Nobody was watching him closely and certainly nobody expected anything from him beyond the narrow list of tasks tied to his wage. Schwab did the work anyway, and then he did more. He stayed late without being asked. He learned parts of the operation that had nothing to do with his job description. He carried a good attitude into work that most...