
A small business owner in England says he learned the hard way that AI can be a little too helpful.
He had added a chatbot to his website to answer basic questions and handle customer queries more quickly. Instead, one customer managed to convince the bot to offer an 80 percent discount on an GBP8,000 order, roughly Rs 10 lakh. The system confirmed the reduced price, and the customer went ahead and placed the order.
“A customer was chatting with it and managed to convince the AI to give them a 25% discount, then he negotiated with the AI up to an 80% discount,” he wrote.
When the owner realised what had happened, he tried to step in. But by then, things had become messy. The business owner said that he would have lost thousands of pounds if he actually sold the products at 80 percent off. He wrote to the customer to explain what happened and cancel the order, but the customer refused a cancellation. According to him, the customer insisted the discount was valid because it had come directly from the company’s own website. He even threatened legal action if the order was cancelled.
The story quickly spread online. Some people felt bad for the business owner, pointing out that AI tools can behave unpredictably if they are not tightly controlled. Others were blunt. They said this is what happens when companies rely on automation without setting clear limits.
What makes this incident uncomfortable is how easy it seems to have been. AI chatbots are designed to be polite, flexible and accommodating. If they are not programmed with strict boundaries around pricing and offers, they can sometimes say yes when they absolutely should not.
For small businesses, AI looks like a lifeline. It promises faster responses, lower staffing costs and round-the-clock availability. But it also needs careful supervision. A chatbot should never have the final say on pricing without guardrails in place.
Whether the discounted order will be honoured is still unclear. But the episode has already become a cautionary tale. AI can save time and money. It can also create an expensive problem in a matter of minutes if no one is watching closely.
Discover the latest Business News, Sensex, and Nifty updates. Obtain Personal Finance insights, tax queries, and expert opinions on Moneycontrol or download the Moneycontrol App to stay updated!
Find the best of Al News in one place, specially curated for you every weekend.
Stay on top of the latest tech trends and biggest startup news.