The Limits of Chatbots in Customer Service Today

Date:

Share post:

By Vivek Astvansh

Customers contact companies regularly to purchase products and services, inquire about orders, make payments and request returns. Until recently, the most common way for customers to contact companies was through phone calls or by interacting with human agents via company websites and mobile apps.

The advent of artificial intelligence (AI) has seen the proliferation of a new kind of interface: chatbots. A chatbot is an intelligent software program that can carry out two-way conversations with customers.

Spurred by the potential of chatbots to communicate with customers round-the-clock, companies are increasingly routing customers to chatbots. As such, the worldwide chatbot market has grown from US$370 million in 2017 to about US$2.2 billion in 2024.

As these tools become more embedded in customer service systems, understanding customer preferences and behaviours is crucial.

Do customers prefer chatbots or human agents?

Despite the enthusiasm on the business side for chatbots, customers are far less convinced. A recent survey found that 71 per cent of customers prefer interacting with a human agent rather than a chatbot. Sixty per cent of customers also report that chatbots often fail to understand their issue.

A pair of hands typing on a laptop, which displays a chat box on a website with a message that says 'Hi! How can I help you?'
Most companies today use chatbots as the first point of contact. Only when a chatbot cannot answer a question or a customer asks to speak with someone does the conversation shift to a human agent. (Shutterstock)

Underlying these preferences is a broader skepticism about AI, as the majority of customers report low trust in it.

Most companies today use chatbots as the first line of customer support. Only when a chatbot fails to provide the necessary information or a customer asks to speak with someone does the conversation shift to a human agent.

While efficient, this one-size-fits-all approach may be sub-optimal because customers may prefer a human agent for some types of services and a chatbot for others.

For example, a recent survey found 47 per cent of Canadians are comfortable letting a company use their purchase history for marketing, but only nine per cent are comfortable letting the company use their financial information.

New research offers insight

To better understand how customers actually interact with chatbots versus human agents, I partnered with a large North American retailer and analyzed over half a million customer service interactions between customers and either agents or chatbots.

I used machine learning methods to conduct three analyses on the chat transcripts.

The first focused on why customers reach out to customer service in the first place. I found most inquiries fell into six main categories: orders, coupons, products, shipping, account issues and payments. Customers rarely turned to chatbots for questions related to shipping or payment, seemingly preferring human agents when their issue involves more detailed or sensitive information.

The second analysis measured how closely the language used by customer service agents — both human and bot agents — matched the language of the customers they were interacting with. It found human agents showed a higher degree of linguistic similarity to customers than chatbots did.

This result was unexpected. Given the sophistication of today’s AI, I had anticipated chatbots would be able to closely mimic customer language. Instead, the findings suggest human agents are better able to follow customers’ varied and dynamically changing language use.

A woman wearing a headset smiles while working on a laptop
Customers want to feel understood and supported — and for now, that often still means talking to a real person. (Shutterstock)

The third analysis tested the thesis that similarity breeds liking — a concept that suggests human agents’ similarity with customers should increase customer’s engagement.

I measured customer engagement by the average number of seconds between a customer’s consecutive messages during a chat. The results show that when human agents displayed higher linguistic similarity, customers responded more quickly and frequently. The more the customer felt “understood,” the more engaged they were.

Recommendations for companies

My research findings make three recommendations to companies. First, companies should identify the reason behind each customer inquiry before assigning that customer to a chatbot or a human agent. The reason should determine whether the company matches the customer to a bot agent or a human agent.

Second, both chatbots and human agents should be trained to adapt their language and communication style to match that of the customer. For human agents, this kind of mirroring may come naturally, but for chatbots, it must be programmed.

My research shows that customers are more engaged when they feel that the agent they are chatting with understands them and communicates in a similar way. Doing this will keep customers engaged and lead to more effective and efficient interactions.

Third, businesses should ask technology companies for evidence on how much their chatbots increase effectiveness and efficiency relative to human agents. Specifically, how do their chatbots compare to human agents in terms of efficiency and customer satisfaction? Only if the metrics exceed a certain threshold should companies consider using chatbots.

Customers want to feel understood and supported — and for now, that often still means talking to a real person. Rather than seeing chatbots as a wholesale replacement, companies should treat them as part of a hybrid approach that respects customer preferences and aligns the right tool with the right task.

About the Author:

Vivek Astvansh is an Associate Professor of Quantitative Marketing and Analytics at McGill University

*The article originally appeared in The Conversation.

More from Retail Insider:

RELATED ARTICLES

Subscribe to the Newsletter

Subscribe

* indicates required

RECENT articles

Home Depot reports 4.9% sales growth in third quarter, raises fiscal 2026 outlook

Home Depot reported US$43.4 billion in third-quarter sales, with comparable sales rising 2.2%, and expects full-year sales growth of approximately 4.5%.

Canadians curb Black Friday spending as affordability pressures squeeze household budgets: Harris & Partners

A Harris & Partners survey found 87.4 per cent of respondents made no unplanned Black Friday purchases in 2025, raising questions about whether spending restraint reflects better budgeting or financial pressures.

REYAL Founder Reflects on Five Years of Growth, Retail Lessons and U.S. Expansion

Five years after launching REYAL Performance, founder Tanner Johnston discusses the Canadian self-care brand's growth into more than 500 retail locations, lessons from wholesale expansion, Amazon economics, self-funding and plans to grow in the United States through fitness partnerships.

Monica Vinader Opens at Holt Renfrew in Toronto and Calgary as Former CEO Sebastian Picardo Leads Canadian Expansion

British jewellery brand Monica Vinader has opened shop-in-shops at Holt Renfrew in Toronto and Calgary. CEO Sebastian Picardo, who previously led the Canadian luxury retailer, discusses the company's selective distribution strategy, plans for additional Canadian locations, and expansion into new jewellery categories.

Bailey Nelson’s Hotel Bailey Pop-Up Drives 1 Million Social Impressions in Vancouver

Bailey Nelson turns its Vancouver eyewear store into an immersive hotel-themed retail experience, boosting customer engagement and generating strong sales results.

Leon’s Eyes Further Appliance Canada Expansion in Western Canada as Commercial Sales Grow

Leon's Furniture is considering additional Western Canadian locations for Appliance Canada after positive results from its Richmond, B.C., operation. Commercial appliance growth is also benefiting from existing construction projects and opportunities created by a competitor's departure.

CEBA Repayment Deadline Looms as Canadian Small Businesses Face Year-End Cash Crunch

Canadian retailers face a December 31, 2026 deadline to repay outstanding CEBA loans. New federal accounts show $7.2 billion in outstanding loans, while Vistance Accounting founder Daryl Ching warns that holiday cash-flow demands and refinancing constraints could complicate repayment.

SportChek’s Sales Productivity Improves as Fanwear and Triangle Loyalty Gain Momentum

SportChek's reporting segment increased sales per square foot by 5.8% despite a smaller store network in Q3 2026. Fanwear contributed about one-third of comparable-sales growth, while Canadian Tire reported record Triangle loyalty penetration at SportChek.

Canadian Kids’ Snack Brand Wellness Monster Secures First Seed Funding Round

Founded by former Mars executive Brittany Compton, Wellness Monster is expanding its Canadian retail presence with new investment, growing distribution and innovative kids’ snacks.

Boston Pizza Reports Record Sales as Canadian Restaurant Expansion Remains Limited

Boston Pizza reported record third-quarter franchise sales of $257.5 million despite limited Canadian restaurant expansion. The company opened one restaurant and permanently closed four through September 2026, while completing 34 renovations across its existing network.

AI agents expected to account for 15% of consumer purchases within five years: Global Payments

Global Payments research finds growing consumer acceptance of AI-powered shopping, but payment security and privacy concerns remain barriers to adoption.

Pet Valu Sees Early Recovery as Canadian Shoppers Balance Premium Products and Value

Pet Valu is seeing early signs of improving sales as premium pet products, sharper promotions and personalized loyalty offers support growth. The retailer is also navigating margin pressure and tighter availability of retail space across Canada.

Canadian shoppers increasingly considering buying local products this holiday season: CPA Canada

A CPA Canada survey finds 56 per cent of holiday shoppers are considering buying more Canadian-made products, while younger consumers face greater financial pressure and increased reliance on credit cards.

Retailers Urged to Balance Automated Cybersecurity With Human Oversight Ahead of Holiday Shopping Season

Retailers face growing cybersecurity risks during the holiday shopping season. Adaptiva's David Sowder explains why automated patch management and human oversight are critical to preventing costly operational disruptions.

Ottawa’s trade war is making it more expensive to buy Canadian

Sylvain Charlebois examines how Canadian food maker ZoRaw is absorbing costs from counter-tariffs on U.S. whey protein isolate, and questions the impact of trade uncertainty on Canadian manufacturers.

Daily Synopsis: November 16, 2026

Inflation elevated, trade war impacts Canadian-made pricing, Renfrew hardware store closing after 110 years, traffic concerns ahead of Windsor Costco opening, Vernon 7-Eleven fined for failing to protect workers from violence, and other news.

Canadian Consumer Insolvencies Remain Above 36,000 for a Third Straight Quarter: CAIRP

CAIRP said consumer insolvencies in Canada remained above 36,000 for a third straight quarter, with 36,797 filings in the third quarter of 2026.

Foodtastic continues its push to acquire MTY Food Group

Foodtastic said MTY shareholders have told Foodtastic they believe the proposal is attractive and want the MTY Board of Directors to engage constructively.

Obasan Expands Direct-to-Consumer Retail with Toronto Showroom, Plans Ottawa Factory Growth

Canadian mattress manufacturer Obasan has opened a 3,000-square-foot Toronto showroom as direct retail grows to approximately 70% of its business. Managing Director Jonathan Laplante also outlined plans to expand the company's Ottawa manufacturing facility by 10,000 square feet in 2027.

Consumer prices on the rise in October: Statistics Canada

Statistics Canada said grocery prices have risen 31.9% since October 2020.