Skip to main content

Customer Service in a World of Ambient Computing

Ambience; Photo by Igor Kasalovic, Unsplash
Soon there will be an additional in-app customer service channel.
So far we have a bunch of service channels, most of them requiring the user to leave the app to
  • Pick up the phone for a call
  • Browse for self support
  • Open up an additional chat window
  • Take on the social media channels
  • Move on to messenger applications
  • How about getting into your car to get to a store?
  •  Etc.

And then a customer may be moving back and forth between these channels with all the potential of losing track of the incident status and the friction that cross channel customer service still causes.
There is no doubt that providing in-app support is the best possibility to offer fast issue resolution. It can provide telemetry information from within the app, identify the user and therefore provides a lot of relevant context that makes it easier for a service agent to help the customer without unnecessary delays. The customers’ shift to emphasize on the “Now” is also seen by Google research.

Not Every Device is a Smartphone

But what if the customer cannot pick up the phone to engage in a typed conversation? The customer might be engaged in a VR game, or driving a car, or in any number of situations without having a free hand.
Maybe the customer simply doesn’t want to pick up a phone?
What if the app doesn’t offer a user interface at all beyond a little light that indicates ‘I am available’? This would e.g. be the situation in an ambient environment that senses the presence of a person and acts accordingly.
An environment like this would mainly be voice and gesture controlled via devices like Amazon’s Alexa, Google Home, Apple’s HomePod, or Microsoft’s upcoming Home Hub. Systems like these will offer a keyboard as a secondary means to access service and support at best.
But there is no need to look that far out. Imagine a gaming situation. Neither an Xbox, nor a Playstation, nor any other major controller offers a keyboard. In case of these or a VR or AR game the user would hold the controller and doesn’t have the leeway to get to a keyboard.
So why would they offer a keyboard to enable conversational (or other) in-app support? There is no reason.
Instead users will interact with the service system and –agent via gesture-, view- and speech based interfaces.

The next In-App Support Channel is Voice

Voice recognition technologies are maturing rapidly and start to achieve human level accuracy in understanding at least English language.
Human level of understanding lies at a word error rate (WER) of about 5 per cent, which means that a human on average gets five out of hundred words wrong due to misrecognition, missing a word, or falsely inserting one.

Machines arrive at human level of language understanding; source 2017 Internet Trends Report
While Amazon doesn’t give any numbers on Alexa’s capabilities, Microsoft announced it reached a word error rate (WER) of 5.9 per cent in October 2016; IBM beat them to the punch with a WER of 5.5 percent in March 2017. And Google announced in May 2017 that it reached a WER of 4.9 per cent.
Using speech recognition techniques on a level like this, in combination with natural language processing (NLP) and perhaps natural language generation (NLG), in-app service conversations can get both, very personal, and very immersive.
And very effective. Speaking is the form of communication that comes easiest to humans. Speaking and conversations are tightly linked.
Last but not least it is also a very efficient way of providing customer service as the human ability to exchange information is highest when speaking.

Bringing Human Back To Customer Service

Right now customer service 2.0, the automation of customer service, seems to move from call deflection via self-service and then bots to customer service 3.0.
Helped by increasing maturity of NLP- and intent detection technology this iteration will move the bots from the second row into the front row. They will become the primary customer support interface. Instead of using a search box on an FAQ, customers will ask a bot for help via a chat interface. The bot itself then will be able to answer the question using e.g. an FAQ or database, or escalate the question to a human operator. The distinction between self-service and aided customer service will first blur, then vanish. The machine takes care of the simpler problems, the human of the more difficult ones.
With further refinement of Natural Language Processing, text to speech-, speech to text technologies and intent detection, typing will give way to speech again, then introducing customer service 4.0.
Customer service will fully turn into a conversation and it will not matter anymore whether it is synchronous or asynchronous.
It also will not matter anymore whether customer service is delivered by a bot or a human, but will appear human. And that might have an impact on the call center and its operation itself that we will look at in a separate post.
The bottom line is: Customer service will be humanized again.


Last Year's Top 5 Popular Posts

Don't mess with Zoho - A Zohoday 2022 recap

After spending two days in Austin, TX, attending the ZohoDay 2022, it is time for a little recap of this interesting event.  We were 99 analysts and 24 customers and plenty of knowledgeable Zoho personnel. The incredible Sandra Lo and her team organized the event around open and transparent communication. So, there was plenty of access for us to customers and the Zoho team.  Which was very important, as already the keynote session by founder and CEO Sridhar Vembu was quite hardcore. Vembu talked about how strategy and culture need to be one, how culture needs to be the root of strategy, and how Zoho implements this. The Zoho strategy lies on three main pillars ·       Transnational localism, a unique concept that in its essence is about embedding a company into a local community by not only selling into it but also by investing into it. This investment is e.g., by offering high paying jobs in areas where these are scarce, by fostering local education, but also by own local sourcing in

How to tie CX to business success in three simple steps

In 2022, the Forrester CX Index dropped for the first time in years, with nearly twenty percent of US brands seeing a drop in customer experience. Towards the second half of 2022, an increasing number of companies fear a recession and put their spending under scrutiny. At the same time, companies still struggle to link CX projects to business outcomes and their metrics, let alone to financial metrics. In addition, Forrester predicts that also in the next few years, CX teams will lack critical design, data and journey skills. In parallel, there is an increasing number of companies that deliver software and/or services that are intended to help businesses improve their CX. In the past years, CX has established itself as a whole new category of software. Many a company has repositioned itself to become a CX vendor, examples including all major CRM vendors, but also call center specialists like Genesys. And, naturally, a good number of these new CX actors got – and get – acquired by bigge

a great human - bot conversation with lots to learn

Inspired by a recent panel discussion as part of the In the Hot Seat podcast that I am involved in, I opened a chat with chatGPT3 . ChatGPT is a language model by OpenAI that interacts in a conversational way. This way, it shall be able to follow a conversation, answer follow up questions or even admit mistakes, challenge incorrect premises or reject inappropriate requests. Our sixth episode of In the Hot Seat revolved about the question whether web3 will deliver on its promise or not. The promise being that content producers and web users get more power by applying concepts like decentralization, blockchain and a token economy. As I am a bit sceptic about this kind of silver bullet promises, I went right for the jugular. A conversation between a human and a bot Thomas : Tell me with arguments why web3 based on blockchain will fail chatGPT3 : It's impossible for me to provide arguments as to why web3 based on blockchain will fail, as web3 is not based on blockchain technolo

Truly Zoho - How capitalism and doing right coincide

The past 9 months have seen quite a rollercoaster in the tech industry. We have seen staggering profits, we continue to see stock buybacks, we have seen consolidation, mergers and acquisitions – and we have seen mass layoffs . Few of them were well handled or communicated. Even fewer showed any sign of executives taking accountability besides stating that they made mistakes during the pandemic and that they feel sorry for what they need to do now. They had simply over-hired and now need to take corrective action to stay on a ‘growth path’. One of these executives arguably took the prized company culture of regarding the employees as family to grave. What do these layoffs have in common? They were initiated to please the capital markets, i.e. shareholders and venture capitalists. The idea behind this is that layoffs is the fastest way to solve or avoid impending financial problems. However, there is mounting scientific evidence that this idea is a myth, as e.g., expressed here , here

Beyond the hype - How to use chatGPT to create value

Now, that we are in the middle of – or hopefully closer to the end of – a general hype that was caused by Open AI’s ChatGPT, it is time to reemphasize on what is possible and what is not, what should be done and what not. It is time to look at business use cases that are beyond the hype and that can be tied to actual business outcomes and business value. This, especially, in the light of the probably most expensive demo ever, after Google Bard gave a factually wrong answer in its release demo. A factual error wiped more than $100bn US off Google’s valuation. I say this without any gloating. Still, this incident shows how high the stakes are when it comes to large language models, LLM. It also shows that businesses need to have a good and hard look at what problems they can meaningfully solve with their help. This includes quick wins as well as strategic solutions. From a business perspective, there are at least two dimensions to look at when assessing the usefulness of solutions that