Photo by Sam Knight on Unsplash

The Future Of Language Understanding Involves More Intents, Not Less

A few months ago I coined the term “Intent Driven Design & Development” (IDD). The premise is that chatbot design and development should start with intents. This is the process of using existing customer utterances and conversations to create clusters of semantically similar sentences.

Cobus Greyling
4 min readAug 24, 2022

--

Introduction

You can call intents what you like, similarity clusters, topics, intent documents, etc. The fact remains that customer intent must be the basis for any successful chatbot deployment, chatbot analysis, defining applicability to the customer journey, and workflow design.

If customer intents are used for defining the domain and design of the chatbot, clarity is established for defining use cases, CX goals and ultimately technology choices.

For successful chatbot deployment, analyse and define the chatbot applicability to the customer journey, and design the chatbot workflow based on customer intent.
~Gartner

Get an email whenever Cobus Greyling publishes. Please click on this link to subscribe.… 🙂

The long-tail of NLU

It is important to address the long-tail of NLU, and ultimately the aim is to address all NLU requirements (including the long-tail) with as little as possible data.

The advantage of NLU’s in current chatbot development environments is the limited amount of data required for training per intent. Often 20 user utterances are enough per intent for training a NLU model.

Deployment teams focus their energy on the features of chatbot technology and metrics instead of focusing on the customer intent.
~Gartner

Intents are evolving with functionality and features being added to intents, especially amongst the Gartner leaders.

Intend Driven Design and Development (IDD) leads to more granular intents, and highly granular intents leads to addressing the long-tail of NLU. This approach also establishes a much deeper taxonomy with identifying sub-intents or nested intents.

Source

This leads to a situation where the long-tail is easily addressed and solved for. The utterances from users which pertains to the long-tail is within your customer conversation transcripts. But discovering those niche utterance clusters is the challenge.

Get an email whenever Cobus Greyling publishes. Please click on this link to subscribe.… 🙂

Intents & User Experience Are Linked

Gartner confirmed that a lack of focus on intents leads to poor user experience. Current customer conversations and utterances can be leveraged from current customer care interfaces like IVR, email, etc. These utterances/conversations can be used for creating intent clusters which are semantically similar.

The popular and dominant current approach to chatbot projects is to start with technology and compiling a comparison matrix for features.

Once the technology is determined, organisations work backwards to implement this technology. And determining the intents is very often a guessing game.

Conclusion

Gartner placed emphasis on the fact that organisations must start with defining user intents. And in turn business intents need to align with customer intents.

https://www.linkedin.com/in/cobusgreyling
https://www.linkedin.com/in/cobusgreyling

--

--

Cobus Greyling

I explore and write about all things at the intersection of AI & language; LLMs/NLP/NLU, Chat/Voicebots, CCAI. www.cobusgreyling.com