Chatbots Must Be Able To Manage User Digression In Conversations

Fundamental principles of digression can be gleaned from how Kore AI has implemented conversation digression in their framework.

Cobus Greyling
5 min readOct 20, 2022

--

Let me start here…

Intents are the frontline of digital assistants (chatbots, voicebots) and lately there has been much innovation in terms of intents.

Innovation came in the form of granular management of intents, structure was added to intents in terms of nested or sub-intents. And lastly, management of intents were improved with merging intents, splitting intents, and more…

Multiple intent recognition is common place, and often disambiguation is implemented to assist the user in choosing the most appropriate intent.

All these developments, can be categorised under NLU Design.

Conversation Design

From a conversation design perspective, the handling of intents have been very linear with resolution paths running in series, not parallel…if you like.

Conversation design is still very much stuck in the following sequence:

  1. Select and assign one single intent to a section of dialog flow
  2. Taking the conversation associated with that intent to its logical conclusion
  3. And only once the conclusion is reached, the conversation flow steps into initiating or addressing another or following intent

This is typical of a state machine process.

Running parallel intents in a conversation

We demand from systems and programs to run multiple tasks in parallel (multiple threads)…but somehow this is not demanded from the Conversation Design process.

When we as humans have a conversation, there can be multiple intents raised in a short succession…and we often address those intents in a very parallel fashion, pausing and continuing on intents spontaneously.

Virtual Assistants (chatbots, voicebots) must be able to accommodate and manage this multi-threading of intents by allowing users to pause a dialog, start and complete another task, and return to the original task.

This should be done in the following way…

  1. Seamlessly
  2. Supporting important contextual data
  3. Maintaining conversational continuity
  4. With granular control

Follow me on LinkedIn for updates on Conversational AI & Voice. 🙂

How Is Kore AI Approaching Digression?

Below is an example conversation with a Kore AI chatbot…in this example the bot responses are simple dialog cards with links.

The user starts the conversation by asking to rebook travel arrangements, then digresses into baggage allowance.

The bot puts the rebook travel intent on hold, and subsequently return to it once the digression task is completed.

Follow me on LinkedIn for updates on Conversational AI & Voice. 🙂

Highly Granular Digression Settings

With Kore AI digression can be managed on three levels:

1️⃣ Flow Node Level
2️⃣ Dialog Task Level
3️⃣ Virtual Assistant Level

Digression, or interruptions as Kore AI refer to it, can be set on a node level. Digression configurations on a node level enjoys the highest priority.

Dialog level digression has a higher priority over the Virtual Assistant level settings. And again, it has a lower priority than node level digression settings.

The Virtual Assistant Level digression settings can be overridden at the task level as discussed above.

Kore AI has four digression sequences:

  1. Hold the current task and resume back once the new task is completed.
  2. Discard the current task and switch to the new task.
  3. Switch to a new task without any notification to the user and discard the current task.
  4. Continue with the current task and add a new task to the follow-up task list.

As seen below…

Nested Digression

Kore AI has also implemented the notion of nested digression, this is the number of tasks on hold which can be set.

The chatbot/voicebot keeps the maximum number of tasks on hold and ignores additional tasks once the threshold is reached.

Below you can see the interface where the on hold quantity can be set, very astutely Kore AI advises that too many tasks on hold can introduce unwanted complexity to the conversation.

Most probably there are certain customer journeys which are deemed as important enough to keep on hold. Whilst other journeys can be deemed as disposable and not qualifying for digression.

Follow me on LinkedIn for updates on Conversational AI & Voice. 🙂

FAQs & Small Talk…

FAQs and small talk are especially susceptible to digression. As seen below, FAQs digression can be set in accordance to the rest of the conversation.

Also below, small talk can be suppressed or executed…

In Closing

I started this article by talking about NLU Design and Conversation Design, and the advanced made in terms of NLU Design.

However, it is important for Conversation Design as a discipline to keep in step with NLU Design innovation…. in order to contribute to an exceptional user experience.

I’m currently the Chief Evangelist @ HumanFirst. I explore and write about all things at the intersection of AI and language; ranging from LLMs, Chatbots, Voicebots, Development Frameworks, Data-Centric latent spaces and more.

https://www.linkedin.com/in/cobusgreyling
https://www.linkedin.com/in/cobusgreyling

--

--

Cobus Greyling

I explore and write about all things at the intersection of AI & language; LLMs/NLP/NLU, Chat/Voicebots, CCAI. www.cobusgreyling.com