dydu documentation
FrenchEnglish
  • A Single Software, various applications
  • First use guide
    • Getting started
    • Create your bot
    • Create your first knowledge
    • Create and publish your chatbot
    • Frequent use cases
    • Best practices
    • Glossary
  • Contents
    • Knowledge
      • Knowledge management
      • Tags management
      • Knowledge types
        • Answer to a question
        • Complementary answer
        • Predefined answer
        • Event-triggered knowledge
        • Slot filling
      • Answers elements
      • Accessibility for bot answers
      • Decision tree
      • Comments
      • Test the bot
      • Qualities alerts
    • Knowledge map
    • Matching groups
    • Global sentences
    • Language / Spaces
    • Context conditions
    • External Contents
    • Gallery
    • Web services
      • Web Services
      • Configuration examples (REST)
      • Configure OIDC on Keycloak for a Web Service
      • Frequently asked questions
    • Advanced
      • Server scripts
      • Predefined answer templates
      • Variables
      • Web services triggers
      • Top knowledge
    • Tools
    • Import/Export of knowledge
  • Learning
    • Dialogs
    • Suggestions
    • Misundestood sentences
  • Analytics
    • Exploitation
      • Important
      • Dialogs
      • Visitors
      • Themes
      • Knowledge
      • Qualification
      • Users feedbacks
      • Clicked links
      • Rewords
      • Performance
      • Other
    • Livechat
      • Dialogs
      • Knowledge
      • Operators
      • Satisfaction
      • Waiting queues
    • Knowledge base
      • Formulations
      • Users
      • Matches
    • Export
    • Configuration
  • Custom analytics
    • Reports
    • Alerts
    • Configuration
      • Reports
      • Exports
      • Predefined sources
      • Alerts
      • Preferences
      • Annex: List of indicators
  • Livechat
    • Enable livechat
    • Knowledge base setup
    • DYDU Livechat
      • Overview of interfaces
        • Operator Interface
        • Manager interface
      • Dydu livechat setup
        • General
        • Competencies
        • Waiting queues
          • General
            • Setting up the waiting queue
          • Competency
            • Setting up the waiting queue by competency
            • Setting up a knowledge base with the waiting queue by competency
        • Operator capactiy
        • Account parameters
    • Genesys Livechat connector
  • Integration
    • FAQ
      • Static FAQ
      • Dynamic FAQ
    • MetaBot
    • Customisation
    • Javascript actions
    • Custom event-triggered rules
    • Channels
      • Dydubox
      • Dydubox advanced
        • Css editor
          • Teaser
            • CSS Teaser Modification
          • Header
            • CSS Header Modification
          • Body
            • CSS Body Modification
        • Custom JS Editor
        • Label management
        • Possible integrations
      • Connector
        • Teams
        • META
          • Messenger
          • Instagram
          • WhatsApp
          • Compatibility of DYDU bot features with META
          • Meta application control
    • LLM - Generative AI (Artificial Intelligence)
    • Integration of a chatbox into a webview
  • Preferences
    • SAML 2
    • OpenID Connect (OIDC)
    • Users and rights
    • Bot
      • General
      • Dialogs
      • Survey
      • URLs
      • Search field
  • Other
    • How does your bot work?
    • Data protection
      • Cookie management policy
    • Console logs
    • Special keywords
    • Technical aspects
      • Hosting
      • Infrastructure
    • Security
      • General information
      • Server usage
      • Open source tools
      • User session expiration
  • Developers
    • API reference
      • Authentication
      • Dialog API
      • Dialogs Export
      • Search field
      • Import Export Bot
      • Import/Export Knowledge Base
      • Server Status API
      • Access to APIS
      • User Management in the BMS
    • Chatbox V5
      • Setup and integration
Powered by GitBook

Tous droits réservés @ 2023 dydu.

On this page
  • Check how the chatbot answers user questions with the test bot
  • Test a knowledge item with the test bot​
  • Enrich your knowledge base by improving the matching score with the test bot​
  • Use the debug panel to get more details about the bot's behavior​
  • FAQ : why sometimes the test bot understands my question but does not provide the right answer?​

Was this helpful?

  1. Contents
  2. Knowledge

Test the bot

PreviousCommentsNextQualities alerts

Last updated 5 months ago

Was this helpful?

Check how the chatbot answers user questions with the test bot

As you build your bot in the Dydu BMS, you can use the Test bot to see how the bot answers user questions so that you can detect and fix any unexpected behavior.

Test a knowledge item with the test bot

  1. Go to the Knowledge page and click on the Test my bot button at the top of the knowledge list.

  2. It's a good idea to select new dialog at the top right of the Test bot panel to clear previous conversations. Clearing previous conversations allows to erase any parameters (such as or ) used by the bot that will impact the matching results.

  3. To start a conversation with the test bot in "production" mode, simply enable the option dialog for production .

Functioning of the "Dialogue for Production" Option:

  • Conversations conducted with this option enabled are recorded as "test" conversations and do not contribute to the statistics, unlike actual production conversations.

  • The channel indicated in the conversations is: Qualification.

  • It is necessary to delete the current conversation for the option change to take effect (switching the option is not possible during an ongoing conversation).

  1. At the "Type your question here" prompt at the bottom of the test bot, enter the predefined user question to start the conversaiton.

    It can be written the same as the user question, with intentional misspellings or by replacing certain words with their synonyms.

    This will allow you to detect any weakness in your bot and enrich it.

TIP

With the Up and Down arrow key on your keyboard, you can navigate through messages sent previously until you click the "new dialog" button.

  1. If you have several consultation spaces that contain different answers to the same user question, use the drop-down list at the bottom of the test to to choose the consultation space in which you want to run your test.

In this case, you can train the bot to recongnize the query either by creating a new knowledge item or adding a formulation to the existing knowledge item.

When the bot does not understand a user query, it implies that after processing the query the bot was not able to identify any knowledge item with a matching score high enough to provide an answer.

Therefore, you can enrich the best-matched knowledge item with the misunderstood query to improve its matching score so that it can be used by the bot as a matched answer.

To do so:

  1. Click on the magnifying glass icon (Search) above the bot's answer.

    This will open on the right of your screen a list of knowledge items that have been analyzed by the bot for this query sorted from the highest score to the lowest.

    Choose the knowledge item that is the closest to the intention of the misunderstood query and click Complete this knowledge.

  1. Confirm (or modify) the user question that you want to associate to this knowledge item and click on the Associate button.

  1. You will receive a confirmation message that the new formulation is now added to the existing knowledge item. You can test the bot again to check the behavior.

  1. To create a new knowledge item from the test bot, click on the the + button above the bot's answer.

It opens the knowledge edition panel on the right of the screen with the misunderstood user query alrealy pre-filled:

  1. Edit this knowledge item as you would usually do.

  2. Reset the dialog of the test bot and ask it the same question. The bot now should give you the expected answer.

The Debug feature of the test bot allows you to get insights about your bot's behavior such as variables use, conversation log, matching details, etc.

After the bot reacts to your query (whether with an expected answer or not), you can open the debug panel to check how the bot has processed the question.

As shown in the image below, in the Matching section knowledge items that have been analyzed by the bot are sorted by matching scores et bots.

The item with the highest score is provided as the bot's answer.

Please note that if both the social bot and the business bot have an answer that scores the same, it's the business bot that takes over.

Matching Score with a Knowledge :

The score of each intent in the knowledge ranges from 0 to 100%.

  • From 0 to 50%: The intent is considered a failure. If no intent with a higher score is found, the user's phrase is considered as not understood.

  • From 50% to 79.98%: The intent is considered a rewording (or reword). If no intent with a higher score is found, alternative intents are suggested to the user.

  • Above 80%: The intent is considered a direct match. A response is provided to the user using the intent with the highest score.

A score of 0 means there is no similarity between the two phrases, while a score of 100% means the two phrases are identical.

Sometimes you might get a "wrong" (unwanted) anwser from the test bot. However, when you look at the matching details, the matching algorithm has a 100% match with the "right" answer and somehow the latter was not used by the bot. Why?

There are several reasons for that.

  1. The knowledge item is disabled:

  2. Matching with a keyword:

  3. There is a match after rewording but the "enable reword" option is not activated:

    when the bot does not find a direct match between the user query and any knowledge item, it can still match with an exsting item whose intention is close to the original query and use its answer as output.

  4. There is a match after rewording but the item as part of a desicion tree is not directly accessible:

  5. The option "only display published rewords" is activated while the rewording knowledge is not published:

    Therefore, if a rewording knowledge item is not published, it will not be used by the bot to provide answers.

If none of these explanations help you resolve your issue, please contact our support team.

To know more about the consultation space, read .

Enrich your knowledge base by improving the matching score with the test bot

When the test bot does not understand a user query, it will provide a general phrase shown in the orange color. (This general phrase can be personnalized .)

Add a new formulation from the test bot

Create a knowledge item from the test bot

The test bot only allows you to create simple knowledge items. Other knowledge types such as or must be created from the Knowledge page.

Use the debug panel to get more details about the bot's behavior

The debug panel is accessible on the top right of the test bot by clicking the button.

Look at the matching details

By clicking on the icon you can look at how the bot has processed each word of the user question. It's useful to look at this panel to find out why sometimes you get unexpected answers from the bot.

FAQ : why sometimes the test bot understands my question but does not provide the right answer?

when the bot matches with a , the bot behaves as if there is 0 match (meaning that it will not even answer with the second most matched knowledge item).

when the bot matches with a contained in a knowledge item, the latter will be considered by the bot as a more appropriate answer than any item with a higher matching score.

In this case, the knowledge item is used as a rewording. However, if the option is not activated on the rewording knowledge item, it can not be used by the bot.

if the rewording knowledge item is a sub-item of a decision tree on which , the bot will not use it to answer the user query.

the option allows the bot administrator to only test on finished and published knowledge items.

this article
​
here
​
​
slot
event triggers
​
​
​
disabled knowledge item
keyword
"enable reword"
direct access is not allowed
"only display published rewords"
​
variables
bounce conditions