Search code examples
ibm-cloudibm-watsonwatson-assistant

IBM Watson Assistant for non-English language - Intent is not recognized

I am working with IBM Watson Asistant for Korean and found the failure rate to detect the correct intent is so high. Therefore, I decided to check language support and I can see the important missing features that is Entity Fuzzy Matching:

Partial match - With partial matching, the feature automatically suggests substring-based synonyms present in the user-defined entities, and assigns a lower confidence score as compared to the exact entity match.

This result in the chatbot that is not very intelligent for which we need to provide synonyms for each word. Check out the example below where Watson Assistant in English can detect an intent from words that is not included in the example by any means. I tested and found it is not possible for Korean language to do so.

I wonder If I understood something wrong or there is away to workaround this issue that I do not know of?

enter image description here

Solution

  • By default, you start with IBM Watson Assistant and an untrained dialog. You can significantly improve the understood intents and entities by providing more examples and then using the dashboard to tag correctly understood conversations and to change incorrect intents / entities to the right ones. This is the preferred way and is just part of the regular development process which includes training the model.

    Another method, this time as workaround, is to preprocess a dialog using Watson Natural Language Understanding which has Korean support, too.

    BTW: I use German language for some of my bots and it requires training for some scenarios.