Search code examples
machine-learningnlpsemanticsibm-watsontext-analysis

How can I cluster similar type of sentences based on their context and extract keywords from them


I wanted to cluster sentences based on their context and extract common keywords from similar context sentences.

For example 1. I need to go to home 2. I am eating 3. He will be going home tomorrow 4. He is at restaurant

Sentences 1 and 3 will be similar with keyword like go and home and maybe it's synonyms like travel and house .

Pre existing API will be helpful like using IBM Watson somehow


Solution

  • This API actually is doing what you are exactly asking for (Clustering sentences + giving key-words): http://www.rxnlp.com/api-reference/cluster-sentences-api-reference/

    Unfortunately the algorithm used for clustering and the for generating the key-words is not available.

    Hope this helps.