Search code examples
javatextartificial-intelligencenlpmining

algorithm to calculate similarity between texts

I am trying to score similarity between posts from social networks, but didn't find any good algorithms for that, thoughts?

I just tried Levenshtein, JaroWinkler, and others, but those one are more used to compare texts without sentiments. In posts we can get one text saying "I really love dogs" and an other saying "I really hate dogs", we need to classify this case as totally different.

Thanks

Solution

  • You might want to have a look at Opinion mining and sentiment analysis to give you an idea of the complexity of the task.

    Short answer: there a no "good algorithms" for this, only mediocre ones. And this is a very hard problem. Good luck.