Search code examples
mysqlmongodbsolrsearch-enginesphinx

Search engine for web app - multi lingual and multibase

I am working on a website project. We have a MySql and a MongoDb base.

  • We want to add a full-text search-engine over these bases (and if it can be linked with PostgreSql it's better).

  • These databases contain multilingual texts but we cannot determine the language.

I saw Solr, ElasticSearch and Sphinx, but what is your advice on this topic ?

  • Solr and Sphinx have stemmings but I am not sure we can use it without knowledge about content language...

  • Elastic is full JSON that could be better if we use more and more mongoDb...

Solution

  • It doesn't matter what search engine you use, stemming is highly language-dependent. IMHO you'll have to somehow detect the language in order to feed the text to the proper stemmer.