Search code examples
algorithmfull-text-searchsearch-engine

Indexing algorithms to develop an app like google desktop search?

I want to develop google desktop search like application, I want to know that which Indexing Techniques/ Algorithms I should use so I can get very fast data retrival.

Solution

  • The Burrows-Wheeler transform, used to compress data in bzip2, can be used to make substring searching of text a constant time function.

    http://en.wikipedia.org/wiki/Burrows-Wheeler_transform

    I haven't seen a simple introduction online, but here is a lot of detail:

    http://www.ddj.com/architect/184405504