:)
I'm build an Electron app which is basically a search. I have a bunch of documents converted to JSON - over 1000000 documents.
I've tried LokiJS
with cryptedFileAdapter
, which starts acting weird over 800000 documents, lowdb
, which is really slow and probably gets slower on every new document. Also, pouchdb
doesn't work well with Electron.
Maybe there some simpler(maybe custom) solution for searching such large amount of data? They must be stored encrypted while not needed for search(when app is closed).
Ended up creating two database files with ~600 000 records in each. Search is done in both databases and results are merged.