Backend Choice for large data offline app


#1

Hi. I’ve been assigned a project that requires an offline app for dealing with uploading large datasets that were already created. To be more accurate there would be an average of 1-2 million experiment trials(small js objects). I was asked to save everything locally offline and that it would be easy to distribute.I have been experiementing with a few js backends like lokiJS, forerunnerDB, and pouchdb but they all freeze the app if I do an upload past 100k objects. Right now I am using LinvoDB as a backend for the app but when I do searches with trials they are pretty slow (querying all of the trials would take 20-30mins).

Is there any tools or specfic backend I should use for these kind of apps with electron or any advice to handle this kind of data with any of the backends I have previously used? I am considering SQLite or sql.js


#2

This is a duplicate of a previous topic:

We like to unify similar discussions under one topic so that people don’t have to read a bunch of different threads to get the whole story. Please continue the discussion there. I’ll be closing this topic as duplicate.


#3

This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.