Doubts regarding GSOC project "Storage for AcousticBrainz v2 data"

[sweta05]

Thank you so much for your inputs @alastairp I submitted a part of my proposal here please check and let me know what you think about it.
Also, I have some more doubts listed there I would be grateful if you could clarify them as well.
I hope I am going in the right way and submit a proper and detailed proposal to work on.

@alastairp

Don’t store lowlevel data directly in the database: This was an idea that we originally had when we started AcousticBrainz, but experience has shown us that it’s not useful. It makes the database slow, and we’re not getting any value out of storing the data here. We want to move this to store data as files on disk instead. Metadata (version table, etc) and high-level data can still be stored in the database because this is useful information that we want to sort and filter.

For this, I was thinking if we can have a JSON to CSV converter and store the files in the file system. Still, I am not sure how efficient this is, I will research more on this and try to come up with a better solution.