ListenBrainz and Big query

[dman6]

I checked out ListenBrainz data over Google big query and it’s pretty cool!
https://console.cloud.google.com/bigquery?p=listenbrainz&d=listenbrainz&t=listen&page=table&folder&organizationId

It seems that data last update is around mid-year of 2018, do you plan to update the data regularly?

[dns_server]

Listenbrainz is moving from being based on big query to apache spark.

GSoC 2019: An open-source music recommendation engine

I’m not involved in development but from what I can see the plan was to use rabitmq to allow for multiple tools to process listens so it could potentially write to both.

[dman6]

Interesting, thanks.
Until then, is there a way to query up to date ListenBrainz data?
I am asking as it seems ListenBrainz data over Google big query is not updated.

What i am trying to archive is to get popular artists by country.
I did check out MusicBrainz API, which is pretty neat, however, i did not find an API capability to fetch top artists by country, unless i missed something.
Than i thought maybe i can use ListenBrainz to find popular songs (artists) and than filter them by Area or Country. I did notice ListenBrainz doesn’t contain much of artist MBID, but MSIDs, and that’s another struggle, matching hopefully can be done by artist name checking.

[dns_server]

There are json based dumps done every few weeks with the last one finished yesterday but I cannot seem to download these files.
You can download the exports from july and parse those.
See https://listenbrainz.readthedocs.io/en/latest/dev/listenbrainz-dumps.html for information about these dumps.

Listenbrainz data does not typically contain mbid and instead is based on a string for track name and a string for the artist name so you need to work out a process to match this to a musicbrainz recording.

Connect Listenbrainz Dataset with Musicbrainz Database

For my Bachelor Thesis I try to answer the question „How a musical change affects the customers of an artist“. For this I (in help with my professor) have already created a skipgram model. For the analysis my professor said that I need to connect the Listenbrainz data with the Musicbrainz data in order to find the right artists, release_groups, … However, I don’t know how that works. Can someone of you explain me step by step what to do? I have no knowledge in programming, using terminals, … …

[dman6]

Thanks, i will look into it more deeply as i need a way to be able to parse the data.
Any reason it stopped been updating for a few month now?

[jflory]

@dman6

Any reason it stopped been updating for a few month now?

Perhaps @rob, @zas, or @Vansika_Pareek could answer about the LB data dumps. I’m not sure myself, I wasn’t able to find a download link from the docs page.

[rob]

We racked up a big bill with BigQuery and that soured their desire to provide us with free services. Whoops. If you want to use the ListenBrainz data, use the data dumps here:

https://listenbrainz.org/data