Something wrong with AcoustID-Server again!

AcoustID
61

I’ve sent 23 fingerprints today 5 hours ago and they’re still pending:

D: 18:13:24,122 webservice._handle_reply:559: Received reply for https://api.acoustid.org/v2/submit -> HTTP 200 (OK)
D: 18:13:24,123 webservice._handle_reply:572: Response received: {'status': 'ok', 'submissions': [{'id': 740255059, 'index': '0', 'status': 'pending'}, {'id': 740255060, 'index': '1', 'status': 'pending'}, {'id': 740255061, 'index': '2', 'status': 'pending'}, {'id': 740255062, 'index': '3', 'status': 'pending'}, {'id': 740255063, 'index': '4', 'status': 'pending'}, {'id': 740255064, 'index': '5', 'status': 'pending'}, {'id': 740255065, 'index': '6', 'status': 'pending'}, {'id': 740255066, 'index': '7', 'status': 'pending'}, {'id': 740255067, 'index': '8', 'status': 'pending'}, {'id': 740255068, 'index': '9', 'status': 'pending'}, {'id': 740255069, 'index': '10', 'status': 'pending'}, {'id': 740255070, 'index': '11', 'status': 'pending'}, {'id': 740255071, 'index': '12', 'status': 'pending'}, {'id': 740255072, 'index': '13', 'status': 'pending'}, {'id': 740255073, 'index': '14', 'status': 'pending'}, {'id': 740255074, 'index': '15', 'status': 'pending'}, {'id': 740255075, 'index': '16', 'status': 'pending'}, {'id': 740255076, 'index': '17', 'status': 'pending'}, {'id': 740255077, 'index': '18', 'status': 'pending'}, {'id': 740255078, 'index': '19', 'status': 'pending'}, {'id': 740255079, 'index': '20', 'status': 'pending'}, {'id': 740255080, 'index': '21', 'status': 'pending'}, {'id': 740255081, 'index': '22', 'status': 'pending'}]}
D: 18:13:24,124 acoustid/manager._batch_submit_finished:244: AcoustID: 23 fingerprints successfully submitted

And when I try to lookup these trackids (for example: 9332d7f6-f123-4bc5-b590-06c522a7fe5b), I get only ‘ok’:

{
	"status": "ok",
	"submissions": []
}
62

In my case there are 689 acoustid pairing imports pending. They don’t connect to the associated recording in music brainz. I’m waiting for days that this happens. Will it ever happen? Very sad :cry: :cry: :cry:

63

Slowly but surely my submissions seem to be going through. I don’t really know how to look up all my pending submissions (except one by one based on the log), but most of the albums in my “to tag” folder are looking good now. Still seems to take at least a day in some cases (like this one: Release “2012-01-14: Metro, Chicago, IL, USA” by The Walkmen - MusicBrainz which I fingerprinted yesterday.)

Here’s an interesting case: Release “John Peel Session 21.02.79” by Essential Logic - MusicBrainz

I fingerprinted the release right after importing it. The AcoustIDs finally showed up yesterday or so, but there are 8 now in total, for 4 tracks. I can pretty much guarantee that I’m the only person to have fingerprinted these (an archival release by an almost forgotten band), based on the 4 tracks I downloaded from Bandcamp. When comparing the fingerprints for the individual recordings, it shows an entirely black bar, e.g.: Compare fingerprints #96292684 and #96260942 | AcoustID I don’t think I’ve seen that before. But I also don’t know if it means anything (bad).

64

Most probably.

If you look at the last hour of imports at the AcoustID server:
https://acoustid.grafana.net/public-dashboards/1249b428418a494daf09e38d6f331d92?orgId=1&refresh=1m&from=now-1h&to=now&timezone=browser
(scroll down to “Background task”)
there are more new submissions added then imported:

image
image1158×490 59.7 KB

If this situation occurs, new submissions are queued and processed as soon as the import process has enough time to import them too.

5 Likes
65

For weeks now, submissions take several days to be imported, at least 3-4 days. I don’t know if there’s been a large raise in submissions and the server is unable to handle it, or if there is something not working in the import process, but this seems the new normal.

Actually, what worries me the most when the server isn’t working properly is that MB doesn’t seem to keep a cache or backup of submitted aIDs, so when the server dies for good, there will be no way to recover it.

66

Something is not working with the assignment of AcoustIDs to MBID. I’ve been waiting for weeks now for the Acoustid I submitted to show up with the corresponding tracks in MusicBrainz. Nothing happens.
Interestingly, the Acoustids appear in the Acoustid server as ‘Additional user submitted metadata’, but not as ‘Linked MusicBrainz recordings’.
Now over thousand tracks with an acoustId in my collectionn are waiting to be linked to MusicBrainz recordings.

67

In the last two days (at least) there are permanently much more submissions added then imported:

image
image1129×474 45.8 KB

I’m not sure if this is the same problem @lukz already mentioned:

Otherwise this could explain why newly submitted fingerprints seems to need much more time to be imported and visible on MB.

3 Likes
68

Luke, save us. :wink: !!

69

image
image1148×461 49.4 KB
image
image1129×436 45.4 KB

We are now at 14 days and counting, where more submissions are constantly being added than imported.

Could @lukz please tell us something about this situation?
Is this a holiday phenomen?
Or just a graphical (misleading) problem?

Update:
It seems that this behaviour started around christmas:

image
image914×727 30.1 KB

70

Within two weeks, 167 tracks have already been processed by the Acoustid server. Considering that over 2500 tracks are waiting to be processed during this time, this is a great achievement. And there are always more tracks waiting to be processed.

71

Am I the only one who has problems with the acoustid server? The processing of the tracks by the Acoustid server is not progressing. No acoutids are assigned to the tracks in the individual releases.

1 Like
72

Maybe the person responsible already has other priorities, husband/wife, children…

He/she don’t want to be in Fight Club anymore. :wink:

73

@Alfg I’ve had submissions jammed for a while now… At some point I hope someone will eventually feed the hamsters.

2 Likes
74

As you can see in the statistics on page https://acoustid.org/stats very little has happened in the daily additions since mid-December.
Will this continue? Probably yes —> very sad :frowning:

1 Like
75

I don’t think @lukz wants to acknowledge that the server is too much work for one person. He does a great job, but at some point MB needs to step in with resources to help bring this vital resource in to the fold.

1 Like
76

Ivan, nobody ever approached me with the intend to help, the only help was monetary, which is nice, but not really solving the real problem. Your message sounds exactly like the messaging around the recent XZ social-engineering attack. I know that’s not your intention, but the only thing this could achieve is that I give up and give AcoustID to whoever and it will die a quick death. If that’s not your intention, then please speak more respectfully.

Yes, I have personal problems in life and yes, AcoustID imports being slow or blocked is not such a high priority for me. I never claimed this situation is ideal. If MusicBrainz wants to take over AcoustID to respond more quickly, I’m open to the discussion, but given that I have those personal problems, I won’t be able to help too much. If they are really committed, I can give them database dumps and they can take it over.

15 Likes
77

And more to the point, compared to the previous months, there is significantly more submissions coming in. I don’t know the source yet. It started early december, there was a huge peak in december 26 and now it’s still 4-5x more than in october/september.

I need to see where are they coming from, if they are “spam”, or I need to find a deal with them.

12 Likes
78

Sorry @lukz. Sometimes I can word things badly. Blame my broken head. You provide such an excellent and unique service. And I thank you for that. Really appreciate all the work you put into AcoustID. I did not mean anything negative against you personally.

9 Likes
79

@lukz We are ready to help, especially if you have personal problems, please join us on next Monday’s meeting (at 19 UTC) on matrix so we can figure out if/how we can help. If you can’t, just email us at support@metabrainz.org.

@rob @reosarevok ^^

14 Likes
80

Thank you @Zas.
And thanks to @lukz for your explanation too!

Since yesterday evening, 11.01.2025 around 18.00 Uhr, the import process (yellow) started to import more submissions then newly added (green). That looks good and shows that the “backlog” is being cleared.

image
image1207×454 50.3 KB

At the same picture you can see that the flow of newly added submissions stopped around 11.01.2025 around 10.30 Uhr.

2 Likes