# No newer search index data dump since 2021-07-14?
**URL:** https://community.metabrainz.org/t/no-newer-search-index-data-dump-since-2021-07-14/546678
**Category:** Development
**Tags:** datadump
**Created:** [August 16, 2021, 11:03am UTC](https://community.metabrainz.org/t/no-newer-search-index-data-dump-since-2021-07-14/546678 "2021-08-16T11:03:11Z")
**Posts on this page:** 12
**Page:** 1
### Author:  [@InvisibleMan78](https://community.metabrainz.org/u/InvisibleMan78)
#### Post date: [August 16, 2021, 11:03am UTC](https://community.metabrainz.org/t/no-newer-search-index-data-dump-since-2021-07-14/546678/1 "2021-08-16T11:03:11Z")
I asked about incomplete data dump here:
> [@\[2021-07-14\] Current data dumps incomplete?](https://community.metabrainz.org/t/2021-07-14-current-data-dumps-incomplete/542160):
>
> Can it be that the actual data dump in [http://ftp.musicbrainz.org/pub/musicbrainz/data/search-indexes/20210714-041021/](http://ftp.musicbrainz.org/pub/musicbrainz/data/search-indexes/20210714-041021/) and [https://mirrors.dotsrc.org/MusicBrainz/data/search-indexes/20210714-041021/](https://mirrors.dotsrc.org/MusicBrainz/data/search-indexes/20210714-041021/) is incomplete? There are no files for md5sum: recording.tar.zst: No such file or directory recording.tar.zst: FAILED open or read md5sum: release-group.tar.zst: No such file or directory release-group.tar.zst: FAILED open or read md5sum: release.tar.zst: No such file or directory release.tar.zs…
Now I see that on your FTP servers, the search index dump is still from 2021-07-14.
The newest data dump is from 2021-08-14, one month later.
Is this just a replication issue or are you no longer exporting the search index dumps for other reasons?
---
### Author:  [@InvisibleMan78](https://community.metabrainz.org/u/InvisibleMan78)
#### Post date: [August 26, 2021, 7:41am UTC](https://community.metabrainz.org/t/no-newer-search-index-data-dump-since-2021-07-14/546678/2 "2021-08-26T07:41:38Z")
The search index data dump from 2021-07-14 is still the “latest”.
_(The latest fullexport data dump is from yesterday, 2021-08-25)._
Any reason why?
---
### Author:  [@yvanzo](https://community.metabrainz.org/u/yvanzo)
#### Post date: [August 26, 2021, 9:40am UTC](https://community.metabrainz.org/t/no-newer-search-index-data-dump-since-2021-07-14/546678/3 "2021-08-26T09:40:45Z")
Sorry, exporter’s configuration has not been correctly updated after server migration. Search indexes were correctly built but not exported. This has been fixed and dumps are available from [main EU server](http://ftp.eu.metabrainz.org/pub/musicbrainz/data/search-indexes/) already. Mirrors just started to synchronize, should be done soon.
---
### Author:  [@InvisibleMan78](https://community.metabrainz.org/u/InvisibleMan78)
#### Post date: [August 26, 2021, 1:31pm UTC](https://community.metabrainz.org/t/no-newer-search-index-data-dump-since-2021-07-14/546678/4 "2021-08-26T13:31:35Z")
Thanks for that fix @yvanzo
Do you know a reason why there are still many gaps between the numbers for DB and INDEX with the newest available dumps?
`admin/check-search-indexes all`
```
CORE STATUS INDEX DB
editor OK 0 /0
instrument OK 1008 /1008
series -- 13930 /13951
place -- 48479 /48524
event -- 53977 /54004
tag -- 98843 /110667
area OK 118563 /118563
label -- 206949 /207198
cdstub -- 288476 /288470
annotation -- 481061 /438362
work -- 1543614 /1544272
artist -- 1861509 /1863047
release-group -- 2329711 /2332074
release -- 2959583 /2962386
url -- 7988848 /8001129
recording -- 25309209 /25326734
```
Most of the DB numbers are larger, with the exception for CDSTUB and ANNOTATION (and the OK lines). What could be the reason for this difference?
---
### Author:  [@InvisibleMan78](https://community.metabrainz.org/u/InvisibleMan78)
#### Post date: [November 11, 2021, 2:25pm UTC](https://community.metabrainz.org/t/no-newer-search-index-data-dump-since-2021-07-14/546678/5 "2021-11-11T14:25:26Z")
@yvanzo: Could it be, that the current search index data dump in
[https://mirrors.dotsrc.org/MusicBrainz/data/search-indexes/20211110-041005/](https://mirrors.dotsrc.org/MusicBrainz/data/search-indexes/20211110-041005/)
is incomplete? Several bigger dump file are missing, like
[recording.tar.zst](http://ftp.musicbrainz.org/pub/musicbrainz/data/search-indexes/20211110-041005/recording.tar.zst) 2021-11-10 04:47 25G
or
[release.tar.zst](http://ftp.musicbrainz.org/pub/musicbrainz/data/search-indexes/20211110-041005/release.tar.zst) 2021-11-10 05:01 2.0G
and others does not seem to be replicated yet.
Or am I just too impatient again?
---
### Author:  [@yindesu](https://community.metabrainz.org/u/yindesu)
#### Post date: [November 11, 2021, 6:34pm UTC](https://community.metabrainz.org/t/no-newer-search-index-data-dump-since-2021-07-14/546678/6 "2021-11-11T18:34:41Z")
Possibly related to indexed search issues from June that still haven’t been resolved:
>
---
### Author:  [@InvisibleMan78](https://community.metabrainz.org/u/InvisibleMan78)
#### Post date: [November 11, 2021, 7:35pm UTC](https://community.metabrainz.org/t/no-newer-search-index-data-dump-since-2021-07-14/546678/7 "2021-11-11T19:35:53Z")
Thank you for this hint.
The export dump worked fine (at least the data I need for tagging purposes) until last sunday.
The replication to the .dortsrc.org server seems to be stuck since then.
---
### Author:  [@InvisibleMan78](https://community.metabrainz.org/u/InvisibleMan78)
#### Post date: [November 15, 2021, 10:52am UTC](https://community.metabrainz.org/t/no-newer-search-index-data-dump-since-2021-07-14/546678/8 "2021-11-15T10:52:05Z")
@yvanzo Should the mirror
[https://mirrors.dotsrc.org/MusicBrainz/data/search-indexes/20211113-041003/](https://mirrors.dotsrc.org/MusicBrainz/data/search-indexes/20211113-041003/)
not be fully replicated until **Monday noon?**
Today, it seems that 5 entities are still not replicated.
**Has something changed in this replication process?**
```
md5sum: release.tar.zst: No such file or directory
release.tar.zst: FAILED open or read
md5sum: series.tar.zst: No such file or directory
series.tar.zst: FAILED open or read
md5sum: tag.tar.zst: No such file or directory
tag.tar.zst: FAILED open or read
md5sum: url.tar.zst: No such file or directory
url.tar.zst: FAILED open or read
md5sum: work.tar.zst: No such file or directory
work.tar.zst: FAILED open or read
```
---
### Author:  [@InvisibleMan78](https://community.metabrainz.org/u/InvisibleMan78)
#### Post date: [May 10, 2023, 4:31pm UTC](https://community.metabrainz.org/t/no-newer-search-index-data-dump-since-2021-07-14/546678/9 "2023-05-10T16:31:27Z")
[https://mirrors.dotsrc.org/MusicBrainz/data/search-indexes/](https://mirrors.dotsrc.org/MusicBrainz/data/search-indexes/)
currently still has
`latest-is-20230506-041002`
but
[data.metabrainz.org/pub/musicbrainz/data/search-indexes](https://data.metabrainz.org/pub/musicbrainz/data/search-indexes)
already has
`latest-is-20230510-041003`
Is something stuck on the mirror process?
---
### Author:  [@reosarevok](https://community.metabrainz.org/u/reosarevok)
#### Post date: [May 11, 2023, 7:59am UTC](https://community.metabrainz.org/t/no-newer-search-index-data-dump-since-2021-07-14/546678/10 "2023-05-11T07:59:18Z")
Now dotsrc has the latest one too - I expect it gets uploaded to ours, _then_ the others mirror it, so there’s a delay? 🙂
---
### Author:  [@InvisibleMan78](https://community.metabrainz.org/u/InvisibleMan78)
#### Post date: [May 11, 2023, 8:12am UTC](https://community.metabrainz.org/t/no-newer-search-index-data-dump-since-2021-07-14/546678/11 "2023-05-11T08:12:08Z")
Yep, I can see it now too, thanks.
The mirror servers usually receive the data until Wednesday evening CET 😉
---
### Author:  [@yvanzo](https://community.metabrainz.org/u/yvanzo)
#### Post date: [May 11, 2023, 8:49am UTC](https://community.metabrainz.org/t/no-newer-search-index-data-dump-since-2021-07-14/546678/12 "2023-05-11T08:49:45Z")