# How to use database-dumps with the virtual machine image

**URL:** https://community.metabrainz.org/t/how-to-use-database-dumps-with-the-virtual-machine-image/390132
**Category:** Development
**Tags:** data-import, musicbrainz-vm, virtualmachine
**Created:** [July 14, 2018, 9:32am UTC](https://community.metabrainz.org/t/how-to-use-database-dumps-with-the-virtual-machine-image/390132 "2018-07-14T09:32:47Z")
**Posts on this page:** 13
**Page:** 1

<div class="post-metadata">

### Author: ![Whistler2010](https://community.metabrainz.org/user_avatar/community.metabrainz.org/whistler2010/32/15668_2.png) [@Whistler2010](https://community.metabrainz.org/u/Whistler2010)
#### Post date: [July 14, 2018, 9:32am UTC](https://community.metabrainz.org/t/how-to-use-database-dumps-with-the-virtual-machine-image/390132/1 "2018-07-14T09:32:48Z")

</div>

I can’t find a working way to import the database-dumps in the vm.  
Running the replication for the last ten month will take at least a week, so I hope it’s possible to import the dumps to speed things up…

---

<div class="post-metadata">

### Author: ![yvanzo](https://community.metabrainz.org/user_avatar/community.metabrainz.org/yvanzo/32/2864_2.png) [@yvanzo](https://community.metabrainz.org/u/yvanzo)
#### Post date: [July 17, 2018, 11:56am UTC](https://community.metabrainz.org/t/how-to-use-database-dumps-with-the-virtual-machine-image/390132/2 "2018-07-17T11:56:06Z")

</div>

Yes, it is possible.

1. Check that the current schema sequence is `24` with:

2. Download the latest data dump ([doc](https://musicbrainz.org/doc/MusicBrainz_Database/Download)) into a folder shared with the VM in VirtualBox, then drop the database, and finally import the dump with `InitDB` ([doc](https://github.com/metabrainz/musicbrainz-server/blob/v-2018-06-30/INSTALL.md#creating-the-database)).

---

<div class="post-metadata">

### Author: ![Whistler2010](https://community.metabrainz.org/user_avatar/community.metabrainz.org/whistler2010/32/15668_2.png) [@Whistler2010](https://community.metabrainz.org/u/Whistler2010)
#### Post date: [July 17, 2018, 11:02pm UTC](https://community.metabrainz.org/t/how-to-use-database-dumps-with-the-virtual-machine-image/390132/3 "2018-07-17T23:02:20Z")

</div>

Unfortunately this doesn’t help me a bit - I still have no idea how to do it.  
Everything I try is failing.

The docs are for a clean install and it seems I can’t get to use them with the docker container.

Why the heck is there a docker-container in a vm? That’s pushing the level too high for me…

---

<div class="post-metadata">

### Author: ![yvanzo](https://community.metabrainz.org/user_avatar/community.metabrainz.org/yvanzo/32/2864_2.png) [@yvanzo](https://community.metabrainz.org/u/yvanzo)
#### Post date: [July 19, 2018, 2:53pm UTC](https://community.metabrainz.org/t/how-to-use-database-dumps-with-the-virtual-machine-image/390132/4 "2018-07-19T14:53:15Z")

</div>

There is a simpler way to do it, thanks to `musicbrainz-docker`:

```auto
cd musicbrainz/musicbrainz-docker/
docker-compose run --rm musicbrainz /recreatedb.sh -fetch

```

This is not documented in `musicbrainz-vm`. We can add a script for it if useful.

---

<div class="post-metadata">

### Author: ![Whistler2010](https://community.metabrainz.org/user_avatar/community.metabrainz.org/whistler2010/32/15668_2.png) [@Whistler2010](https://community.metabrainz.org/u/Whistler2010)
#### Post date: [July 20, 2018, 4:55pm UTC](https://community.metabrainz.org/t/how-to-use-database-dumps-with-the-virtual-machine-image/390132/5 "2018-07-20T16:55:06Z")

</div>

I tried your advice on a fresh installed vm, but still no luck…

 ![133](https://community.metabrainz.org/uploads/default/original/2X/1/1d736b6378d5e394ffce52587e3bb146f9242921.png)

---

<div class="post-metadata">

### Author: ![yvanzo](https://community.metabrainz.org/user_avatar/community.metabrainz.org/yvanzo/32/2864_2.png) [@yvanzo](https://community.metabrainz.org/u/yvanzo)
#### Post date: [July 20, 2018, 6:36pm UTC](https://community.metabrainz.org/t/how-to-use-database-dumps-with-the-virtual-machine-image/390132/6 "2018-07-20T18:36:04Z")

</div>

For some reason, the `db` service was not running in the VM, please try:

```auto
reset-containers
cd musicbrainz/musicbrainz-docker
docker-compose exec musicbrainz /recreatedb.sh -fetch

```

You will be prompted for the password (default: `musicbrainz`) of PostgreSQL user _musicbrainz_.

---

<div class="post-metadata">

### Author: ![Whistler2010](https://community.metabrainz.org/user_avatar/community.metabrainz.org/whistler2010/32/15668_2.png) [@Whistler2010](https://community.metabrainz.org/u/Whistler2010)
#### Post date: [July 20, 2018, 8:22pm UTC](https://community.metabrainz.org/t/how-to-use-database-dumps-with-the-virtual-machine-image/390132/7 "2018-07-20T20:22:21Z")

</div>

```
reset-containers
cd musicbrainz/musicbrainz-docker

```

So far so good…

```
docker-compose exec musicbrainz /recreatedb.sh -fetch

```

This seems to be wrong, I guess it should be this:

```
docker exec musicbrainzdocker_musicbrainz_1 /recreatedb.sh -fetch

```

Which unfortunately leeds to this:

 ![134](https://community.metabrainz.org/uploads/default/original/2X/5/584f1540206829513b7de06e6447d151547e596b.png)

And there’s no prompt for any password… 😕

---

<div class="post-metadata">

### Author: ![Whistler2010](https://community.metabrainz.org/user_avatar/community.metabrainz.org/whistler2010/32/15668_2.png) [@Whistler2010](https://community.metabrainz.org/u/Whistler2010)
#### Post date: [July 20, 2018, 8:24pm UTC](https://community.metabrainz.org/t/how-to-use-database-dumps-with-the-virtual-machine-image/390132/8 "2018-07-20T20:24:34Z")

</div>

By the way, this is what happened on “reset-containers”:

 ![135](https://community.metabrainz.org/uploads/default/original/2X/d/d820ef9e3d1d85f44a0f38d48a85b96deba5a243.png)

Maybe it helps…

---

<div class="post-metadata">

### Author: ![yvanzo](https://community.metabrainz.org/user_avatar/community.metabrainz.org/yvanzo/32/2864_2.png) [@yvanzo](https://community.metabrainz.org/u/yvanzo)
#### Post date: [July 20, 2018, 9:40pm UTC](https://community.metabrainz.org/t/how-to-use-database-dumps-with-the-virtual-machine-image/390132/9 "2018-07-20T21:40:03Z")

</div>

> [@Whistler2010](#):
>
> This seems to be wrong

It should work with docker-compose version 1.17.1 which is shipped in [test VM 2018-07-10](https://community.metabrainz.org/t/updated-vm-available-for-replication-reindexation-test/390477).

1. Which VM image/version do you use?

2. What returns

3. Does the file `~/musicbrainz/musicbrainz-docker/docker-compose.yml` contains:

---

<div class="post-metadata">

### Author: ![Whistler2010](https://community.metabrainz.org/user_avatar/community.metabrainz.org/whistler2010/32/15668_2.png) [@Whistler2010](https://community.metabrainz.org/u/Whistler2010)
#### Post date: [July 21, 2018, 12:16am UTC](https://community.metabrainz.org/t/how-to-use-database-dumps-with-the-virtual-machine-image/390132/10 "2018-07-21T00:16:50Z")

</div>

> 1. Which VM image/version do you use?

The official VM from 2017-09-07 that linked [here](https://musicbrainz.org/doc/MusicBrainz_Server/Setup).

So I downloaded the latest image and tried again:  
Database docker container is running and listening on port 5432 - but there’s no musicbrainz container running…  
So I updated /musicbrainz/musicbrainz-docker/indexer-dockerfile/Dockerfile as I read [here](https://community.metabrainz.org/t/updated-vm-available-for-replication-reindexation-test/390477/6) and ran:

```
reset-containers

```

Now also the musicbrainz container is running.

So I tried

```
cd musicbrainz/musicbrainz-docker
docker-compose exec musicbrainz /recreatedb.sh -fetch

```

but I got only errors…

 ![136](https://community.metabrainz.org/uploads/default/original/2X/8/87d7c65d6f34e90c1ad3174a72451a6861aac50a.png)

So I tried to edit /musicbrainz/musicbrainz-docker/musicbrainz-dockerfile/scripts/createdb.sh as followed:

 ![137](https://community.metabrainz.org/uploads/default/original/2X/3/373aea19e7b89da483095dece246c76a07ae6c02.png)

But still I get the same errors as before. I even tried another reset-containers

---

<div class="post-metadata">

### Author: ![yvanzo](https://community.metabrainz.org/user_avatar/community.metabrainz.org/yvanzo/32/2864_2.png) [@yvanzo](https://community.metabrainz.org/u/yvanzo)
#### Post date: [July 21, 2018, 6:52am UTC](https://community.metabrainz.org/t/how-to-use-database-dumps-with-the-virtual-machine-image/390132/11 "2018-07-21T06:52:19Z")

</div>

Great! It seems to boil down to a VirtualBox networking/dns issue. Does `ftp.eu.metabrainz.org` resolve from the host? from the guest? (or is it only from the musicbrainz docker container?)

---

<div class="post-metadata">

### Author: ![Whistler2010](https://community.metabrainz.org/user_avatar/community.metabrainz.org/whistler2010/32/15668_2.png) [@Whistler2010](https://community.metabrainz.org/u/Whistler2010)
#### Post date: [July 21, 2018, 8:26am UTC](https://community.metabrainz.org/t/how-to-use-database-dumps-with-the-virtual-machine-image/390132/12 "2018-07-21T08:26:01Z")

</div>

No, dns/network is working great - during `reset-containers` something is downloaded - but on `docker-compose exec musicbrainz /recreatedb.sh -fetch` there’s the wrong url used (`ftp://ftp.metabrainz.org/` instead of `ftp://ftp.eu.metabrainz.org`).

---

<div class="post-metadata">

### Author: ![yvanzo](https://community.metabrainz.org/user_avatar/community.metabrainz.org/yvanzo/32/2864_2.png) [@yvanzo](https://community.metabrainz.org/u/yvanzo)
#### Post date: [July 31, 2018, 2:54pm UTC](https://community.metabrainz.org/t/how-to-use-database-dumps-with-the-virtual-machine-image/390132/13 "2018-07-31T14:54:40Z")

</div>

Ok, sorry, I misread the part “same errors as before”. It looks like a TTY issue but I’m not sure.

A new beta build is available, see [Updated VM available for replication/reindexation test](https://community.metabrainz.org/t/updated-vm-available-for-replication-reindexation-test/390477?u=yvanzo).

- Helper scripts have been fixed/improved.
- Base image is more recent (that might fix the potential TTY issue).
- It does not modify `recreatedb.sh` but it contains the latest database dump.
