Notes from #MetaBrainz Meeting on 2016-06-27

Freso · July 13, 2016, 1:35pm

MetaBrainz Meeting 2016-06-27

Meeting start: IRC Logs for #metabrainz | MetaBrainz Chatlogs

Agenda

Reviews
Old FreeDB VM at OSUOSL
JIRA upgrade status?
Docker-mini meeting

Reviews

@Freso

IRC Logs for #metabrainz | MetaBrainz Chatlogs

Freso:

I’m back home from the Google Code-in trip! Hi everyone!
The trip was lovely; it was great to meet gcilou, opatel99, CallerNo6, Clint, modwizcode - and possibly other people in here - in person.
Fun to see some SF and Google stuff too, and I managed to join a couple of Irish trad. sessions and one b-boying practice session too, as well as stopping by the Internet Archive where CallerNo6, Clint, and myself had a good talk with Eric Blossom and Mek of their CD-Archive(?) project. I really need to find an e-mail address to keep the conversation going!
CallerNo6 and I also got a visit from strycore, lead dev of Lutris https://lutris.net/, and we went to see the gaming museum MADE https://themade.org/.
I tried to keep up with IRC and forums while I was away, but apart from in-person networking, I didn’t manage to do a whole lot else.
Coming back home last week, I started recovering as well as planning my last couple of dance classes at Love2dance (the last one was this Saturday), so now those are no longer a thing, and my trip to Barcelona is now a step closer.
I also lost my connection as I was going to switch ISP (to a fiber one!), but due to various issues on their end, they were not ready in time, and it was too late to cancel the cancelling of my previous arrangement.
So my connection has been spotty; to begin with I taxed out my mobile phone’s connection, but my upstairs neighbour has now given me access to use her wireless, and I’ve borrowed a couple of USB WiFi dongles, so I should be able to get the RPi2 and desktop online Soon™ too. But it’s not done yet.
So yeah. In all, not much for me, other than generally being around and about!

@reosarevok

IRC Logs for #metabrainz | MetaBrainz Chatlogs

@bitmap

@Gentlecat

@Rob

IRC Logs for #metabrainz | MetaBrainz Chatlogs

Rob:

last week I spent a lot of time catching up.
mostly dockerizing listenbrainz as my project to learn docker and to work through armalcolite’s patches.
I’ve caught up there and did the eval.
I also fired up some VMs: one for freedb-gateway and one for CB testing.
that first docker test for CB was pretty good. makes me happy.
and I also took on taking plex to task. tweeted to them and got a conversation going.
cleared up some misconceptions – they are now a gracenote customer.
but we came to a verbal agreement for them to fork over $5000 and then I’ll wipe the slate clean.
I’ submit an invoice in a minute and I’ve already taken them out of the penalty box.
they claim is was their customers who refused to upgrade their old clients.
smells a little waffely, but whatever.
I’ve checked the logs and they are pretty quiet now, so I’m happy to consider this issue closed.
they did use use for a number of months, so this is actually a pretty decent deal for them.
oh, one more thing: I’m gone next week wed-sun.

@chrisskye

IRC Logs for #metabrainz | MetaBrainz Chatlogs

@LordSputnik

IRC Logs for #metabrainz | MetaBrainz Chatlogs

LordSputnik:

This week I spent my time sorting out my MB OAuth branch on BB that’s been in progress for a while.
It’s all working now, and I’m just doing some refactoring before hopefully releasing it on bb.org tonight.
I’ll then send out an email for our editors asking them to link their BB and MB accounts.
When this is all done, I plan to move onto implementing Selenium browser testing for BookBrainz so that we can detect when the site is functionally broken.
This’ll allow us to catch issues early, and also reduce the amount of time we spend manually performing these tests each major release.
I also did a little bit of work on MusicBrainz docker files - I’ve got a couple of issues open at GitHub - metabrainz/musicbrainz-docker: Docker Compose project for the MusicBrainz Server with replication, search, and development setup which I’m working on.
I’m hoping that we can use this image with some modification on the new rika as the base image for people’s sandboxes (or maybe not, depending on how versatile bitmap’s image for production use is) - but we can possibly talk more about that later on.
And of course I helped out Quora with GSoC, leaving some (hopefully) helpful commit comments and meeting with him on Tuesday (he’s been away since Thursday). I completed the midterm evaluation with some input from Leftmost and things seem to be going well.
Also, forgot to mention - following the OAuth stuff, I’ll be working on a BB docker image as well - there are a few dependencies there that mean that docker stuff is currently blocked

@alastairp

IRC Logs for #metabrainz | MetaBrainz Chatlogs

alastairp:

last week not as productive as I had hoped, but still a bunch of stuff done
I’m finally getting on top of AB reviews. It’s a learning process - I’m learning to never leave too many open PRs at a time… they start snowballing
good news is I think I’ve finished all of Gentlecat’s, just got to merge them hopefully tonight or tomorrow morning
SoC with kartikgupta0909 is going great. We’ve got a prototype ppa of gaia for i368 going (weird bug with amd64… will look at it soon)
and some good research into choosing a serialization format for moving lowlevel datafiles around, and storing framebased data
Gentlecat and I met at UPF last week to work out a bunch of plans for the dataset editor. We have some cool stuff planned which should happen in the next few months
and I’ve finally started integrating the work we did for our paper (which we’re presenting in August), so we’ll be able to show that off at the conference too

Old FreeDB VM at OSUOSL

IRC Logs for #metabrainz | MetaBrainz Chatlogs

@chirlu now has the FreeDB gateway running in a Google VM and wanted to know if anything was still needed from the old VM running on OSUOSL. No one mentioned anything specific and @Rob said old VM was treated as disposable, so it should be fine to just kill it.

JIRA upgrade status?

IRC Logs for #metabrainz | MetaBrainz Chatlogs

As per @Rob, we still very much want to upgrade our JIRA instance, but we want to move to NewHost more, so @Zas (and everyone else) are all about moving our things to Docker. Once everything is dockerised, we can move to NewHost, and then we can upgrade JIRA.

Docker mini meeting

IRC Logs for #metabrainz | MetaBrainz Chatlogs

This concludes the regular meeting, so only people actually involved (or interested) in the dockerisation process were asked to remain around.

pgbouncer vs. pg-pool

pool is much more complex than bouncer and has some drawbacks, and high availability stuff seems tacked on. @Bitmap says dockerization should not depend on moving to pool since we have already spent enough time getting pgbouncer to work properly in dockers, and that we may want to look at using “haproxy or something” for load balancing, with pgbouncer in front of that.

Conclusion is that @Bitmap investigates this further.

progress on MBS docker image

@Bitmap estimates that he’s “approaching half way done” for the MBS docker image.

next up

@Rob will look at search related things.
@Zas should “focus on the gateways and ancillary images, such as rsync, ftp.”
@LordSputnik might be able to look at CAA.
@Gentlecat was asked to “focus on CB, then MeB, then CAA if LordSputnik isn’t done with it.”

move CAA to Flask before dockerizing

@Gentlecat and @Rob talked a bit back and forth, but nothing conclusive.

dev/deployment

Discussion about whether a prod/dev split is even necessary: it is.
Then discussion turned into how to achieve this, and Docker’s own docks recommend using separate compose files, so we’re going with that: one common which can be “extended” into a dev and a prod file.

@LordSputnik asks…

Would it be better to keep docker files in project repositories (as it seems to be currently), or together in a metabrainz-dockerfiles repo?
@Rob and @Bitmap agrees that the files should be in the project repositories.
Could we use debian rather than ubuntu as the base image, to reduce image size and have “cleaner” resulting images?
@Zas says, “i think using debian as base is better yes, but for some services we can go for alpine”.

Freso · July 13, 2016, 1:36pm

The docker "mini " meeting made this one hard to write. Sorry about the delay!