Notes from #MetaBrainz Meeting on 2016-06-27

[Freso]

#MetaBrainz Meeting 2016-06-27

Meeting start: https://chatlogs.metabrainz.org/brainzbot/metabrainz/msg/3635721/

Agenda

• Reviews
• Old FreeDB VM at OSUOSL
• JIRA upgrade status?
• Docker-mini meeting

Reviews

@Freso

https://chatlogs.metabrainz.org/brainzbot/metabrainz/msg/3635735/

I'm back home from the Google Code-in trip! Hi everyone!
The trip was lovely; it was great to meet gcilou, opatel99, CallerNo6, Clint, modwizcode - and possibly other people in here - in person.
Fun to see some SF and Google stuff too, and I managed to join a couple of Irish trad. sessions and one b-boying practice session too, as well as stopping by the Internet Archive where CallerNo6, Clint, and myself had a good talk with Eric Blossom and Mek of their CD-Archive(?) project. I really need to find an e-mail address to keep the conversation going!
CallerNo6 and I also got a visit from strycore, lead dev of Lutris https://lutris.net/, and we went to see the gaming museum MADE https://themade.org/.
I tried to keep up with IRC and forums while I was away, but apart from in-person networking, I didn't manage to do a whole lot else.
Coming back home last week, I started recovering as well as planning my last couple of dance classes at Love2dance (the last one was this Saturday), so now those are no longer a thing, and my trip to Barcelona is now a step closer.
I also lost my connection as I was going to switch ISP (to a fiber one!), but due to various issues on their end, they were not ready in time, and it was too late to cancel the cancelling of my previous arrangement.
So my connection has been spotty; to begin with I taxed out my mobile phone's connection, but my upstairs neighbour has now given me access to use her wireless, and I've borrowed a couple of USB WiFi dongles, so I should be able to get the RPi2 and desktop online Soon™ too. But it's not done yet.
So yeah. In all, not much for me, other than generally being around and about!

@reosarevok

https://chatlogs.metabrainz.org/brainzbot/metabrainz/msg/3635746/

Support and editing and that's it for this week, plus some helping around in Discourse
Too hot for my brain lately

@bitmap

I worked on docker files for MBS all week
basic stuff is working but I'm still figuring out how to do private configuration
maybe that's relevant to other projects too

@Gentlecat

I reviewed GSoC stuff, fixed login issues in AB, published new customers on MeB, started setting up docker in jenkins and doing other things related to that

@Rob

https://chatlogs.metabrainz.org/brainzbot/metabrainz/msg/3635776/

last week I spent a lot of time catching up.
mostly dockerizing listenbrainz as my project to learn docker and to work through armalcolite's patches.
I've caught up there and did the eval.
I also fired up some VMs: one for freedb-gateway and one for CB testing.
that first docker test for CB was pretty good. makes me happy.
and I also took on taking plex to task. tweeted to them and got a conversation going.
cleared up some misconceptions -- they are now a gracenote customer.
but we came to a verbal agreement for them to fork over $5000 and then I'll wipe the slate clean.
I' submit an invoice in a minute and I've already taken them out of the penalty box.
they claim is was their customers who refused to upgrade their old clients.
smells a little waffely, but whatever.
I've checked the logs and they are pretty quiet now, so I'm happy to consider this issue closed.
they did use use for a number of months, so this is actually a pretty decent deal for them.
oh, one more thing: I'm gone next week wed-sun.

@chrisskye

https://chatlogs.metabrainz.org/brainzbot/metabrainz/msg/3635794/

I wrote email.
I am considering resigning, for personal reasons.

@LordSputnik

https://chatlogs.metabrainz.org/brainzbot/metabrainz/msg/3635801/

This week I spent my time sorting out my MB OAuth branch on BB that's been in progress for a while.
It's all working now, and I'm just doing some refactoring before hopefully releasing it on bb.org tonight.
I'll then send out an email for our editors asking them to link their BB and MB accounts.
When this is all done, I plan to move onto implementing Selenium browser testing for BookBrainz so that we can detect when the site is functionally broken.
This'll allow us to catch issues early, and also reduce the amount of time we spend manually performing these tests each major release.
I also did a little bit of work on MusicBrainz docker files - I've got a couple of issues open at https://github.com/jsturgis/musicbrainz-docker which I'm working on.
I'm hoping that we can use this image with some modification on the new rika as the base image for people's sandboxes (or maybe not, depending on how versatile bitmap's image for production use is) - but we can possibly talk more about that later on.
And of course I helped out Quora with GSoC, leaving some (hopefully) helpful commit comments and meeting with him on Tuesday (he's been away since Thursday). I completed the midterm evaluation with some input from Leftmost and things seem to be going well.
Also, forgot to mention - following the OAuth stuff, I'll be working on a BB docker image as well - there are a few dependencies there that mean that docker stuff is currently blocked

@alastairp

https://chatlogs.metabrainz.org/brainzbot/metabrainz/msg/3635814/

last week not as productive as I had hoped, but still a bunch of stuff done
I'm finally getting on top of AB reviews. It's a learning process - I'm learning to never leave too many open PRs at a time... they start snowballing
good news is I think I've finished all of Gentlecat's, just got to merge them hopefully tonight or tomorrow morning
SoC with kartikgupta0909 is going great. We've got a prototype ppa of gaia for i368 going (weird bug with amd64... will look at it soon)
and some good research into choosing a serialization format for moving lowlevel datafiles around, and storing framebased data
Gentlecat and I met at UPF last week to work out a bunch of plans for the dataset editor. We have some cool stuff planned which should happen in the next few months
and I've finally started integrating the work we did for our paper (which we're presenting in August), so we'll be able to show that off at the conference too

@zas

https://chatlogs.metabrainz.org/brainzbot/metabrainz/msg/3635829/

I did a bunch of security upgrades, disk cleanup (we need to do something about nginx logs, asterix was using 192Gb of logs), worked a bit on docker
i set up ftp/rsync/rate limit on sakura
fix up passive/active ftp (thanks to chirlu)
and as usual, added a bunch of releases and artists to MB, nothing more

@rahulr

https://chatlogs.metabrainz.org/brainzbot/metabrainz/msg/3635836/

Last week I worked on finishing up the track searching dialog. Some fixes and restructuring into that.
I'm hoping to get it merged into master by this week.

@Quora

https://chatlogs.metabrainz.org/brainzbot/metabrainz/msg/3635842/

been back from a LAN party for a few minutes :p. sortef an admin system for BB achievements and fixed some issues LordSputnik brought up in commit comments (they were super helpful, thanks!) just got GSoC feedback and ill get to work implementing those comments this week
on my mobile, still havent unpacked, sorry for any mistakes

@armalcolite

https://chatlogs.metabrainz.org/brainzbot/metabrainz/msg/3635846/

this week was kind of lucky, got my patches merged!
did some docker-stuff to get things working and got it setup(proxy settings are really pain)
worked on the api_compat
at this stage, its pretty much working and can be used.
got some feedback from ruaok today, hopefully do them soon.

@hellska

https://chatlogs.metabrainz.org/brainzbot/metabrainz/msg/3635862/

This week I reviewed GSoC code after receiving comments
Opened a new ticket in jira and started working on the schema changes needed to make dataset submissions work
Made a PR ,changed the schema to flag the ID Type of the recordings and accept items without MBID
discussed with gentlecat and alastairp how to proceed with the project
hopefully I will finish the schema change this week

@kartikgupta0909

https://chatlogs.metabrainz.org/brainzbot/metabrainz/msg/3635876/

Last week was able to successfully able to upload gaia to the PPA
it built successfully for i386 but failed for amd64
also we looked at 5 different formats to store low level data in AB
we will be choosing one soon to proceed
and this week I plan to write server and client code to interact with each other
to make the job running on the local machine

Old FreeDB VM at OSUOSL

https://chatlogs.metabrainz.org/brainzbot/metabrainz/msg/3635891/

@chirlu now has the FreeDB gateway running in a Google VM and wanted to know if anything was still needed from the old VM running on OSUOSL. No one mentioned anything specific and @Rob said old VM was treated as disposable, so it should be fine to just kill it.

JIRA upgrade status?

https://chatlogs.metabrainz.org/brainzbot/metabrainz/msg/3635906/

As per @Rob, we still very much want to upgrade our JIRA instance, but we want to move to NewHost more, so @Zas (and everyone else) are all about moving our things to Docker. Once everything is dockerised, we can move to NewHost, and then we can upgrade JIRA.

Docker mini meeting

https://chatlogs.metabrainz.org/brainzbot/metabrainz/msg/3635929/

This concludes the regular meeting, so only people actually involved (or interested) in the dockerisation process were asked to remain around.

pgbouncer vs. pg-pool

pool is much more complex than bouncer and has some drawbacks, and high availability stuff seems tacked on. @Bitmap says dockerization should not depend on moving to pool since we have already spent enough time getting pgbouncer to work properly in dockers, and that we may want to look at using "haproxy or something" for load balancing, with pgbouncer in front of that.

Conclusion is that @Bitmap investigates this further.

progress on MBS docker image

@Bitmap estimates that he's "approaching half way done" for the MBS docker image.

next up

@Rob will look at search related things.
@Zas should "focus on the gateways and ancillary images, such as rsync, ftp."
@LordSputnik might be able to look at CAA.
@Gentlecat was asked to "focus on CB, then MeB, then CAA if LordSputnik isn't done with it."

move CAA to Flask before dockerizing

@Gentlecat and @Rob talked a bit back and forth, but nothing conclusive.

dev/deployment

I'm seeing a pattern emerge where Dockerfiles could be generic,but docker-compose files could be purpose-specific.
so, docker-compose-dev.yml and docker-compose-prod.yml.
production specific bits go into the -prod file.
not sure that is going to be flexible enough.

Discussion about whether a prod/dev split is even necessary: it is.
Then discussion turned into how to achieve this, and Docker's own docks recommend using separate compose files, so we're going with that: one common which can be "extended" into a dev and a prod file.

@LordSputnik asks…

1. Would it be better to keep docker files in project repositories (as it seems to be currently), or together in a metabrainz-dockerfiles repo?
   @Rob and @Bitmap agrees that the files should be in the project repositories.
2. Could we use debian rather than ubuntu as the base image, to reduce image size and have "cleaner" resulting images?
   @Zas says, "i think using debian as base is better yes, but for some services we can go for alpine".

[Freso]

The docker "mini " meeting made this one hard to write. Sorry about the delay!