Notes from #MetaBrainz Meeting 2021-11-08

[Freso]

MetaBrainz Meeting 2021-11-08

Meeting start: https://chatlogs.metabrainz.org/libera/metabrainz/msg/4904087/

Aaron Swartz Monday
https://www.youtube.com/watch?v=Qb0tCgNzbjk

Agenda

• Reviews
• Follow up on Summit Notes → Tickets

Last meeting: 2021-11-01
Next meeting: 2021-11-15

Reviews

@rob

https://chatlogs.metabrainz.org/libera/metabrainz/msg/4904097/

@rob

last week was pretty nigthmareish.
betwen attending and presenting at two conferences (ODI and GSoC Mentor summit)
I got to experience a 4 hour total meltdown of all of our infrastructure.
which was fixed by creating a band-aid CAA server that is shoveling out Gigs of data each day in millions of requests. (720 reqs/s!)
creazy freaking experience I could do without. really.
but I was in sardinia, which made of up for it.
back in BCN now and hopefully a more calm week.
we also started planning for the 2021 LB year in review report. which is gonna be pretty awesome!

@CatQuest

https://chatlogs.metabrainz.org/libera/metabrainz/msg/4904116/

@CatQuest

Last week I worked with @reosarevok to add instrument images, therefor also fiddled around with some inter-instrumental links
Iforrigweek, I basically had hallowmass <3

@yvanzo

https://chatlogs.metabrainz.org/libera/metabrainz/msg/4904121/

@yvanzo

I did review some pull requests.
Set up a replica of the MB DB on the new server “purple” (to band-aid CAA).
Otherwise, I prepared my move, leaving tomorrow, I won’t be available this week.

@akshaaatt

https://chatlogs.metabrainz.org/libera/metabrainz/msg/4904127/

@akshaaatt

My week started with some automation around Android and then I learnt CI/CD for deploying almost everything, so great learning on that!
I had a chat with the stripe people because I found some bugs in their code and reported it
Highlight of the week we’re the discussions I had with @mr_monkey!
Amazing stuff
I even reviewed a lot of his PRs
We discussed about the LB design
Later during the weekend, I had a video chat with him
Available at
https://youtu.be/bjmGFMDPWdY
Do watch it when you find the time

@lucifer

https://chatlogs.metabrainz.org/libera/metabrainz/msg/4904139/

@lucifer

i began the week with some experimentation with kombu to replace pika in rmq connections. then the meltdown happened, tried to help debug it. later helped setting up redirects for non supporting radios responsible for bulk of caa traffic.
had lots of discussions on various stuff like LB year in review, mapping, etc. did some cleanup of messybrainz code. and debugged misc stuff like dumps not getting cleared on ftp, uswgi headers issue and some stats issues.

@alastairp

https://chatlogs.metabrainz.org/libera/metabrainz/msg/4904144/

@alastairp

I mailed a review to @Freso and he posted it before realising that everyone was in the middle of solving CAA
the review last week said that I did some PR reviews and attended a kubernetes training course at MTG which was interesting
last week I did some more reviews. with monkey we finished our proposed documentation updates for the LB submission json format
that PR is ready in case people didn’t see the previous notification. please check it out if you have opinions™ about documentation:
https://github.com/metabrainz/listenbrainz-server/pull/1607

@mr_monkey

https://chatlogs.metabrainz.org/libera/metabrainz/msg/4904151/

@mr_monkey

In the last couple of weeks, I finisheed refactoring the ListenBrainz front-end to use the same ListenCard component everywhere. Phew !
With that we gain some functionality and homogeneity across the website.
I also picked a bunch of tickets and did one lucifer’s worth of work:
https://usercontent.irccloud-cdn.com/file/RHoefgJw/image.png
Had some good discussions as mentionned before about “Your year in music” and the ListenBrainz redesign
Lots of bug fixes and small improvements
Some PR Reviews and ticket cleaning
And that’s it in a nutshell

@bitmap

https://chatlogs.metabrainz.org/libera/metabrainz/msg/4904167/

@bitmap

last week I spent a bit more time writing Selenium tests for the artist credit editor
and worked on a patch to convert the medium tracklist in the release editor to React (in order to integrate the new artist credit editor), which is almost ready
I also did a little bit of code review and helped with setting up the temporary artwork redirect service on purple

@zas

https://chatlogs.metabrainz.org/libera/metabrainz/msg/4904171/

@zas

Busy week.
Helped to restore services after last Monday chaos related to CAA & radio plugins.
It was a combination of snowball effects, lack of CPU resources, sudden traffic due to a widely used WP radio plugin switching to https, and an unrelated gateways switch at the bad moment.
Fixed [MBH-539](https://tickets.metabrainz.org/browse/MBH-539 “Make “www” subdomains redirect to main domains”), introducing a new way to define simple redirections (http(s)://www.domain to https://domain) via config.prod.json
Proper nginx configs are now generated based on redirects{} section in the json file, using a specific template + consul
I finished the deployment of serviceregistrator, fixing few compat issues on the way, registrator & git2consul are now totally gone, opening the path to the deployment of new consul version
The plan is to run separate instances of serviceregistrator & gitzconsul to feed the new consul cluster
I’ll work on this this week.
I reworked gitzconsul & serviceregistrator a bit, cleaning the code, and improving tests
I also reworked picard-website docker images generation, using github workflow instead of jenkins, image is now half the size it was, and takes only 2 minutes to generate. It will ease deployment of new versions.
Also worked on Picard, a new 2.7 beta release is planned tomorrow
I upgraded stats.metabrainz.org to grafana 8.2.3, fixed dashboard issues I noticed (if you see broken graphs, tell me)
I also started to collect infos in order to redesign load balancing (aka gateways), read / view tons of documents, and wrote down few pointers.
Apart that, usual user support, supervision upgrades, minor tweaks & fixes, and of course MB edits.

@reosarevok

https://chatlogs.metabrainz.org/libera/metabrainz/msg/4904195/

@reosarevok

I mostly worked on converting edit display to React
All the individual edits are already converted, so this is actually making the edit index and edit list page also be React
Which meant a ton of playing around with Flow typing and whatnot
And now finally actual React conversion
Other than that, I fixed a bunch of small tickets and helped @CatQuest with a bunch of instrument images

@Freso

https://chatlogs.metabrainz.org/libera/metabrainz/msg/4904204/

@Freso

Last two weeks were a bunch of poking at spam/reports/flags. Also discussed MBS-12055 with @reosarevok a bit. And tried to be around/about.

Follow up on Summit Notes → Tickets

https://chatlogs.metabrainz.org/libera/metabrainz/msg/4904212/

@mr_monkey did “a few, didn’t do a thorough passthrough”. No one else seemed to have done anything. Keeping topic up for another few weeks to try and remind people to get it done.

[yindesu]

Right now, MusicBrainz is exhibiting the same lag that immediately preceeded the infrastructure meltdown last week.