Notes from #MetaBrainz Meeting 2022-05-30

[Freso]

MetaBrainz Meeting 2022-05-30

Meeting start: https://chatlogs.metabrainz.org/libera/metabrainz/msg/5013334/

Monday of the International Week of Solidarity with the Peoples of Non-Self-Governing Territories

Palestine

Agenda

• Reviews
• Securing MeB infrastructure - part 5

Last meeting: 2022-05-23
Next meeting: 2022-06-06

Reviews

@reosarevok

https://chatlogs.metabrainz.org/libera/metabrainz/msg/5013339/

@reosarevok

This week I rested for half the week, then worked mostly on a lot of small tickets (to put in beta today) and some fixups to the genre code
I also attended the MeB board meeting on Tuesday

@Freso

https://chatlogs.metabrainz.org/libera/metabrainz/msg/5013348/

@Freso

Mostly poked at reports and flags last week. Have a few stressors going on right now. Should hopefully get some of the worst of it cleared up after tomorrow.
Relatedly, I won’t be around tomorrow.

@yvanzo

https://chatlogs.metabrainz.org/libera/metabrainz/msg/5013356/

@yvanzo

Not a lot to report on last week either as I mostly rested.
Updated this PR that is still needing the attention of MeB software engineers and maybe system admins: Document using RabbitMQ for main contributors by yvanzo · Pull Request #17 · metabrainz/guidelines · GitHub
Plus some PR reviews, tickets triage, and support.

@rob

https://chatlogs.metabrainz.org/libera/metabrainz/msg/5013362/

@rob

Last week was, as @reosarevok mentioned the board meeting which I prepped for and held.
one of the things that came out of that was that the 15,000GBP that we are receiving from the ODI is cleared to be spent on donations to other orgs and people.
and the first one in that group is chinmay.
we’re going to accept him as a faux summer of code students for a half time project and pay his stipend ourselves.
the other thing to come out was a wash, but I’ll let @akshaaatt tell that story when its his turn.
then I worked on fixing the release/release group tags for mb medata cache and finishing the work to get the first troi-bot daily jams working.
those will start appearing the day after the next release for all people who have listens and who follow troi-bot on LB.
then some background MeB stuff …
finally, I will be off this thursday/friday as well as next week thursday/friday.
I’ll be reachable for questions, but the turnaround time will be slow.
hopefully this will mark the end of my stressful phase in my life and after that you’ll have my undivided attention again. for better or for worse. ha!

@akshaaatt

https://chatlogs.metabrainz.org/libera/metabrainz/msg/5013379/

@akshaaatt

I have made significant updates to the bootstrap 5 migration of ListenBrainz and tried fixing my MusicBrainz PRs.
We were also setting things up in the Design System to automate lint and formatting.
Also, I transfered my hobby project for MusicBrainz iOS app to our official organization. It currently has the basic setup ready and features the dashboard and some functionalities.
Hopefully, we could have volunteers working on this in the future if they like and release to the app store.
Other than that, as @rob mentioned, I have some news
I will be joining another company next to next week and have submitted my request for the same at MetaBrainz.
I hope this doesn’t affect too much. So I won’t be sharing any goodbyes. I’ll be present for mentoring for GSoC as usual and aim to be available as always.

@rob

I’ve asked @mr_monkey and @bitmap to look at the design system so that we can focus akshaaatt’s efforts on that project for these last two weeks.
that is the most important thing to look after.
the MB home page, the MB says, can be finished by them.
so, I hope that make the marching orders clear for the next two weeks, so that we can hopefully come to meaningful stopping point on that project.

@akshaaatt

Yes, I would like to take responsibility for getting them even after I am not bound by the contract.
Again, no goodbyes because I’ll be here. I just had to urge to learn some more things hence made the move

@mr_monkey

https://chatlogs.metabrainz.org/libera/metabrainz/msg/5013408/

@mr_monkey

Lots more PR reviewing last week. So many good contributions, so little time !
I lost most of a day because heat wave, turned me into goo.
I started looking at using the new React 18 for BookBrainz. So far the conversion is very simple, although it’s going to take more work to fully use the new React server-side rendering lazy loading goodness
Had a useful discussion about MeB OAuth with @rob and @alastairp
And worked on a couple of BB projects with @Shubh: the long-time-pending Author credits, fixing bugs that slow down the entity editor.
Finally, a bit of work on the LB metadata viewer, and some investigation into Spotify API weirdness

@alastairp

https://chatlogs.metabrainz.org/libera/metabrainz/msg/5013426/

@alastairp

I fixed the bug that @mr_monkey and I introduced that broke brainzbot/jora (due to old python/ssl certs verification)
I made a BU/CB release to fix a broken query due to some changed columns in the MB event tables during schema change
I finished testing and merging ansh’s PRs for showing more info on label and place pages on CB
I helped ansh start with prep for his SoC project (!)
I helped @lucifer fix an interesting bug in the listen ingestion pipeline in LB, where we were trying to process 70,000 messages at once and hitting rabbitmq timeouts (and in the process I learned a bunch about rabbitmq and the ingestion pipeline, which I’ve not been very involved in until now)
finally, today I upgraded the MB database replica on wolf (@yvanzo if you have 5 mins after meeting I have a question about it, otherwise it can wait until another day)

@lucifer

https://chatlogs.metabrainz.org/libera/metabrainz/msg/5013437/

@lucifer

last week i helped on unblocking the listen pipeline after that huge message. we also added api checks to avoid the situation in future.
worked on finishing up raw recommendations prs. after that restarted work on recording similarity stuff from some months ago and exported some datasets to wolf.
also wrote a tiny bash and python script to automate most of moving the datasets from HDFS to postgres on wolf.
investigated a bug in CB due to which the cache wasn’t not being cleared. also, worked on fixing readthedocs builds for LB.
finally, progressed on the feature to show feedback submitted using MBIDs on LB frontend.
oh, also cleaned up and finished the sir tests PR!

@bitmap

https://chatlogs.metabrainz.org/libera/metabrainz/msg/5013450/

@bitmap

last week I fixed some issues that that surfaced after the schema change - MBS-12400 and MBS-12398
I added some tests for those and generated new dumps after hot-fixing MBS-12400
also upgraded some MBS dependencies, which required some code changes - one for react v18, another for a broken/unmaintained perl dep
other than that I did a bunch of code review, worked on the artwork-indexer a bit more (upgrading to python 3.10 and fixing tests), and rebased my React relationship editor branch & fixed Flow errors in that

@zas

https://chatlogs.metabrainz.org/libera/metabrainz/msg/5013460/

@zas

last week we released Picard 2.8
we add a small meeting with new GSoC student skelly37 with @outsidecontext
we discussed a bit about Picard dev priorities for upcoming 2.9 & 3.0
I also deployed a workaround for an annoying warning about SSD failure on trille (according to Hetzner the problem isn’t real, and the net seems to confirm that)
I started few polls about auto-editor system, I find elections too rare
plus usual upgrades, supervision, user support, minor issues handling.

@atj

https://chatlogs.metabrainz.org/libera/metabrainz/msg/5013475/

@atj

last week I made some changes to our smartmontools and netplan ansible roles. the first was to resolve the issue zas mentioned just now and the second was prep work for moving the spark cluster to ansible.
I had a look at the spark cluster configuration, and created a WIP PR for our ansible playbook
we’ve been focused on physical servers up until this point, so including VMs requires some reorganisation
hopefully I’ll find some more time to work on that this week so we can get the jackson VMs into ansible ASAP
(some conversation clarifying that those are bare metal servers, not virtual ones)
sorry, ignore my mention of VMs then however they have VLAN interfaces which is the primary difference
that’s about it I think, FYI I’ll be AFK on Thursday and Friday, as we have been bestowed with an extra bank holiday thanks to our archaic system of government involving strange woman lying in ponds distributing swords

Securing MeB infrastructure - part 5

https://chatlogs.metabrainz.org/libera/metabrainz/msg/5013533/

Continued discussion about securing our infrastructure, specifically regarding “Reducing docker container capabilities”. Please refer to the IRC logs for details.