#metabrainz

alastairp: I dont have comparison numbers to hand.

apparently others disagree

strongly

CatQuest: oddly, the top duplicate-sumitted track on AB is some B-side from a beatles single

this was a pretty simple query I suspect that spark will be more flexible in the long run

oh ye?

what ?

yeah, it was werid. I had never heard of it

what was it called?

is it that one with jimi hendrix on guitar? :D

ruaok: right, but I guess spark requires shipping the whole database there too, before we can run any stats on it

vacuumdb done!

I guess it's no different to running timescale queries on a db replica

or that one super early instrumental one called tide something

CatQuest: I don't recall, and I don't have the data easily to hand, sorry

ah. no worries. but if you do come over it again, i'd be interested in the name

CatQuest: Sgt. Peppers for me !

that data may have changed since I computed it again

hah my point exactly :D

one of my near-term goals for AB is to get this kind of stats running

neeeat

database seems to be operating normally, I'll take it out of consul maint mode

alastairp: spark already has the whole DB.

bitmap: vacuum done already??

yupp

crazy

wow, yes

oh i remembered another "popular" and I thought was alright (listened one album): Pearl Jam

ruaok: yeah, right. so in order to perform any kind of stats in spark we have to keep an entire duplicate of the db there, in addition to whatever other db we use primarily?

yes.

spark is considered disposable.

leaving pink down since I need to resync that later

reosarevok: insert a pokemongo refrence (spark eg?)

sure. it's not like we'd want to run background tasks on the main production database anyway I guess

in order to prevent it from overloading

yep.

so it's not like it's any more "innefficient" than any other way that we'd have to set up a stats infrastructure

I'm so happy the stats infra is getting squared away.

it's been pretty stable the last few days.

i'm just waiting for a new data dump to complete so that we can import it.

started sir-prod back up without issue

starting caa-indexer

time to start other services?

yup

doing trille, lemmy and hip

done with serge

LB up

Done prince. BB looks fine (beta, prod and test)

I'll do cage, ludwig, pink

for perf, our spark cluster takes around 6 min to calculate all artist listen counts for ALL users with basically no tuning rn.

CB up, MeB up.

with some smart data partitioning, i'm pretty sure we could bring that down.

MSB up.

guess so

I guess so.

reosarevok: you've actually added quite a lot of BB-tickets for things I was going to do (but ofcoursely you've enunciated yourself much more eloquently than I could ever)

wow, that took pretty much 1.5 hours.

!m bitmap

You're doing good work, bitmap!

w00t

thanks for the hard work y'all!

!m bitmap, smooth

You're doing good work, bitmap, smooth!

there should be a script that writes !m bitmap in the chhan every so often by default :P

<3

something like BrainzThanksBitmapBot?

:D

So given that you’ve just finished the db upgrade, do you want to call off meeting today? Otherwise we’re go in 12 min and I need to prepare. :)

bitmap: did you restart telegraf on pink & floyd yet?

nope, thanks for the reminder

I'll do it

done (though postgres-pink is still down for now)

k, I'll recheck after a while if metrics are showing up

ruaok: Your call: meeting or no?

sentry is still down btw

Can take down the banner on mb.o

Looks like there’s still some clean up going on, so maybe no?

*Sounds

Mr_Monkey: can we have a jira component "add/editing pages" (or add/editing interface) or similar?

Freso: personally I have nothing to report so...

(well other thna creating tickets and partying yesterday)

We want to know about the party.

17 Mai. look it up :P

iliekcomputers: oh, I see what's wrong. will fix

yvanzo: It was World Telecommunication and Information Society Day yesterday, clearly a day of much rejoicing.

bitmap: good, metrics are there for pg instances

great

not pink though

Freso: ಠ_ಠ

I'll restore pink soon

I'm stunned at how smooth this was. well done!

:/

here it's a holiday today

Lotheric_: ok! have some cake too!

I spoiled myself with a takeout breakfast/brunch :P

CatQuest: Ship that to me. I want some cake 😂

iliekcomputers: ah, cool. that's what I was interested in knowing (stats computation time)

i uh. ate it already 😕

but it sounds like there's also other implicit time required there (time needed to do a dump, time needed to import it)

:|

any idea if we can stream data to spark from postgres as it comes in?

alastairp: possible yes, but we haven't done that yet.

It’s No Dirty Dishes Monday!

People up for reviews: pristine__, Freso, reosarevok, zas, yvanzo, alastairp, bitmap, ruaok, Mr_Monkey, ishaanshah[m], shivam-kapila, Cyna[m], _lucifer – anyone else who wants to give a review, please let me know ASAP!

pristine__: Go!

cool, if that's possible then that'd be a great future improvement

...

No pristine__? reosarevok, go!

Hi!

hi

Last week I mostly worked on making it so that when a URL is rejected as a relationship

The user is actually told why in cases that can be confusing

"why can't I add this allmusic link on the release" "why can't I add a bandcamp album to the artist" etc

That's the main thing, although I also did some refactoring and whatnot and some reviews

CatQuest: wanna go at all? If not Freso

hi

I don't have anything except adding tickets for BB (and commenting on reosarevoks tickets :P) and aprtying yesterday

partying*

next freso?

🙋

Spent a good chunk of time looking into and dealing with reported editors. Also was around and about.

fin.

zas: Go!

Hey

Not much to say, usual supervision, upgrades and maintenance

also reviewed a lot of Picard PRs stuff (mainly an incoming patch that will boost UI reactivity)

fin. yvanzo ?

Hi!

Last week, I published the first release of MusicBrainz Docker Compose files.

(People still up for reviews: alastairp, bitmap, ruaok, Mr_Monkey, ishaanshah[m], shivam-kapila, Cyna[m], _lucifer – anyone else who wants to give a review, please let me know ASAP!)

See https://blog.metabrainz.org/2020/05/16/musicbra...

And https://github.com/metabrainz/musicbrainz-docke... for details.

!m yvanzo

You're doing good work, yvanzo!

Otherwise released a new version of MBS, including a patch by navap!