#metabrainz

aerozol: https://github.com/metabrainz/musicbrainz-serve...

Thanks! What did you think re. not having pictures with the small print on the login page? Ok?

Hi lucifer, if you have time, could you have a look at my overhauled proposal before i show it to mayhem? https://community.metabrainz.org/t/gsoc-2022-pr...    I would hope to incorporate these discussions to my proposal if it's okay.

Thanks!

SivanD: looking into it. as mayhem suggested, you can go for a generic make a playlist. this can probably also include new releases stuff as a part of it.

one more suggestion would be to write a concise bullet list of points showing the crux of your algorithm.

like this https://www.irccloud.com/pastebin/zLbQ7xz7/

personally this is the first thing i would like to look at so that i can understand whats going on. maybe after this add details why you chose to do it this way etc.

Oh I see, like a pseudocode. Thanks for the suggestions.

regarding how to put generate those playlists and put in LB, don't worry. we have most of it already done in Troi. the thing to be figured out is how to run every friday which can be as simple as a weekly cron job.

the details of that can be discussed later (today if time permits or afterwards), but the first thing to focus on should be the steps to generate a playlist.

i don't have any other particular comments on the proposal but feel free to ask any questions you have.

chinmay: did you submit listens locally or are you relying on the imported dump? iirc you imported the public dump which doesn't have listens, you need to import a listens dump for that. if you submitted locally, it should already be appearing fine otherwise it may be a LB bug.

Hi lucifer, could you elaborate on "include new releases stuff as a part of a generic make a playlist", IMO my draft code is sort of doing this job. Plz correct me if I'm wrong. Also I've updated with the pseudocode in the post now.

And you are saying that I don't have to come up with a automatic method for Weekly updates for now in my proposal? Thanks for the explanation!

SivanD: that was for if you want to switch the proposal to a general “make a recommendation playlist”, i meant you could various types of data for this and if you want optionally include the new releases. if you want to do release radar, proposal then ofc it has to be related to recent releases so then ignore the comment.

i mean we already have a way to do updates when a user manually triggers a command, it only needs to be automated.

I see, thank you.

automating it may be as simple as adding a cron job entry.

like https://github.com/metabrainz/listenbrainz-serv...

in troi we have https://github.com/metabrainz/troi-recommendati... to create patch for all users and write playlists.

my point is think about this part later, first focus on you algorithm first and refine it as needed.

thanks, I see, I'll mention these codes briefly wrt automatic updates in my proposal as well.

bitmap: do I remember correctly that MBS-12320 is a schema change? (not sure we'd want to do it, but that's a different question I guess)

MBS-12320: Change _recording_firstreleasedate to exclude Bootleg releases (without excluding Promotion releases) https://tickets.metabrainz.org/browse/MBS-12320

[musicbrainz-server] 14reosarevok opened pull request #2494 (03master…MBS-11556): MBS-11556: Standardise / clean up YouTube Music URLs https://github.com/metabrainz/musicbrainz-serve...

lucifer: you're right, I haven't imported the listens dump yet. Thanks.

O’Moin

morn morn

reosarevok: Thank you for the release. The task list in the blog post looks weird though.

zas: mb*-beta has to be moved as there are only 2 instances (serge, zappa); Which server can I use instead?

Oops, didn’t read the next line: paco :)

But we need a second server too.

It depends whether or not serge and zappa are down at the same time.

moooin!

welcome back mayhem

morning

thanks.

did you know that Arizona also exists in Catalunya?

desert? americans?

grand canyon?

desert. desert flowers amazing peaks. stuning beauty.

yep. not too far from where we were. why is this not in all tourist literature?

because people from barcelona like making fun of lleida

yes, lleida is shit, we had to travel through it. but what a missed opportunity for the region and humans.

we immediately want to go back in two weeks before it gets hot

https://www.instagram.com/montsecbikepackingloop/ really want to do that asap

zas, cc bitmap: Started an MB beta instance on paco; It should be enough if serge and zappa are not down at the same time.

alastairp: that region has two types of roads: steep uphill and steep downhill. nothing in between.

yeah, I bet

hiking is the same. I plotted out a hike that was clearly waay beyond us. and the two concilliation hikes are STUNNING

yvanzo: serge & zappa will not be down at the same time

👍

chinmay: ah cool, you can just import the incremental dumps to get some listens. full dumps will be too large and probably not needed for your purposes.

lucifer: hi. sounds like we might not have tested dump imports recently? something to look into?

zas: hi, I can move CB, is there an available server? It doesn't need many resources anyway

alastairp: yes probably. the feedback dump in particular was the one which failed the other day.

though the error seemed like due to bad data to me which is even weirder.

uh not the feedback dump but the feedback table in the public dump.

yeah, right

oh i see, https://github.com/metabrainz/listenbrainz-serv...

we didn't update this to inlude recording_mbid column

alastairp: you can move it to paco if it doesn't need much resources, it will be temporary anyway

once a server is free from services I'll upgrade it, I'd like to start with serge

LB-1090: Investigate uWSGI listen queue full errors in log https://tickets.metabrainz.org/browse/LB-1090

also please make sure nothing important left in your homedirs on those servers (serge, zappa, trille)

from looking a the docs, is the "listen queue" just the number of avaialble worker threads, or another setting?

i think something like the number of concurrent requests it handles.

*max concurrent requests

lucifer: was gonna ask. Thanks a lot :)

yvanzo: oh, my bad, will fix

lucifer: About the error I had while importing public dump the other day - I removed the CHECK constraint altogether locally to make it work.

chinmay: yes but then you'll probably have rows in database where the recording_msid and recording_mbid is NULL so those basically are missing which recording the feedback is about.

the reason is that we can give feedback either using recording mbid or recording msid but we forgot to add recording mbid column to the dumps.

lucifer: we have dump tests - so at a guess we don't have any feedback dumps in those tests?

yes i think that might be the case.

bitmap, cc zas: I don’t know about moving CAA and MB smtp/exim containers.

yvanzo: let's wait for bitmap for that, and we'll document along

mayhem: alastairp: ^, spotify finally sent the correct files.

`"ts": "1970-01-20T02:10:42.130Z"`

oh lol i said too soon

cool. now, can everyone else get that, or do they need to wait for 4 months?

1970?

it has millis precision but see the data

*date

yeah lol, so the drama continues

i'll send another mail 😞

haha, so - one sec

1970-01-20T02:10:42.130Z -> epoch 1649442 -> *1000 -> 1649442000 -> Friday, 8 April 2022 6:20:00 PM

🤣 i wonder how they ended up making that error now.

Conversion from Javascript timestamps (milliseconds) to some other language?

maybe. i guess if they wanted to cheat they could multiply the seconds timestamp by 1000 and call it a milliseconds timestamp but somehow they ended up dividing by 1000 instead.

monkey: for when you have some time, LB-1088

LB-1088: Separate North Korea and South Korea in artist origins map https://tickets.metabrainz.org/browse/LB-1088

^ more likely

Huh, another one of those

i think MB has both separate so makes sense to have them separate in LB too.

Yeah, probably a good idea. Do our stats calculation take the two Koreas into account?

since MB has two Koreas stats should be taking into consideration but i'll need to check to confirm.

I assumed the same, just wanted to make sure

(that we don't lose Korea stats entirely)

moving jenkins back to paco

monkey: yup its KR for South Korea and KP for North Korea.

zas: what is the upgrade/maintenance procedure for our VMs? (I'm specifically thinking of sentry.metabrainz.org, which is a hetzner cloud VM. is this something that you will periodically maintain, or should one of us do it as part of sentry maintenance?

alastairp: I don't manage sentry, but we should move it to ansible (as SOLR cloud)

ansible for management of the base system, or also for setup of sentry (I recall you talking about a plan to add solr-cloud deployment to ansible too?)

I'm happy to coordinate with you on this when you want to do it

sentry setup is a single directory with a docker-compose.yaml file in it (from private repo sentry-onpremise on our github org, documentation in syswiki)

[musicbrainz-server] 14reosarevok opened pull request #2495 (03master…MBS-12318): MBS-12318 / MBS-12323 / MBS-12324: Improvements to ArtistsThatMayBe reports https://github.com/metabrainz/musicbrainz-serve...

mayhem: this got requested again recently https://tickets.metabrainz.org/browse/STYLE-210 - under most lyrics pages they seem to say in small print "Lyrics Licensed & Provided by LyricFind", but a few (at least the ones under "Promoted Lyrics") don't say anything, guess the point is the artist sent it themselves or some shit

STYLE-210: Add Lyrics.com to list of Approved lyric sites.

Does that still qualify? Maybe I should try to submit some lyrics myself and see what they say under them...

Heh. They ask for language and do not even support Estonian

What a crap site :p

I think I'll say not now based on that alone

reosarevok: did you see https://community.metabrainz.org/t/gsoc-2022-cr... ?

not sure what that page is from, do you know it?

reosarevok: I agree with your sentiment on that ticket. If it is not all 100% clear, we don't link.

akshaaatt: for theming, do you think we need to update the app's themes to match new material3/ material you guidelines?

mayhem: available/want to discuss the recs stuff?

yes, perfect timing, actually. except that I didn't have a chance to read anything yet. too much nature.