#metabrainz

Morning

!m bitmap

You're doing good work, bitmap!

morning!

moooin

alastairp: I spent some time looking at the results of the acrm_search and found that the pink floyd test case https://datasets.listenbrainz.org/acrm-search?q... that failed was interpreted by the hoster to be TWO queries. See at the bottom.

removing the comma from the query makes the search succeed. this means that 100% of my test cases for typesense produce the correct result. I'm really stoked now!

mo’’in’

Is an artist_msid from ListenBraiz's API the same as a ArtistID from the MB's Database?

I think MSID is meant to be just the "messybrainz ID" which only identifies a name string

But ruaok can tell you for certain

hi vintagegold, nice to meet you

I was CC'd on the emails that ruaok sent you.

no, a msid (messybrainz id) and an artist mbid (artist musicbrainz id) are different. The reason is that we can't guarantee that people will send us mbid data when they send data to listenbrainz, so we generate a temporary id for it

we're actively in the process of building tools to link these two identifiers together

alastairp reosarevok Hi alastairp nice to meet you too. Okay sounds good, in the mean time I'll use Fuzzy Match or Levensteins Match and see how far I can get with that

The matching will be on concat(artist_name,track_name)

vintagegold: we don't guarantee its availability, but take a look at http://bono.metabrainz.org:8000/acrm-search?que...

alastairp awsome! I am building an idea out for an interactive graph recommendation experience, so I would like to do some testing. Are you okay with me pinging this "endpoint" periodically with a script? I am totally okay with elaborating on the idea if that makes everyone more comfortable

more of a music network*

how much do you think you'll need it? we're using this tool: https://typesense.org/, so we can definitely get our setup instructions to you if you want to build the index yourself

cool, we're really interested in this kind of navigation/exploration tools

Now that I am think about it I can do a smaller test of around 50 artists manually and prove out the concept. Do you mind sending over the set up instructions so familiarize myself and I can follow up next week?

alastairp

I don't have much experience with Javascript

sure thing. ruaok set up the typesense server, when he sees this message he'll either be able to send you a link to the instructions, or he will write some instructions and add his code to a repository if he hasn't done that already ;)

alastairp Awesome! Looking forward to it :)

alastairp You having Portishead as the artist in the "endpoint" got me to listen to their album "Dummy" again :)

Nice indirect voluntolding, alastairp.

vintagegold: glad you're here. I'm taking today off, except for some critical items. Happy to help/chat tomorrow.

And yes, dummy is a sublime piece of work...

And yes, feel free to hit that endpoint for testing purposes. The web ui has a bug that I plan to fix asap.

!m alastairp

You're doing good work, alastairp!

That was indeed very good voluntolding

ruaok Sounds good, Thursday is best for me, so I will be most active then

ok, good. I hope things will be a bit more calm by then. loads of things up in the air for me right now.

this interactive graph recommendation tool... are you planning to make it open source? because we would love love love to have something like that running on listenbrainz.org

@Ruaok That's the plan :)

yay, that's fantastic.

if you need anyone to help test, post a URL here -- I think there are a few of us who are interested in such projects.

ruaok Will do

bitmap: you about yet?

ruaok: hey, I'm here

ok guise this is kinda crazy but a book i just read yesterday actually used the term "voluntold" :O

fiction/fantasy book

Freso: ping

ruaok: pong

still 10 min?

I'd like to go first today, there is something import to discuss.

Got it.

thx

<BANG>

It’s World Continuous Improvement Monday!

I haven’t received any mailed in reports, but Rob has requested to go first, so…

ruaok: Go!

(Others up tonight: yvanzo, bitmap, Freso, zas, reosarevok, alastairp, Mr_Monkey, CatQuest, shivam-kapila, _lucifer, jmp_music – anyone else who wants to give review, let me know ASAP!)

thanks.

so, we have some rough news to report. :(

we leaked some email addresses.

some 17k of them. :(

is our complete write up of what happened and how we've arrived at this point.

I hope the blog post covers the critical details.

bitmap: reosarevok: care to add anything?

questions?

Other than "sorry we missed that bug", not a lot :/

just to sorry that I'm deeply sorry for anyone affected and we're working to ensure it doesn't happen again

the perplexing thing is that botnets hit us with a ton of traffic all the time, and we never had an idea why.

now we know.

and I can help answer any questions not covered in the blog post

CatQuest: ops, sorry, quite possible. :(

:(

Same statement: deeply sorry to have missed that for so long.

I think we've done everything we can do now. we need to follow up with the archive and the board of directors and see what fallout comes our way.

unless anyone has any questions/comments, lets go on with the usual meeting, I'll take my turn when it comes.

back to freso...

"the perplexing thing is that botnets hit us with a ton of traffic all the time, and we never had an idea why."

Sadly I guess they won't stop because of this, but

ruaok: Is that your review for the week? If not, go ahead with that. :)

k

thankfully its not.

Wonder if everyone gets hit with botnets all the time or someone caught this and kept at it

Anyway, sorry, go on ruaok :)

last week there was another scare.. I found some LB dump files on the FTP server that looked like private data dumps, but the files were actually empty.

zas and I spent the day fixing that, so that the LB dump scripts are less brittle. that fix is in production as well.

!m zas and you

You're doing good work, zas and you!

I also did a lot of prep for the hack day this weekend. I'll let someone else talk about that one though.

this biggest technical accomplishment came when I got the new MB Mapping working:

given just a few words (sun shines tv) you can find the right track, album and artist.

this was built using typesense, a new fuzzy text indexing engine.

I'm shocked at how well this works and the engine still has some improvements coming that will make this even better.

hopefully I will be able to begin back filling MBIDs into the listen database with the goal of no longer needing to map MSIDs to MBIDs, which will be super exciting.

I'm sure you'll hear more of this as time goes on.

fin. Mr_Monkey?

Hi !

Last week I finished implementing all areas in BookBrainz, reviewed and helped along some PRs for BB and LB, and did some cleanup of database and dependencies.

I spent the rest of the week working on various aspects of LB: tried with alastair and with some measure of success to implement a BrainzPlayer iframe to be used on other Brainz websites.

ruaok: do you see that working well enough to have it on MB proper?