alastairp: I spent some time looking at the results of the acrm_search and found that the pink floyd test case https://datasets.listenbrainz.org/acrm-search?q... that failed was interpreted by the hoster to be TWO queries. See at the bottom.
removing the comma from the query makes the search succeed. this means that 100% of my test cases for typesense produce the correct result. I'm really stoked now!
yvanzo
mo’’in’
Gazooo79494 has quit
Gazooo79494 joined the channel
vintagegold joined the channel
vintagegold
Is an artist_msid from ListenBraiz's API the same as a ArtistID from the MB's Database?
reosarevok
I think MSID is meant to be just the "messybrainz ID" which only identifies a name string
But ruaok can tell you for certain
alastairp
hi vintagegold, nice to meet you
I was CC'd on the emails that ruaok sent you.
no, a msid (messybrainz id) and an artist mbid (artist musicbrainz id) are different. The reason is that we can't guarantee that people will send us mbid data when they send data to listenbrainz, so we generate a temporary id for it
we're actively in the process of building tools to link these two identifiers together
reg_[m] has quit
joshuaboniface has quit
goldenshimmer has quit
tripathyprateek[ has quit
nobodyrocks[m] has quit
maverickfox3[m] has quit
MagnusSvensson[m has quit
maxlath[m] has quit
kepstin has quit
joshuaboniface joined the channel
vintagegold
alastairp reosarevok Hi alastairp nice to meet you too. Okay sounds good, in the mean time I'll use Fuzzy Match or Levensteins Match and see how far I can get with that
The matching will be on concat(artist_name,track_name)
alastairp awsome! I am building an idea out for an interactive graph recommendation experience, so I would like to do some testing. Are you okay with me pinging this "endpoint" periodically with a script? I am totally okay with elaborating on the idea if that makes everyone more comfortable
more of a music network*
alastairp
how much do you think you'll need it? we're using this tool: https://typesense.org/, so we can definitely get our setup instructions to you if you want to build the index yourself
cool, we're really interested in this kind of navigation/exploration tools
vintagegold
Now that I am think about it I can do a smaller test of around 50 artists manually and prove out the concept. Do you mind sending over the set up instructions so familiarize myself and I can follow up next week?
alastairp
I don't have much experience with Javascript
alastairp
sure thing. ruaok set up the typesense server, when he sees this message he'll either be able to send you a link to the instructions, or he will write some instructions and add his code to a repository if he hasn't done that already ;)
vintagegold
alastairp Awesome! Looking forward to it :)
alastairp You having Portishead as the artist in the "endpoint" got me to listen to their album "Dummy" again :)
maxlath[m] joined the channel
MagnusSvensson[m joined the channel
tripathyprateek[ joined the channel
reg[m] joined the channel
kepstin joined the channel
goldenshimmer joined the channel
nobodyrocks[m] joined the channel
maverickfox3[m] joined the channel
d4rkie has quit
Nyanko-sensei joined the channel
v6lur joined the channel
ruaok
Nice indirect voluntolding, alastairp.
vintagegold: glad you're here. I'm taking today off, except for some critical items. Happy to help/chat tomorrow.
And yes, dummy is a sublime piece of work...
And yes, feel free to hit that endpoint for testing purposes. The web ui has a bug that I plan to fix asap.
reosarevok
!m alastairp
BrainzBot
You're doing good work, alastairp!
reosarevok
That was indeed very good voluntolding
vintagegold
ruaok Sounds good, Thursday is best for me, so I will be most active then
ruaok
ok, good. I hope things will be a bit more calm by then. loads of things up in the air for me right now.
this interactive graph recommendation tool... are you planning to make it open source? because we would love love love to have something like that running on listenbrainz.org
vintagegold
@Ruaok That's the plan :)
ruaok
yay, that's fantastic.
if you need anyone to help test, post a URL here -- I think there are a few of us who are interested in such projects.
vintagegold
ruaok Will do
ruaok
bitmap: you about yet?
bitmap
ruaok: hey, I'm here
SothoTalKer has quit
SothoTalKer joined the channel
SothoTalKer has quit
SothoTalKer joined the channel
CatQuest
ok guise this is kinda crazy but a book i just read yesterday actually used the term "voluntold" :O
fiction/fantasy book
ruaok
Freso: ping
Freso
ruaok: pong
CatQuest
still 10 min?
ruaok
I'd like to go first today, there is something import to discuss.
I haven’t received any mailed in reports, but Rob has requested to go first, so…
ruaok: Go!
(Others up tonight: yvanzo, bitmap, Freso, zas, reosarevok, alastairp, Mr_Monkey, CatQuest, shivam-kapila, _lucifer, jmp_music – anyone else who wants to give review, let me know ASAP!)
is our complete write up of what happened and how we've arrived at this point.
I hope the blog post covers the critical details.
bitmap: reosarevok: care to add anything?
questions?
reosarevok
Other than "sorry we missed that bug", not a lot :/
bitmap
just to sorry that I'm deeply sorry for anyone affected and we're working to ensure it doesn't happen again
ruaok
the perplexing thing is that botnets hit us with a ton of traffic all the time, and we never had an idea why.
now we know.
bitmap
and I can help answer any questions not covered in the blog post
ruaok
CatQuest: ops, sorry, quite possible. :(
CatQuest
:(
yvanzo
Same statement: deeply sorry to have missed that for so long.
ruaok
I think we've done everything we can do now. we need to follow up with the archive and the board of directors and see what fallout comes our way.
unless anyone has any questions/comments, lets go on with the usual meeting, I'll take my turn when it comes.
back to freso...
reosarevok
"the perplexing thing is that botnets hit us with a ton of traffic all the time, and we never had an idea why."
Sadly I guess they won't stop because of this, but
Freso
ruaok: Is that your review for the week? If not, go ahead with that. :)
ruaok
k
CatQuest nods
thankfully its not.
reosarevok
Wonder if everyone gets hit with botnets all the time or someone caught this and kept at it
Anyway, sorry, go on ruaok :)
ruaok
last week there was another scare.. I found some LB dump files on the FTP server that looked like private data dumps, but the files were actually empty.
zas and I spent the day fixing that, so that the LB dump scripts are less brittle. that fix is in production as well.
reosarevok
!m zas and you
BrainzBot
You're doing good work, zas and you!
ruaok
I also did a lot of prep for the hack day this weekend. I'll let someone else talk about that one though.
this biggest technical accomplishment came when I got the new MB Mapping working:
given just a few words (sun shines tv) you can find the right track, album and artist.
this was built using typesense, a new fuzzy text indexing engine.
I'm shocked at how well this works and the engine still has some improvements coming that will make this even better.
hopefully I will be able to begin back filling MBIDs into the listen database with the goal of no longer needing to map MSIDs to MBIDs, which will be super exciting.
I'm sure you'll hear more of this as time goes on.
fin. Mr_Monkey?
Mr_Monkey
Hi !
Last week I finished implementing all areas in BookBrainz, reviewed and helped along some PRs for BB and LB, and did some cleanup of database and dependencies.
I spent the rest of the week working on various aspects of LB: tried with alastair and with some measure of success to implement a BrainzPlayer iframe to be used on other Brainz websites.
reosarevok
ruaok: do you see that working well enough to have it on MB proper?