alastairp: I spent some time looking at the results of the acrm_search and found that the pink floyd test case https://datasets.listenbrainz.org/acrm-search?que… that failed was interpreted by the hoster to be TWO queries. See at the bottom.
2020-11-23 32836, 2020
ruaok
removing the comma from the query makes the search succeed. this means that 100% of my test cases for typesense produce the correct result. I'm really stoked now!
2020-11-23 32812, 2020
yvanzo
mo’’in’
2020-11-23 32801, 2020
Gazooo79494 has quit
2020-11-23 32845, 2020
Gazooo79494 joined the channel
2020-11-23 32808, 2020
vintagegold joined the channel
2020-11-23 32846, 2020
vintagegold
Is an artist_msid from ListenBraiz's API the same as a ArtistID from the MB's Database?
2020-11-23 32853, 2020
reosarevok
I think MSID is meant to be just the "messybrainz ID" which only identifies a name string
2020-11-23 32859, 2020
reosarevok
But ruaok can tell you for certain
2020-11-23 32837, 2020
alastairp
hi vintagegold, nice to meet you
2020-11-23 32853, 2020
alastairp
I was CC'd on the emails that ruaok sent you.
2020-11-23 32843, 2020
alastairp
no, a msid (messybrainz id) and an artist mbid (artist musicbrainz id) are different. The reason is that we can't guarantee that people will send us mbid data when they send data to listenbrainz, so we generate a temporary id for it
2020-11-23 32858, 2020
alastairp
we're actively in the process of building tools to link these two identifiers together
2020-11-23 32819, 2020
reg_[m] has quit
2020-11-23 32821, 2020
joshuaboniface has quit
2020-11-23 32827, 2020
goldenshimmer has quit
2020-11-23 32827, 2020
tripathyprateek[ has quit
2020-11-23 32829, 2020
nobodyrocks[m] has quit
2020-11-23 32830, 2020
maverickfox3[m] has quit
2020-11-23 32830, 2020
MagnusSvensson[m has quit
2020-11-23 32831, 2020
maxlath[m] has quit
2020-11-23 32848, 2020
kepstin has quit
2020-11-23 32836, 2020
joshuaboniface joined the channel
2020-11-23 32850, 2020
vintagegold
alastairp reosarevok Hi alastairp nice to meet you too. Okay sounds good, in the mean time I'll use Fuzzy Match or Levensteins Match and see how far I can get with that
2020-11-23 32841, 2020
vintagegold
The matching will be on concat(artist_name,track_name)
alastairp awsome! I am building an idea out for an interactive graph recommendation experience, so I would like to do some testing. Are you okay with me pinging this "endpoint" periodically with a script? I am totally okay with elaborating on the idea if that makes everyone more comfortable
2020-11-23 32844, 2020
vintagegold
more of a music network*
2020-11-23 32804, 2020
alastairp
how much do you think you'll need it? we're using this tool: https://typesense.org/, so we can definitely get our setup instructions to you if you want to build the index yourself
2020-11-23 32823, 2020
alastairp
cool, we're really interested in this kind of navigation/exploration tools
2020-11-23 32805, 2020
vintagegold
Now that I am think about it I can do a smaller test of around 50 artists manually and prove out the concept. Do you mind sending over the set up instructions so familiarize myself and I can follow up next week?
2020-11-23 32814, 2020
vintagegold
alastairp
2020-11-23 32810, 2020
vintagegold
I don't have much experience with Javascript
2020-11-23 32833, 2020
alastairp
sure thing. ruaok set up the typesense server, when he sees this message he'll either be able to send you a link to the instructions, or he will write some instructions and add his code to a repository if he hasn't done that already ;)
2020-11-23 32837, 2020
vintagegold
alastairp Awesome! Looking forward to it :)
2020-11-23 32859, 2020
vintagegold
alastairp You having Portishead as the artist in the "endpoint" got me to listen to their album "Dummy" again :)
2020-11-23 32850, 2020
maxlath[m] joined the channel
2020-11-23 32850, 2020
MagnusSvensson[m joined the channel
2020-11-23 32850, 2020
tripathyprateek[ joined the channel
2020-11-23 32850, 2020
reg[m] joined the channel
2020-11-23 32850, 2020
kepstin joined the channel
2020-11-23 32850, 2020
goldenshimmer joined the channel
2020-11-23 32856, 2020
nobodyrocks[m] joined the channel
2020-11-23 32856, 2020
maverickfox3[m] joined the channel
2020-11-23 32822, 2020
d4rkie has quit
2020-11-23 32859, 2020
Nyanko-sensei joined the channel
2020-11-23 32835, 2020
v6lur joined the channel
2020-11-23 32856, 2020
ruaok
Nice indirect voluntolding, alastairp.
2020-11-23 32832, 2020
ruaok
vintagegold: glad you're here. I'm taking today off, except for some critical items. Happy to help/chat tomorrow.
2020-11-23 32827, 2020
ruaok
And yes, dummy is a sublime piece of work...
2020-11-23 32859, 2020
ruaok
And yes, feel free to hit that endpoint for testing purposes. The web ui has a bug that I plan to fix asap.
2020-11-23 32840, 2020
reosarevok
!m alastairp
2020-11-23 32840, 2020
BrainzBot
You're doing good work, alastairp!
2020-11-23 32853, 2020
reosarevok
That was indeed very good voluntolding
2020-11-23 32835, 2020
vintagegold
ruaok Sounds good, Thursday is best for me, so I will be most active then
2020-11-23 32827, 2020
ruaok
ok, good. I hope things will be a bit more calm by then. loads of things up in the air for me right now.
2020-11-23 32801, 2020
ruaok
this interactive graph recommendation tool... are you planning to make it open source? because we would love love love to have something like that running on listenbrainz.org
2020-11-23 32818, 2020
vintagegold
@Ruaok That's the plan :)
2020-11-23 32801, 2020
ruaok
yay, that's fantastic.
2020-11-23 32839, 2020
ruaok
if you need anyone to help test, post a URL here -- I think there are a few of us who are interested in such projects.
2020-11-23 32846, 2020
vintagegold
ruaok Will do
2020-11-23 32852, 2020
ruaok
bitmap: you about yet?
2020-11-23 32819, 2020
bitmap
ruaok: hey, I'm here
2020-11-23 32849, 2020
SothoTalKer has quit
2020-11-23 32848, 2020
SothoTalKer joined the channel
2020-11-23 32840, 2020
SothoTalKer has quit
2020-11-23 32800, 2020
SothoTalKer joined the channel
2020-11-23 32810, 2020
CatQuest
ok guise this is kinda crazy but a book i just read yesterday actually used the term "voluntold" :O
2020-11-23 32818, 2020
CatQuest
fiction/fantasy book
2020-11-23 32801, 2020
ruaok
Freso: ping
2020-11-23 32814, 2020
Freso
ruaok: pong
2020-11-23 32816, 2020
CatQuest
still 10 min?
2020-11-23 32832, 2020
ruaok
I'd like to go first today, there is something import to discuss.
I haven’t received any mailed in reports, but Rob has requested to go first, so…
2020-11-23 32805, 2020
Freso
ruaok: Go!
2020-11-23 32806, 2020
Freso
(Others up tonight: yvanzo, bitmap, Freso, zas, reosarevok, alastairp, Mr_Monkey, CatQuest, shivam-kapila, _lucifer, jmp_music – anyone else who wants to give review, let me know ASAP!)
is our complete write up of what happened and how we've arrived at this point.
2020-11-23 32824, 2020
ruaok
I hope the blog post covers the critical details.
2020-11-23 32859, 2020
ruaok
bitmap: reosarevok: care to add anything?
2020-11-23 32803, 2020
ruaok
questions?
2020-11-23 32819, 2020
reosarevok
Other than "sorry we missed that bug", not a lot :/
2020-11-23 32826, 2020
bitmap
just to sorry that I'm deeply sorry for anyone affected and we're working to ensure it doesn't happen again
2020-11-23 32836, 2020
ruaok
the perplexing thing is that botnets hit us with a ton of traffic all the time, and we never had an idea why.
2020-11-23 32842, 2020
ruaok
now we know.
2020-11-23 32842, 2020
bitmap
and I can help answer any questions not covered in the blog post
2020-11-23 32854, 2020
ruaok
CatQuest: ops, sorry, quite possible. :(
2020-11-23 32805, 2020
CatQuest
:(
2020-11-23 32831, 2020
yvanzo
Same statement: deeply sorry to have missed that for so long.
2020-11-23 32848, 2020
ruaok
I think we've done everything we can do now. we need to follow up with the archive and the board of directors and see what fallout comes our way.
2020-11-23 32821, 2020
ruaok
unless anyone has any questions/comments, lets go on with the usual meeting, I'll take my turn when it comes.
2020-11-23 32829, 2020
ruaok
back to freso...
2020-11-23 32841, 2020
reosarevok
"the perplexing thing is that botnets hit us with a ton of traffic all the time, and we never had an idea why."
2020-11-23 32849, 2020
reosarevok
Sadly I guess they won't stop because of this, but
2020-11-23 32853, 2020
Freso
ruaok: Is that your review for the week? If not, go ahead with that. :)
2020-11-23 32802, 2020
ruaok
k
2020-11-23 32803, 2020
CatQuest nods
2020-11-23 32807, 2020
ruaok
thankfully its not.
2020-11-23 32819, 2020
reosarevok
Wonder if everyone gets hit with botnets all the time or someone caught this and kept at it
2020-11-23 32824, 2020
reosarevok
Anyway, sorry, go on ruaok :)
2020-11-23 32834, 2020
ruaok
last week there was another scare.. I found some LB dump files on the FTP server that looked like private data dumps, but the files were actually empty.
2020-11-23 32803, 2020
ruaok
zas and I spent the day fixing that, so that the LB dump scripts are less brittle. that fix is in production as well.
2020-11-23 32821, 2020
reosarevok
!m zas and you
2020-11-23 32821, 2020
BrainzBot
You're doing good work, zas and you!
2020-11-23 32826, 2020
ruaok
I also did a lot of prep for the hack day this weekend. I'll let someone else talk about that one though.
2020-11-23 32852, 2020
ruaok
this biggest technical accomplishment came when I got the new MB Mapping working:
given just a few words (sun shines tv) you can find the right track, album and artist.
2020-11-23 32836, 2020
ruaok
this was built using typesense, a new fuzzy text indexing engine.
2020-11-23 32800, 2020
ruaok
I'm shocked at how well this works and the engine still has some improvements coming that will make this even better.
2020-11-23 32832, 2020
ruaok
hopefully I will be able to begin back filling MBIDs into the listen database with the goal of no longer needing to map MSIDs to MBIDs, which will be super exciting.
2020-11-23 32842, 2020
ruaok
I'm sure you'll hear more of this as time goes on.
2020-11-23 32846, 2020
ruaok
fin. Mr_Monkey?
2020-11-23 32853, 2020
Mr_Monkey
Hi !
2020-11-23 32809, 2020
Mr_Monkey
Last week I finished implementing all areas in BookBrainz, reviewed and helped along some PRs for BB and LB, and did some cleanup of database and dependencies.
2020-11-23 32826, 2020
Mr_Monkey
I spent the rest of the week working on various aspects of LB: tried with alastair and with some measure of success to implement a BrainzPlayer iframe to be used on other Brainz websites.
2020-11-23 32835, 2020
reosarevok
ruaok: do you see that working well enough to have it on MB proper?
