#metabrainz

Hi!

I discussed my project with gentlecat and received some good advices on how to improve te proposal

started to look into the jira system and identified somo issues that are related to datasets in AcousticBrainz

Freso: whoops, at 8:55 I forgot :)

I can go at end

alastairp: 👍

alastairp: You're after Leftmost then.

hellska: fin?

I guess so.

aaaa sorry I went offline :(

Ah.

jazztel!

… yess :(

snap

well … to finish

I’m working with the AcousticBrainz server and sterted creating my development environment

(alastairp that is)

I think it’s all for this week :)

Great. Thanks hellska_ :)

oh you already got fiber?

cetko: Hi! Go! :)

Hi, I'm Goran from Croatia but people call me cetko (tsetko). I'll be working on AcousticBrainz BigQuery data exploration this summer with alastairp as mentor. I'm in the middle of my midterm exams this week so my focus has mostly been on surviving that. Once that's done I'll discuss the account setup with alastair for BigQuery to play around and start working on the db schema design.

wrote ahead :D

ruaok: without interrupting the meeting too much more, great. fast, stable, fijo works well

cetko: Good plan ;)

cool

alastairp: +1 same here

cetko: we have more work for you.

keep in touch. I'm always here

because clearly the BigQuery stuff is far easier than alastairp and I expected.

cetko: we hosted a bigquer developer advocate last week

but that is good. :)

I'll talk about it on my turn

+1

cetko: You got my e-mail, right? It'd be great to have you hang around the channel more, when you're free. :)

Anyway, thanks!

ok, let me know. I guess that's it from me for now

This was our 6 GSoC students everyone!

I'm usually on irc but sometimes the server reboots

I am left Freso :(

Oh, dammit.

kartikgupta0909: Go go go!

And hi :D

Hi

finished off with my exams last week

this week i plan to get AB-63 merged

after which we will have a nice page on acousticbrainz which will show a list of all public datasets

and also finalize everything about the project with alastairp

👍

Sounds good. :)

and finaly write a blog about my project

Thats it

Great. Thanks. :)

And *that* was our six GSoC students!

Freso: are we doing student blogs this year?

Hi to you all again. :)

alastairp: Don't know. Let's talk later/post-meeting.

Leftmost: Go.

Freso actually did remove me from the list and then add me back. I didn’t expect that. :)

Freso: fine

Leftmost: ;)

Lots of work on the underpinnings of the BB site code this week. A few wins as far as user experience, but it will also make it much easier to improve things going forward. Going to try to release those changes in the next couple days.

I mostly procrastinated on my schema change ticket, as I’m finding it a bit frustrating to find all the places that barcodes are pulled in, but I think I just need to make another run through and fix up tests and the WS and then it's review time.

Fin.

alastairp: Go.

not much wrt AB server this week, I reviewed a few of Gentlecat's patches, will do more later this week

now that we have SoC students, there's a bit of planning of things to do

Leftmost: yeah, just submit what you have even if you're not sure

some people saw filipe around last week, he's a developer advocate at google and was in Barcelona, so he and ruaok and Gentlecat hung out for a few hours

that was really fun. :)

alastairp: did you solve the hl_calc issue on spike ?

basically, it took us about 20 minutes to import all of acousticbrainz into google bigquery

Whoa.

and now we can do queries like this: http://demo.redash.io/embed/query/1571/visualiz...

which is key vs release year

we also got some really cool correlation plots between things like loudness and bpm grouped by genre

takes about 4 seconds to do a query, but in the current way we have it set up, eats through about 80GB of data processing it :/

first job for cetko is to write a schema which will get that down to <50MB for a similar query

oy

MSD rescue is done

!m alastairp

You're doing good work, alastairp!

zas: it's on my list for this week, I guess hl_calc isn't deleting temp files after creating them, but a quick look at the code didn't show anything out of place. I'll see

fin

Alright. Thanks everyone. :)

I don't have much concrete to say about it at this point, but I wanted to direct people to https://community.metabrainz.org/t/single-sign-... for some brainstorming on what it should look like.

I suspect it will be schema change-y, so I'd like to gather a bunch of feedback and then I might start working on a prototype to see what's feasible and what isn't. If anyone else wants to help out, that'd be much appreciated. :)

That's all I have to say on it for now, not sure if anyone else wants to chip in.

Alright. Thanks for doing this legwork, Leftmost. :)

zas: New Search Server (NSS?)

Well, what's the alternative plan ? weeksio will not work on it if i understood, and our old servers are ..

and me, I suspect.

yeah, let me set the stage...

so, weeksio emailed me with a predicament... he was offered an internship locally to where he lives.

KodeStar: I'm pretty sure we'd be open to let other projects use it. We currently use OAuth2 which anyone can ping against.

and he felt that that was a better opportunity for him.

which made me sad, but in the grand scheme of things, I understand.

^ this is something I'd like to write a "state of the <thingy>" post for

I did, however, basically make it clear to him that we needed undivided attention on this project.

Freso: will the sso replace OAuth2 or will they both run concurrently?

KodeStar: E.g., AcoustID.org can use MB OAuth for logging in.

because this is a really big problem for us now.

KodeStar: Participate in the thread on the forum and ask. :)

Freso: roger that

that said, I might just need to bit the bullet and take on this project myself.

once I submit the PR for http://tickets.musicbrainz.org/browse/MBS-8736 it'll be much easier for me to do dev stuff with the search server, too

It is especially a big problem with the move to NewHost

so, my hope is that if armalcolite can run with LB, then I can focus on tackling the last bits that are missing for the SOLR stuff.

zas: the move to NewHost needs to have the SOLR stuff in place, without a doubt.

zas and I started looking at the search stuff again, trying another approach to try and understand what is happening.

perhaps we can buy ourselves some time, but I doubt it.

(Off topic but someone relatedly, I'm really excited to see where Music/MetaBrainz is at come Summer 2017. :))

mostly I feel that I need to devote some of my time toward this ugly wart of ours.

ruaok: sure. (i would be taking some time before going into coding mode. Want to enjoy a bit after the exams :) )

armalcolite: as you should. let's discuss tomorrow.

but there are a lot of plans for LB as well.

ruaok: ok.

so, really I can't give very concrete plans on the search stuff just yet, but perhaps in 2 weeks time we can have a better view of what is going to happen.

ruaok: (i would be taking some time before going into coding mode. Want to enjoy a bit after the exams :) )

in the meantime... use the biggest hammer you have zas.

I'll have all the amenities you'd like once you get to BCN, zas.

Ok. ;)

I'm also stoked that zas and bitmap are coming for social visits this month!

next?

Me too :)

Freso: that might actually work!

Anyway.

Freso / reosarevok: AE elections.

So.

reosarevok had a bit of talk yesterday about the current situation with AE election.

Summary and our proposed "workflow"/temp. system can be seen at...

New temp. AE election system:

1) Proposer creates elections and adds post in AE category.

2) You mail out to all AEs with a link to the election topic (and a link to the blog post, if we make one, to explain the current situation?).

3) Proposer/you/me/AEs update the thread when status of the election changes (2nders found, passed, rejected).