#metabrainz

/

      • darwin
        (won't the owner of dummy.net not appreciate that?)
      • 2016-05-30 15100, 2016

      • darwin
        (why change the email addresses to a routable email at all?)
      • 2016-05-30 15135, 2016

      • D4RK-PH0ENiX has quit
      • 2016-05-30 15158, 2016

      • D4RK-PH0ENiX joined the channel
      • 2016-05-30 15101, 2016

      • D4RK-PH0ENiX has quit
      • 2016-05-30 15133, 2016

      • D4RK-PH0ENiX joined the channel
      • 2016-05-30 15142, 2016

      • pingupingu has quit
      • 2016-05-30 15105, 2016

      • Gore|home has quit
      • 2016-05-30 15117, 2016

      • Gore|home joined the channel
      • 2016-05-30 15147, 2016

      • pingupingu joined the channel
      • 2016-05-30 15115, 2016

      • chirlu has quit
      • 2016-05-30 15125, 2016

      • chirlu joined the channel
      • 2016-05-30 15130, 2016

      • opatel99 has quit
      • 2016-05-30 15115, 2016

      • ariscop has quit
      • 2016-05-30 15113, 2016

      • mihaitish joined the channel
      • 2016-05-30 15123, 2016

      • JesseW joined the channel
      • 2016-05-30 15155, 2016

      • pingupingu has quit
      • 2016-05-30 15116, 2016

      • Mineo joined the channel
      • 2016-05-30 15129, 2016

      • opatel99 joined the channel
      • 2016-05-30 15147, 2016

      • diana_olhovyk joined the channel
      • 2016-05-30 15154, 2016

      • CallerNo6 joined the channel
      • 2016-05-30 15109, 2016

      • regagain joined the channel
      • 2016-05-30 15129, 2016

      • ariscop joined the channel
      • 2016-05-30 15159, 2016

      • JesseW has quit
      • 2016-05-30 15108, 2016

      • Lingo_ joined the channel
      • 2016-05-30 15110, 2016

      • Mineo has quit
      • 2016-05-30 15119, 2016

      • mihaitish has quit
      • 2016-05-30 15125, 2016

      • kanha has quit
      • 2016-05-30 15103, 2016

      • Jormangeud has quit
      • 2016-05-30 15158, 2016

      • Jormangeud joined the channel
      • 2016-05-30 15115, 2016

      • reosarevok
        haha
      • 2016-05-30 15128, 2016

      • reosarevok
        "while I am very happy to see this improvement and grateful for all the efforts that lead to it, I must say that 1 request per second reminds me of my youth, which, sadly, finished before this century"
      • 2016-05-30 15125, 2016

      • reosarevok
      • 2016-05-30 15158, 2016

      • cetko
        alastairp: how can I dump the acousticbrainz lowlevel data into google storage? I tried copying it from Felipe's but I don't have read permissions
      • 2016-05-30 15111, 2016

      • cetko
        I need large data to test the schema
      • 2016-05-30 15119, 2016

      • Lingo_ has quit
      • 2016-05-30 15139, 2016

      • zas
        the rate limiter sucks, we need to work on this. I started some research on it, and a solution based on lua (to rate limit on gateways, as we do atm, to prevent loads on backends), and redis (to ensure atomicity) seems to be the best way. Current rate limiter is not enough flexible and is buggy (it leaks somehow).
      • 2016-05-30 15156, 2016

      • Lingo_ joined the channel
      • 2016-05-30 15139, 2016

      • cetko
        alastairp: ideally, some access to the postgres database or to already dumped json files would be great :)
      • 2016-05-30 15110, 2016

      • mihaitish joined the channel
      • 2016-05-30 15149, 2016

      • alastairp
        cetko: cool!
      • 2016-05-30 15152, 2016

      • alastairp
        let me see
      • 2016-05-30 15136, 2016

      • alastairp
        how much do you want? 1gb, 5gb? 30gb?
      • 2016-05-30 15101, 2016

      • alastairp
      • 2016-05-30 15114, 2016

      • alastairp
        acousticbrainz-lowlevel-json-20150112-json.tar.bz2 is 30gb
      • 2016-05-30 15135, 2016

      • alastairp
        there are 18 incr dumps if you want lots of them
      • 2016-05-30 15103, 2016

      • alastairp
        can you give us a sneak peek at the schema?
      • 2016-05-30 15102, 2016

      • Lingo_ has quit
      • 2016-05-30 15137, 2016

      • Lingo_ joined the channel
      • 2016-05-30 15110, 2016

      • kanha joined the channel
      • 2016-05-30 15130, 2016

      • opatel99 has quit
      • 2016-05-30 15103, 2016

      • LordSputnik
        darwin: well, nothing in the code sends emails, so the user of the dump would have to manually send email there, and they could send email to an arbitrary address without the dump amyway
      • 2016-05-30 15116, 2016

      • regagain has quit
      • 2016-05-30 15122, 2016

      • cetko
        alastairp: this is going to take a while to download XD
      • 2016-05-30 15116, 2016

      • cetko
        but the data is perfect to test
      • 2016-05-30 15137, 2016

      • Lingo_ has quit
      • 2016-05-30 15105, 2016

      • Lingo_ joined the channel
      • 2016-05-30 15150, 2016

      • alastairp
        cetko: yeah. Do you have permission to create a server in the Google console?
      • 2016-05-30 15159, 2016

      • alastairp
        How much does it cost per month?
      • 2016-05-30 15120, 2016

      • alastairp
        A cheap machine with some disk would be fast to upload and download
      • 2016-05-30 15148, 2016

      • cetko
        alastairp: hm, never did that, let me check
      • 2016-05-30 15132, 2016

      • jcazevedo has quit
      • 2016-05-30 15109, 2016

      • jcazevedo joined the channel
      • 2016-05-30 15132, 2016

      • cetko
        Erm, how do you create a server??
      • 2016-05-30 15141, 2016

      • cetko
        in Google Console
      • 2016-05-30 15120, 2016

      • jesus2099 joined the channel
      • 2016-05-30 15124, 2016

      • Leo_Verto has quit
      • 2016-05-30 15104, 2016

      • alastairp
        I'm not actually sure
      • 2016-05-30 15150, 2016

      • mihaitish has quit
      • 2016-05-30 15151, 2016

      • Leo_Verto joined the channel
      • 2016-05-30 15107, 2016

      • jesus2099 joined the channel
      • 2016-05-30 15105, 2016

      • mihaitish joined the channel
      • 2016-05-30 15114, 2016

      • chirlu has quit
      • 2016-05-30 15132, 2016

      • chirlu joined the channel
      • 2016-05-30 15116, 2016

      • Lingo_ has quit
      • 2016-05-30 15102, 2016

      • chirlu has quit
      • 2016-05-30 15121, 2016

      • chirlu joined the channel
      • 2016-05-30 15115, 2016

      • Zialus has quit
      • 2016-05-30 15155, 2016

      • Zialus joined the channel
      • 2016-05-30 15121, 2016

      • chirlu has quit
      • 2016-05-30 15118, 2016

      • chirlu joined the channel
      • 2016-05-30 15125, 2016

      • ocharles_ is now known as ocharles
      • 2016-05-30 15142, 2016

      • ocharles has quit
      • 2016-05-30 15143, 2016

      • ocharles joined the channel
      • 2016-05-30 15127, 2016

      • regagain joined the channel
      • 2016-05-30 15109, 2016

      • ruaok
        cetko: need help still?
      • 2016-05-30 15105, 2016

      • alastairp
        ruaok: I currently have a free trial on ($300, 60 days), and cetko is a member of my project
      • 2016-05-30 15128, 2016

      • alastairp
        thing is, I have no idea what my credit is for. is it only for BQ? the whole compute platform?
      • 2016-05-30 15156, 2016

      • alastairp
        perhaps if MeB credit can also be applied to bigquery it might be a better idea to do that, so that I don't get an awkward bill in August :)
      • 2016-05-30 15109, 2016

      • alastairp
        btw, Felipe is back on the 13th
      • 2016-05-30 15151, 2016

      • ruaok
        perfect, I should have mental capacity by then.
      • 2016-05-30 15111, 2016

      • ruaok
        as for VMs we have one that is under utilized at the moment. what are your needs?
      • 2016-05-30 15140, 2016

      • alastairp
        a little bit of disk space to download a zip file and upload it to storage
      • 2016-05-30 15147, 2016

      • alastairp
        or, we just give him an account on spike
      • 2016-05-30 15104, 2016

      • ruaok
        either is fine by me, no need to spin up a VM for that.
      • 2016-05-30 15105, 2016

      • alastairp
        "little bit" - 50gb
      • 2016-05-30 15129, 2016

      • ruaok
        I bet the transfer will be faster if done from google cloud.
      • 2016-05-30 15140, 2016

      • alastairp
        yeah
      • 2016-05-30 15142, 2016

      • ruaok
        let me create an account for cetko
      • 2016-05-30 15152, 2016

      • ruaok
        cetko: what login do you want?
      • 2016-05-30 15143, 2016

      • jesus2099 has quit
      • 2016-05-30 15113, 2016

      • alastairp
        thanks, ruaok
      • 2016-05-30 15121, 2016

      • alastairp
        you're heading out again this week?
      • 2016-05-30 15123, 2016

      • ruaok
        dn
      • 2016-05-30 15117, 2016

      • ruaok
        yeah, bologna and hippies in the forest starting wednesday. back next... tuesday?
      • 2016-05-30 15139, 2016

      • ruaok
        then I'm in town for 6 weeks and I'm really hoping to be able to buckle down and move some projects forward in that time.
      • 2016-05-30 15145, 2016

      • ruaok
        LB & BQ in particular.
      • 2016-05-30 15154, 2016

      • alastairp
        are we supposed to talk today or tomorrow?
      • 2016-05-30 15109, 2016

      • ruaok
        tomorrow we're on for tag teaming LB PRs
      • 2016-05-30 15113, 2016

      • alastairp
        OK
      • 2016-05-30 15119, 2016

      • alastairp
        are we going to do it here, or over a beer?
      • 2016-05-30 15146, 2016

      • ruaok
        my hope is that when I get back, that i can spin up test.lb.org with all of the PRs and get people to beta test a bit.
      • 2016-05-30 15137, 2016

      • ruaok
        my time is getting short -- my logistics for getting a piece of art to italy with only 1 or 2 pieces of luggage is a challenge that I need to a bit of time today/tomorrow evening.
      • 2016-05-30 15147, 2016

      • alastairp
        ok, no worries
      • 2016-05-30 15152, 2016

      • ruaok
        that said, lets work on the PRs over the course of the way if possible and reserve the beer for when I get back.
      • 2016-05-30 15159, 2016

      • alastairp
        I'm a little busy too, paper deadline is tomorrow evening
      • 2016-05-30 15102, 2016

      • ruaok
        zas arrives in BCN the day after I do.
      • 2016-05-30 15104, 2016

      • alastairp
        and I'm about ready for a lot of it
      • 2016-05-30 15136, 2016

      • ruaok
        ok, hopefully there will be enough time tomorrow to get the PR out.
      • 2016-05-30 15148, 2016

      • alastairp
        we have cool results though
      • 2016-05-30 15156, 2016

      • ruaok
        so, not sure how much time you can spend in early june, but zas and I are going to dockerize a pile of things.
      • 2016-05-30 15112, 2016

      • alastairp
        june is good for me
      • 2016-05-30 15113, 2016

      • ruaok
        results on genre stuff?
      • 2016-05-30 15116, 2016

      • alastairp
        yeah
      • 2016-05-30 15126, 2016

      • ruaok
        cool, can't wait to hear about it.
      • 2016-05-30 15127, 2016

      • alastairp
        e.g. 400000 mbids have annotations in 3 different sources
      • 2016-05-30 15144, 2016

      • alastairp
        except only about half of them have agreement between all those sources
      • 2016-05-30 15144, 2016

      • ruaok
        recording IDs?
      • 2016-05-30 15147, 2016

      • alastairp
        yes
      • 2016-05-30 15104, 2016

      • ruaok
        still, some agreement is far better than none
      • 2016-05-30 15111, 2016

      • alastairp
        so. good luck getting a computer to choose a genre when disogs, allmusic, and itunes disagree on them
      • 2016-05-30 15130, 2016

      • alastairp
        then we're just going to leave an open question :)
      • 2016-05-30 15106, 2016

      • ruaok
        well and no two record shops ever agreed before the digital services came.
      • 2016-05-30 15143, 2016

      • alastairp
        yeah
      • 2016-05-30 15105, 2016

      • alastairp
        allmusic and discogs are pretty cool in this regard, actually
      • 2016-05-30 15118, 2016

      • D4RK-PH0ENiX has quit
      • 2016-05-30 15120, 2016

      • alastairp
        they include descriptions of the labels, enough that you can work out where to put something
      • 2016-05-30 15128, 2016

      • alastairp
        although, perhaps their descriptions of the same label are different
      • 2016-05-30 15150, 2016

      • alastairp
        but still. at least we're not working with 1000 songs any more
      • 2016-05-30 15133, 2016

      • ruaok
        +1000 on that.
      • 2016-05-30 15134, 2016

      • ruaok
        errr.
      • 2016-05-30 15138, 2016

      • ruaok
        +100,000
      • 2016-05-30 15119, 2016

      • alastairp
        + however many annotations we have
      • 2016-05-30 15129, 2016

      • MajorLurker has quit
      • 2016-05-30 15137, 2016

      • ruaok
        :)
      • 2016-05-30 15148, 2016

      • _iwc joined the channel
      • 2016-05-30 15148, 2016

      • _iwc has left the channel
      • 2016-05-30 15152, 2016

      • _iwc joined the channel
      • 2016-05-30 15152, 2016

      • _iwc has left the channel
      • 2016-05-30 15103, 2016

      • _iwc joined the channel