#metabrainz

/

      • forumulator__ joined the channel
      • 2016-03-01 06104, 2016

      • forumulator__ has quit
      • 2016-03-01 06104, 2016

      • ashutoshsaboo joined the channel
      • 2016-03-01 06131, 2016

      • ashutoshsaboo
        Hi. For solving the issues mentioned here - http://tickets.musicbrainz.org/browse/AB . Do I need to set up https://github.com/MTG/essentia or https://github.com/metabrainz/acousticbrainz-serv… for solving these issues? Could someone help me out?
      • 2016-03-01 06126, 2016

      • ashutoshsaboo
        I can't find any link mentioned online, as to how to set up AcousticBrainz, or MusicBrainz on linux, without a VM? Any help would be appreciated! :)
      • 2016-03-01 06118, 2016

      • umeshksingla has quit
      • 2016-03-01 06150, 2016

      • umeshksingla joined the channel
      • 2016-03-01 06155, 2016

      • umeshksingla has quit
      • 2016-03-01 06141, 2016

      • ariscop joined the channel
      • 2016-03-01 06107, 2016

      • ashutoshsaboo has quit
      • 2016-03-01 06158, 2016

      • ashutoshsaboo joined the channel
      • 2016-03-01 06129, 2016

      • UmkaDK_ has quit
      • 2016-03-01 06155, 2016

      • UmkaDK joined the channel
      • 2016-03-01 06134, 2016

      • bee2502_ joined the channel
      • 2016-03-01 06100, 2016

      • LordSputnik
        ashutoshsaboo: most of those will be for the acousticbrainz server
      • 2016-03-01 06126, 2016

      • bee2502_
        Hi , I am Bhagyashree(Bee). I am interested in contributing to MusicBrainz for GSoC. My previous work has been in Data Analytics - including Machine Learning,social media analytics and NLP and I can program well in Python , C++
      • 2016-03-01 06137, 2016

      • ruaok
        sigh.
      • 2016-03-01 06148, 2016

      • ruaok
        summer of code spams.
      • 2016-03-01 06118, 2016

      • ruaok
        "how do I increase my chances of getting this project" in a private message. sigh. read the application template that tells you to NOT do that.
      • 2016-03-01 06135, 2016

      • ruaok
        all potential GSoC Applicants: ^^
      • 2016-03-01 06121, 2016

      • LordSputnik
        bee2502_: great!
      • 2016-03-01 06105, 2016

      • bee2502_
        I was hoping someone could help me get started - I like multiple project ideas currently including AcousticBrainz, social media features for MusicBrainz and statistics
      • 2016-03-01 06119, 2016

      • bee2502_
        LordSputnik ^
      • 2016-03-01 06127, 2016

      • UmkaDK has quit
      • 2016-03-01 06129, 2016

      • LordSputnik
      • 2016-03-01 06142, 2016

      • LordSputnik
        that should help you get started
      • 2016-03-01 06127, 2016

      • LordSputnik
        if you want to know more about the projects, I'd suggest just taking a look around the websites :)
      • 2016-03-01 06123, 2016

      • LordSputnik
        I've got a couple more ideas to add for BookBrainz, which'll hopefully be added today
      • 2016-03-01 06151, 2016

      • bee2502_
        LordSputnik : I see. I was hoping you could provide me with a link to the API documentation for fetching AcousticBrainz/ListenBrainz data ?
      • 2016-03-01 06106, 2016

      • bee2502_
        Also, do you have any suggestions for the initial contributions ? I am interested in the data analytics projects rather than development and I was hoping to do some basic data analytics with the data as an initial contribution
      • 2016-03-01 06115, 2016

      • bee2502_
        What are your thoughts on this ?
      • 2016-03-01 06146, 2016

      • bee2502_
        ruoak ,alastairp ^
      • 2016-03-01 06158, 2016

      • bee2502_
        *ruaok ^^
      • 2016-03-01 06139, 2016

      • ruaok
        bee2502_: you should really be able to find the API docs for fetching AcousticBrainz data.
      • 2016-03-01 06124, 2016

      • ruaok
        if you can't, you're not qualified to be participating in GSoC.
      • 2016-03-01 06122, 2016

      • bee2502_
        ruaok : yeah, sorry, I did
      • 2016-03-01 06152, 2016

      • ruaok
        and really, we want ideas and projects to come from people in the community.
      • 2016-03-01 06104, 2016

      • ruaok
        we don't really want to tell people what to do.
      • 2016-03-01 06112, 2016

      • ruaok
        we want to hear what YOU want to do.
      • 2016-03-01 06122, 2016

      • ashutoshsaboo has quit
      • 2016-03-01 06108, 2016

      • bee2502_
        hmm - I see.
      • 2016-03-01 06139, 2016

      • ruaok
        until your application is accepted, you should be wooing us with your amazing skills. you should NOT be asking us for help.
      • 2016-03-01 06114, 2016

      • Nyanko-sensei joined the channel
      • 2016-03-01 06143, 2016

      • D4RK-PH0ENiX has quit
      • 2016-03-01 06103, 2016

      • UmkaDK joined the channel
      • 2016-03-01 06121, 2016

      • a_k joined the channel
      • 2016-03-01 06148, 2016

      • a_k
        hey, i just read about musicbrainz from https://wiki.musicbrainz.org/Development/Summer_o…. can someone pl tell me what to do next?
      • 2016-03-01 06102, 2016

      • ruaok
        yes, I'm actually interested in that. thanks!
      • 2016-03-01 06108, 2016

      • ruaok might actually apply
      • 2016-03-01 06154, 2016

      • Leftmost
        It'd put you awful close to reo, though.
      • 2016-03-01 06157, 2016

      • reosarevok
        They do say they "prefer Nordic countries" but we also "prefer performers as recording artists for classical" and it only happens half of the time, so :p
      • 2016-03-01 06107, 2016

      • reosarevok
        I'd say you might as well give it a shot
      • 2016-03-01 06105, 2016

      • reosarevok
        Unrelatedly, sigh, I'm still getting newsletters from my Dutch bank. I wonder if they haven't closed my account even 6 years later
      • 2016-03-01 06120, 2016

      • reosarevok hopes he doesn't unknowingly owe a ton of fees to ING
      • 2016-03-01 06112, 2016

      • alastairp
        schrodinger's fees
      • 2016-03-01 06105, 2016

      • alastairp
        you either owe nothing, or are responsible for the entire european economic downturn, but you won't know until you ask
      • 2016-03-01 06120, 2016

      • gcilou has quit
      • 2016-03-01 06144, 2016

      • reosarevok
        I mean, I'm not going to ask :D
      • 2016-03-01 06151, 2016

      • reosarevok
        I just hope I never get a legal letter from them
      • 2016-03-01 06155, 2016

      • a_k
        hey, i just read about musicbrainz from https://wiki.musicbrainz.org/Development/Summer_o…. can someone pl tell me what to do next?
      • 2016-03-01 06128, 2016

      • reosarevok
        Well, think what you'd be interested in doing and able to do I guess? That's a very generic question :)
      • 2016-03-01 06153, 2016

      • ruaok
        reosarevok: I can play up that I am half Danish. :)
      • 2016-03-01 06159, 2016

      • reosarevok
        haha
      • 2016-03-01 06109, 2016

      • reosarevok
        Good luck with that :)
      • 2016-03-01 06110, 2016

      • ruaok
        a_k: No, you should tell us what you want to do.
      • 2016-03-01 06114, 2016

      • ruaok
        reosarevok: :)
      • 2016-03-01 06152, 2016

      • a_k
        i know python and found ListenBrainz: Statistics and ListenBrainz: A submission API compatible with Last.fm scrobblers interesting
      • 2016-03-01 06159, 2016

      • a_k
        ruaok:
      • 2016-03-01 06131, 2016

      • ruaok
        a_k: you're still not telling me what you want to do. what do you want to do?
      • 2016-03-01 06105, 2016

      • a_k
        ruaok: i want to contribute to these projects
      • 2016-03-01 06122, 2016

      • ruaok
        how do you want to contribute to these projects. and please don't tell me that you want to write code to make us happy.
      • 2016-03-01 06119, 2016

      • a_k
        help in solving bugs i guess, i am not sure
      • 2016-03-01 06131, 2016

      • a_k
        ruaok:
      • 2016-03-01 06157, 2016

      • ruaok
        ok, please come back when you are sure of what you want to do.
      • 2016-03-01 06131, 2016

      • a_k
        can you tell me the ways to contribute
      • 2016-03-01 06150, 2016

      • Gentlecat
        there's information about that in the wiki, you should read it first
      • 2016-03-01 06102, 2016

      • Gentlecat
        find a project you are interested in, try to install it
      • 2016-03-01 06138, 2016

      • Gentlecat
        if you can't do that, you'll have a hard time later
      • 2016-03-01 06148, 2016

      • rahulr has quit
      • 2016-03-01 06130, 2016

      • alastairp deletes migrated AB database
      • 2016-03-01 06131, 2016

      • alastairp
        sigh
      • 2016-03-01 06150, 2016

      • Gentlecat
        ?
      • 2016-03-01 06106, 2016

      • alastairp
        I didn't fill in the 'created' time correctly. it was set to now()
      • 2016-03-01 06127, 2016

      • alastairp
        so all submissions in AB are now created between 26th and 27th of feb
      • 2016-03-01 06129, 2016

      • alastairp
        this year
      • 2016-03-01 06131, 2016

      • alastairp
        *all* of them
      • 2016-03-01 06123, 2016

      • alastairp
        how did I miss that?
      • 2016-03-01 06140, 2016

      • alastairp
        ah, actually. ids are the same. I should be able to copy them over
      • 2016-03-01 06120, 2016

      • jesus2099 joined the channel
      • 2016-03-01 06140, 2016

      • ruaok
        alastairp: :( bummer.
      • 2016-03-01 06128, 2016

      • alastairp
        ruaok: I think it's OK. I *did* copy ids manually instead of using the sequence, so they should be the same in both databases. I'll just copy the created time over
      • 2016-03-01 06125, 2016

      • Nyanko-sensei has quit
      • 2016-03-01 06152, 2016

      • D4RK-PH0ENiX joined the channel
      • 2016-03-01 06122, 2016

      • hitesh96db joined the channel
      • 2016-03-01 06153, 2016

      • ruaok
        alastairp: I wonder if that will be faster than re-doing the migration.
      • 2016-03-01 06102, 2016

      • alastairp
        I think so
      • 2016-03-01 06112, 2016

      • alastairp
        because it's just ("just") 3 million inserts
      • 2016-03-01 06116, 2016

      • ruaok
        ok, I think the first version of my presentation to the EC is ready-enough.
      • 2016-03-01 06120, 2016

      • ruaok
        "just"
      • 2016-03-01 06123, 2016

      • jesus2099 has left the channel
      • 2016-03-01 06137, 2016

      • D4RK-PH0ENiX has quit
      • 2016-03-01 06138, 2016

      • alastairp
        whereas the migration is select, split, alter, re-encode, insert 20 rows, repeat 3 million times
      • 2016-03-01 06114, 2016

      • ruaok
        the only thing slow about that is the insert.
      • 2016-03-01 06120, 2016

      • ruaok
        and I think insert is still faster than update.
      • 2016-03-01 06126, 2016

      • alastairp
        right
      • 2016-03-01 06131, 2016

      • ruaok
        I'm really curious about this. keep track of the time, please?
      • 2016-03-01 06133, 2016

      • alastairp
        let me try it
      • 2016-03-01 06144, 2016

      • ruaok
        of course. this is great learning.
      • 2016-03-01 06141, 2016

      • ruaok
        Gentlecat, zas: invoices please.
      • 2016-03-01 06123, 2016

      • alastairp
        ruaok: huh
      • 2016-03-01 06139, 2016

      • alastairp
        so, I think it was about 30 seconds per 1000 rows to insert
      • 2016-03-01 06145, 2016

      • alastairp
        update is about 10s
      • 2016-03-01 06105, 2016

      • hitesh96db has quit
      • 2016-03-01 06120, 2016

      • D4RK-PH0ENiX joined the channel
      • 2016-03-01 06122, 2016

      • alastairp
        though I'm doing 1000 updates in a transaction then moving on. I wonder if it would be faster if I did one query per 1000 items
      • 2016-03-01 06124, 2016

      • hitesh96db joined the channel
      • 2016-03-01 06114, 2016

      • ruaok
        Freso: where is that GSoC flow chart from last year?
      • 2016-03-01 06115, 2016

      • ruaok
        we need it.
      • 2016-03-01 06146, 2016

      • alastairp
        ruaok: also, I had no indexes, pk, or fk during the insert, but I do now for the update
      • 2016-03-01 06151, 2016

      • alastairp
        perhaps that's related
      • 2016-03-01 06157, 2016

      • alastairp
        I wonder if there's an index on created
      • 2016-03-01 06136, 2016

      • ruaok
        that has a drastic impact on the speed of things.
      • 2016-03-01 06150, 2016

      • ruaok
        which is exactly why a re-migration might just be simpler.
      • 2016-03-01 06152, 2016

      • alastairp
        huh. there's not. that's actually a mistake, but I guess it'll be faster
      • 2016-03-01 06159, 2016

      • ruaok
        either that or drop the index and then re-created.
      • 2016-03-01 06123, 2016

      • alastairp
        anyway, update is 3x faster than migration, so I'll leave it running
      • 2016-03-01 06137, 2016

      • alastairp
        although I kinda hoped it would have been 10x faster :)
      • 2016-03-01 06135, 2016

      • reosarevok
        ruaok: thanks for the money! :)
      • 2016-03-01 06143, 2016

      • reosarevok buys tickets for La traviata tomorrow
      • 2016-03-01 06147, 2016

      • ruaok
        :)
      • 2016-03-01 06130, 2016

      • ruaok
        me neither. forward to reosarevok? he's seems to deal well with these kinds of emails. :)
      • 2016-03-01 06144, 2016

      • reosarevok shudders
      • 2016-03-01 06119, 2016

      • alastairp
        I don't even recognise the result format. is it search server json?
      • 2016-03-01 06157, 2016

      • alastairp
        reosarevok: email?
      • 2016-03-01 06104, 2016

      • reosarevok
        My nick at meb
      • 2016-03-01 06115, 2016

      • rahulr joined the channel
      • 2016-03-01 06119, 2016

      • ruaok
        ok, time to run off to the EC. I even polished my shoes!!! :)
      • 2016-03-01 06106, 2016

      • Gentlecat
        good luck
      • 2016-03-01 06113, 2016

      • ruaok
        thanks.
      • 2016-03-01 06120, 2016

      • alastairp
        hmm. it's slowing down :-P
      • 2016-03-01 06130, 2016

      • ruaok
        I'mn tempted to plaster the EC meeting rooms with MB stickers. :)
      • 2016-03-01 06137, 2016

      • alastairp
        I'll leave it running for a few hours, and see if it's worth re-importing instead
      • 2016-03-01 06102, 2016

      • ruaok
        alastairp: keep me posted, please
      • 2016-03-01 06106, 2016

      • ruaok is off
      • 2016-03-01 06137, 2016

      • alastairp
        oooh
      • 2016-03-01 06122, 2016

      • alastairp drops the date column, creates a new table with just the date, then creates a new table as a join query on both tables
      • 2016-03-01 06118, 2016

      • Gentlecat
        💥
      • 2016-03-01 06136, 2016

      • alastairp
        it's still kinda slow
      • 2016-03-01 06102, 2016

      • alastairp
        acousticbrainz=> \copy ll_submitted from 'submitted_times.csv' with csv;
      • 2016-03-01 06102, 2016

      • alastairp
        COPY 3508050