#metabrainz

/

      • ariscop joined the channel
      • 2016-10-03 27724, 2016

      • colbydray has quit
      • 2016-10-03 27705, 2016

      • JonnyJD_ has quit
      • 2016-10-03 27714, 2016

      • grough has quit
      • 2016-10-03 27718, 2016

      • ariscop has quit
      • 2016-10-03 27750, 2016

      • Slurpee has quit
      • 2016-10-03 27706, 2016

      • Gore|home has quit
      • 2016-10-03 27737, 2016

      • Gore|home joined the channel
      • 2016-10-03 27753, 2016

      • D4RK-PH0ENiX has quit
      • 2016-10-03 27719, 2016

      • D4RK-PH0ENiX joined the channel
      • 2016-10-03 27700, 2016

      • inquiry-theory joined the channel
      • 2016-10-03 27722, 2016

      • mihaitish joined the channel
      • 2016-10-03 27718, 2016

      • JesseW has quit
      • 2016-10-03 27735, 2016

      • mihaitish has quit
      • 2016-10-03 27755, 2016

      • dboys joined the channel
      • 2016-10-03 27712, 2016

      • inquiry-theory has quit
      • 2016-10-03 27734, 2016

      • mihaitish joined the channel
      • 2016-10-03 27756, 2016

      • mihaitish has quit
      • 2016-10-03 27728, 2016

      • jesus2099 joined the channel
      • 2016-10-03 27712, 2016

      • jesus2099 has quit
      • 2016-10-03 27751, 2016

      • mihaitish joined the channel
      • 2016-10-03 27718, 2016

      • dboys has quit
      • 2016-10-03 27757, 2016

      • dboys_ joined the channel
      • 2016-10-03 27721, 2016

      • alastairp
        Gentlecat: hi
      • 2016-10-03 27719, 2016

      • Gentlecat
      • 2016-10-03 27725, 2016

      • alastairp
      • 2016-10-03 27727, 2016

      • alastairp
        merging this
      • 2016-10-03 27734, 2016

      • alastairp
        and adding some extra tests, validation
      • 2016-10-03 27748, 2016

      • alastairp
        I just had a thought that /recordings isn't a great endpoint name
      • 2016-10-03 27758, 2016

      • alastairp
        especially since this is getting low-level stuff
      • 2016-10-03 27701, 2016

      • alastairp
        any thoughts?
      • 2016-10-03 27742, 2016

      • alastairp
        we kind of already hashed this out: https://github.com/metabrainz/acousticbrainz-serv…
      • 2016-10-03 27754, 2016

      • Gentlecat
        if I wasn't looking at the docs I'd just expect this to return either summary of recordings or all data that we have on them
      • 2016-10-03 27749, 2016

      • alastairp
        GET /api/v1/low-level?ids=
      • 2016-10-03 27750, 2016

      • alastairp
        perhaps
      • 2016-10-03 27710, 2016

      • alastairp
        similar to the existing GET /api/v1/(uuid: mbid)/low-level
      • 2016-10-03 27711, 2016

      • Gentlecat
        recording_ids
      • 2016-10-03 27716, 2016

      • alastairp
        better
      • 2016-10-03 27723, 2016

      • Mineo
        the list of open pull requests for picard at https://github.com/metabrainz/picard/pulls has been slowly (but unfortunately steadily ☹ ) growing, with a lot of pull requests tagged "Decision Required" with just 1 or 2 persons giving feedback. if anyone of you (even as a user, not developer of picard) could spare a few minutes to look at them, that would be great!
      • 2016-10-03 27735, 2016

      • Gentlecat
        I'd still love to be able to reference each submission
      • 2016-10-03 27740, 2016

      • Gentlecat
        without an offset
      • 2016-10-03 27748, 2016

      • alastairp
        we *do* have row ids
      • 2016-10-03 27752, 2016

      • Gentlecat
        pretty sure it would be useful for dataset stuff too
      • 2016-10-03 27754, 2016

      • alastairp
        what's your usecase?
      • 2016-10-03 27701, 2016

      • Gentlecat
        are they UUIDs?
      • 2016-10-03 27704, 2016

      • alastairp
        no
      • 2016-10-03 27707, 2016

      • alastairp
        just ints
      • 2016-10-03 27729, 2016

      • alastairp
        in datasets I do think it would be a good idea to use row ids in some places
      • 2016-10-03 27729, 2016

      • Gentlecat
        for example using a specific submission to train a model
      • 2016-10-03 27740, 2016

      • alastairp
        I see it like this:
      • 2016-10-03 27704, 2016

      • alastairp
        a dataset contains mbids, and a filter function, to choose a specific duplicate
      • 2016-10-03 27726, 2016

      • alastairp
        which could be first submitted, first flac, etc
      • 2016-10-03 27741, 2016

      • alastairp
        apply mbid + rule -> ids -> snapshot
      • 2016-10-03 27748, 2016

      • alastairp
        so that snapshot always stays the same
      • 2016-10-03 27700, 2016

      • Gentlecat
        right
      • 2016-10-03 27704, 2016

      • alastairp
        but applying the same rules to the same dataset later may result in a different snapshot
      • 2016-10-03 27728, 2016

      • Gentlecat
        so I guess what I have in mind is one of those rules
      • 2016-10-03 27747, 2016

      • Gentlecat
        use a specific submission for this recording
      • 2016-10-03 27700, 2016

      • Gentlecat
        if I want to build a model just with my own data
      • 2016-10-03 27703, 2016

      • alastairp
        they're definitely important. I'd like to see a rule which pre-filters submissions to remove obviously incorrect songs
      • 2016-10-03 27705, 2016

      • Gentlecat
        what do you mean by incorrect?
      • 2016-10-03 27707, 2016

      • alastairp
        right
      • 2016-10-03 27728, 2016

      • alastairp
        someone may have submitted a track with the wrong mbid
      • 2016-10-03 27747, 2016

      • alastairp
      • 2016-10-03 27751, 2016

      • Gentlecat
        so there needs to be some kind of system for manually reporting incorrect data?
      • 2016-10-03 27703, 2016

      • alastairp
        first I want to look at doing it automatically
      • 2016-10-03 27721, 2016

      • alastairp
        we can do basic stuff - track length, beat positions, chroma
      • 2016-10-03 27710, 2016

      • Gentlecat
        I wanted to do something similar on a recording page, but just as a visualization
      • 2016-10-03 27722, 2016

      • alastairp
        cool, let's do that then :D
      • 2016-10-03 27724, 2016

      • Gentlecat
        how different all the submissions are, an actual summary
      • 2016-10-03 27731, 2016

      • alastairp
      • 2016-10-03 27735, 2016

      • Gentlecat
        well...
      • 2016-10-03 27743, 2016

      • alastairp
        it was one of the projects I set last year for amplab
      • 2016-10-03 27700, 2016

      • Gentlecat
        oh, I must have forgot about it :)
      • 2016-10-03 27727, 2016

      • Gentlecat
        and I assume nobody tried that, right?
      • 2016-10-03 27739, 2016

      • alastairp
        we had a few people do some really basic analysis
      • 2016-10-03 27759, 2016

      • alastairp
        but not in a form that we could run it on the server
      • 2016-10-03 27723, 2016

      • alastairp
        let's wait until I get the data into bigquery. it might be able to do it all for us
      • 2016-10-03 27725, 2016

      • Gentlecat
        sure
      • 2016-10-03 27717, 2016

      • Gentlecat
        is there a ticket for filtering out recordings for which we don't have data yet?
      • 2016-10-03 27747, 2016

      • alastairp
        what do you mean? in the dataset?
      • 2016-10-03 27754, 2016

      • alastairp
        I don't think so
      • 2016-10-03 27707, 2016

      • alastairp
        I had wanted to do that with the metadata changes I made, but I've not done them either :(
      • 2016-10-03 27705, 2016

      • alastairp
        actually, we could do it separately. Just have a [x] Ignore recordings which don't exist in AB, right?
      • 2016-10-03 27725, 2016

      • Freso
        Mineo: I'm about to head to the office. I'll try and take some time to look them over once I'm there.
      • 2016-10-03 27725, 2016

      • Gentlecat
        right, that's what I meant
      • 2016-10-03 27739, 2016

      • Gentlecat
        some people asked for that too
      • 2016-10-03 27759, 2016

      • Freso was one of those
      • 2016-10-03 27721, 2016

      • alastairp
        in fact, I think it should be the default
      • 2016-10-03 27726, 2016

      • alastairp
        is that something you want to look at?
      • 2016-10-03 27747, 2016

      • Gentlecat
        not really :)
      • 2016-10-03 27754, 2016

      • alastairp
        👍
      • 2016-10-03 27703, 2016

      • alastairp
        I have a new masters student working for me
      • 2016-10-03 27712, 2016

      • alastairp
        perhaps it's a good intro to the dataset stuff
      • 2016-10-03 27722, 2016

      • Gentlecat
        so nothing unusual?
      • 2016-10-03 27746, 2016

      • alastairp
        I seem to collect people
      • 2016-10-03 27750, 2016

      • Gentlecat
        SMC ones?
      • 2016-10-03 27755, 2016

      • alastairp
        yeah
      • 2016-10-03 27703, 2016

      • Gentlecat
        haven't seen any
      • 2016-10-03 27721, 2016

      • Gentlecat
        maybe I should go to the uni one of those days
      • 2016-10-03 27732, 2016

      • Gentlecat
        instead of waiting until next year
      • 2016-10-03 27752, 2016

      • Gentlecat
        but perhaps I could come and hack a bit
      • 2016-10-03 27743, 2016

      • ruaok
        alastairp: are you going to have time to look at the bigquery schema stuff soon?
      • 2016-10-03 27702, 2016

      • alastairp
        ruaok: PR merging today, bigquery tomorrow
      • 2016-10-03 27717, 2016

      • ruaok
        kewl.
      • 2016-10-03 27720, 2016

      • alastairp
        maybe even this afternoon
      • 2016-10-03 27721, 2016

      • ruaok
        bitmap, Gentlecat, alastairp, Freso: Bitmap is headed home on thursday iirc. Shall we go and have dinner on wednesday?
      • 2016-10-03 27746, 2016

      • alastairp
        ok
      • 2016-10-03 27733, 2016

      • alastairp
        is Freso back already?
      • 2016-10-03 27737, 2016

      • ruaok
        yep.
      • 2016-10-03 27746, 2016

      • ruaok
        he's been farting up my couch for 24 hours now.
      • 2016-10-03 27728, 2016

      • JonnyJD_ joined the channel
      • 2016-10-03 27734, 2016

      • Gentlecat
        alastairp: what happened to search stuff
      • 2016-10-03 27750, 2016

      • Gentlecat
        search by recordings I mean
      • 2016-10-03 27726, 2016

      • alastairp
        on my list :)
      • 2016-10-03 27708, 2016

      • mat_ has quit
      • 2016-10-03 27725, 2016

      • mat_ joined the channel
      • 2016-10-03 27750, 2016

      • UmkaDK
        Guys, a bit of a random question but thought I'd ask...
      • 2016-10-03 27709, 2016

      • ruaok
        we've got all the random answers for you.
      • 2016-10-03 27715, 2016

      • UmkaDK
        :)
      • 2016-10-03 27723, 2016

      • ruaok
        if you want a specifc/correct one, that might be more challenging
      • 2016-10-03 27734, 2016

      • UmkaDK
        Do we still need unaccent and collate extensions with the new postgresql?
      • 2016-10-03 27753, 2016

      • ruaok
        yes
      • 2016-10-03 27702, 2016

      • UmkaDK
        hmmm... but there is a default unaccent function... why not use that??
      • 2016-10-03 27723, 2016

      • ruaok
        because we're busy moving to NewHost.
      • 2016-10-03 27744, 2016

      • ruaok
        open a ticket for us and we'll see about doing that once we get settled in the new digs.
      • 2016-10-03 27728, 2016

      • UmkaDK
        I'm not winging, just wanted to see if I was missing something ...
      • 2016-10-03 27720, 2016

      • ruaok
        not perceived as winging -- seriously please open a ticket.
      • 2016-10-03 27740, 2016

      • UmkaDK
        Also, as an alternative, it appears that the entire unaccent extension can be implemented in pure SQL: https://gist.github.com/UmkaDK/bdf771d89b39e1873e…
      • 2016-10-03 27700, 2016

      • UmkaDK
        Sure, will open a ticket!
      • 2016-10-03 27719, 2016

      • ruaok
        thx
      • 2016-10-03 27757, 2016

      • Freso
        ruaok: 👍 to dinner on Wed.
      • 2016-10-03 27704, 2016

      • Freso
        alastairp: And hi. :)
      • 2016-10-03 27735, 2016

      • Freso sitting in the office now with ruaok, Gentlecat, and bitmap
      • 2016-10-03 27707, 2016

      • chirlu
        UmkaDK: Yes, there are a few historical things that aren’t actually needed anymore. I personally know of our own median implementation that can be done directly in Pg 9.5+.
      • 2016-10-03 27729, 2016

      • chirlu
        Whether other options for unaccent/collate do exactly what is needed would need closer review, of course.
      • 2016-10-03 27720, 2016

      • UmkaDK
        sure! I'll add the code to the ticket (when I raise it) and leave it in your hands guys. :)
      • 2016-10-03 27758, 2016

      • Freso
        UmkaDK: Thanks. :)
      • 2016-10-03 27751, 2016

      • Freso
        UmkaDK: I don't know how closely you've followed the channel, but ruaok set a hard deadline for the switch in the beginning of November, so we'll Soon™ be able to look into things like that.
      • 2016-10-03 27724, 2016

      • ruaok
        I just booked a car too. that car that will haul all of our precious servers to the recycling station ;_;
      • 2016-10-03 27701, 2016

      • UmkaDK
        No worries! It's just something we came across in the process of moving to the new infrastructure and were wondering if we could cut a corner there.
      • 2016-10-03 27711, 2016

      • UmkaDK
        (by not installing the extensions)
      • 2016-10-03 27700, 2016

      • bitmap
        lol @ "typical novice's session" http://c2.com/cgi/wiki?EdIsTheStandardTextEditor
      • 2016-10-03 27731, 2016

      • bitmap
        that was me 10 mins ago
      • 2016-10-03 27733, 2016

      • D4RK-PH0ENiX has quit
      • 2016-10-03 27701, 2016

      • Freso
        ruaok: 50 or 100 á Messy?
      • 2016-10-03 27713, 2016

      • ruaok
        100
      • 2016-10-03 27716, 2016

      • Freso
        👍
      • 2016-10-03 27759, 2016

      • D4RK-PH0ENiX joined the channel
      • 2016-10-03 27720, 2016

      • mihaitish has quit