#metabrainz

/

      • alastairp
        ah, right
      • 2019-05-15 13558, 2019

      • SothoTalKer joined the channel
      • 2019-05-15 13504, 2019

      • D4RK-PH0ENiX joined the channel
      • 2019-05-15 13528, 2019

      • zas
        5s cache on /api/ only, i'll wait few minutes to see if it has any impact (unlikely), then i'll raise duration a bit
      • 2019-05-15 13510, 2019

      • alastairp
        ok
      • 2019-05-15 13543, 2019

      • alastairp
        I'd be really interested to see what the histogram of inter-interval requests is
      • 2019-05-15 13552, 2019

      • alastairp
        how frequently the most popular mbids are requested
      • 2019-05-15 13530, 2019

      • zas
        alastairp: what are /<uuid>/(low|high)-level queries vs /api/v1/<uuid> , website vs web service ?
      • 2019-05-15 13545, 2019

      • alastairp
        old-style API vs new API
      • 2019-05-15 13517, 2019

      • zas
        hmmm; and no redirect ?
      • 2019-05-15 13530, 2019

      • alastairp
        not yet, we just serve the same from both endpoints
      • 2019-05-15 13544, 2019

      • alastairp
        we could start to deprecate it. add a redirect as a first point
      • 2019-05-15 13553, 2019

      • zas
        ok, first ones are not as easy to match (lack of a prefix)
      • 2019-05-15 13524, 2019

      • alastairp
        the thing is, as it's accessed by api clients and not browsers, they're almost certainly not going to cache redirects, even permanent ones
      • 2019-05-15 13544, 2019

      • alastairp
        mm, right. so if we add a redirect then it's little work for the python server, but then makes caching easier
      • 2019-05-15 13547, 2019

      • alastairp
        I'll open a ticket
      • 2019-05-15 13537, 2019

      • zas
        ok, for now, i'll cache more widely and for a longer time, if we want to measure any effect
      • 2019-05-15 13534, 2019

      • zas
        Mr_Monkey: where are you atm ? Rob & I are heading out to find something to eat, are you in ?
      • 2019-05-15 13556, 2019

      • aidanlw17
        alastairp: hey, for the bulk high level get, I've been writing a similar single query to the low level one
      • 2019-05-15 13515, 2019

      • aidanlw17
        But I have a question about raising exceptions for no data found
      • 2019-05-15 13502, 2019

      • aidanlw17
        The load_high_level function https://github.com/metabrainz/acousticbrainz-serv… raises no data found if the row is none or if there isn't any metadata, just a placeholder when the hl calculation failed
      • 2019-05-15 13539, 2019

      • aidanlw17
        I was just wondering whether you think I should raise an exception if this is the case in the bulk get case, or if we should just skip the row altogether so that we can still return the high level data for the remaining (mbid, offset) pairs
      • 2019-05-15 13538, 2019

      • ruaok
        iliekcomputers: did you get near finishing the review for the ratelimiter?
      • 2019-05-15 13509, 2019

      • Mr_Monkey
        zas: having lunch at home in the end. Had some stuff to do in the house
      • 2019-05-15 13521, 2019

      • alastairp
        hi aidanlw17
      • 2019-05-15 13503, 2019

      • alastairp
        for bulk get, we should raise no errors if there is no highlevel data for a given mbid
      • 2019-05-15 13522, 2019

      • alastairp
        regardless of the error (doesn't exist, or only a hl row and no data rows)
      • 2019-05-15 13522, 2019

      • alastairp
        like bulk get lowlevel, we just skip mbids if they don't exist (otherwise a user would have to make a request to see if each mbid exists before doing a bulk get... that removes all benefit from doing a bulk get in the first place
      • 2019-05-15 13505, 2019

      • aidanlw17
        Thanks alastairp. After thinking about it a bit more I changed it to skip like that. One other question, when we skip a row I was thinking that it might be beneficial to have a way of alerting the user that one of their recordings was not returned
      • 2019-05-15 13533, 2019

      • alastairp
        we decided to not do that - the idea is that they know what mbids they requested. If the id isn't in the response, it means it doesn't exist
      • 2019-05-15 13558, 2019

      • alastairp
        you're right, we could have added a "missing" field, but we decided not to
      • 2019-05-15 13549, 2019

      • aidanlw17
        Okay I see, thanks for clarifying that
      • 2019-05-15 13547, 2019

      • ferbncode
        spellew: ping (how did your finals go? :) o/ )
      • 2019-05-15 13531, 2019

      • Mr_Monkey
        zas, ruaok: Is either one of you at Rob's? Can I come over?
      • 2019-05-15 13540, 2019

      • zas
        we are right now
      • 2019-05-15 13512, 2019

      • zas
        and yes, i think you can come over, we just came back from lunch
      • 2019-05-15 13504, 2019

      • Mr_Monkey
        Okidoke
      • 2019-05-15 13509, 2019

      • Mr_Monkey
        On my way
      • 2019-05-15 13529, 2019

      • BestSteve has quit
      • 2019-05-15 13506, 2019

      • BestSteve joined the channel
      • 2019-05-15 13501, 2019

      • BrainzGit
        [listenbrainz-server] MonkeyDo opened pull request #570 (master…LB-447): Quickfix for LB-447: spotify iframe styling issue = no sound on chrome https://github.com/metabrainz/listenbrainz-server…
      • 2019-05-15 13503, 2019

      • BrainzBot
        LB-447: Regression: Player does not play any sound https://tickets.metabrainz.org/browse/LB-447
      • 2019-05-15 13513, 2019

      • Mr_Monkey
        I lied. On my way now.
      • 2019-05-15 13501, 2019

      • Mr_Monkey
        ^ This issue with the spotify player is ridiculous.
      • 2019-05-15 13510, 2019

      • Mr_Monkey
      • 2019-05-15 13503, 2019

      • reosarevok
        lol
      • 2019-05-15 13518, 2019

      • thomasross has quit
      • 2019-05-15 13530, 2019

      • BrainzGit
        [sir] yvanzo opened pull request #105 (master…bump-req): Update requirements mbdata, pysolr, and sqlalchemy https://github.com/metabrainz/sir/pull/105
      • 2019-05-15 13530, 2019

      • reosarevok
        Mr_Monkey: https://tickets.metabrainz.org/browse/LB-448 also a new regression?
      • 2019-05-15 13531, 2019

      • BrainzBot
        LB-448: Listens show up in the global "Recents Listens" List, but vanish from user page
      • 2019-05-15 13538, 2019

      • alastairp
        hi yvanzo and reosarevok
      • 2019-05-15 13504, 2019

      • alastairp
        MBS-10169 has been reported at https://community.metabrainz.org/t/collections-ap…, as a result of using pymbngs
      • 2019-05-15 13504, 2019

      • BrainzBot
        MBS-10169: Regression: ws/2/collection returns random user collection list https://tickets.metabrainz.org/browse/MBS-10169
      • 2019-05-15 13518, 2019

      • alastairp
        which means that perhaps it should be fixed sooner rather than later
      • 2019-05-15 13503, 2019

      • Mr_Monkey
        reosarevok: ¯\_(ツ)_/¯
      • 2019-05-15 13508, 2019

      • reosarevok
        alastairp: do you remember how you decided for just /collection without a specified username on pymbngs?
      • 2019-05-15 13509, 2019

      • alastairp
        oh, I see that it's mentioned that the bindings use it. Interesting, why did we use the wrong endpoint?
      • 2019-05-15 13510, 2019

      • Mr_Monkey
        I suppose so
      • 2019-05-15 13519, 2019

      • alastairp
        reosarevok: yeah, good question
      • 2019-05-15 13541, 2019

      • alastairp
        perhaps "I tried it and it worked, so I left it as-is"
      • 2019-05-15 13542, 2019

      • reosarevok
        I mean, maybe that was originally going to be the right endpoint, it was later changed, and that's why it's not documented?
      • 2019-05-15 13550, 2019

      • reosarevok
        Since Picard does the same
      • 2019-05-15 13519, 2019

      • alastairp
        You can also perform a get request on the collection list, which will present you an of collections for the currently authenticated user, with the amount of releases in each collection:
      • 2019-05-15 13519, 2019

      • alastairp
        GET /ws/2/collection
      • 2019-05-15 13528, 2019

      • alastairp
      • 2019-05-15 13547, 2019

      • reosarevok
        Heh. So I guess that's what it is.
      • 2019-05-15 13550, 2019

      • reosarevok
        yvanzo: ^
      • 2019-05-15 13505, 2019

      • BrainzGit
        [listenbrainz-server] mayhem merged pull request #570 (master…LB-447): Quickfix for LB-447: spotify iframe styling issue = no sound on chrome https://github.com/metabrainz/listenbrainz-server…
      • 2019-05-15 13506, 2019

      • BrainzBot
        LB-447: Regression: Player does not play any sound https://tickets.metabrainz.org/browse/LB-447
      • 2019-05-15 13507, 2019

      • reosarevok
        And maybe we changed it when we started allowing private collections or something?
      • 2019-05-15 13533, 2019

      • alastairp
        yeah, possibly
      • 2019-05-15 13542, 2019

      • alastairp
        so, pymb should use the new format at the very least
      • 2019-05-15 13555, 2019

      • alastairp
        but it still sounds like a regression, if there's no reason to not remove that endpoint
      • 2019-05-15 13505, 2019

      • alastairp
        at least wait for me to get a new version out ;)
      • 2019-05-15 13530, 2019

      • yvanzo
        The new format seems to be 3 years old, but my hope is we can continue supporting the former one still used by Picard and Python bindings.
      • 2019-05-15 13550, 2019

      • alastairp
        great. I'll reply to the user indicating that, and open a ticket to update bindings
      • 2019-05-15 13552, 2019

      • alastairp
        thanks
      • 2019-05-15 13551, 2019

      • alastairp
      • 2019-05-15 13553, 2019

      • alastairp
        should be updated
      • 2019-05-15 13503, 2019

      • alastairp
        keep the content but update the status, or delete the content?
      • 2019-05-15 13503, 2019

      • Mr_Monkey
      • 2019-05-15 13513, 2019

      • ruaok
        Mr_Monkey: I'm working to fix the failing tests. very slowly, but still, making progress.
      • 2019-05-15 13516, 2019

      • CallerNo6
        alastairp, I'll move it to history
      • 2019-05-15 13503, 2019

      • ruaok
        Mr_Monkey: this should fix the test for LB.
      • 2019-05-15 13514, 2019

      • ruaok
        I'll have to work with iliekcomputers to actually release it.
      • 2019-05-15 13520, 2019

      • ruaok
        iliekcomputers: ping me when you're around, please
      • 2019-05-15 13529, 2019

      • yvanzo
        reosarevok: genre should be added to CORE_TABLE_LIST
      • 2019-05-15 13535, 2019

      • reosarevok
        Thanks!
      • 2019-05-15 13542, 2019

      • iliekcomputers
        ruaok: sorry, be around in say 45 minutes
      • 2019-05-15 13548, 2019

      • iliekcomputers
        What do you need?
      • 2019-05-15 13513, 2019

      • ruaok
        a host of things, but mostly want to deploy this:
      • 2019-05-15 13513, 2019

      • ruaok
      • 2019-05-15 13523, 2019

      • reosarevok
        yvanzo: should I add genre_alias too, even if it's still empty and will be for a bit?
      • 2019-05-15 13531, 2019

      • alastairp
        CallerNo6: thanks. I removed the link to it on the ws/2 docs
      • 2019-05-15 13532, 2019

      • ruaok
        I'll make a PR for production as well.
      • 2019-05-15 13545, 2019

      • ruaok
        45 minutes is fine, iliekcomputers
      • 2019-05-15 13553, 2019

      • yvanzo
        reosarevok: yes
      • 2019-05-15 13558, 2019

      • reosarevok
        Ok!
      • 2019-05-15 13551, 2019

      • CallerNo6
        alastairp, oops, just added it back. your way might be the more correctest way though.
      • 2019-05-15 13532, 2019

      • BrainzGit
        [musicbrainz-server] reosarevok opened pull request #1075 (master…MBS-9491-dump-genres): MBS-9491 / MBS-10062: Dump genre and genre_alias tables https://github.com/metabrainz/musicbrainz-server/…
      • 2019-05-15 13534, 2019

      • BrainzBot
        MBS-9491: Move genres to be read from the database https://tickets.metabrainz.org/browse/MBS-9491
      • 2019-05-15 13534, 2019

      • BrainzBot
        MBS-10062: Add aliases for genres https://tickets.metabrainz.org/browse/MBS-10062
      • 2019-05-15 13538, 2019

      • alastairp
        I don't think it's important to point people to it, because otherwise they might expect it to work
      • 2019-05-15 13516, 2019

      • reosarevok
        Yeah. If anything we could link to a document like "how to convert your ws/1 software to ws/2", but I'm not going to write that...
      • 2019-05-15 13515, 2019

      • alastairp
        It's been down for long enough that I don't think anyone needs it
      • 2019-05-15 13547, 2019

      • reosarevok
        Yea, we did get a few mails like "hey did something break", one of which was like "oh, well, that's legacy software so we won't be fixing it"
      • 2019-05-15 13515, 2019

      • reosarevok hopes they at least apologized to the (I assume paid) user who wrote to us separately asking for help with his now broken program...
      • 2019-05-15 13501, 2019

      • CallerNo6
        At this point, how stable is the data model? I mean, besides possibly genres, how many more entities are in the pipeline?
      • 2019-05-15 13521, 2019

      • CallerNo6
        (or I guess significant changes to entity types might also count)
      • 2019-05-15 13552, 2019

      • CallerNo6
        Oh. Tracklists probably?
      • 2019-05-15 13514, 2019

      • yvanzo
        zas: I cannot reproduce the ws/2/collection bug locally, may openresty caching changes trigger it?
      • 2019-05-15 13515, 2019

      • reosarevok
        Not possibly, genres are implemented as an entity already
      • 2019-05-15 13534, 2019

      • reosarevok
        And dunno. If we feel a need for more we'll add more, I guess
      • 2019-05-15 13555, 2019

      • reosarevok
      • 2019-05-15 13532, 2019

      • zas
        Something went wrong.
      • 2019-05-15 13545, 2019

      • zas
        It's all what i get following this link...
      • 2019-05-15 13508, 2019

      • ZoeB joined the channel
      • 2019-05-15 13538, 2019

      • zas
        ah it works now... twitter...
      • 2019-05-15 13503, 2019

      • ZoeB
        So, um, I might be missing something, but it looks to me like the latest mbdump is missing the tag file, and all the other _tag files..?
      • 2019-05-15 13543, 2019

      • yvanzo
        it is in mbdump-derived.tar.bz2
      • 2019-05-15 13545, 2019

      • zas
        reosarevok: nope, no idea
      • 2019-05-15 13508, 2019

      • reosarevok
        ZoeB: tag data isn't CC0, but CC-BY-NC-SA IIRC, so it's released separately
      • 2019-05-15 13520, 2019

      • ZoeB
        Ooooh, thank you!
      • 2019-05-15 13534, 2019

      • ZoeB
        Of course I did it wrong, sorry
      • 2019-05-15 13537, 2019

      • BrainzGit
        [acousticbrainz-server] aidanlw17 opened pull request #341 (master…ab-406-3): AB-406 Part 3: Remove nullable, use offset for bulk get endpoints https://github.com/metabrainz/acousticbrainz-serv…
      • 2019-05-15 13538, 2019

      • BrainzBot
        AB-406: Add column representing submission offset https://tickets.metabrainz.org/browse/AB-406
      • 2019-05-15 13545, 2019

      • zas
        yvanzo: about the /ws/2/collection issue, dunno.
      • 2019-05-15 13557, 2019

      • reosarevok
        ZoeB: well, the genre one being missing I did wrong, so eh :D
      • 2019-05-15 13510, 2019

      • ZoeB
        So we're even? :D
      • 2019-05-15 13537, 2019

      • ZoeB
        Implementing genres was an impressive and wonderful change, thank you all! I've been looking forward to this for ages.
      • 2019-05-15 13537, 2019

      • ruaok
        you'd to have to screw up a lot more to be even with reosarevok, ZoeB.
      • 2019-05-15 13546, 2019

      • yvanzo
        zas: can we temporarily disable it for /ws/2/collection only?
      • 2019-05-15 13500, 2019

      • yvanzo
        zas: and /ws/2/collection/
      • 2019-05-15 13515, 2019

      • zas
        yes, i'll do that
      • 2019-05-15 13540, 2019

      • yvanzo
        Thanks, I did not find any code change possibly causing it either.
      • 2019-05-15 13500, 2019

      • ZoeB
        Yeah, there are the tag files, thank you!
      • 2019-05-15 13509, 2019

      • yvanzo
        np :)
      • 2019-05-15 13505, 2019

      • zas
        yvanzo: done
      • 2019-05-15 13511, 2019

      • yvanzo
        zas: thank you, asking for feedback on community
      • 2019-05-15 13525, 2019

      • ZoeB has left the channel
      • 2019-05-15 13531, 2019

      • Lotheric has quit
      • 2019-05-15 13535, 2019

      • yvanzo
        zas: just checked bug history, it’s been first reported on 12th May on #musicbrainz, that is the day before schema change release.
      • 2019-05-15 13538, 2019

      • zas
        first caching changes started on 11th, so it might be it. Since i changed minor things, that may have affect the behavior. I think I'll disable this stuff completly before re-introducing it more cleanly. It's rather interesting, but it needs to be tuned, per service.
      • 2019-05-15 13553, 2019

      • BrainzGit
        [listenbrainz-server] paramsingh opened pull request #571 (production…merge-branch): Merge master into production https://github.com/metabrainz/listenbrainz-server…
      • 2019-05-15 13544, 2019

      • BrainzGit
        [messybrainz-server] paramsingh opened pull request #62 (production…mbdata-upgrade): Upgrade mbdata https://github.com/metabrainz/messybrainz-server/…
      • 2019-05-15 13537, 2019

      • BrainzGit
        [messybrainz-server] paramsingh merged pull request #62 (production…mbdata-upgrade): Upgrade mbdata https://github.com/metabrainz/messybrainz-server/…
      • 2019-05-15 13503, 2019

      • modwizcode has quit
      • 2019-05-15 13514, 2019

      • modwizcode joined the channel
      • 2019-05-15 13500, 2019

      • BrainzGit
        [listenbrainz-server] paramsingh merged pull request #571 (production…merge-branch): Merge master into production https://github.com/metabrainz/listenbrainz-server…
      • 2019-05-15 13546, 2019

      • modwizcode has quit