#metabrainz

/

      • _lucifer
        was going to ask the same
      • 2021-02-11 04251, 2021

      • _lucifer
        :D
      • 2021-02-11 04234, 2021

      • BrainzGit
        [critiquebrainz] alastair merged pull request #343 (master…fix-versions): Upgrade base python image https://github.com/metabrainz/critiquebrainz/pull…
      • 2021-02-11 04222, 2021

      • alastairp
      • 2021-02-11 04223, 2021

      • alastairp
        !m _lucifer
      • 2021-02-11 04224, 2021

      • BrainzBot
        You're doing good work, _lucifer!
      • 2021-02-11 04254, 2021

      • alastairp
        I resolved the issues in sentry and cleaned up some others, hopefully we'll only get reports for real issues now!
      • 2021-02-11 04226, 2021

      • _lucifer
        there's one issue. something to do with dumps which I have been seeing for a long time
      • 2021-02-11 04237, 2021

      • alastairp
        yep, see that it's related to 2019
      • 2021-02-11 04256, 2021

      • alastairp
        I suspect that the dump code is trying to clean up old dumps, and it's failing because of a persmissions problem
      • 2021-02-11 04202, 2021

      • alastairp
        I'll look at it, but I don't think it's urgent
      • 2021-02-11 04207, 2021

      • alastairp
        as long as dumps are actually ahppening
      • 2021-02-11 04257, 2021

      • _lucifer
        yup makes sense
      • 2021-02-11 04227, 2021

      • _lucifer
        beta does not seem to be updated yet
      • 2021-02-11 04237, 2021

      • alastairp
        I didn't update it
      • 2021-02-11 04244, 2021

      • alastairp
        straight to prod!
      • 2021-02-11 04201, 2021

      • _lucifer
        ah ok
      • 2021-02-11 04249, 2021

      • alastairp
        restarted beta
      • 2021-02-11 04240, 2021

      • v6lur has quit
      • 2021-02-11 04219, 2021

      • BrainzGit
        [listenbrainz-server] MonkeyDo opened pull request #1278 (master…sort-playlist-collaborators): Sort playlist collaborators https://github.com/metabrainz/listenbrainz-server…
      • 2021-02-11 04249, 2021

      • ruaok
        alastairp: is there a particular reason why this line is inside the for loop? https://github.com/metabrainz/listenbrainz-server…
      • 2021-02-11 04231, 2021

      • alastairp
        ruaok: looks like it should be outside
      • 2021-02-11 04249, 2021

      • ruaok
        Mr_Monkey: ^^ my comment on that PR is correct then.
      • 2021-02-11 04251, 2021

      • ruaok
        alastairp: thanks.
      • 2021-02-11 04238, 2021

      • Mr_Monkey
        Thanks
      • 2021-02-11 04250, 2021

      • Clint has quit
      • 2021-02-11 04217, 2021

      • Mr_Monkey
        I thought I was sooo clever when I started using a getter setter on the model, but damn did I get that pye in my face !
      • 2021-02-11 04201, 2021

      • Clint joined the channel
      • 2021-02-11 04238, 2021

      • ruaok
        heh. when I think a piece of code is clever, it is the first hint that I am on the wrong track.
      • 2021-02-11 04201, 2021

      • alastairp
        ah, that sucks that pydantic doesn't serialise properties
      • 2021-02-11 04221, 2021

      • alastairp
        I guess it makes a bit of sense... it exists so that you can define a data model along with types
      • 2021-02-11 04254, 2021

      • alastairp
        and I'm a little unhappy with the fact that we have 2 of these fields (e.g. collaborators/collaborator_ids) it'd be nice to work out how to combine them together
      • 2021-02-11 04219, 2021

      • alastairp
        maybe one option is to have a User object with id/name fields, but I'm not convinced about that either
      • 2021-02-11 04202, 2021

      • Mr_Monkey
        Yeah, all that is sub-ideal.
      • 2021-02-11 04227, 2021

      • BrainzGit
        [listenbrainz-server] mayhem opened pull request #1279 (master…dump-fixes): Dump fixes https://github.com/metabrainz/listenbrainz-server…
      • 2021-02-11 04219, 2021

      • zas
        Freso: discourse mail sending is broken since a while, I'm looking into it
      • 2021-02-11 04251, 2021

      • zas
        I tested mail sending from cmd line on node and in discourse container, it works, so that's something with discourse itself
      • 2021-02-11 04215, 2021

      • BrainzGit
        [listenbrainz-server] MonkeyDo merged pull request #1275 (master…websockets_server_port): Clean up: Correction of websockets port in config template https://github.com/metabrainz/listenbrainz-server…
      • 2021-02-11 04201, 2021

      • ruaok
        Mr_Monkey: _lucifer on ^^ -- should I enter a PR to rename that container?
      • 2021-02-11 04211, 2021

      • ruaok
        that has been bugging me too.
      • 2021-02-11 04214, 2021

      • Mr_Monkey
        Oh, that would be grand
      • 2021-02-11 04220, 2021

      • ruaok
        what should we call it?
      • 2021-02-11 04228, 2021

      • Mr_Monkey
        `websockets_server` ?
      • 2021-02-11 04244, 2021

      • ruaok
        yeah, I was going for something similar.
      • 2021-02-11 04217, 2021

      • Mr_Monkey
        or simply `websockets` I guess, in the context of `listenbrainz-websockets-beta` for example.
      • 2021-02-11 04238, 2021

      • ruaok
        💯
      • 2021-02-11 04230, 2021

      • ruaok
        while we're doing this, should we also remove the old follow feature?
      • 2021-02-11 04233, 2021

      • ruaok
        and maybe do another release?
      • 2021-02-11 04214, 2021

      • Mr_Monkey
        In another release. I think it's bad practice to remove a feature without warning or a replacement, even if the feature is a bit wonky.
      • 2021-02-11 04236, 2021

      • ruaok
        ok fair. I'm 1000% positive no one will miss it.
      • 2021-02-11 04258, 2021

      • Mr_Monkey
        So regarding the consul config, what effect does changing the name of a service have? the vhosts don't change in this case, just the consul service name I guess ("beta.listenbrainz-follow-dispatcher").
      • 2021-02-11 04258, 2021

      • Mr_Monkey
        Does it require a restart of the services, and of consul?
      • 2021-02-11 04219, 2021

      • ruaok
        only of the service.
      • 2021-02-11 04231, 2021

      • Mr_Monkey
        That's good magic.
      • 2021-02-11 04251, 2021

      • ruaok
      • 2021-02-11 04208, 2021

      • ruaok
        this very large single line command starts the container.
      • 2021-02-11 04203, 2021

      • ruaok
        lines 1331-1137 and 1339-13340 set env vars for the container.
      • 2021-02-11 04209, 2021

      • Mr_Monkey
        Also do you want me to open a PR with the required changes in the LB repo (uwsgi files)?
      • 2021-02-11 04213, 2021

      • outsidecontext
        if the old follow feature is the stuff under the follow menu entry, which I never figured out how to use, than I'm all in favour of getting this removed or bury it real deep
      • 2021-02-11 04224, 2021

      • ruaok
        the registrator service that zas is working on right now picks these up and then updates consul accordingly.
      • 2021-02-11 04235, 2021

      • ruaok
        Mr_Monkey: already done.
      • 2021-02-11 04238, 2021

      • Mr_Monkey
        OK.
      • 2021-02-11 04254, 2021

      • Mr_Monkey
        outsidecontext: Yeah, I agree too. We have a replacement in the works thankfully.
      • 2021-02-11 04259, 2021

      • ruaok
        outsidecontext: yeah, which is why I was for a swift removal of it.
      • 2021-02-11 04213, 2021

      • ruaok
        I personally see no problem just nuking it asap.
      • 2021-02-11 04230, 2021

      • outsidecontext
        :D looking forward to the new feature then
      • 2021-02-11 04221, 2021

      • CardinalWolseley joined the channel
      • 2021-02-11 04227, 2021

      • BrainzGit
        [listenbrainz-server] mayhem opened pull request #1280 (master…rename-follow-server-container): Rename the follow server to websockets https://github.com/metabrainz/listenbrainz-server…
      • 2021-02-11 04246, 2021

      • ruaok
        Mr_Monkey: ^^
      • 2021-02-11 04204, 2021

      • Mr_Monkey
        Shall I merge that then?
      • 2021-02-11 04216, 2021

      • ruaok
        sure
      • 2021-02-11 04224, 2021

      • BrainzGit
        [listenbrainz-server] MonkeyDo merged pull request #1280 (master…rename-follow-server-container): Rename the follow server to websockets https://github.com/metabrainz/listenbrainz-server…
      • 2021-02-11 04241, 2021

      • Mr_Monkey
        Goodbye follow-dispatcher
      • 2021-02-11 04257, 2021

      • ruaok
      • 2021-02-11 04220, 2021

      • zas
        removed? renamed?
      • 2021-02-11 04239, 2021

      • ruaok
        we're renaming the listenbrainz-follow-dispatcher-$PROD containers to listenbrainz-websockets-$PROD
      • 2021-02-11 04245, 2021

      • ruaok
        what should happen there?
      • 2021-02-11 04212, 2021

      • zas
        well, it will create new logs matching new names, so we need to change this line
      • 2021-02-11 04220, 2021

      • ruaok
        thats it?
      • 2021-02-11 04223, 2021

      • zas
        yes
      • 2021-02-11 04248, 2021

      • zas
        stats will not be merged though
      • 2021-02-11 04257, 2021

      • ruaok
        totally fine.
      • 2021-02-11 04217, 2021

      • zas
        is it deployed already?
      • 2021-02-11 04203, 2021

      • ruaok
      • 2021-02-11 04216, 2021

      • zas
        Freso: I rebuild web discourse container, but email issue persists...
      • 2021-02-11 04219, 2021

      • ruaok
        once we get this approved, I'll deploy
      • 2021-02-11 04202, 2021

      • zas
        ruaok: ok, then tell me when done, I'll deploy new stats and remove old one
      • 2021-02-11 04235, 2021

      • Darkloke has quit
      • 2021-02-11 04246, 2021

      • ruaok
        zas: have a look at the PR, please
      • 2021-02-11 04211, 2021

      • ruaok
        deploying.
      • 2021-02-11 04243, 2021

      • zas
        Freso: discourse emails issue is likely https://meta.discourse.org/t/discourse-smtp-sends… I'm trying suggested "fix"
      • 2021-02-11 04216, 2021

      • ruaok
        zas: deployed.
      • 2021-02-11 04230, 2021

      • ruaok
        Mr_Monkey: care to test to see if the websockets stuff is working?
      • 2021-02-11 04248, 2021

      • Mr_Monkey
        Sure. On test, beta and prod I imagine?
      • 2021-02-11 04257, 2021

      • ruaok
        most importantly prod.
      • 2021-02-11 04204, 2021

      • ruaok
        I see stuff in logs, so that is a good sign
      • 2021-02-11 04213, 2021

      • zas
        Freso: discourse email issue fixed
      • 2021-02-11 04237, 2021

      • Mr_Monkey
        Yep, WS updates working on prod
      • 2021-02-11 04251, 2021

      • Mr_Monkey
        With #1276 merged we'll have a proper playlist collaborating feature. Woo!
      • 2021-02-11 04252, 2021

      • Mr_Monkey
        I'm working on the tests now.
      • 2021-02-11 04205, 2021

      • ruaok
        sweet!
      • 2021-02-11 04223, 2021

      • ruaok
        and with 1276 merged more heisentests will be fixed too.
      • 2021-02-11 04257, 2021

      • c1e0 has quit
      • 2021-02-11 04200, 2021

      • Mr_Monkey
        Looks like it's not working on beta though. logs of the websockets_beta container are filled with `init script has no clue which service to start. Set env var CONTAINER_NAME!`
      • 2021-02-11 04225, 2021

      • ruaok looks
      • 2021-02-11 04231, 2021

      • Mr_Monkey
        same for test looks like
      • 2021-02-11 04259, 2021

      • ruaok
        oh yes.
      • 2021-02-11 04206, 2021

      • ruaok
        my dum dum. hang on
      • 2021-02-11 04241, 2021

      • ruaok
        meh, just tagging a container forces a complete rebuild right now. annoying.
      • 2021-02-11 04250, 2021

      • zas
        ruaok, Mr_Monkey : lb websockets stats deployed, since domain didn't change still visible at same place (but file is different) -> http://stats.metabrainz.org/goto/zbrDTFPGk
      • 2021-02-11 04206, 2021

      • ruaok
        thx
      • 2021-02-11 04250, 2021

      • BrainzGit
        [listenbrainz-server] MonkeyDo opened pull request #1281 (master…safe-track-metadata-react): Safely get track metadata in React components https://github.com/metabrainz/listenbrainz-server…
      • 2021-02-11 04235, 2021

      • ruaok
        Mr_Monkey: ws-test restarted. no errors in long
      • 2021-02-11 04237, 2021

      • ruaok
        log
      • 2021-02-11 04225, 2021

      • Mr_Monkey
        Confirming playlist updates are working on test
      • 2021-02-11 04244, 2021

      • ruaok
        beta updated, Mr_Monkey
      • 2021-02-11 04240, 2021

      • Mr_Monkey
        Working on beta! 👎
      • 2021-02-11 04247, 2021

      • Mr_Monkey
        Err, 👍
      • 2021-02-11 04256, 2021

      • Mr_Monkey
        Thanks for doing this ruaok !
      • 2021-02-11 04256, 2021

      • ruaok
        yay, one more thing cleaned up.
      • 2021-02-11 04258, 2021

      • ruaok
        np
      • 2021-02-11 04222, 2021

      • CardinalWolseley has quit
      • 2021-02-11 04201, 2021

      • _lucifer
        alastairp: another issue with ws cache, entity_id is optional
      • 2021-02-11 04202, 2021

      • _lucifer
        in case entity id is not supplied, we have nothing to find what to invalidate
      • 2021-02-11 04236, 2021

      • alastairp
        can you give me an example of something being cached without an entity id?
      • 2021-02-11 04243, 2021

      • alastairp
        oh, this is like a "list of all recordings" ?
      • 2021-02-11 04246, 2021

      • _lucifer
        yes
      • 2021-02-11 04255, 2021

      • _lucifer
        list of any 50 reviews
      • 2021-02-11 04205, 2021

      • alastairp
        so, you'll have to invalidate that one each time
      • 2021-02-11 04221, 2021

      • _lucifer
        how about not cache if entity_id is not available?
      • 2021-02-11 04253, 2021

      • alastairp
        unless you check if the cache exists, and check if this item is in the cache, and only expire if that's the case...
      • 2021-02-11 04213, 2021

      • _lucifer
        yeah, but the issue is the key is generated is cache.gen_key('list', entity_id, user_id, sort, limit, offset, language)
      • 2021-02-11 04205, 2021

      • alastairp
        yeah, maybe just not caching it is a good idea
      • 2021-02-11 04228, 2021

      • _lucifer
        main user of the data is mb anyways which supplies the entity_id
      • 2021-02-11 04239, 2021

      • _lucifer
        so should be much of an issue
      • 2021-02-11 04243, 2021

      • _lucifer
        *should not
      • 2021-02-11 04258, 2021

      • alastairp
        I mentioned this a few days ago - we have a lot of caching in place, but I have no idea how often the caches are actually used
      • 2021-02-11 04244, 2021

      • _lucifer
        once the metrics pr is merged, we can try to work something out
      • 2021-02-11 04205, 2021

      • ruaok
        alastairp: what is the status of your telegraf in BU support work going? I think I may want to track the progress of the MBID mapping using telegraf and grafana.
      • 2021-02-11 04224, 2021

      • alastairp
        ruaok: the PR for a counter is ready
      • 2021-02-11 04249, 2021

      • alastairp
        when you and I discussed it last you showed an interest in being able to just post a value
      • 2021-02-11 04221, 2021

      • alastairp
        and I left it there - I needed to have a chat with zas about how to store that in granfa
      • 2021-02-11 04211, 2021

      • ruaok
        +1 to finishing that
      • 2021-02-11 04233, 2021

      • alastairp
        maybe we can have that discussion now?
      • 2021-02-11 04218, 2021

      • ruaok
        sure, but we need zas, no?
      • 2021-02-11 04256, 2021

      • alastairp
        we do. I was just thinking that it's like a beetlejuice thing
      • 2021-02-11 04223, 2021

      • ruaok
        zas! zas! zas!
      • 2021-02-11 04230, 2021

      • zas
        what?
      • 2021-02-11 04235, 2021

      • ruaok
        LOLOLOL
      • 2021-02-11 04245, 2021

      • ruaok
        I gotta remember that.