#metabrainz

/

      • _lucifer
        ruaok: i think its ready to be deployed. alastairp: sanity check please
      • 2021-02-16 04751, 2021

      • atj
        My suggestion would be that you have a simple boolean field to flag an image as potentially offensive. Then you can have an profile option to enable/disable display of such images, with the default to not display for anonymous users.
      • 2021-02-16 04709, 2021

      • alastairp
        looks good to me ruaok _lucifer
      • 2021-02-16 04728, 2021

      • alastairp
        do we know what version of flask was used previously?
      • 2021-02-16 04700, 2021

      • alastairp
        if it was on 0.9mumble then there _may_ be some incompatible upgrades, but I don't know the app enough to know if this was the case
      • 2021-02-16 04725, 2021

      • ruaok
        not that old. I recently upgraded pacakges.
      • 2021-02-16 04735, 2021

      • alastairp
        yeah, I see that the BU dependency is recent
      • 2021-02-16 04700, 2021

      • ZaphodBeeblebrox really goes now
      • 2021-02-16 04722, 2021

      • alastairp
        mmm
      • 2021-02-16 04729, 2021

      • alastairp
        yeah, looks like flask didn't change since v0.15, so looks good to me 👍
      • 2021-02-16 04751, 2021

      • _lucifer
        i have a dev instance up here http://bono.metabrainz.org:6500/ without login enabled if it helps
      • 2021-02-16 04708, 2021

      • alastairp
        I'm more interested in what happens _after_ you log in
      • 2021-02-16 04731, 2021

      • alastairp
        I'm just remembering back to places where they changed the flag on flask-login to know if a user was anonymous or not from a function to a property
      • 2021-02-16 04746, 2021

      • alastairp
        that caused us no end of problems with various versions of BU floating around all of the projects
      • 2021-02-16 04749, 2021

      • _lucifer
        i can add the keys and we can test here before deploying in that case
      • 2021-02-16 04719, 2021

      • alastairp
        it's OK, I just checked and we didn't upgrade any dependencies between 0.15 and 0.15
      • 2021-02-16 04729, 2021

      • alastairp
        and MeB was running on 0.15 before. so it's fine
      • 2021-02-16 04738, 2021

      • _lucifer
        👍
      • 2021-02-16 04737, 2021

      • BrainzGit
        [musicbrainz-docker] release v-2021-02-16 has been published by reosarevok: https://github.com/metabrainz/musicbrainz-docker/…
      • 2021-02-16 04732, 2021

      • _lucifer
        ruaok: alastairp: MEB-117
      • 2021-02-16 04733, 2021

      • BrainzBot
      • 2021-02-16 04705, 2021

      • ruaok
        yeah, I know. I'm not the right person to dig into this. Its been on my list for a while now.
      • 2021-02-16 04742, 2021

      • ruaok
        do you know how to do this?
      • 2021-02-16 04752, 2021

      • alastairp
        it looks like the only dependency installed by node is lessc
      • 2021-02-16 04705, 2021

      • alastairp
        and there's no build tool
      • 2021-02-16 04715, 2021

      • _lucifer
        i think upgrading is the easy part
      • 2021-02-16 04723, 2021

      • alastairp
        so I'm 99% sure that it's going to be a matter of upgrading to 14 (latest LTS), and possibly upgrading the version of lessc
      • 2021-02-16 04724, 2021

      • ruaok
        meb.org deployed and working fine.
      • 2021-02-16 04727, 2021

      • _lucifer
        testing to make sure everything works is harder
      • 2021-02-16 04720, 2021

      • _lucifer
        alastairp: so upgrade nodejs and the dependency. build image, run tests and visual inspection of the site?
      • 2021-02-16 04733, 2021

      • alastairp
        yeah
      • 2021-02-16 04745, 2021

      • alastairp
        I would go as far as to say if the css compiles, then everything is going to be fine
      • 2021-02-16 04701, 2021

      • _lucifer
        cool, i can probably do that.
      • 2021-02-16 04721, 2021

      • _lucifer
        alastairp: also, AB seems to be running an old version of PG.
      • 2021-02-16 04745, 2021

      • alastairp
        what do you mean by "old"
      • 2021-02-16 04733, 2021

      • _lucifer
        i mean older than 12, which almost all other projects are using
      • 2021-02-16 04753, 2021

      • alastairp
        I think we match it to the production version
      • 2021-02-16 04716, 2021

      • alastairp
        it's a huge task to upgrade it, and we don't get anything useful out of a newer version, so it's fine for now
      • 2021-02-16 04732, 2021

      • _lucifer
        makes sense
      • 2021-02-16 04700, 2021

      • dipesh joined the channel
      • 2021-02-16 04721, 2021

      • _lucifer
        I have tested sentry upgrade with AB, CB and LB. it works.
      • 2021-02-16 04741, 2021

      • _lucifer
        for meb website, there's this comment https://github.com/metabrainz/metabrainz.org/blob…
      • 2021-02-16 04710, 2021

      • _lucifer
        should i replace it with logging.info or the equivalent to capture_message in new sentry-sdk
      • 2021-02-16 04715, 2021

      • _lucifer
        ruaok: ^
      • 2021-02-16 04747, 2021

      • alastairp
        if logging.info gets sent to sentry, then it's fine to change it to that
      • 2021-02-16 04700, 2021

      • alastairp
        but if it doesn't then it should stay as capture_message
      • 2021-02-16 04728, 2021

      • _lucifer
        it depends on the configuration
      • 2021-02-16 04707, 2021

      • _lucifer
        if the logging level for sentry is configured to info, in that case this message won't be sent i think.
      • 2021-02-16 04724, 2021

      • dipesh has quit
      • 2021-02-16 04732, 2021

      • _lucifer
        The default behaviour is to capture logging.info, but we configure it in LOG_SENTRY = { ..., level="OUR LEVEL"}.
      • 2021-02-16 04713, 2021

      • Darkloke has quit
      • 2021-02-16 04739, 2021

      • Darkloke joined the channel
      • 2021-02-16 04741, 2021

      • _lucifer
      • 2021-02-16 04749, 2021

      • alastairp
        I would say if we currently log all logger.info() messages to sentry then we can do that. if we don't, we should send the message directly
      • 2021-02-16 04700, 2021

      • Darkloke has quit
      • 2021-02-16 04744, 2021

      • flamingspinach has quit
      • 2021-02-16 04701, 2021

      • flamingspinach joined the channel
      • 2021-02-16 04704, 2021

      • BrainzGit
        [musicbrainz-server] reosarevok opened pull request #1913 (master…MBS-11268-pt-2): MBS-11268 / MBS-11349: Improvements related to medium duration https://github.com/metabrainz/musicbrainz-server/…
      • 2021-02-16 04701, 2021

      • ruaok
        alastairp: https://ci.metabrainz.org/job/listenbrainz-integr… the test to call our production labs api endpoint for recording lookup times out during testing. I personally think we should not be doing that in running integration tests. we should have a test for fetching the metadata with mocks and all that, but we should disable the metadata fetching during testing since it adds nothing to the tests and hitting a
      • 2021-02-16 04701, 2021

      • ruaok
        production API for testing is questionable in the first place. Thoughts? How would you disable this?
      • 2021-02-16 04701, 2021

      • ruaok
        oh, I see. the logical way. :)
      • 2021-02-16 04746, 2021

      • alastairp
        ruaok: this is LB-782
      • 2021-02-16 04747, 2021

      • BrainzBot
        LB-782: Docker networks in listenbrainz/jenkins unit tests don't allow external network requests https://tickets.metabrainz.org/browse/LB-782
      • 2021-02-16 04756, 2021

      • alastairp
        I got around it in a few places by mocking
      • 2021-02-16 04733, 2021

      • ruaok
        in this case I'm adding a flag to get_paylist with fetch_metadata, which allows the tests to pass a False flag in order to skip this issue for the one test we have failing now.
      • 2021-02-16 04734, 2021

      • iliekcomputers
        ruaok: did you get a chance to look at stripe.com/climate ? I'd love to get your opinion on us participating.
      • 2021-02-16 04726, 2021

      • ruaok
        oh, I wanted to figure out what that number was for 2020, but then got angry at QuickBooks for never allowing the sorts of simple queries I want. let me see if I can do that after I submit this fix.
      • 2021-02-16 04749, 2021

      • iliekcomputers
        yeah, I think we could even mention that x% of donations via stripe go to carbon capture. wonder if that'd increase donations :)
      • 2021-02-16 04706, 2021

      • BrainzGit
        [brainzutils-python] amCap1712 opened pull request #56 (master…sentry): Upgrade raven to sentry_sdk https://github.com/metabrainz/brainzutils-python/…
      • 2021-02-16 04715, 2021

      • iliekcomputers
        mention on https://metabrainz.org/donate, i mean.
      • 2021-02-16 04719, 2021

      • ruaok
        I also need to move to the new version of checkout. EU cc payments are likely failing right now.
      • 2021-02-16 04728, 2021

      • ruaok
        oh duh. I should ask stripe, not quickbooks.
      • 2021-02-16 04750, 2021

      • iliekcomputers
        :D
      • 2021-02-16 04705, 2021

      • iliekcomputers
        i see we save a lot of payments info in the metabrainz.org DB.
      • 2021-02-16 04709, 2021

      • iliekcomputers
        like addresses etc.
      • 2021-02-16 04754, 2021

      • iliekcomputers
        if we start doing checkout, i guess we'll have to write webhooks to fill that in, not sure.
      • 2021-02-16 04755, 2021

      • ruaok
        yes, addresses are needed in case the IRS wants to come snoop.
      • 2021-02-16 04710, 2021

      • ruaok
        oh joy.
      • 2021-02-16 04751, 2021

      • iliekcomputers
        we could also save customers in stripe and run a script to call the API and fill the data in every day or so, i guess.
      • 2021-02-16 04718, 2021

      • iliekcomputers
        looking at it, the webhook is probably less work https://stripe.com/docs/payments/checkout/fulfill…
      • 2021-02-16 04753, 2021

      • ruaok
        $20,859 in stripe transactions last year. 1% of that would be $208.
      • 2021-02-16 04727, 2021

      • iliekcomputers
        +++
      • 2021-02-16 04729, 2021

      • iliekcomputers
        nice.
      • 2021-02-16 04748, 2021

      • _lucifer
        ruaok: alastairp: i think that listenbrainz_spark is using flask (and BU) only for logging and loading config values. but the sentry_sdk comes with a PysparkIntegration so its easy to use it directly instead. that way we can remove the BU dependency from spark. do you think its worthwhile to make the shift?
      • 2021-02-16 04733, 2021

      • iliekcomputers
        big yes
      • 2021-02-16 04701, 2021

      • ruaok
        Flask there makes no sense, so please!
      • 2021-02-16 04717, 2021

      • _lucifer
        👍
      • 2021-02-16 04712, 2021

      • alastairp
        sounds good
      • 2021-02-16 04755, 2021

      • alastairp
      • 2021-02-16 04709, 2021

      • alastairp
        we should upgrade our base images
      • 2021-02-16 04703, 2021

      • ruaok
        where do we accept float input? in AB I guess, but that is still on py 2.x
      • 2021-02-16 04704, 2021

      • BrainzGit
        [listenbrainz-server] mayhem opened pull request #1288 (master…playlist_collaborators_test_fixes): Playlist collaborators test fixes https://github.com/metabrainz/listenbrainz-server…
      • 2021-02-16 04735, 2021

      • ruaok
        Mr_Monkey: alastairp ^^ see what you think, but I hope that should improve testing and fix the failing test.
      • 2021-02-16 04721, 2021

      • alastairp
        ruaok: and even the floating point data in AB isn't a single user-provided input
      • 2021-02-16 04739, 2021

      • atj
        that's a fun bug
      • 2021-02-16 04752, 2021

      • ruaok
        woo. all tests for 1288 pass. thoughts on the fix, alastairp ?
      • 2021-02-16 04745, 2021

      • bitmap has quit
      • 2021-02-16 04753, 2021

      • bitmap_ joined the channel
      • 2021-02-16 04717, 2021

      • bitmap_ is now known as bitmap
      • 2021-02-16 04710, 2021

      • Mr_Monkey
        If we test the metadata fetching in another way, as you suggest, then this does look good. Thanks for looking at it, I was scratching my brain at those test failures yesterday.
      • 2021-02-16 04736, 2021

      • ruaok
        well, the previous method didn't test the metadata fetching either. :)
      • 2021-02-16 04704, 2021

      • ruaok
        let me merge that branch into yours and then add a test for the metadata fetch.
      • 2021-02-16 04710, 2021

      • ruaok
        then hopefully we can merge this finally.
      • 2021-02-16 04720, 2021

      • Mr_Monkey
        Sweet !
      • 2021-02-16 04742, 2021

      • BrainzGit
        [listenbrainz-server] mayhem closed pull request #1288 (master…playlist_collaborators_test_fixes): Playlist collaborators test fixes https://github.com/metabrainz/listenbrainz-server…
      • 2021-02-16 04751, 2021

      • Mr_Monkey
        🤞 at tests
      • 2021-02-16 04748, 2021

      • ruaok
        gah. not sure I care to write this test. this test will soon be thrown away when we add the more nuanced service layer that is missing. we're not losing a test, so I'm all for merging and moving on.
      • 2021-02-16 04702, 2021

      • ruaok
        Mr_Monkey: there are open conversations on PR 1276. have a look, please?
      • 2021-02-16 04759, 2021

      • Mr_Monkey
        OK
      • 2021-02-16 04715, 2021

      • Mr_Monkey
        All converstions closed, pushed a small docstrings change.
      • 2021-02-16 04753, 2021

      • ruaok
        it would be nice to add another couple of tests...
      • 2021-02-16 04731, 2021

      • ruaok
        wait, I take that back. what I was thinking would already be covered by other tests.
      • 2021-02-16 04757, 2021

      • ruaok
        integration tests passed. woo
      • 2021-02-16 04735, 2021

      • ruaok
        Mr_Monkey: all tests pass. wanna do the honors?
      • 2021-02-16 04756, 2021

      • Mr_Monkey honors
      • 2021-02-16 04705, 2021

      • BrainzGit
        [listenbrainz-server] MonkeyDo merged pull request #1276 (master…playlist_collaborators): Allow playlist collaborators to access private playlist https://github.com/metabrainz/listenbrainz-server…
      • 2021-02-16 04713, 2021

      • _lucifer
      • 2021-02-16 04740, 2021

      • ruaok
        _lucifer: update your DB connect strings to match what is in config.py.sample
      • 2021-02-16 04744, 2021

      • _lucifer
        I am having trouble with timescaledb initialization. How can I remove the existing vdata?
      • 2021-02-16 04758, 2021

      • _lucifer
        ruaok: i have done that already
      • 2021-02-16 04719, 2021

      • ruaok
        docker volume ls
      • 2021-02-16 04724, 2021

      • ruaok
        docker volume rm <volumename>
      • 2021-02-16 04725, 2021

      • ruaok
        yvanzo: is there a new timeline for rabbitmq deployment?
      • 2021-02-16 04730, 2021

      • _lucifer
        removing the volume worked. thanks!
      • 2021-02-16 04737, 2021

      • ruaok
        np
      • 2021-02-16 04725, 2021

      • yvanzo
        ruaok: I just started merging PRs, migrating sir-test first.
      • 2021-02-16 04705, 2021

      • ruaok
        my production image just passed all its tests, let me beta deploy. I should theoretically be ready to migrate in 15 minutes or so.
      • 2021-02-16 04754, 2021

      • ruaok
        Mr_Monkey: woo, I finally was able to add a track to your collaborative playlist on beta. woo
      • 2021-02-16 04727, 2021

      • ruaok
        ok, beta looks good.
      • 2021-02-16 04730, 2021

      • Mr_Monkey
        Nice !
      • 2021-02-16 04735, 2021

      • sumedh joined the channel
      • 2021-02-16 04714, 2021

      • sumedh has quit
      • 2021-02-16 04704, 2021

      • yvanzo
        ruaok: I completed sir-test migration, getting ready for listenbrainz
      • 2021-02-16 04725, 2021

      • ruaok
        I dont have a lot of time left today. :( how long do think it will take?
      • 2021-02-16 04739, 2021

      • yvanzo
        ok, sorry, about ten minutes... if nothing goes wrong.
      • 2021-02-16 04747, 2021

      • ruaok
        lol, ok.
      • 2021-02-16 04754, 2021

      • ruaok
        pushing the prod image very soon.
      • 2021-02-16 04704, 2021

      • ruaok
        what is the env var value I need to set>
      • 2021-02-16 04705, 2021

      • ruaok
        ?
      • 2021-02-16 04728, 2021

      • ruaok
        is `export VAR=value` good enough or does that need to happen in services.sh?
      • 2021-02-16 04702, 2021

      • yvanzo
        there is one more thing to do: configure vhost/exchanges/queues at the new rabbitmq instance.
      • 2021-02-16 04712, 2021

      • ruaok
        export RABBITMQ_SERVICE="..." yes?
      • 2021-02-16 04750, 2021

      • ruaok
        yvanzo: ok, what needs doing?
      • 2021-02-16 04756, 2021

      • yvanzo
      • 2021-02-16 04753, 2021

      • ruaok
      • 2021-02-16 04730, 2021

      • ruaok
        that looks right, I think. but I am not a rabbitmq expert.
      • 2021-02-16 04723, 2021

      • yvanzo
      • 2021-02-16 04757, 2021

      • yvanzo
      • 2021-02-16 04712, 2021

      • ruaok
        hmmm.
      • 2021-02-16 04724, 2021

      • ruaok
        ten minutes have passed and we've not started doing anything yet.