#metabrainz

/

      • _lucifer
        also, did you see my message above from earlier regarding APIBadRequests?
      • 2021-03-31 09003, 2021

      • alastairp
        ah, I glanced at it
      • 2021-03-31 09020, 2021

      • alastairp
        this is the one where the spotify importer is raising it and causing it to trigger to sentry?
      • 2021-03-31 09054, 2021

      • _lucifer
        yes
      • 2021-03-31 09031, 2021

      • alastairp
        in that case I think that the spotify importer should catch the exception and silently continue
      • 2021-03-31 09057, 2021

      • _lucifer
        yeah makes sense
      • 2021-03-31 09032, 2021

      • alastairp
        oh, I just had a thought, did you add the ability to ignore specific exceptions in sentry?
      • 2021-03-31 09041, 2021

      • alastairp
        I can't remember if we finished that discussion
      • 2021-03-31 09050, 2021

      • _lucifer
        no, i haven't yet.
      • 2021-03-31 09029, 2021

      • alastairp
        ok, no problem. it should be no different with sentry-python compared to what it was previously doing, but that's a future improvement
      • 2021-03-31 09036, 2021

      • alastairp
        do we have a ticket for it? I'll make one if not
      • 2021-03-31 09040, 2021

      • _lucifer
        afair, we decided to pass exception during initialization to sentry.
      • 2021-03-31 09012, 2021

      • _lucifer
        no, we don't have a ticket for that.
      • 2021-03-31 09013, 2021

      • alastairp
        yes, that's what I recall too
      • 2021-03-31 09013, 2021

      • _lucifer
        also, we wanted to see how these new integrations work out and if we don't need to add that at all
      • 2021-03-31 09027, 2021

      • _lucifer
        i think we won't be needing it soon because the APIBadRequests are now probably figured out.
      • 2021-03-31 09011, 2021

      • alastairp
        yeah, if the badreuests are due to the spotify importer then maybe it's doing the right thing
      • 2021-03-31 09034, 2021

      • alastairp
        regarding the null entry in postgres... we had similar issues in AB because we store data in json
      • 2021-03-31 09056, 2021

      • alastairp
        let me find how we fix it - I don't know if we look for null, or catch a specific exception from the db
      • 2021-03-31 09018, 2021

      • _lucifer
        UntranslaeCharacterError I think it is.
      • 2021-03-31 09057, 2021

      • _lucifer
        my original thinking was to catch it and sanitize the input and retry. but catching and raising a 400 is fine too.
      • 2021-03-31 09046, 2021

      • _lucifer
        alastairp, sentry-sdk recently attained 1.0.0. when I had tested it, it was 0.20.*. which one should i upgrade to ?
      • 2021-03-31 09050, 2021

      • alastairp
        oh whoops. didn't think of that
      • 2021-03-31 09055, 2021

      • alastairp
        let's just use the old version
      • 2021-03-31 09009, 2021

      • _lucifer
        👍
      • 2021-03-31 09045, 2021

      • alastairp
        _lucifer: what's the python-sentry config item? ignore_errors or before_send?
      • 2021-03-31 09051, 2021

      • alastairp
        I'm finding conflicting information
      • 2021-03-31 09057, 2021

      • _lucifer
        ignore_errors
      • 2021-03-31 09032, 2021

      • _lucifer
        you could use before_send to emulate ignore_errors behaviour
      • 2021-03-31 09016, 2021

      • alastairp
        BU-43
      • 2021-03-31 09017, 2021

      • BrainzBot
        BU-43: Add a way for apps to tell sentry to not report on specific exceptions https://tickets.metabrainz.org/browse/BU-43
      • 2021-03-31 09037, 2021

      • _lucifer
        the issue I found was that a user was doing that and wanted a built in method for that. the sentry devs had replied that there is ignroe_errors but it was probably not documented.
      • 2021-03-31 09051, 2021

      • alastairp
        -> lunch, back in ~15m
      • 2021-03-31 09055, 2021

      • _lucifer
        👍
      • 2021-03-31 09021, 2021

      • BrainzGit
        [listenbrainz-server] amCap1712 opened pull request #1367 (master…sentry-upgrade): Upgrade brainzutils and sentry_sdk https://github.com/metabrainz/listenbrainz-server…
      • 2021-03-31 09048, 2021

      • ruaok
        _lucifer: I added one change to your PR : https://github.com/metabrainz/listenbrainz-server…
      • 2021-03-31 09005, 2021

      • ruaok
        if that looks ok to you, I'll merge and test.
      • 2021-03-31 09027, 2021

      • _lucifer
        yup, lgtm.
      • 2021-03-31 09032, 2021

      • ruaok
        kewl.
      • 2021-03-31 09057, 2021

      • BrainzGit
        [listenbrainz-server] mayhem merged pull request #1366 (master…listen-threshold): LB-851: Calculate similar users only for users who have a minimum number of listens https://github.com/metabrainz/listenbrainz-server…
      • 2021-03-31 09023, 2021

      • ruaok
        !m _lucifer
      • 2021-03-31 09023, 2021

      • BrainzBot
        You're doing good work, _lucifer!
      • 2021-03-31 09059, 2021

      • ruaok
        _lucifer: on leader you were smart to save the spark_config.py, but we didn't save spark_config.sh . :(
      • 2021-03-31 09023, 2021

      • ruaok
        lets hope that there were no changes from the default version. heh.
      • 2021-03-31 09046, 2021

      • _lucifer
        oh! i forgot about. 🤞
      • 2021-03-31 09022, 2021

      • _lucifer
        if it works fine now, i'll add spark_config.sh as well to docker-server-configs
      • 2021-03-31 09031, 2021

      • ruaok
        ok, trying now.
      • 2021-03-31 09023, 2021

      • c1e0 joined the channel
      • 2021-03-31 09006, 2021

      • c1e0 has quit
      • 2021-03-31 09045, 2021

      • BrainzGit
        [metabrainz.org] amCap1712 opened pull request #359 (master…sentry-upgrade): Upgrade brainzutils and sentry-sdk https://github.com/metabrainz/metabrainz.org/pull…
      • 2021-03-31 09052, 2021

      • alastairp
        hello, I'm back now
      • 2021-03-31 09005, 2021

      • alastairp
        _lucifer: if you're working on LB, I could do AB
      • 2021-03-31 09008, 2021

      • ruaok
        hello formerly alastairp. nice to meet you back!
      • 2021-03-31 09022, 2021

      • alastairp
        ruaok big on the dad jokes these days
      • 2021-03-31 09051, 2021

      • _lucifer
        alastairp, i am done with LB, MeB. doing CB now. sure, thanks!
      • 2021-03-31 09011, 2021

      • alastairp
        ah, I see the LB one. so many brainzgit reports from you I can't keep track of them
      • 2021-03-31 09016, 2021

      • ruaok
        _lucifer: see sentry for a hiccup on the new thresholding.
      • 2021-03-31 09019, 2021

      • _lucifer
        ruaok, i see. its confusing the field with the method. i'll change the field name to something else.
      • 2021-03-31 09034, 2021

      • ruaok
        yep, seems like it.
      • 2021-03-31 09056, 2021

      • ruaok
        alastairp: do we have internal API endpoints in LB?
      • 2021-03-31 09023, 2021

      • alastairp
        what do you mean by internal? for the website to use, or this concept that I wanted to introduce for the stats?
      • 2021-03-31 09043, 2021

      • _lucifer
        i think using as a string could work though. should i just hotfix in leader? if it works then i'll open a PR.
      • 2021-03-31 09052, 2021

      • ruaok
        something not officially supported, but could be used by javascript in our pages.
      • 2021-03-31 09003, 2021

      • ruaok
        _lucifer: go for the fix.
      • 2021-03-31 09008, 2021

      • ruaok
        hotfix.
      • 2021-03-31 09035, 2021

      • alastairp
        in some places we've just added a view in the html blueprint that returns json
      • 2021-03-31 09038, 2021

      • c1e0 joined the channel
      • 2021-03-31 09051, 2021

      • alastairp
        there's an example of a spotify token refresh endpoint somewhere which the player uses
      • 2021-03-31 09059, 2021

      • ruaok
        thanks, perfect.
      • 2021-03-31 09005, 2021

      • alastairp
        but we don't have a standardised way of doing this
      • 2021-03-31 09050, 2021

      • alastairp
        the "get people who x follows" was one of these but then we moved it into API_PREFIX
      • 2021-03-31 09005, 2021

      • BrainzGit
        [critiquebrainz] amCap1712 opened pull request #354 (master…sentry-upgrade): Upgrade brainzutils and sentry-sdk https://github.com/metabrainz/critiquebrainz/pull…
      • 2021-03-31 09026, 2021

      • antlarr has quit
      • 2021-03-31 09047, 2021

      • antlarr joined the channel
      • 2021-03-31 09020, 2021

      • alastairp
        _lucifer: hi, just to confirm - when you were originally working on this task you performed the upgrade on all downstream apps and tried to send an error?
      • 2021-03-31 09041, 2021

      • _lucifer
        alastairp, yes.
      • 2021-03-31 09028, 2021

      • _lucifer
        but i do not remember whether I tested `capture_message` specifically.
      • 2021-03-31 09007, 2021

      • BharatKalluri joined the channel
      • 2021-03-31 09011, 2021

      • _lucifer
        I found my old branch. I tested that as well.
      • 2021-03-31 09019, 2021

      • alastairp
        🎉
      • 2021-03-31 09038, 2021

      • ruaok
        _lucifer: can I try regenerating the dataframes now?
      • 2021-03-31 09025, 2021

      • _lucifer
        ruaok, no i figured the hotfix won't work because the workers won't get the updated code. i am working on a PR as we speak.
      • 2021-03-31 09037, 2021

      • ruaok
        ah, ok.
      • 2021-03-31 09043, 2021

      • ruaok
        thanks.
      • 2021-03-31 09037, 2021

      • BrainzGit
        [acousticbrainz-server] alastair opened pull request #394 (master…sentry-upgrade): Upgrade brainzutils and sentry-sdk https://github.com/metabrainz/acousticbrainz-serv…
      • 2021-03-31 09025, 2021

      • BrainzGit
        [listenbrainz-server] amCap1712 opened pull request #1368 (master…listen-threshold): Update filter condition to tell spark we want the field and fix a regression https://github.com/metabrainz/listenbrainz-server…
      • 2021-03-31 09000, 2021

      • _lucifer
        let's wait for the tests to pass.
      • 2021-03-31 09029, 2021

      • _lucifer
        in case this fix doesn't work, i'll rename the count field to soemthing but that'll probably need changes elsewhere as well.
      • 2021-03-31 09007, 2021

      • alastairp
        _lucifer: I noticed that in docker-server-configs we are using the old deprecated dsn with a secret for most services
      • 2021-03-31 09019, 2021

      • _lucifer
        yes right.
      • 2021-03-31 09026, 2021

      • alastairp
        I'll open a PR to update that to the public DSN for these apps
      • 2021-03-31 09038, 2021

      • _lucifer
        cool thanks!
      • 2021-03-31 09032, 2021

      • _lucifer
        huh, we also have bono-ds-hoster. I forgot to test that.
      • 2021-03-31 09005, 2021

      • alastairp
        hmm, but I may have set that up manually instead of using BU
      • 2021-03-31 09015, 2021

      • alastairp
        I remember that one of these services I did manually
      • 2021-03-31 09042, 2021

      • BharatKalluri has quit
      • 2021-03-31 09044, 2021

      • _lucifer
        yeah right that uses sentry-sdk directly
      • 2021-03-31 09054, 2021

      • _lucifer
        its already using new sentry
      • 2021-03-31 09015, 2021

      • alastairp
        great
      • 2021-03-31 09049, 2021

      • alastairp
        just jumping ahead a moment here - in order to merge the cache updates in BU we need to merge the CB release which does manual cache expiration?
      • 2021-03-31 09035, 2021

      • _lucifer
      • 2021-03-31 09039, 2021

      • alastairp
        great
      • 2021-03-31 09045, 2021

      • alastairp
        once I do docker-server-configs I'll look at that
      • 2021-03-31 09056, 2021

      • _lucifer
        👍
      • 2021-03-31 09009, 2021

      • alastairp
        want to try and release that today too?
      • 2021-03-31 09014, 2021

      • alastairp
        it'd be great to get it out of the way!
      • 2021-03-31 09025, 2021

      • _lucifer
        should we go for cache or startup
      • 2021-03-31 09033, 2021

      • alastairp
        cache
      • 2021-03-31 09045, 2021

      • _lucifer
        sure, let's do that then
      • 2021-03-31 09004, 2021

      • alastairp
        well, depending on how long you're around for maybe we could do both... let's see
      • 2021-03-31 09006, 2021

      • _lucifer
        we also a cache PR in LB
      • 2021-03-31 09008, 2021

      • alastairp
        there's always tomorrow :)
      • 2021-03-31 09040, 2021

      • _lucifer
        yup
      • 2021-03-31 09040, 2021

      • alastairp
        the ratelimiting? yeah
      • 2021-03-31 09044, 2021

      • _lucifer
        yes
      • 2021-03-31 09008, 2021

      • _lucifer
        that's not related to this perse though.
      • 2021-03-31 09028, 2021

      • alastairp
        OK, great. let's keep that in mind for next steps, but let's not get distracted by it
      • 2021-03-31 09035, 2021

      • _lucifer
        👍
      • 2021-03-31 09043, 2021

      • alastairp
        I see a dsn configuration for AB beta that I can't find in sentry
      • 2021-03-31 09047, 2021

      • alastairp
        I wonder if we deleted it
      • 2021-03-31 09052, 2021

      • alastairp
      • 2021-03-31 09004, 2021

      • alastairp
        I wonder if we should use environments instead of different projects for beta/test/prod
      • 2021-03-31 09023, 2021

      • BrainzGit
        [acousticbrainz-server] alastair merged pull request #394 (master…sentry-upgrade): Upgrade brainzutils and sentry-sdk https://github.com/metabrainz/acousticbrainz-serv…
      • 2021-03-31 09030, 2021

      • _lucifer
        alastairp, i think using environments will be better. that would let us group errors across environments. that's not possible with projects i think.
      • 2021-03-31 09042, 2021

      • alastairp
        _lucifer: ah, I think I found a bug in our sentry-sdk upgrade
      • 2021-03-31 09049, 2021

      • alastairp
      • 2021-03-31 09002, 2021

      • alastairp
      • 2021-03-31 09003, 2021

      • alastairp
        so it seems that there was some way of passing generic information to raven (including environment), by using SENTRY_CONFIG. You're not using **options in the call to sentry_sdk.init
      • 2021-03-31 09052, 2021

      • _lucifer
        ah ok, remove SENTRY_CONFIG and just pass **options to init?
      • 2021-03-31 09027, 2021

      • alastairp
        I'm not sure. give me a moment to think it through
      • 2021-03-31 09035, 2021

      • BharatKalluri joined the channel
      • 2021-03-31 09050, 2021

      • ruaok
        _lucifer: one failing test on the spark PR.
      • 2021-03-31 09057, 2021

      • ruaok
      • 2021-03-31 09026, 2021

      • c1e0 has quit
      • 2021-03-31 09030, 2021

      • alastairp
        _lucifer: I think you're right, we can just pass it straight into init(). I opened BU-44 to cover this
      • 2021-03-31 09030, 2021

      • BrainzBot
        BU-44: Further improvements to sentry integration https://tickets.metabrainz.org/browse/BU-44
      • 2021-03-31 09034, 2021

      • alastairp
        _lucifer: I'm digging further into sentry config in consul, and have written comments on LB and CB
      • 2021-03-31 09026, 2021

      • alastairp
        while we're touching this code we should get rid of the out-of-date config options and structure. It looks like AB is fine in this regard
      • 2021-03-31 09050, 2021

      • _lucifer
        ruaok, i had pushed the fix for that. i see you merged it. thanks!
      • 2021-03-31 09005, 2021

      • _lucifer
        alastairp, yeah makes sense to cleanup the config.
      • 2021-03-31 09014, 2021

      • _lucifer
        i have updated LB PR.
      • 2021-03-31 09022, 2021

      • alastairp
        !m _lucifer
      • 2021-03-31 09022, 2021

      • BrainzBot
        You're doing good work, _lucifer!
      • 2021-03-31 09034, 2021

      • alastairp
        two people dragging you in 2 directions and you still manage to get stuff updated
      • 2021-03-31 09040, 2021

      • _lucifer
        regarding CB, should we do lazy-loading or usual?
      • 2021-03-31 09042, 2021

      • BrainzGit
        [listenbrainz-server] mayhem merged pull request #1368 (master…listen-threshold): Update filter condition to tell spark we want the field and fix a regression https://github.com/metabrainz/listenbrainz-server…
      • 2021-03-31 09004, 2021

      • alastairp
        what do you mean usual?
      • 2021-03-31 09025, 2021

      • ruaok
        indeed, _lucifer the multitasking master!
      • 2021-03-31 09025, 2021

      • _lucifer
        i mean eager, like we do currently for ravenjs.
      • 2021-03-31 09053, 2021

      • alastairp
        sorry, I still don't know what you mean :(