#metabrainz

/

      • CatQuest has quit
      • 2023-06-07 15856, 2023

      • CatQuest joined the channel
      • 2023-06-07 15856, 2023

      • CatQuest has quit
      • 2023-06-07 15856, 2023

      • CatQuest joined the channel
      • 2023-06-07 15801, 2023

      • BrainzGit
        [listenbrainz-android] 14dependabot[bot] opened pull request #172 (03main…dependabot/gradle/io.sentry.android.gradle-3.8.0): Bump io.sentry.android.gradle from 3.7.0 to 3.8.0 https://github.com/metabrainz/listenbrainz-androi…
      • 2023-06-07 15856, 2023

      • BrainzGit
        [listenbrainz-android] 14amCap1712 opened pull request #173 (03main…retrieve-token): Use WebView to extract LB Auth token https://github.com/metabrainz/listenbrainz-androi…
      • 2023-06-07 15822, 2023

      • lucifer
        akshaaatt: ^ will need polish probably but works in general.
      • 2023-06-07 15826, 2023

      • CatQuest
        what?! zas doesn't rhyme with "jazz"???
      • 2023-06-07 15827, 2023

      • CatQuest
        but that way is how I've always mentally pronounced "zas" :(
      • 2023-06-07 15837, 2023

      • CatQuest
        well..
      • 2023-06-07 15802, 2023

      • CatQuest
        i probably pronounce jazz wrong cause it also rhymes with "sass"
      • 2023-06-07 15829, 2023

      • aerozol
        I think it does rhyme with jazz? Or Pizazz!
      • 2023-06-07 15842, 2023

      • CatQuest
        or any other mass, plass, kass etch word
      • 2023-06-07 15847, 2023

      • CatQuest
        etc*
      • 2023-06-07 15849, 2023

      • CatQuest
        idk
      • 2023-06-07 15854, 2023

      • CatQuest
        morena!
      • 2023-06-07 15855, 2023

      • aerozol
        Just couldn’t think of anything to go with ‘zas the…’, like ‘Catquest the best’
      • 2023-06-07 15801, 2023

      • CatQuest
        ..
      • 2023-06-07 15820, 2023

      • CatQuest
        it's CatQuest the Endeavouring Cat!
      • 2023-06-07 15830, 2023

      • CatQuest
        :P
      • 2023-06-07 15831, 2023

      • aerozol
        Haha of course, sorry
      • 2023-06-07 15847, 2023

      • CatQuest
        oh
      • 2023-06-07 15848, 2023

      • CatQuest
        uh
      • 2023-06-07 15805, 2023

      • CatQuest
        it'd only be "the as" and thats not nice
      • 2023-06-07 15820, 2023

      • aerozol
        :D
      • 2023-06-07 15846, 2023

      • CatQuest
        or.. zas the mas-ter
      • 2023-06-07 15852, 2023

      • CatQuest
        🤷
      • 2023-06-07 15849, 2023

      • zas
        damn....
      • 2023-06-07 15818, 2023

      • zas
        reosarevok: I just saw something that may be in relation with the docker image id thing you got yesterday
      • 2023-06-07 15801, 2023

      • zas
        I just upgraded 1 image, used by 2 containers on moroder, and when I ran docker ps just after, here what I got
      • 2023-06-07 15807, 2023

      • zas
      • 2023-06-07 15822, 2023

      • zas
        both grafana-*-renderer containers are using the same image at this point and were rm -f then rebuilt
      • 2023-06-07 15841, 2023

      • zas
        but for some reason docker ps shows one with a name, the other with an id....
      • 2023-06-07 15850, 2023

      • zas
        oh wait, I know why
      • 2023-06-07 15814, 2023

      • zas
        because the name is shared between both images (something:latest)
      • 2023-06-07 15846, 2023

      • zas
        so when it displays them, it displays the id of the old image and the name for the new one
      • 2023-06-07 15858, 2023

      • zas
        it makes sense
      • 2023-06-07 15816, 2023

      • Pratha-Fish
        Morena
      • 2023-06-07 15833, 2023

      • Pratha-Fish
        🌅:D
      • 2023-06-07 15851, 2023

      • aerozol
        Mōrena!
      • 2023-06-07 15806, 2023

      • aerozol
        mayhem: monkey: running behind, as usual, but I’ve put my notes re the recs redesign into this doc: https://docs.google.com/document/d/1N7FmZdJNagXXx…
      • 2023-06-07 15824, 2023

      • aerozol
        So that stuff doesn’t get lost across timelines/metabrainz messages
      • 2023-06-07 15859, 2023

      • zas
        reosarevok: so, if you have 2 containers C1 & C2 running 'image:tag' with id 1, once you retrieved 'image:tag' with id 2 and used it for C1, C2 would have his image listed as id 1 rather than its name, so basically search by name isn't reliable. And that's perhaps what is happened with your script.
      • 2023-06-07 15803, 2023

      • aerozol
        I’ll also put the text from the linked doc here, so there’s a record on IRC https://www.irccloud.com/pastebin/aH3HJjIF/
      • 2023-06-07 15818, 2023

      • aerozol
        The doc has screenshots though :)
      • 2023-06-07 15823, 2023

      • akshaaatt
        Thanks a lot lucifer for working on this! ⚡️
      • 2023-06-07 15845, 2023

      • akshaaatt
        I see your PR is in draft currently. Are you working on it or should I pick something up for you?
      • 2023-06-07 15820, 2023

      • Zhele has quit
      • 2023-06-07 15814, 2023

      • CatQuest
        zas no offence meant. you're the mas-ter of all sysadmin things <3
      • 2023-06-07 15805, 2023

      • rozlav has quit
      • 2023-06-07 15849, 2023

      • Zhele joined the channel
      • 2023-06-07 15814, 2023

      • Zhele has quit
      • 2023-06-07 15808, 2023

      • BrainzGit
        [listenbrainz-android] 14akshaaatt opened pull request #174 (03main…fix-spotify-remote-crash): Fix Spotify remote crash https://github.com/metabrainz/listenbrainz-androi…
      • 2023-06-07 15812, 2023

      • texke joined the channel
      • 2023-06-07 15832, 2023

      • BrainzGit
        [listenbrainz-android] 14akshaaatt merged pull request #174 (03main…fix-spotify-remote-crash): Fix Spotify remote crash https://github.com/metabrainz/listenbrainz-androi…
      • 2023-06-07 15838, 2023

      • akshaaatt
        lucifer the webview works amazing but lags a lot for me
      • 2023-06-07 15803, 2023

      • akshaaatt
        It basically took 5-10secs to load every single screen and then around 10secs to redirect
      • 2023-06-07 15851, 2023

      • Zhele joined the channel
      • 2023-06-07 15817, 2023

      • Zhele has quit
      • 2023-06-07 15834, 2023

      • Zhele joined the channel
      • 2023-06-07 15826, 2023

      • lucifer
        akshaaatt: yeah, i had marked it as draft so that you could take over and make any changes you want later. feel free.
      • 2023-06-07 15820, 2023

      • yvanzo
        O’Moin
      • 2023-06-07 15814, 2023

      • lucifer
        akshaaatt: it works quite fast for me even in the emulator.
      • 2023-06-07 15825, 2023

      • lucifer
        i am not sure why it lags in your case.
      • 2023-06-07 15839, 2023

      • Zhele has quit
      • 2023-06-07 15826, 2023

      • Zhele joined the channel
      • 2023-06-07 15824, 2023

      • q3lont joined the channel
      • 2023-06-07 15829, 2023

      • rozlav joined the channel
      • 2023-06-07 15851, 2023

      • zas
        all containers were stopped on kiki & herb
      • 2023-06-07 15851, 2023

      • reosarevok
        zas: so is the point that while we usually had one container per server for a service, now we have several or?
      • 2023-06-07 15804, 2023

      • reosarevok
        moin yvanzo :) Seems we need to update the update script
      • 2023-06-07 15859, 2023

      • zas
        reosarevok: technically you can have multiple containers for a service, even on the same node. It is just about them to not conflict (different ports and names).
      • 2023-06-07 15838, 2023

      • reosarevok
        Sure, it's just we have never had this issue before the update, so I was wondering what changed :)
      • 2023-06-07 15854, 2023

      • reosarevok
        (that we'd now have a C1 and a C2 to conflict)
      • 2023-06-07 15803, 2023

      • yvanzo
        reosarevok: containers update script?
      • 2023-06-07 15835, 2023

      • reosarevok
        Yeah. It broke when trying to update beta because it was expecting to get back the container name but got the id instead
      • 2023-06-07 15848, 2023

      • reosarevok
        zas suggested a reason for it a bit earlier
      • 2023-06-07 15807, 2023

      • monkey
        aerozol: I found the PR from the tweet, after checking said tweet's date. I'm afraid it was a no-go: https://github.com/metabrainz/listenbrainz-server…
      • 2023-06-07 15822, 2023

      • monkey
        Thanks for the feedback document !
      • 2023-06-07 15850, 2023

      • monkey
        Just wanted to point out that we do currently have arrows to the right and left like rob mentioned
      • 2023-06-07 15859, 2023

      • monkey
        Bah, I'll leave comments on the doc
      • 2023-06-07 15843, 2023

      • yvanzo
        reosarevok: Did you update beta?
      • 2023-06-07 15857, 2023

      • reosarevok
        No, because the script to update it didn't work, as I said :)
      • 2023-06-07 15810, 2023

      • yvanzo
        Can you please summarize the course of events :)
      • 2023-06-07 15810, 2023

      • reosarevok
      • 2023-06-07 15824, 2023

      • atj
        yvanzo: you broke it
      • 2023-06-07 15832, 2023

      • yvanzo
        atj: thanks :D
      • 2023-06-07 15833, 2023

      • atj
        And reosarevok is giving you both pieces
      • 2023-06-07 15852, 2023

      • reosarevok
        :p
      • 2023-06-07 15801, 2023

      • reosarevok
        The docker ps --filter "name=$container" --format '{{.Image}}' thing doesn't work anymore or at least not consistently, it seems
      • 2023-06-07 15816, 2023

      • reosarevok
      • 2023-06-07 15838, 2023

      • atj
        the script compares a container name with a container id
      • 2023-06-07 15840, 2023

      • reosarevok
        But that used to be both container names
      • 2023-06-07 15857, 2023

      • reosarevok
        zas said that: "if you have 2 containers C1 & C2 running 'image:tag' with id 1, once you retrieved 'image:tag' with id 2 and used it for C1, C2 would have his image listed as id 1 rather than its name, so basically search by name isn't reliable. And that's perhaps what is happened with your script."
      • 2023-06-07 15830, 2023

      • yvanzo
        We don't have 2 containers running the same image tag on paco.
      • 2023-06-07 15843, 2023

      • reosarevok
        Yeah, dunno
      • 2023-06-07 15847, 2023

      • reosarevok
      • 2023-06-07 15836, 2023

      • monkey
        zas: Hi! looks like the test websites are working at the moment, at least test.listenbrainz.org, test.bookbrainz.org and test.musicbrainz.org
      • 2023-06-07 15836, 2023

      • monkey
        Requests get timed out.
      • 2023-06-07 15836, 2023

      • monkey
        I looked in more details for BB, the container looks fine (tried restarting it too) but requests don't seem to hit it.
      • 2023-06-07 15836, 2023

      • monkey
        Help please :)
      • 2023-06-07 15848, 2023

      • monkey
        aren't working*
      • 2023-06-07 15829, 2023

      • yvanzo
        There are new beta images atm but the containers are still running the old image, no longer matching the image beta tag, so it’s expected that the image for the container is listed with an id instead.
      • 2023-06-07 15849, 2023

      • yvanzo
        Thanks!
      • 2023-06-07 15856, 2023

      • yvanzo
        Something to start with :)
      • 2023-06-07 15852, 2023

      • reosarevok
        Yeah, the image was generated, just not updated
      • 2023-06-07 15826, 2023

      • reosarevok
        But that's the same process we've always followed and this used to work
      • 2023-06-07 15839, 2023

      • reosarevok
        Which makes me assume the change must be in the new setup from yesterday
      • 2023-06-07 15835, 2023

      • reosarevok
        Which is why I started by asking zas and atj :)
      • 2023-06-07 15801, 2023

      • zas
        monkey: let me check
      • 2023-06-07 15805, 2023

      • monkey
        Merci
      • 2023-06-07 15837, 2023

      • reosarevok
        monkey: re: https://github.com/metabrainz/bookbrainz-site/pul… - do you have a table of proposed privs somewhere?
      • 2023-06-07 15847, 2023

      • q3lont has quit
      • 2023-06-07 15817, 2023

      • reosarevok
        (MB uses 0 as the standard and our flagged privs start with 1, so I was a bit surprised to see 1 as the default)
      • 2023-06-07 15829, 2023

      • reosarevok
        (although I guess it's not wrong in any way either)
      • 2023-06-07 15812, 2023

      • zas
        monkey: matching containers properly registered services and they appear in openresty config
      • 2023-06-07 15827, 2023

      • monkey
        reosarevok: Here's what was in the proposal:
      • 2023-06-07 15830, 2023

      • monkey
      • 2023-06-07 15850, 2023

      • monkey
        But I'm keen on aligning with MB, no reason to be off by one
      • 2023-06-07 15855, 2023

      • reosarevok
        Oh, ok, so just starting from 1 and there's no "default" no privs flag
      • 2023-06-07 15801, 2023

      • reosarevok
        I mean, we don't have a 0 flag :)
      • 2023-06-07 15809, 2023

      • reosarevok
        It's just 0 if there's nothing we would call a priv
      • 2023-06-07 15813, 2023

      • monkey
        I guess 1 is the default no special privs
      • 2023-06-07 15819, 2023

      • reosarevok
        (so, they just use the site normally)
      • 2023-06-07 15831, 2023

      • monkey
        That's how I read 'ACCESS_THE_ENTITY'
      • 2023-06-07 15832, 2023

      • reosarevok
        Yeah. I don't think that's wrong either, as long as you document it somewhere
      • 2023-06-07 15834, 2023

      • yvanzo
        reosarevok: I just ran the script again and it worked fine.
      • 2023-06-07 15837, 2023

      • monkey
        = read
      • 2023-06-07 15845, 2023

      • reosarevok
        yvanzo: huh, ok :) Maybe I should have just retried :D
      • 2023-06-07 15810, 2023

      • reosarevok
        "retry until it works" is not the most ideal approach, but hey, if it works for our selenium tests 🤣
      • 2023-06-07 15811, 2023

      • yvanzo
        atj, zas: Might it be that docker-server-configs working copy at paco was not up-to-date when reosarevok tried to update beta?
      • 2023-06-07 15812, 2023

      • monkey
        zas thanks for checking. Mystery. I swear test.LB and test.BB were working yesterday after the consul migration, I checked them
      • 2023-06-07 15802, 2023

      • reosarevok
        monkey: do you have a constants file? I'd put the constants in that file already if so, so that everyone has a clear view of the meanings from the get go :)
      • 2023-06-07 15803, 2023

      • yvanzo
        Since the script that failed is the one that zas patched in the PR. The error message was possibly about the consul container being stopped.
      • 2023-06-07 15843, 2023

      • zas
        monkey: I keep searching, the problem is real, that's just not that
      • 2023-06-07 15853, 2023

      • monkey
        Yep
      • 2023-06-07 15829, 2023

      • reosarevok
        yvanzo: ok, I guess I'll continue with a prod release then for now and see if it all works, unless you have anything against it? :)
      • 2023-06-07 15840, 2023

      • reosarevok
        Well, after a brief check that beta works :)
      • 2023-06-07 15806, 2023

      • monkey
        reosarevok: Good call. We don't have a central constants file yet but there's a good place for it
      • 2023-06-07 15823, 2023

      • reosarevok
      • 2023-06-07 15840, 2023

      • reosarevok
        zas: is there some expected issue with staticbrainz?
      • 2023-06-07 15859, 2023

      • monkey
        I see a few websites went down in the past coupl eof minutes
      • 2023-06-07 15814, 2023

      • monkey
        (CB BB LB)
      • 2023-06-07 15817, 2023

      • monkey
        Could be related
      • 2023-06-07 15822, 2023

      • yvanzo
        reosarevok: Do you have the full log of this failed attempt to update beta?
      • 2023-06-07 15844, 2023

      • reosarevok
        yvanzo: sending it in private :)
      • 2023-06-07 15822, 2023

      • zas
        something weird and bad is happening
      • 2023-06-07 15827, 2023

      • zas
        checking
      • 2023-06-07 15847, 2023

      • yvanzo
        Sorry, it was already the full log.
      • 2023-06-07 15805, 2023

      • zas
        2023/06/07 09:10:43 [error] 267#267: *7374 lua tcp socket connect timed out, when connecting to 10.2.3.1:6379, context: ssl_certificate_by_lua*, client: 10.2.2.60, server: 0.0.0.0:60443