ok, let me read up about this. I will set this up later then and test the builds. I'll write you on the results. But thanks a lot for setting this up, I love it. That there was no full CI deployment for this porject already bothered me
(FWIW, I have a few listens submitted with the current code: https://api.listenbrainz.org/1/user/Freso/listens - only local files though, so the `music_service` part hasn’t been tested in action (yet).)
2021-11-01 30533, 2021
zas
I deployed serviceregistrator on serge & zappa, it replaces registrator. I'll continue deployment over the week, I'm careful because this stuff is quite critical in our infra.
2021-11-01 30539, 2021
Sophist-UK joined the channel
2021-11-01 30558, 2021
Sophist_UK has quit
2021-11-01 30533, 2021
alastairp
Freso: it means that I will look at your stuff at the same time as I finish this PR
2021-11-01 30550, 2021
Freso
alastairp: Alright. Thanks. :)
2021-11-01 30550, 2021
yyoung[m]
Hi Freso , I've been quite busy recently and there're some problems with my development environment, so nothing to review for last week :)
2021-11-01 30540, 2021
Freso
yyoung[m]: 👍 You’re not under any obligation to give a review btw (anymore), so if you’re not on my list at https://wiki.musicbrainz.org/User:Freso/MetaBrain… and you don’t mail anything to me, you won’t be called on for the reviews. :)
2021-11-01 30541, 2021
yyoung[m]
OK
2021-11-01 30516, 2021
outsidecontext
akshat: the deployment does not work yet :( Complains about "The Android App Bundle was not signed.", but I don't see any error to the signing itself. It's supposed to work, as far as I can tell the secrets are setup correctly. Any ideas? https://github.com/phw/PicardBarcodeScanner/runs/…
2021-11-01 30509, 2021
BrainzGit joined the channel
2021-11-01 30527, 2021
zas
switching to herb, for maint
2021-11-01 30522, 2021
zas
hmmm, something went wrong
2021-11-01 30510, 2021
lucifer
uh yeah, all websites inaccessible. any way we can help?
2021-11-01 30505, 2021
zas
well, not sure what's happening, since sometimes it works
2021-11-01 30528, 2021
zas
I think we had similar issue in the past, it was related to hetzner floating IP
2021-11-01 30536, 2021
lucifer
currently unable to ssh to herb.
2021-11-01 30546, 2021
zas
yes, rebooting right now
2021-11-01 30556, 2021
zas
I'll switch to it when it will come back
2021-11-01 30556, 2021
lucifer
👍
2021-11-01 30507, 2021
zas
I think that's an issue at IP or TCP level, nginx doesn't output any error, config is ok
2021-11-01 30544, 2021
zas
switching to herb
2021-11-01 30559, 2021
zas
help welcome if someone can identify the actual issue
2021-11-01 30537, 2021
zas
rebooting kiki
2021-11-01 30528, 2021
ruaok
zas: want a second set of eyes?
2021-11-01 30558, 2021
Sophist_UK joined the channel
2021-11-01 30558, 2021
Sophist_UK has quit
2021-11-01 30558, 2021
Sophist_UK joined the channel
2021-11-01 30541, 2021
Sophist-UK has quit
2021-11-01 30500, 2021
zas
yes, definitively
2021-11-01 30514, 2021
zas
I'm switching back to kiki
2021-11-01 30501, 2021
zas
something broke, but everything looks ok, but that's related to IP failover
2021-11-01 30529, 2021
Sophist_UK has quit
2021-11-01 30530, 2021
Sophist-UK joined the channel
2021-11-01 30530, 2021
Sophist-UK has quit
2021-11-01 30530, 2021
Sophist-UK joined the channel
2021-11-01 30516, 2021
ruaok
ok, where do you want me to start looking?
2021-11-01 30524, 2021
zas
weird, I can ssh to kiki, but ping doesn't work...
2021-11-01 30508, 2021
zas
I guess that's a network level issue, so you can start to look at everything related to network
2021-11-01 30559, 2021
lucifer
openresty on kiki has several consul errors in logs.
2021-11-01 30550, 2021
lucifer
on herb, it has warnings related to dependencies. not sure if its just noise.
2021-11-01 30530, 2021
ruaok
MB backend response times peaked as well. which is odd.
2021-11-01 30506, 2021
akshat
Hi outsidecontext ! Let me take a look at it
2021-11-01 30507, 2021
lucifer
other sites are plain inaccessible.
2021-11-01 30529, 2021
ruaok
confirmed can ping herb, but not kiki. ssh to kiki works fine
2021-11-01 30556, 2021
zas
and that's definitively very weird
2021-11-01 30516, 2021
ruaok
consul seems to be the using a bit of CPU -- more than anything else. that suggests something is miss there.
2021-11-01 30534, 2021
ruaok
not that anythings IS using much CPU.
2021-11-01 30549, 2021
lucifer
firewall?
2021-11-01 30557, 2021
outsidecontext
akshat: something does not seem to be correct with the signing config. I think it doesn't use the values from keystore.properties at all
akshat: just did that. I think I chancged this in a previous attempt to fix the signing, but I now see that was wrong. But also fixed updating the keystore.properties, that was generated wrongly. Let's see
2021-11-01 30510, 2021
akshat
Great!
2021-11-01 30526, 2021
zas
ah yes, that's me, I noticed some packets were blocked on lo, which shouldn't happen, but I guess that not the actual problem
2021-11-01 30543, 2021
zas
ruaok: I'll stop kiki
2021-11-01 30548, 2021
outsidecontext
akshat: same :(
2021-11-01 30555, 2021
ruaok
zas: do it
2021-11-01 30516, 2021
akshat
Hahahah I've dealt with this all throughout the weekend😂
