16:07 PM
zas
ok, good
2023-06-06 15704, 2023
16:08 PM
atj
it's going to take a few mins to complete the rest because we have to update apt package cache and then install the new package
2023-06-06 15736, 2023
16:08 PM
atj
also restarting the service takes some time for some reason
2023-06-06 15752, 2023
16:08 PM
atj
i think consul doesn't signal success to systemd until various internal checks have passed
2023-06-06 15721, 2023
16:09 PM
zas
likely
2023-06-06 15700, 2023
16:10 PM
zas
2023-06-06 15721, 2023
16:10 PM
zas
clash done
2023-06-06 15734, 2023
16:10 PM
atj
yeah, i think that when that message is logged is when the service restart completes
2023-06-06 15707, 2023
16:11 PM
zas
2023-06-06 15724, 2023
16:11 PM
zas
~90 seconds later
2023-06-06 15730, 2023
16:11 PM
atj
suspicious that it seems to take exactly 1m30
2023-06-06 15733, 2023
16:11 PM
atj
yeah
2023-06-06 15705, 2023
16:12 PM
atj
i think we should set serial to 2 or 3 when upgrading clients in future
2023-06-06 15723, 2023
16:12 PM
atj
this is going to take a little while
2023-06-06 15756, 2023
16:12 PM
zas
2 minutes per server, but we could do them in parallel
2023-06-06 15705, 2023
16:13 PM
atj
well maybe 2 or 3
2023-06-06 15722, 2023
16:13 PM
zas
for clients, I don't think that's a problem
2023-06-06 15737, 2023
16:13 PM
atj
got a failed got gaga and then a join
2023-06-06 15743, 2023
16:13 PM
atj
*for gaga
2023-06-06 15746, 2023
16:13 PM
zas
yes, I saw that
2023-06-06 15707, 2023
16:14 PM
zas
same for hip
2023-06-06 15713, 2023
16:14 PM
zas
messages are obscure...
2023-06-06 15720, 2023
16:15 PM
monkey
Go team go ! You both get a consulation prize at the end of this, right?
2023-06-06 15736, 2023
16:15 PM
atj
i have beers in the fridge
2023-06-06 15707, 2023
16:16 PM
monkey
(that wasn't a typo)
2023-06-06 15729, 2023
16:16 PM
zas
kiss load is quite high
2023-06-06 15735, 2023
16:16 PM
rdswift got the joke.
2023-06-06 15748, 2023
16:16 PM
atj
sorry monkey, sense of humour bypass
2023-06-06 15753, 2023
16:16 PM
zas
:D
2023-06-06 15758, 2023
16:16 PM
monkey
Understandable
2023-06-06 15717, 2023
16:17 PM
atj
quite high is an understatement
2023-06-06 15733, 2023
16:17 PM
atj
ah, just dropped
2023-06-06 15753, 2023
16:17 PM
atj
was it due to a consul service causing reloads / restarts?
2023-06-06 15747, 2023
16:18 PM
zas
2023-06-06 15705, 2023
16:19 PM
zas
time is matching
2023-06-06 15738, 2023
16:19 PM
zas
but the load increases started 15 minutes sooner
2023-06-06 15706, 2023
16:20 PM
atj
4 left
2023-06-06 15708, 2023
16:22 PM
zas
we don't have EventMemberUpdate each time...
2023-06-06 15751, 2023
16:22 PM
atj
when that happens the service restarts almost instantly
2023-06-06 15717, 2023
16:23 PM
zas
2023-06-06 15735, 2023
16:23 PM
atj
we're going to get an update from zappa
2023-06-06 15739, 2023
16:23 PM
atj
then it's done
2023-06-06 15705, 2023
16:24 PM
zas
ok, I think we can restore services now
2023-06-06 15742, 2023
16:24 PM
atj
ok, done
2023-06-06 15755, 2023
16:24 PM
atj
thank god for that
2023-06-06 15708, 2023
16:25 PM
zas
ready to go?
2023-06-06 15713, 2023
16:25 PM
atj
yep
2023-06-06 15731, 2023
16:27 PM
zas
ok, everything's back
2023-06-06 15700, 2023
16:28 PM
zas
atj: please commit playbooks you used for the upgrade
2023-06-06 15705, 2023
16:28 PM
monkey
Should I tweet we're back online?
2023-06-06 15719, 2023
16:28 PM
atj
if everyone is happy things are working
2023-06-06 15712, 2023
16:29 PM
monkey
I checked BB, LB and CB web pages, working š
2023-06-06 15718, 2023
16:29 PM
monkey tweets for those three
2023-06-06 15734, 2023
16:29 PM
monkey
LB API also responding
2023-06-06 15732, 2023
16:30 PM
zas
we have few alerts still on, but most should resolve soon
2023-06-06 15701, 2023
16:31 PM
bitmap
MB website and WS look ok
2023-06-06 15744, 2023
16:31 PM
zas
2023-06-06 15756, 2023
16:31 PM
bitmap
I can push consul config changes to docker-server-configs now, right?
2023-06-06 15710, 2023
16:32 PM
zas
bitmap: yes
2023-06-06 15719, 2023
16:32 PM
bitmap
thanks
2023-06-06 15744, 2023
16:32 PM
monkey
Tweeted for BB, CB and LB.
2023-06-06 15759, 2023
16:32 PM
zas
atj: we have to go through servers to remove old containers: dnsmasq, consulagent
2023-06-06 15745, 2023
16:34 PM
zas
atj: you can merge the consul-migration branch now
2023-06-06 15701, 2023
16:35 PM
atj
zas: i'm just re-arranging and amending some commits
2023-06-06 15706, 2023
16:36 PM
monkey
!m atj and zas š
2023-06-06 15706, 2023
16:36 PM
BrainzBot
You're doing good work, atj and zas š!
2023-06-06 15745, 2023
16:37 PM
akshaaatt
2023-06-06 15727, 2023
16:38 PM
akshaaatt
I mean, people dig such facts. The likes, shares and comments on the post can tell
2023-06-06 15738, 2023
16:38 PM
akshaaatt
This is a good way to make noise about our stats
2023-06-06 15752, 2023
16:38 PM
akshaaatt
However, I think MB would play a bigger role in all this
2023-06-06 15711, 2023
16:39 PM
zas
atj: I'll clean old containers
2023-06-06 15723, 2023
16:39 PM
atj
zas: ok thanks
2023-06-06 15757, 2023
16:43 PM
atj
2023-06-06 15753, 2023
16:44 PM
vardan joined the channel
2023-06-06 15759, 2023
16:44 PM
atj
just have another quick look through and confirm you're happy
2023-06-06 15757, 2023
16:45 PM
atj
bitmap: test. is still b0rked, do you know what the issue is? i think Pratha-Fish was hoping to use it for his GSoC development
2023-06-06 15735, 2023
16:47 PM
reosarevok
zas, atj, bitmap: can I release MBS now? :)
2023-06-06 15704, 2023
16:51 PM
bitmap
atj: Pratha-Fish: yeah Iām importing a new test DB now, will let you know when itās ready
2023-06-06 15702, 2023
16:52 PM
bitmap
reosarevok: seems so
2023-06-06 15743, 2023
16:52 PM
reosarevok
Ok :)
2023-06-06 15746, 2023
16:52 PM
zas
reosarevok: yes, but beware running scripts from docker-server-configs
2023-06-06 15757, 2023
16:52 PM
reosarevok
Oh. Still cannot do that?
2023-06-06 15707, 2023
16:53 PM
zas
you can, but carefully
2023-06-06 15709, 2023
16:53 PM
reosarevok
The upgrade system checks stuff in d-s-c
2023-06-06 15711, 2023
16:53 PM
reosarevok
Oh
2023-06-06 15714, 2023
16:53 PM
zas
because I made a lot of changes
2023-06-06 15727, 2023
16:53 PM
reosarevok
Well only one way to find out if it works I guess
2023-06-06 15737, 2023
16:53 PM
reosarevok
I'll do beta first and hope for the best
2023-06-06 15753, 2023
16:53 PM
reosarevok
2023-06-06 15719, 2023
16:56 PM
BrainzGit
2023-06-06 15752, 2023
16:56 PM
reosarevok
I guess I'll skip translations this time since yvanzo hasn't mentioned being done with weblate
2023-06-06 15713, 2023
17:01 PM
atj
bitmap: thanks
2023-06-06 15738, 2023
17:04 PM
reosarevok
Trying a beta update
2023-06-06 15746, 2023
17:04 PM
reosarevok
2023-06-06 15756, 2023
17:04 PM
reosarevok
Guess not trivial
2023-06-06 15755, 2023
17:05 PM
reosarevok
2023-06-06 15709, 2023
17:06 PM
reosarevok
I assume on
2023-06-06 15711, 2023
17:06 PM
reosarevok
2023-06-06 15710, 2023
17:07 PM
reosarevok
2023-06-06 15718, 2023
17:07 PM
reosarevok
Or maybe something really is not running, but
2023-06-06 15713, 2023
17:09 PM
Pratha-Fish
mayhem epic. I"ll reach out to you soon about troi. Gotta put that degree in use somewhere šæ
2023-06-06 15732, 2023
17:09 PM
atj
reosarevok: can you run bash -x ./script/update_containers.sh beta
2023-06-06 15727, 2023
17:10 PM
reosarevok
Sure can try
2023-06-06 15740, 2023
17:10 PM
Pratha-Fish
reosarevok: bitmap hey thanks for the quick diagnosis, but it's alright if you take your time. I am unfortunately out of station for today and tomorrow š„². Please take your time fixing it
2023-06-06 15710, 2023
17:12 PM
reosarevok
atj: I guess it's safe to paste the log here? :)
2023-06-06 15717, 2023
17:12 PM
atj
not sure
2023-06-06 15727, 2023
17:12 PM
reosarevok
I'll paste in pm in case then
2023-06-06 15753, 2023
17:15 PM
atj
2023-06-06 15736, 2023
17:16 PM
reosarevok
The running_image assignment is getting an id instead of the name that I assume was getting before
2023-06-06 15757, 2023
17:16 PM
atj
$running_image is a container id, but $updated_image is a container name
2023-06-06 15755, 2023
17:18 PM
reosarevok
Is there a reason why the result of docker ps --filter "name=$container" --format '{{.Image}}' would have changed?
2023-06-06 15743, 2023
17:21 PM
zas
nope, but if you want the name that's not .Image
2023-06-06 15733, 2023
17:22 PM
zas
2023-06-06 15740, 2023
17:22 PM
zas
those are running on paco
2023-06-06 15754, 2023
17:22 PM
zas
2023-06-06 15739, 2023
17:23 PM
atj
docker ps --filter name=musicbrainz-webservice-beta --format '{{.Names}}'
2023-06-06 15757, 2023
17:23 PM
atj
kinda of redundant tho i guess L()
2023-06-06 15711, 2023
17:24 PM
zas
but if you filter by name ... I guess you have it
2023-06-06 15729, 2023
17:24 PM
zas
reosarevok: what do you want to achieve?
2023-06-06 15759, 2023
17:24 PM
atj
i guess it's to check if the docker image matches?
2023-06-06 15721, 2023
17:25 PM
atj
which would need the ID rather than the name
2023-06-06 15744, 2023
17:25 PM
reosarevok
This is not my code, but yeah, the idea is to check if the image needs updating or not
2023-06-06 15712, 2023
17:26 PM
atj
yes, who wrote this code? i thought it was zas :P
2023-06-06 15724, 2023
17:26 PM
akshaaatt
Hi theflash_ !
2023-06-06 15701, 2023
17:27 PM
zas
not at all
2023-06-06 15713, 2023
17:27 PM
reosarevok
yvanzo:
2023-06-06 15718, 2023
17:27 PM
reosarevok
* without the :
2023-06-06 15722, 2023
17:27 PM
akshaaatt
Can you please go to your local codebase on xcode, click on the artist model file, add it to Target Membership from the right panel and then push that code to github? theflash_
2023-06-06 15702, 2023
17:28 PM
reosarevok
Basically, it checks whether the new image we have is the same as the one already running, if it is it does nothing, if it is not it puts the container in maintenance mode and then updates it, then puts it out of maintenance mode
2023-06-06 15708, 2023
17:28 PM
reosarevok
Don't ask me what maintenance mode did, I don't remember
2023-06-06 15732, 2023
17:28 PM
zas
also the filter should probably be stricter to avoid issues
2023-06-06 15736, 2023
17:28 PM
zas
that's a regex
2023-06-06 15744, 2023
17:28 PM
zas
--filter "name=^musicbrainz-webservice-beta$"
2023-06-06 15708, 2023
17:31 PM
zas
2023-06-06 15743, 2023
17:31 PM
zas
about spotify_metadata
2023-06-06 15746, 2023
17:32 PM
zas
atj: do you have the change to hold the docker version in Ansible ready? I don't think you committed it
2023-06-06 15736, 2023
17:33 PM
BrainzGit
2023-06-06 15749, 2023
17:33 PM
BrainzGit
2023-06-06 15721, 2023
17:34 PM
BrainzGit
2023-06-06 15716, 2023
17:35 PM
reosarevok
Ok, I'll talk about it with yvanzo in the morning :)
2023-06-06 15737, 2023
17:35 PM
CatQuest
š
2023-06-06 15715, 2023
17:36 PM
CatQuest
šæ
2023-06-06 15759, 2023
17:48 PM
ansh has quit
2023-06-06 15704, 2023
17:49 PM
Maxr1998 joined the channel
2023-06-06 15706, 2023
17:49 PM
Pratha-Fish has quit
2023-06-06 15708, 2023
17:49 PM
ansh joined the channel
2023-06-06 15731, 2023
17:49 PM
Maxr1998_ has quit
2023-06-06 15732, 2023
17:49 PM
shivam_ has quit
2023-06-06 15740, 2023
17:49 PM
vscode has quit
2023-06-06 15741, 2023
17:49 PM
Pratha-Fish joined the channel
