reosarevok: it's trying to connect to floyd for some reason
even though the config contains no references to floyd
human joined the channel
human has quit
reosarevok: i think this is related to the postgres changes bitmap made yesterday. there is no pgbouncer container running on floyd, but critiquebranz is trying to connect to one
reosarevok
Can we bounce them elsewhere? :P
human joined the channel
aaditya joined the channel
aaditya has quit
human has quit
human joined the channel
mayhem
safe travels home akshaaatt -- you're the last person to return from the summit. next time you're in barcelona we'll unravel the dark mysteries of how shower curtains work. another exciting trip, for sure!
yeah, we should depricate that piece, and just tell people to use LB API, but I'll got restart it.
atj
reosarevok: I could probably hard code some IPs, but I don't really want to mess with stuff I don't fully understand, especially when it's database related
reosarevok
Seems ok to wait for bitmap
bitmap
mayhem fixed it already but basically you just need to restart the container if that happens
mayhem
critiquebrainz-web-prod is what I restarted
bitmap
if we have any other projcets using uwsgi it'd be nice to compare their setup and find out why cb's is borked
atj
bitmap: ffs :P
i restarted uwsgi and it was still broken, so i thought a container restart was pointless
bitmap
yeah! I tried restarting the runit service at first too but it wouldn't take
atj
I guess I should trust in the old three-finger salute method more
bitmap
aerozol: thanks for the posts, was gonna ping you today but should've done it sooner :)
yvanzo: zas: hi, so in order to move sir-prod off of floyd and onto hendrix, I understand we have to whitelist hendrix's IP somewhere. could you help with that?
one is for master/primary connections, one for slave/standby connections, and another for "any" (unused, but useful if we want to distribute read only queries to either the master or standby in the future)
atj
would be good to work out what this uwsgi issue is
zas
bitmap: then we should adapt so we can get stats for all pgbouncer instances
reosarevok
It says "One limitation of the approach used here is that it doesn't detect relationship changes." - maybe you have any suggestions for that :)
bitmap
reosarevok: not yet, but I can check it later today
reosarevok
Perfect
Would be good to put a beta out tonight or tomorrow
But I see you're quite busy today :D
bitmap
zas: the relevant containers now are postgres-jimmy, postgres-hendrix, pgbouncer-master, pgbouncer-slave, pgbouncer-any, and haproxy-postgres
zas
bitmap: ok, thanks, I'll add them
bitmap
if there is an easy way to add haproxy stats to telegraf, it might be useful too
pgbouncer connects to haproxy, haproxy to pg
zas
bitmap: yes, I was thinking about it, we may need to make few changes to haproxy configs so telegraf can gather stats from them, I'll have a look at this this week
bitmap: we need to have /stats endpoint accessible on haproxy containers on hendrix/jimmy, it runs on port 8182 according to config, but this port isn't exposed by containers it seems
I had a great meeting with monkey where we discussed some of the blockers for this PR.
Other than that I spent time working on getting spark to work with the new filters, and fixing some frontend tests.
Thats it for me
'''
yvanzo said:
'''
Last week I worked mostly on actionable tasks following the summit: writing notes, prepping weblate, fixing small issues, triaging tickets, and a bit of support…
'''
aerozol said:
'''
It’s a holiday/long weekend here, and Lucy-Belle’s birthday, so I almost forgot it was Monday! I didn’t though. Lucky lucky you.
mayhem
stitches? what did I miss?
sounds like an unusal merge conflict
reosarevok
aerozol said:
'''
It’s a holiday/long weekend here, and Lucy-Belle’s birthday, so I almost forgot it was Monday! I didn’t though. Lucky lucky you.
mayhem
oy, not too bad I hope!
reosarevok
Last week I mainly worked on other client work, but I did a bit more work on the summit 23 blog post. I will post it Wednesday.
Other than that I made some changes to the Fresh Releases redesign mockup, that Ansh has made great progress on, and noodled about with some design considerations with monkey
I also added YouTube videos/walkthroughs to a bunch of wiki pages
The person who is second (after me) most likely to forget it’s Monday can go next
'''
monkey
Mon-what?
reosarevok
I'm not sure how likely FishFish is to forget it's Monday but here's his review:
