updated the gist with the timestamp of every occurence, if that helps narrow down a problem
2016-08-11 22443, 2016
rvedotrc has quit
2016-08-11 22405, 2016
rvedotrc joined the channel
2016-08-11 22419, 2016
ruaok
yeah, we've been seeing random 504s. they are not just limited to one site, which suggests that it is a gateway problem
2016-08-11 22420, 2016
bitmap
ah
2016-08-11 22442, 2016
bitmap
I'll add some code to retry to request there anyway
2016-08-11 22430, 2016
pingupingu has quit
2016-08-11 22425, 2016
pingupingu joined the channel
2016-08-11 22425, 2016
pingupingu has quit
2016-08-11 22425, 2016
pingupingu joined the channel
2016-08-11 22414, 2016
UmkaDK has quit
2016-08-11 22441, 2016
UmkaDK joined the channel
2016-08-11 22429, 2016
ruaok
Gentlecat: does the sentry setup catch 504s for meb on sakura?
2016-08-11 22428, 2016
reosarevok is in Spain now, will be somewhat more active :)
2016-08-11 22432, 2016
reosarevok
Still no mobile internet, mind
2016-08-11 22444, 2016
reosarevok answered all the emails for now
2016-08-11 22405, 2016
reosarevok sighs at 5 days of subscription edit mails :D
2016-08-11 22421, 2016
Gentlecat
ruaok: of its in the app, it should
2016-08-11 22425, 2016
Gentlecat
if*
2016-08-11 22437, 2016
ruaok
ok, then it idn
2016-08-11 22443, 2016
ruaok
isn't sakura's fault.
2016-08-11 22408, 2016
drsaunders has quit
2016-08-11 22449, 2016
ZarkBit joined the channel
2016-08-11 22422, 2016
D4RK-PH0ENiX has quit
2016-08-11 22435, 2016
D4RK-PH0ENiX joined the channel
2016-08-11 22440, 2016
D4RK-PH0ENiX has quit
2016-08-11 22407, 2016
D4RK-PH0ENiX joined the channel
2016-08-11 22400, 2016
adhawkins
Morning. Just came in to see if you were interested in another 504 report, but it seems like you already know about them :)
2016-08-11 22405, 2016
ariscop has quit
2016-08-11 22430, 2016
adhawkins
For what it's worth, I had another at 05:16:02 downloading a replication packet.
2016-08-11 22412, 2016
ruaok
yeah, we know.
2016-08-11 22444, 2016
ruaok
at least we no know that it is a gateway problem and not a app server problem.
2016-08-11 22419, 2016
ruaok
and I'd hate to stick zas on it, because we should be focusing on moving to NewHost, but zas remains on vacation.
2016-08-11 22448, 2016
ruaok
so, shitty service will remain.
2016-08-11 22447, 2016
ruaok desperately hopes that a time will come when he won't feel super frustrated about work
2016-08-11 22406, 2016
adhawkins
It's not so bad to be honest. I only notice it because occasionally I get a failure email from my slave server. It seems to recover itself the following hour.
2016-08-11 22457, 2016
zas
Replication related 504s are due to Sakura, they happen when it swaps heavily. I'm working on openresty container atm
2016-08-11 22453, 2016
ruaok
and why is sakura swapping?
2016-08-11 22416, 2016
ruaok
75 uwsgi processes running.
2016-08-11 22418, 2016
ruaok
gee, I wonder.
2016-08-11 22415, 2016
ruaok
adhawkins: let me know if it happens again
2016-08-11 22435, 2016
ruaok
zas: does graphana have a graph for examining memory usage for a given server?