0:00 AM
ruaok
nn freso
2016-11-08 31332, 2016
0:00 AM
ruaok
musicbrainz and caa updated.
2016-11-08 31354, 2016
0:27 AM
esmiurium joined the channel
2016-11-08 31347, 2016
0:35 AM
ruaok
chirlu: rika is up.
2016-11-08 31349, 2016
0:35 AM
ruaok
you still up?
2016-11-08 31359, 2016
0:35 AM
chirlu
Yes, I logged in already.
2016-11-08 31325, 2016
0:36 AM
chirlu
But Postgres doesn’t seem to be running.
2016-11-08 31322, 2016
0:37 AM
ruaok
great.
2016-11-08 31329, 2016
0:37 AM
ruaok
you have sudo, so you can start PG.
2016-11-08 31342, 2016
0:38 AM
ruaok
do what you can. I also have a 2TB portable drive that I am going to backup stuff to.
2016-11-08 31350, 2016
0:38 AM
ruaok
if you want to toss things for me to copy, mail me.
2016-11-08 31355, 2016
0:38 AM
ruaok bugs out of DWNI again
2016-11-08 31314, 2016
0:39 AM
chirlu
ruaok: sudo wants my password, which I don’t know (I set it to some random value after setting up pubkey auth years ago).
2016-11-08 31300, 2016
0:42 AM
bitmap
what's rika's IP?
2016-11-08 31324, 2016
0:42 AM
chirlu
72.29.167.152
2016-11-08 31346, 2016
0:43 AM
bitmap
can you sudo now?
2016-11-08 31349, 2016
0:45 AM
chirlu
Yes, thanks.
2016-11-08 31325, 2016
0:46 AM
JesseW joined the channel
2016-11-08 31325, 2016
0:46 AM
chirlu
Pg running.
2016-11-08 31341, 2016
0:50 AM
ruaok
bitmap: zas: Gentlecat: we've been OKed to use as much bandwidth as we need.
2016-11-08 31348, 2016
0:50 AM
ruaok
so, no need for downtime.
2016-11-08 31352, 2016
0:50 AM
ruaok
I'll update the doc
2016-11-08 31357, 2016
0:50 AM
bitmap
sweet
2016-11-08 31348, 2016
0:53 AM
ruaok
done.
2016-11-08 31319, 2016
0:54 AM
ruaok
ok, we need to do no limiting on our end. just let'er rip. :)
2016-11-08 31342, 2016
1:05 AM
Zialus has quit
2016-11-08 31350, 2016
1:09 AM
chirlu has quit
2016-11-08 31332, 2016
1:29 AM
chirlu joined the channel
2016-11-08 31323, 2016
1:42 AM
chirlu
Reportstool data saved.
2016-11-08 31329, 2016
1:43 AM
chirlu
If anyone else also wants it, you can fetch ~chirlu/reportstool.tar.xz (note that the configuration file contains the OAuth secret value that is probably still valid).
2016-11-08 31335, 2016
1:43 AM
Lotheric_ joined the channel
2016-11-08 31357, 2016
1:46 AM
Lotheric__ has quit
2016-11-08 31311, 2016
2:24 AM
bitmap
staticbrainz is part of the gateway configuration now
2016-11-08 31328, 2016
2:25 AM
bitmap
2016-11-08 31358, 2016
2:31 AM
opatel99 joined the channel
2016-11-08 31354, 2016
2:39 AM
legoktm
Did MB get selected for GCI?
2016-11-08 31346, 2016
2:40 AM
chirlu
Apparently yes.
2016-11-08 31302, 2016
2:42 AM
chirlu
So was Wikimedia.
2016-11-08 31316, 2016
2:43 AM
chirlu
ruaok: I think I’m finished with rika.
2016-11-08 31327, 2016
2:43 AM
chirlu also saved the sleepycat.png.
2016-11-08 31328, 2016
2:44 AM
ruaok
Lol.
2016-11-08 31346, 2016
2:44 AM
ruaok
Is there anything else I should copy off rika?
2016-11-08 31359, 2016
2:44 AM
ruaok
And thanks, for your help here...
2016-11-08 31301, 2016
2:49 AM
chirlu
Well, I’m not aware of anything important. Of course, the safest way is always to keep a full backup. :-)
2016-11-08 31330, 2016
2:58 AM
Leftmost
Nothing of import in my stuff.
2016-11-08 31327, 2016
2:59 AM
bitmap
I'm copying some historical artifacts
2016-11-08 31317, 2016
3:26 AM
legoktm
chirlu: Yeah, I knew about Wikimedia :) and sweet!
2016-11-08 31313, 2016
3:27 AM
chirlu
2016-11-08 31342, 2016
3:29 AM
legoktm
ah, thanks
2016-11-08 31329, 2016
3:52 AM
magerharz has quit
2016-11-08 31340, 2016
3:56 AM
Leftmost has quit
2016-11-08 31355, 2016
4:03 AM
Leftmost joined the channel
2016-11-08 31329, 2016
4:06 AM
Slurpee has quit
2016-11-08 31312, 2016
4:26 AM
Leftmost has quit
2016-11-08 31301, 2016
4:44 AM
Leftmost joined the channel
2016-11-08 31340, 2016
5:16 AM
opatel99 has quit
2016-11-08 31308, 2016
5:17 AM
eharris has quit
2016-11-08 31309, 2016
5:17 AM
dseomn has quit
2016-11-08 31317, 2016
5:17 AM
eharris joined the channel
2016-11-08 31337, 2016
5:17 AM
vin-ivar has quit
2016-11-08 31301, 2016
5:18 AM
dseomn joined the channel
2016-11-08 31304, 2016
5:18 AM
CallerNo6 has quit
2016-11-08 31331, 2016
5:18 AM
CallerNo6 joined the channel
2016-11-08 31339, 2016
5:20 AM
vin-ivar joined the channel
2016-11-08 31354, 2016
5:31 AM
kyan has quit
2016-11-08 31306, 2016
5:54 AM
Nyanko-sensei joined the channel
2016-11-08 31337, 2016
5:57 AM
D4RK-PH0ENiX has quit
2016-11-08 31346, 2016
6:32 AM
Nyanko-sensei has quit
2016-11-08 31312, 2016
6:33 AM
D4RK-PH0ENiX joined the channel
2016-11-08 31344, 2016
6:55 AM
zas
moin
2016-11-08 31303, 2016
6:56 AM
bitmap
moin
2016-11-08 31303, 2016
7:01 AM
JesseW has quit
2016-11-08 31348, 2016
7:15 AM
dboys_ joined the channel
2016-11-08 31342, 2016
7:24 AM
JonnyJD_ joined the channel
2016-11-08 31345, 2016
7:26 AM
armalcolite
wow! MB gets selected again.
2016-11-08 31321, 2016
7:28 AM
armalcolite
Freso: if there is anything that i can do then please inform me.
2016-11-08 31327, 2016
7:43 AM
mihaitish joined the channel
2016-11-08 31324, 2016
7:50 AM
yeeeargh joined the channel
2016-11-08 31314, 2016
8:13 AM
JonnyJD_ has quit
2016-11-08 31303, 2016
9:03 AM
github joined the channel
2016-11-08 31303, 2016
9:03 AM
github
2016-11-08 31303, 2016
9:03 AM
github has left the channel
2016-11-08 31345, 2016
9:04 AM
zas
1300 req/s on ws for 200 concurrent connections, bottleneck is number of ws containers, not db (it depends on requests ofc)
2016-11-08 31301, 2016
9:05 AM
zas
and 3500 req/s on static files
2016-11-08 31347, 2016
9:05 AM
zas
^^ this is to make ruaok happy even before coffee ;)
2016-11-08 31329, 2016
9:12 AM
UmkaDK has quit
2016-11-08 31313, 2016
9:13 AM
UmkaDK joined the channel
2016-11-08 31345, 2016
9:36 AM
chirlu has quit
2016-11-08 31310, 2016
9:37 AM
chirlu joined the channel
2016-11-08 31310, 2016
10:30 AM
lazka joined the channel
2016-11-08 31341, 2016
10:55 AM
Freso has quit
2016-11-08 31313, 2016
10:56 AM
Freso joined the channel
2016-11-08 31356, 2016
11:06 AM
Gentlecat
zas: remind me how to check if multiple backends are being used by nginx
2016-11-08 31313, 2016
11:07 AM
Gentlecat
I just added another meb container, want to see if it shows up
2016-11-08 31320, 2016
11:07 AM
zas
Hey
2016-11-08 31341, 2016
11:08 AM
zas
no easy way yet, but log in kiki and do
2016-11-08 31345, 2016
11:08 AM
zas
grep -A20 -F '# metabrainz' /home/zas/openresty-gateways/files/nginx/conf.d/upstreams-auto-generated.conf
2016-11-08 31305, 2016
11:09 AM
zas
replace metabrainz by your service name
2016-11-08 31338, 2016
11:09 AM
Gentlecat
2016-11-08 31300, 2016
11:10 AM
zas
important thing
2016-11-08 31311, 2016
11:10 AM
zas
we discovered an issue related to consul http checks
2016-11-08 31352, 2016
11:10 AM
Gentlecat
what's the issue?
2016-11-08 31302, 2016
11:11 AM
zas
under heavy load, if your service doesn't return 429 responses (too many requests), consul may consider the upstream as dead
2016-11-08 31333, 2016
11:11 AM
zas
and therefore remove it from this list, balancing the load to the remaining upstreams, eventually cascading to death
2016-11-08 31344, 2016
11:12 AM
zas
if under too many requests your service returns 5xx (or anything != 429), better use tcp health checks
2016-11-08 31310, 2016
11:13 AM
zas
we did that dor mb services (because they suck, using 5xx instead of 429)
2016-11-08 31347, 2016
11:14 AM
zas
2016-11-08 31305, 2016
11:15 AM
zas
"The status of the service depends on the HTTP response code: any 2xx code is considered passing, a 429 Too Many Requests is a warning, and anything else is a failure."
2016-11-08 31343, 2016
11:15 AM
zas
and if it is a failure... upstream is removed after few secs
2016-11-08 31309, 2016
11:16 AM
zas
i discovered it the hard way while doing load tests
2016-11-08 31313, 2016
11:17 AM
zas
2016-11-08 31315, 2016
11:19 AM
Leo_Verto has quit
2016-11-08 31304, 2016
11:21 AM
Gentlecat
almost all of the containers I've made are using TCP check because they are based on uWSGI
2016-11-08 31337, 2016
11:21 AM
Gentlecat
the only two exceptions are mbspotify nginx container (which is a bit broken now anyway) and sentry
2016-11-08 31328, 2016
11:41 AM
D4RK-PH0ENiX has quit
2016-11-08 31300, 2016
11:42 AM
Nyanko-sensei joined the channel
2016-11-08 31325, 2016
11:45 AM
dpmittal joined the channel
2016-11-08 31318, 2016
11:46 AM
Nyanko-sensei has quit
2016-11-08 31358, 2016
11:55 AM
D4RK-PH0ENiX joined the channel
2016-11-08 31302, 2016
11:58 AM
dpmittal has quit
2016-11-08 31346, 2016
12:03 PM
Gentlecat
bitmap: good morning
2016-11-08 31315, 2016
12:20 PM
bitmap
mornin'
2016-11-08 31344, 2016
12:22 PM
bitmap is slap happy
2016-11-08 31346, 2016
12:31 PM
Freso is here!
2016-11-08 31306, 2016
12:32 PM
Freso
armalcolite: I'm sure the BB team would appreciate another mentor on the team. :)
2016-11-08 31307, 2016
12:32 PM
zas is here... since days
2016-11-08 31333, 2016
12:32 PM
zas
ruaok: ping, wake up, coffee, this is The Day
2016-11-08 31305, 2016
12:35 PM
Freso goes to backup ~freso and ~i18n on rika
2016-11-08 31349, 2016
12:40 PM
Gentlecat goes to the office to backup Freso
2016-11-08 31340, 2016
12:41 PM
Freso
:o
2016-11-08 31317, 2016
13:08 PM
zas
2016-11-08 31311, 2016
13:09 PM
zas
if you add anything to kiki, it is expected to run on herb too. And backend servers should not run on kiki or herb at all
2016-11-08 31325, 2016
13:09 PM
zas
or do i miss something ?
2016-11-08 31330, 2016
13:09 PM
Gentlecat
ah, OK
2016-11-08 31340, 2016
13:09 PM
Gentlecat
I missed that
2016-11-08 31352, 2016
13:09 PM
Gentlecat
will move it somewhere else
2016-11-08 31305, 2016
13:10 PM
zas
gateways are totally redundant, we may switch from one to the other at any moment
2016-11-08 31324, 2016
13:10 PM
bitmap
zas: in /home/ftp-data/.ssh/authorized_keys on sakura we use some fancy rrsync commands, do you know if that's no longer necessary?
2016-11-08 31302, 2016
13:11 PM
zas
bitmap: make a copy for history (that's the ssh command trick right ?)
2016-11-08 31315, 2016
13:11 PM
zas
basically it runs a command based on key used
2016-11-08 31315, 2016
13:11 PM
CatQuest
[22:47] <Leftmost> Tagging isn't a big application for me, but library management is, with tagging as a sidebar.
2016-11-08 31316, 2016
13:11 PM
CatQuest
library managmeent. ie what I said earlier of the "digital shelf" :)
2016-11-08 31323, 2016
13:11 PM
bitmap
command="/home/ftp-data/bin/rrsync /media/ftp/root/pub/musicbrainz/data/fullexport/"
2016-11-08 31326, 2016
13:11 PM
bitmap
right
2016-11-08 31337, 2016
13:11 PM
bitmap
command="rm /media/ftp/root/pub/musicbrainz/data/fullexport/latest-is* ; /home/ftp-data/bin/rrsync /media/ftp/root/pub/musicbrainz/data/fullexport/"
2016-11-08 31348, 2016
13:11 PM
bitmap
I'm a bit confused what the rm is for
2016-11-08 31301, 2016
13:12 PM
zas
i guess it deletes ;)
2016-11-08 31317, 2016
13:12 PM
bitmap
but why :)
2016-11-08 31321, 2016
13:12 PM
zas
rrsync is the useful part
2016-11-08 31340, 2016
13:12 PM
zas
but we should have it somewhere
