12:48 PM
Freso
Sure. But we *just* (Monday meeting last week) revamped the supported browsers.
2015-11-25 32932, 2015
12:48 PM
ruaok
ah, good!
2015-11-25 32920, 2015
12:49 PM
Freso
So I'm fine with giving IE8 a couple more months to live on for MB, maybe we can even agree to drop some more IE versions come May. ;)
2015-11-25 32951, 2015
12:49 PM
reosarevok
All of them! :p
2015-11-25 32907, 2015
12:50 PM
Freso
But with MS EOL'ing it, I definitely don't think we should care about continuing to support it from May, even if it will still *just* make the threshhold.
2015-11-25 32956, 2015
12:55 PM
d4rkie has quit
2015-11-25 32957, 2015
12:58 PM
MajorLurker has quit
2015-11-25 32948, 2015
13:07 PM
zas
I vote that we finally drop IE come next schema change. ;)
2015-11-25 32904, 2015
13:10 PM
Nyanko-sensei joined the channel
2015-11-25 32916, 2015
13:10 PM
Leo_Verto joined the channel
2015-11-25 32954, 2015
13:23 PM
Freso
Edge too?
2015-11-25 32916, 2015
13:28 PM
ruaok
zas: what should I try next?
2015-11-25 32927, 2015
13:39 PM
Bookzombie
2015-11-25 32906, 2015
13:45 PM
zas
ruaok: no idea, i didnt encounter such issue, this is something related to ssh, what do you have in your .ssh/config ?
2015-11-25 32948, 2015
13:46 PM
ruaok removes .ssh/config only to have to fail again.
2015-11-25 32919, 2015
13:48 PM
zas
ruaok:
https://docs.chef.io/resource_git.html -> perhaps play with user and ssh_wrapper options to see if it helps. I see no reason for it to work manually and not under chef. Also try same commands prefixing them with sudo -E to see if they work or no
2015-11-25 32959, 2015
13:48 PM
ruaok
no difference with sudo -E
2015-11-25 32928, 2015
13:49 PM
zas
you have no specific .ssh/config for github ? create one, and specify user and identity there
2015-11-25 32955, 2015
13:53 PM
zas
you can also add -l debug chef-solo option in ./test.sh to have more infos
2015-11-25 32955, 2015
13:58 PM
zas
2015-11-25 32907, 2015
13:59 PM
Bookzombie
2015-11-25 32954, 2015
13:59 PM
ruaok
I just noticed the -A at the end of the ssh command.
2015-11-25 32907, 2015
14:00 PM
ruaok
let me recreate my VM and do this properly. :)
2015-11-25 32948, 2015
14:02 PM
Leo_Verto has quit
2015-11-25 32933, 2015
14:04 PM
zas
ah yes, vagrant ssh -- -A is mandatory to pass keys
2015-11-25 32945, 2015
14:04 PM
ruaok
I didn't do the ssh-add beforehand.
2015-11-25 32957, 2015
14:04 PM
ruaok
I installed my own .ssh setup instead.
2015-11-25 32949, 2015
14:07 PM
ruaok
that was it. sigh.
2015-11-25 32925, 2015
14:08 PM
Bookzombie
2015-11-25 32939, 2015
14:11 PM
ruaok
zas: crm_mon -1r:
2015-11-25 32941, 2015
14:11 PM
ruaok
0 Resources configured
2015-11-25 32925, 2015
14:12 PM
zas
ah yes ;)
2015-11-25 32933, 2015
14:13 PM
zas
ha::configure ran without error ?
2015-11-25 32909, 2015
14:14 PM
ruaok
yep
2015-11-25 32910, 2015
14:14 PM
zas
service corosync status ? service pacemaker status ?
2015-11-25 32923, 2015
14:14 PM
zas
both should run
2015-11-25 32940, 2015
14:14 PM
ruaok
they are
2015-11-25 32904, 2015
14:15 PM
zas
sudo crm_mon -1r show any node configured ?
2015-11-25 32926, 2015
14:15 PM
ruaok
2 nodes configured
2015-11-25 32956, 2015
14:15 PM
zas
sudo crm configure show ? -> any config ?
2015-11-25 32934, 2015
14:16 PM
ruaok
2015-11-25 32955, 2015
14:16 PM
zas
ok so the recipe didn't installed the config
2015-11-25 32930, 2015
14:17 PM
ruaok
2015-11-25 32933, 2015
14:17 PM
ruaok
it looked like it did
2015-11-25 32951, 2015
14:18 PM
zas
it didn't trigger the last part
2015-11-25 32930, 2015
14:19 PM
zas
i wonder why
2015-11-25 32952, 2015
14:20 PM
zas
to test if it fails only on first install, just edit cookbooks/ha/files/default/crm.conf add a blank line, re-run test.sh
2015-11-25 32912, 2015
14:21 PM
zag joined the channel
2015-11-25 32919, 2015
14:21 PM
zas
i think the notification didn't work, not sure why yet
2015-11-25 32936, 2015
14:21 PM
zas
it creates the file in cache, but didn't use it
2015-11-25 32957, 2015
14:21 PM
ruaok
2 nodes, 18 resources?
2015-11-25 32907, 2015
14:22 PM
zas
yes much better
2015-11-25 32933, 2015
14:22 PM
ruaok
everything started but nginx. that as it should be?
2015-11-25 32905, 2015
14:23 PM
zas
show me crm_mon -1r result
2015-11-25 32936, 2015
14:23 PM
zas
it should have started, perhaps another issue with fresh install
2015-11-25 32957, 2015
14:23 PM
ruaok
2015-11-25 32908, 2015
14:24 PM
zas
nginx (ocf::ngyuki:daemontools): Started ernie
2015-11-25 32911, 2015
14:24 PM
zas
:)
2015-11-25 32917, 2015
14:24 PM
zas
it takes more time to start
2015-11-25 32919, 2015
14:24 PM
ruaok
now bert?
2015-11-25 32929, 2015
14:24 PM
zas
bert is configured already
2015-11-25 32959, 2015
14:24 PM
zas
try svc -d /etc/service/ratelimit
2015-11-25 32910, 2015
14:25 PM
zas
and see what happens using crm_mon -r
2015-11-25 32931, 2015
14:25 PM
zas
it should migrate few things to bert
2015-11-25 32905, 2015
14:26 PM
ruaok
2015-11-25 32912, 2015
14:26 PM
Bookzombie
2015-11-25 32929, 2015
14:26 PM
ruaok
maybe didn't wait long enoguh
2015-11-25 32935, 2015
14:26 PM
zas
you need to wait
2015-11-25 32940, 2015
14:26 PM
zas
2-3 minutes
2015-11-25 32946, 2015
14:26 PM
zas
it depends on config
2015-11-25 32905, 2015
14:27 PM
ruaok
it saw the ratelimiter stop
2015-11-25 32906, 2015
14:27 PM
zas
but it has to detect failure, and do the migration, ensure services are up again
2015-11-25 32934, 2015
14:27 PM
zas
use crm_mon without -1 option to have a real time monitoring (ala top)
2015-11-25 32958, 2015
14:27 PM
zas
now show crm_mon -1r result
2015-11-25 32910, 2015
14:28 PM
samphippen has quit
2015-11-25 32943, 2015
14:28 PM
zas
ahah nevermind
2015-11-25 32946, 2015
14:28 PM
ruaok
2015-11-25 32950, 2015
14:28 PM
zas
did you setup bert ?
2015-11-25 32902, 2015
14:29 PM
zas
OFFLINE: [ bert ]
2015-11-25 32912, 2015
14:29 PM
ruaok
no, I thought you said that was created automatically.
2015-11-25 32922, 2015
14:29 PM
zas
if the VM is up ofc
2015-11-25 32959, 2015
14:30 PM
zas
Repeat for VM-bert in another terminal: <--- sorry this is a bit small in the README
2015-11-25 32917, 2015
14:31 PM
zas
you need to setup both machines, then crm conf is shared
2015-11-25 32933, 2015
14:31 PM
zas
but for that corosync & pacemaker have to run on both
2015-11-25 32903, 2015
14:32 PM
zas
it sets ratelimit to Stopped because it couldn't find another place to run it
2015-11-25 32929, 2015
14:32 PM
zas
you can restore it on ernie just doing 'crm resource cleanup ratelimit'
2015-11-25 32941, 2015
14:32 PM
zas
it clears failures history
2015-11-25 32901, 2015
14:35 PM
ruaok
bert installed. ratelimit failed. waiting
2015-11-25 32927, 2015
14:35 PM
ruaok
ratelimit migrated to bert.
2015-11-25 32939, 2015
14:40 PM
zas
:)
2015-11-25 32905, 2015
14:41 PM
zas
ok now test various things (exemples in the README to start with)
2015-11-25 32921, 2015
14:41 PM
zas
it should work as expected, with few things to know:
2015-11-25 32936, 2015
14:41 PM
zas
- if a resource cannot run anywhere, it is stopped
2015-11-25 32951, 2015
14:41 PM
zas
- normally it is stopped until one does smt
2015-11-25 32912, 2015
14:42 PM
zas
- but here i set autoclear of failure errrors after 2 minutes
2015-11-25 32950, 2015
14:42 PM
zas
if you need to clear the status after a failure use 'crm resource cleanup <resource>'
2015-11-25 32914, 2015
14:43 PM
zas
crm_mon will show what it's happening
2015-11-25 32934, 2015
14:43 PM
zas
delay to detect a failure depends on configuration and the way it is tested
2015-11-25 32917, 2015
14:44 PM
ruaok
I put ernie on standby.
2015-11-25 32933, 2015
14:44 PM
ruaok
now dnscache and nginx are stopped.
2015-11-25 32954, 2015
14:44 PM
ruaok
ok, its fine now.
2015-11-25 32901, 2015
14:45 PM
ruaok
the were not instantly moved over.
2015-11-25 32907, 2015
14:45 PM
zas
they can't
2015-11-25 32927, 2015
14:45 PM
zas
because it takes time to set up network interfaces
2015-11-25 32946, 2015
14:45 PM
zas
it stops them on one side, then up them on the other side
2015-11-25 32934, 2015
14:46 PM
zas
also it honors order and check each service is effectively working before starting dependent services
2015-11-25 32958, 2015
14:47 PM
zas
we can speed up things working on dependencies, and running services in parallel instead of stopping them on one side to start them on the other side
2015-11-25 32953, 2015
14:48 PM
zas
ie. i think we should run dnscache + tinydns on both sides, using 2 IPs (10.1.1.250 + 251?) and using both in resolv.conf on our machines
2015-11-25 32908, 2015
14:49 PM
ruaok
sure
2015-11-25 32910, 2015
14:49 PM
zas
so if one fails, no need to switch IP
2015-11-25 32906, 2015
14:50 PM
zas
but i didn't want to bother with this for now, the whole thing is ok now, apart few bits, it is much better than nothing anyway
2015-11-25 32904, 2015
14:51 PM
Bookzombie
2015-11-25 32921, 2015
14:51 PM
zas
nginx has a deeper test, checking it actually answers
2015-11-25 32925, 2015
14:51 PM
ruaok
ok, the things I tried all seem to work fine.
2015-11-25 32930, 2015
14:51 PM
ruaok
looks very promising.
2015-11-25 32941, 2015
14:51 PM
ruaok
now for the prize question: how do we push this live?
2015-11-25 32930, 2015
14:52 PM
zas
we have to stop things which may conflict: things managed by HA shouldn't be managed by any other mean
2015-11-25 32938, 2015
14:52 PM
zas
i think about interfaces
2015-11-25 32900, 2015
14:53 PM
zas
but basically, this is the same as you just did
2015-11-25 32947, 2015
14:53 PM
zas
but we arent on a clean machine, so everything coming in the way should be removed before
2015-11-25 32942, 2015
14:54 PM
zas
i would update bert (system)
2015-11-25 32958, 2015
14:54 PM
zas
deploy cookbooks but the ha::configure
2015-11-25 32916, 2015
14:55 PM
zas
see if all works
2015-11-25 32942, 2015
14:55 PM
ruaok
when do you want to do this?
2015-11-25 32948, 2015
14:55 PM
zas
then stop services and interfaces on ernie, configure and start corosync on bert
2015-11-25 32953, 2015
14:55 PM
ruaok
I'm leaving for london, until dec 1, tomorrow.
2015-11-25 32908, 2015
14:56 PM
zas
we could do that tonight
2015-11-25 32943, 2015
14:56 PM
zas
i can prepare things before, and we do it late after peak hours
2015-11-25 32904, 2015
14:57 PM
ruaok
I don't have a lot of free time tonight.
2015-11-25 32908, 2015
14:57 PM
ruaok
but we can try.
2015-11-25 32930, 2015
14:57 PM
zas
or we postpone a bit, and do it later
2015-11-25 32901, 2015
14:58 PM
zas
the main thing that could seriously go wrong, is the network thing
2015-11-25 32904, 2015
14:58 PM
ruaok
I'd love for this to be done and over with.
2015-11-25 32912, 2015
14:58 PM
ruaok
what if we say, screw it and do it now?
2015-11-25 32934, 2015
14:58 PM
ruaok
just put up a banner saying that we might have some intermittened connectivity issues for a few minutes?
2015-11-25 32957, 2015
14:58 PM
zas
i'll upgrade bert first
2015-11-25 32911, 2015
14:59 PM
zas
if it needs a reboot i do it
2015-11-25 32936, 2015
14:59 PM
ruaok
ok, i'll fuss around with other things in the meantime. let me know when it is show time
2015-11-25 32948, 2015
14:59 PM
ruaok goes to wrangle universal music
2015-11-25 32901, 2015
15:01 PM
Bookzombie
2015-11-25 32952, 2015
15:07 PM
Bookzombie
2015-11-25 32938, 2015
15:08 PM
samphippen joined the channel
2015-11-25 32903, 2015
15:16 PM
zas
ruaok: one issue is related to pre-installed software, ie. we have apache2 and php5 on bert...
2015-11-25 32929, 2015
15:16 PM
zas
cookbooks would need much more work to be able to cleanup all packages and their dependencies
2015-11-25 32930, 2015
15:16 PM
ruaok
ewww.
2015-11-25 32938, 2015
15:16 PM
ruaok
do it manually for now.
2015-11-25 32945, 2015
15:16 PM
zas
yes
2015-11-25 32925, 2015
15:17 PM
Bookzombie
2015-11-25 32918, 2015
15:22 PM
ruaok
samphippen: I'm reading your gist again and I am wondering if that would ever unwind the stack.
2015-11-25 32936, 2015
15:22 PM
ruaok
or would it eventually run out of stack space?
