16:58 PM
kepstin-laptop notes that the X240 has a squished keyboard with a firmware issue that turns the end key into insert when you enable function-lock (i.e. so your F* keys are F* keys instead of brightness, etc.)
2014-01-06 00638, 2014
16:59 PM
kepstin-laptop
since insert is Fn+End, and the Fn-lock swaps all of the top-row keys with special functions :/
2014-01-06 00638, 2014
17:03 PM
kepstin-laptop
whoa, that's weird. on the new X1 carbon they moved the `~ key to between the right alt and ctrl at the bottom
2014-01-06 00652, 2014
17:03 PM
kepstin-laptop
and escape went where it used to be :/
2014-01-06 00622, 2014
17:04 PM
kepstin-laptop
(this video appears to be using the US layout)
2014-01-06 00608, 2014
17:05 PM
adhawkins
ocharles: Figured you'd have seen it already. Made me chuckle :D
2014-01-06 00628, 2014
17:09 PM
adhawkins
Server still having problems? Any ETA? (Not hassling, just wondering when I should next check it)
2014-01-06 00619, 2014
17:10 PM
chirlu`
Reminds me, there is a small Haskell program that I need to finish.
2014-01-06 00659, 2014
17:10 PM
CallerNo6 , when he finally gets the thinkpad he's lusting after, will probably glue a cover over the touchpad/trackpad/thingy. hate those things.
2014-01-06 00635, 2014
17:11 PM
kepstin-laptop
CallerNo6: easier to disable it in software, looks better too.
2014-01-06 00623, 2014
17:12 PM
CallerNo6
But what if I glue somethng /useful/ over it? Picture frame? Big Gulp holder?
2014-01-06 00640, 2014
17:12 PM
kepstin-laptop
and if you get a late-2013/2014 model, you need the touchpad available because its touch-sensitivity is used to tell which trackpoint button you're pressing.
2014-01-06 00637, 2014
17:13 PM
kepstin-laptop
(this means anything with the last two digits of the model number >30)
2014-01-06 00632, 2014
17:14 PM
CallerNo6
fortunately, a new one isn't in the budget anyway
2014-01-06 00608, 2014
17:15 PM
voiceinsideyou joined the channel
2014-01-06 00604, 2014
17:18 PM
voiceinsideyou2 joined the channel
2014-01-06 00643, 2014
17:19 PM
rvedotrc joined the channel
2014-01-06 00646, 2014
17:43 PM
misterswag joined the channel
2014-01-06 00604, 2014
19:19 PM
djinni` joined the channel
2014-01-06 00655, 2014
19:33 PM
zas__
2014-01-06 00631, 2014
19:42 PM
ijabz joined the channel
2014-01-06 00642, 2014
19:42 PM
bitmap
zas__: can you check if the left pane is clipped (has scrollable contents) and just resize the window/pane accordingly?
2014-01-06 00617, 2014
19:43 PM
bitmap
I'm not too fond of creating our own checkbox widget
2014-01-06 00650, 2014
19:44 PM
zas__
bitmap: the left pane (tree) isn't scrollable atm
2014-01-06 00632, 2014
19:45 PM
zas__
bitmap: i'm not fond of new checkbox widget too, and perhaps some other widget has the same behavior...
2014-01-06 00628, 2014
19:46 PM
bitmap
hm, it's scrollable on osx
2014-01-06 00656, 2014
19:47 PM
bitmap
in any case there might be a way to compare the width of the pane to the width of the inner tree, but I'm not too sure
2014-01-06 00623, 2014
19:59 PM
chirlu`
2014-01-06 00605, 2014
20:00 PM
ruaok
bang!
2014-01-06 00611, 2014
20:00 PM
ruaok
meeting time.
2014-01-06 00614, 2014
20:00 PM
ianmcorvidae
hello
2014-01-06 00620, 2014
20:00 PM
ruaok
is there a postgres doctor in the house? ;-)
2014-01-06 00625, 2014
20:00 PM
ruaok
morning ianmcorvidae
2014-01-06 00631, 2014
20:00 PM
fractalizator2 joined the channel
2014-01-06 00639, 2014
20:00 PM
ruaok
ocharles and I made nearly no progress on totoro.
2014-01-06 00653, 2014
20:00 PM
ruaok
I've got a script that kills stucks procs, which is keeping things sane.
2014-01-06 00605, 2014
20:01 PM
ruaok
we've tried to up shared_buffers. no effect.
2014-01-06 00610, 2014
20:01 PM
ianmcorvidae
yeah. I hear there was some vacuuming that found weirdnesses in the edit table too, or?
2014-01-06 00634, 2014
20:01 PM
ruaok
I just upped effective_cache_size to 20GB and that relieved some pressure, but that artist edits still don't load.
2014-01-06 00641, 2014
20:01 PM
ruaok
yes, we got two error messages, but nothing else
2014-01-06 00656, 2014
20:01 PM
ruaok
I'm flat out of ideas, sadly.
2014-01-06 00602, 2014
20:02 PM
ianmcorvidae
I wonder if we've done the same for edit_artist
2014-01-06 00608, 2014
20:02 PM
ianmcorvidae
but yeah, I'm not sure either
2014-01-06 00609, 2014
20:02 PM
ruaok
have not.
2014-01-06 00615, 2014
20:02 PM
ruaok
probably a good idea.
2014-01-06 00617, 2014
20:02 PM
LordSputnik joined the channel
2014-01-06 00617, 2014
20:02 PM
ruaok
shall I start that?
2014-01-06 00620, 2014
20:02 PM
ianmcorvidae
(it's mostly been artists that have been the issue, so)
2014-01-06 00632, 2014
20:02 PM
ianmcorvidae
well, if it's fine for now we may as well do our meeting at least :P
2014-01-06 00655, 2014
20:02 PM
ruaok
ok.
2014-01-06 00613, 2014
20:03 PM
ruaok
besides travel and new years and pg issues, I've got nothing really new.
2014-01-06 00617, 2014
20:03 PM
ruaok
anyone have anything to discuss?
2014-01-06 00620, 2014
20:03 PM
Freso likes that ruaok and ianmcorvidae's nicks both show up as cyan - also, is here
2014-01-06 00648, 2014
20:03 PM
ruaok kicks off the vacuum
2014-01-06 00653, 2014
20:03 PM
Freso
nikki: Ping?
2014-01-06 00604, 2014
20:04 PM
ianmcorvidae
not much here either; I took wednesday off and worked on some various things around it
2014-01-06 00613, 2014
20:04 PM
ianmcorvidae
did at least get one long-lived ticket up for review
2014-01-06 00618, 2014
20:04 PM
Freso
I guess nikki's the only one with something on the agenda. She was around a few minutes ago.
2014-01-06 00634, 2014
20:04 PM
ruaok
ianmcorvidae: did you test increasing the rate limit and seeing if it had an effect on rika?
2014-01-06 00652, 2014
20:04 PM
ianmcorvidae
I've increased it, but haven't seen what it's done for rika
2014-01-06 00613, 2014
20:05 PM
ianmcorvidae
nikki, reoafk, bitmap, chirlu might be able to weigh in if it's been better the last couple days or not
2014-01-06 00619, 2014
20:05 PM
ruaok
another thought would be to pay attention to the peaks and troughs in our 95th graph.
2014-01-06 00631, 2014
20:05 PM
ruaok
rika should be nicer to use in a trough, than a peak
2014-01-06 00636, 2014
20:05 PM
bitmap
rika was fast for me when I was using it yesterday
2014-01-06 00639, 2014
20:05 PM
ruaok
if there is anything to the bandwidth limiting idea.
2014-01-06 00648, 2014
20:05 PM
djinni` joined the channel
2014-01-06 00650, 2014
20:05 PM
derwin
stop typoing "riak"
2014-01-06 00602, 2014
20:06 PM
bitmap
was even able to submit a 40 disc release on it :)
2014-01-06 00617, 2014
20:06 PM
chirlu`
There is a delay when typing on rika, but I would consider it normal.
2014-01-06 00625, 2014
20:06 PM
chirlu`
Can't compare to previous weeks, though.
2014-01-06 00637, 2014
20:06 PM
reodroid joined the channel
2014-01-06 00639, 2014
20:06 PM
ruaok
hmm.
2014-01-06 00647, 2014
20:06 PM
ianmcorvidae
okay. well, we'll see if the small improvements stick
2014-01-06 00651, 2014
20:06 PM
Freso
Seems snappier to me too right now.
2014-01-06 00654, 2014
20:06 PM
bitmap
the ssh delay is better than it usually is right now
2014-01-06 00604, 2014
20:07 PM
ruaok
well, if anyone encounters trouble, note where in the 95th graph we are
2014-01-06 00606, 2014
20:07 PM
ianmcorvidae
it's always been slightly slow, intentionally, but usably so is a change
2014-01-06 00623, 2014
20:07 PM
ruaok
2014-01-06 00637, 2014
20:07 PM
ruaok
interestingly enough we're headed to a peak now and its doing well.
2014-01-06 00648, 2014
20:07 PM
ruaok
what else can we discuss on rika?
2014-01-06 00655, 2014
20:07 PM
ruaok
watch and observe, what else?
2014-01-06 00609, 2014
20:08 PM
ianmcorvidae
I'm not sure there's much else that'd be part of this topic
2014-01-06 00619, 2014
20:08 PM
ianmcorvidae
I need to dist-upgrade it at some point but that's probably unrelated
2014-01-06 00600, 2014
20:09 PM
ruaok
k.
2014-01-06 00610, 2014
20:09 PM
ruaok
any other topics?
2014-01-06 00648, 2014
20:09 PM
Freso
What's for dinner?
2014-01-06 00657, 2014
20:09 PM
Freso hides
2014-01-06 00658, 2014
20:09 PM
ruaok
burger wraps here. :)
2014-01-06 00615, 2014
20:10 PM
ianmcorvidae
a few hours away, here :P
2014-01-06 00620, 2014
20:10 PM
ianmcorvidae
but nothing more from me, I don't think
2014-01-06 00622, 2014
20:10 PM
ruaok
well, if no one has anything else to discuss, then I think I'd love to chat with ianmcorvidae and ocharles about totoro.
2014-01-06 00658, 2014
20:10 PM
ruaok
see if the three of us (and anyone else who'd care to participate) can think up new things to check out.
2014-01-06 00612, 2014
20:11 PM
ianmcorvidae
how's that edit_artist vacuum doing?
2014-01-06 00615, 2014
20:11 PM
ruaok is looking forward to a more action packed meeting next week.
2014-01-06 00631, 2014
20:11 PM
ianmcorvidae
and the main thing that comes to mind is why the MBS timeout isn't working
2014-01-06 00635, 2014
20:11 PM
ruaok
still going. load 13, 6-10MB/s io
2014-01-06 00648, 2014
20:11 PM
ruaok
let's close the general meeting, then.
2014-01-06 00649, 2014
20:11 PM
ianmcorvidae
we fix that and it still 504s, but it doesn't start slowly breaking totoro in the process
2014-01-06 00603, 2014
20:12 PM
ruaok
sorry for not delving into DRs this week, but the sick DB server is important for us to pay attention to.
2014-01-06 00607, 2014
20:12 PM
ruaok
thanks everyone!
2014-01-06 00610, 2014
20:12 PM
ruaok
/bang!
2014-01-06 00616, 2014
20:12 PM
reodroid
heh that was fast :)
2014-01-06 00624, 2014
20:12 PM
nikki
oh
2014-01-06 00632, 2014
20:12 PM
ruaok
nikki: ?
2014-01-06 00655, 2014
20:12 PM
ruaok
ianmcorvidae: yes, the timeout killer is odd -- ocharles tried it a couple of different ways and it worked.
2014-01-06 00658, 2014
20:12 PM
ruaok
except in production
2014-01-06 00601, 2014
20:13 PM
ruaok shrugs
2014-01-06 00640, 2014
20:13 PM
nikki
I managed to miss the entire meeting :P
2014-01-06 00649, 2014
20:13 PM
ianmcorvidae
one question I had was what our old version of pgbouncer was
2014-01-06 00615, 2014
20:14 PM
ianmcorvidae
since with the dist-upgrade we switched to a package manager-installed one from a hand-compiled one
2014-01-06 00634, 2014
20:14 PM
ianmcorvidae
ocharles: you'd seem to be the one who might know on that count
2014-01-06 00602, 2014
20:15 PM
Freso
nikki: I did try to ping you. :)
2014-01-06 00603, 2014
20:15 PM
ruaok
ianmcorvidae: ah, that is an interesting idea.
2014-01-06 00617, 2014
20:15 PM
ruaok
which fits with your observation that something changed at dist-upgrade time
2014-01-06 00645, 2014
20:15 PM
ruaok
also, jozo asked if the collate problem that prevented the replication packets from applying could hamper our server.
2014-01-06 00646, 2014
20:15 PM
ianmcorvidae
yeah -- though I will stress again that it wasn't anything near this bad until last night, of course
2014-01-06 00658, 2014
20:15 PM
ruaok
do we need to rebuild those indexes?
2014-01-06 00607, 2014
20:16 PM
ruaok
ianmcorvidae: yes, but I've seen this pattern before.
2014-01-06 00625, 2014
20:16 PM
ruaok
things a slightly elevated and then you hit some inflection point and BAM, things go south.
2014-01-06 00628, 2014
20:16 PM
ianmcorvidae
we might need to because postgresql-musicbrainz-collate's behavior has changed, but we should actually update it first
2014-01-06 00646, 2014
20:16 PM
ruaok
I've kept forgetting to mention this for the past few meetings. this had been making me uneasy, TBH
2014-01-06 00652, 2014
20:16 PM
ianmcorvidae
I think ollie got the package updated though, so if you've done some provisions we may be fine
2014-01-06 00658, 2014
20:16 PM
ianmcorvidae
(on the collate issue)
2014-01-06 00610, 2014
20:17 PM
ruaok
we did a provision today to up the shared_buffers.
2014-01-06 00629, 2014
20:17 PM
ianmcorvidae
any chance you remember if it updated a postgresql-musicbrainz-collate package in the mix there?
2014-01-06 00631, 2014
20:17 PM
ruaok
that reminds me, I need to back-propagate the effective_cache_size change
2014-01-06 00638, 2014
20:17 PM
ruaok
not i.
2014-01-06 00641, 2014
20:17 PM
ruaok
ocharles was driving.
2014-01-06 00601, 2014
20:18 PM
ruaok
should we pre-emptively hand-compile a pg-bouncer?
2014-01-06 00621, 2014
20:18 PM
ianmcorvidae
without knowing what version the old one was I don't know that it'd help
2014-01-06 00627, 2014
20:18 PM
ianmcorvidae
I don't know if we upgraded or downgraded or neither :)
2014-01-06 00643, 2014
20:18 PM
ruaok
where would that have gotten installed?
2014-01-06 00649, 2014
20:18 PM
ruaok
into the postgres install dir?
2014-01-06 00652, 2014
20:18 PM
ruaok
or elsewhere?
2014-01-06 00657, 2014
20:18 PM
ruaok
maybe its still around.
2014-01-06 00606, 2014
20:19 PM
ianmcorvidae
it installed to /usr/local/pgbouncer or so, but you can't run the binaries
2014-01-06 00614, 2014
20:19 PM
ianmcorvidae
because of missing libraries from the pre-dist-upgrade server
2014-01-06 00616, 2014
20:19 PM
ruaok
strings?
2014-01-06 00622, 2014
20:19 PM
ianmcorvidae
hm, maybe
2014-01-06 00647, 2014
20:19 PM
ruaok
vacuum of edit_artist is still going
2014-01-06 00623, 2014
20:20 PM
ianmcorvidae
1.5.2, current version installed is 1.5.4-3.pgdg12.4+1
2014-01-06 00637, 2014
20:20 PM
ruaok
yay.
2014-01-06 00647, 2014
20:20 PM
ianmcorvidae wonders if I can find a pgbouncer changelog
2014-01-06 00655, 2014
20:20 PM
ruaok
I'd say lets compile 1.5.2 and try to use it and see what happens.
2014-01-06 00651, 2014
20:22 PM
ruaok
2014-01-06 00646, 2014
20:23 PM
ianmcorvidae also looks into pgbouncer configuration options that might help us
2014-01-06 00620, 2014
20:27 PM
ianmcorvidae
hm
2014-01-06 00635, 2014
20:27 PM
ianmcorvidae
only the 'dangerous timeouts' section looks like it could help, so that's less than ideal
2014-01-06 00619, 2014
20:28 PM
ruaok
huh.
2014-01-06 00631, 2014
20:28 PM
ruaok
the vacuum is still going and yet things are really calm now.