kepstin hits save on ~16k files in picard and waits
2012-12-31 36633, 2012
kepstin
it's managing around 15-20 files per second over nfs, which doesn't seem that bad :)
2012-12-31 36633, 2012
kepstin
using nearly 200mbit/s of network tho :)
2012-12-31 36645, 2012
kepstin
(the files are all flac)
2012-12-31 36636, 2012
Cook879 joined the channel
2012-12-31 36652, 2012
Lotheric
502 Bad Gateway
2012-12-31 36626, 2012
kepstin
Lotheric: what were you doing?
2012-12-31 36645, 2012
Lotheric
editing a release group name
2012-12-31 36600, 2012
kepstin
hmm :/
2012-12-31 36611, 2012
Lotheric
changing ... for �
2012-12-31 36620, 2012
ianmcorvidae
statistics is running
2012-12-31 36628, 2012
kepstin
ah, it's 502 o'clock?
2012-12-31 36629, 2012
ianmcorvidae
haven't had any damn time to figure out why that causes 502s
2012-12-31 36641, 2012
ianmcorvidae
yeah, statistics got moved an hour later, and the 502s went with it :P
2012-12-31 36604, 2012
kepstin wonders if running the statistics off a mirrored db would help alleviate the pain
2012-12-31 36617, 2012
ianmcorvidae
not all of them can even be run there, but it might help
2012-12-31 36626, 2012
ianmcorvidae
I don't know what's causing the problem though, so I can't really say
2012-12-31 36640, 2012
ianweller edit-note refutes no-votes
2012-12-31 36653, 2012
kepstin
hmm, why are there some that can't be done on a mirror?
2012-12-31 36655, 2012
ianmcorvidae
it seems like it must be related to the edit- or editor-related stats though, which certainly couldn't be run on a mirror
2012-12-31 36603, 2012
ianmcorvidae
because there are things that don't get mirrored :)
2012-12-31 36636, 2012
kepstin
well, there are workarounds for that :)
2012-12-31 36647, 2012
ianmcorvidae
heh
2012-12-31 36608, 2012
ianmcorvidae
anyway, the main issue is that other than it being statistics I don't think we understand what's causing the issues
2012-12-31 36611, 2012
ianmcorvidae
so
2012-12-31 36658, 2012
kepstin
yeah, all we know is that the statistics running causes some edits (database modifications) to take a long time :/
2012-12-31 36600, 2012
Lotheric listens to: Public Enemy - You�re Gonna Get Yours (Terminator X Getaway mix).mp3
2012-12-31 36603, 2012
Lotheric
My '98 Oldsmobile is... 502n'
2012-12-31 36607, 2012
kepstin
it probably would make sense to use postgres's streaming replication to set up a warm backup db server anyways, tho.
2012-12-31 36614, 2012
ianmcorvidae
we have one, actually
2012-12-31 36626, 2012
kepstin
well, run the stats on that, then ;)
2012-12-31 36628, 2012
ianmcorvidae
so yeah, you're right we could probably run stats on that :)
2012-12-31 36649, 2012
ianmcorvidae
looking at locks now on one transaction that suspiciously looks like it must be stats given the gigantic number of AccessShareLock it has
2012-12-31 36621, 2012
kepstin
well, big read queries for stats would have shared locks - which presumably conflict with the non-shared locks needed for writes?
2012-12-31 36644, 2012
ianmcorvidae
shouldn't, because of MVCC
2012-12-31 36656, 2012
Lotheric
kepstin: my edit passed just now
2012-12-31 36644, 2012
kepstin reads the postgres concurrency control docs
2012-12-31 36659, 2012
ianmcorvidae
access share conflicts with access exclusive only
2012-12-31 36648, 2012
ianmcorvidae
(which you have to explicitly ask for in most cases; only alter/drop table, truncate, reindex, cluster, and vacuum full get it automatically)
2012-12-31 36604, 2012
ianmcorvidae
yeah, the only non-access-share lock it had when I looked was on the statistic table, which is quite fine :P
2012-12-31 36619, 2012
ianmcorvidae
except for some row locks
2012-12-31 36630, 2012
ianmcorvidae
(on dbmirror_pending, it seems)
2012-12-31 36650, 2012
kepstin
'Remember that all of these lock modes are table-level locks, even if the name contains the word "row"'
2012-12-31 36654, 2012
ianmcorvidae
hm, so I guess it could be the dbmirror_pending row-exclusive locks
2012-12-31 36616, 2012
ianmcorvidae
except edits and editors won't conflict there
2012-12-31 36620, 2012
kepstin
but yeah, the 'row exclusive' lock (acquired by any command that modifies data in a table) only conflicts with 'share' (create index) and a few types that are only used manually
2012-12-31 36636, 2012
ianmcorvidae
yeah
2012-12-31 36622, 2012
kepstin
which means that if a write is failing, then either an index is being created on a table that it's modifying, or some code is manually locking things :/
2012-12-31 36638, 2012
ianmcorvidae
yeah
2012-12-31 36618, 2012
kepstin
or just that the db can't keep up with the load on it, which seems somewhat unlikely
2012-12-31 36624, 2012
ianmcorvidae leaves a note to myself to submit an edit and then dump pg_locks (and whatever else might help, wonder if I can determine what pid something's waiting on...) while it's 502ing :P
2012-12-31 36602, 2012
jessew joined the channel
2012-12-31 36637, 2012
derr84 has left the channel
2012-12-31 36619, 2012
nano- joined the channel
2012-12-31 36623, 2012
djinni` joined the channel
2012-12-31 36633, 2012
gnu_andrew joined the channel
2012-12-31 36634, 2012
adhawkins-away joined the channel
2012-12-31 36654, 2012
STalKer-X joined the channel
2012-12-31 36619, 2012
mchou joined the channel
2012-12-31 36656, 2012
faen joined the channel
2012-12-31 36604, 2012
STalKer-X_g joined the channel
2012-12-31 36650, 2012
Leftmost joined the channel
2012-12-31 36610, 2012
derr84 joined the channel
2012-12-31 36610, 2012
kepstin uploads the popular cover art for the unmastered version of californication, and now it's quite easily visible on http://mbjs.kepstin.ca/?release-group=ca5dfcc3-83fb-3eee-9061-c27296b77b2c :)
2012-12-31 36601, 2012
kepstin
I didn't realize it until just now, but it actually says '-UNMASTERED VIRSION-' on it instead of version :/
2012-12-31 36653, 2012
function1 joined the channel
2012-12-31 36658, 2012
voiceinsideyou joined the channel
2012-12-31 36648, 2012
VxJasonxV
lol
2012-12-31 36658, 2012
VxJasonxV
also, where?
2012-12-31 36605, 2012
VxJasonxV
that's an awesome cover misprint
2012-12-31 36608, 2012
kepstin-laptop
well, it's a cover for a bootleg that someone hacked together with a couple minutes of photoshop
