10:17 AM
ocharles
I'm going to go down the no email means it's all ok route
10:17 AM
djce
k
10:18 AM
reosarevok joined the channel
10:22 AM
oh, ocharles can I borrow you for 3 min on a different topic? ping me when ready....
10:22 AM
ocharles
djce: fire away
10:22 AM
djce
10:22 AM
I updated the spec on that ticket
10:22 AM
voiceinsideyou joined the channel
10:22 AM
and I think it'll mainly (probably only) affect the MBS codebase in fact.
10:23 AM
ocharles
yay, md5sums
10:23 AM
djce
So some combination of a FYI, and a "please shout if you see a problem",
10:23 AM
and my next task is to estimate how long that'll take
10:23 AM
ocharles
Yea, it looks like it's just MBS
10:23 AM
djce
so I can keep my boss updated as to how long I'm bunking off BBC work to do MBH instead :-)
10:24 AM
ocharles
:)
10:24 AM
djce
I'm still unclear as to where I'll be testing this, alas.
10:24 AM
Might have to resurrect replication packet emitting on hobbes.
10:24 AM
but I have no access to any MB slaves :-(
10:25 AM
ocharles
hobbes is pretty much ready for that I'd think
10:25 AM
djce
(well.... hmm... I could use pretty much any machine in fact if I just mock the bit where it loads the packet into the database I suppose).
10:25 AM
ok. Thanks. that's all for now, just wanted to keep you informed mainly.
10:26 AM
(damn, 10 sec over my 3 minute chat estimate ;-)
10:26 AM
ocharles
lol
10:53 AM
jdamcd joined the channel
10:56 AM
voiceinsideyou joined the channel
11:02 AM
cjk32 joined the channel
11:02 AM
cjk32
ISE on the release editor, MBS-3165 if someone wants to capture stack traces etc from the error log.
11:18 AM
ocharles
Sigh, we're getting 502s again it seems
11:28 AM
jdamcd joined the channel
11:34 AM
voiceinsideyou joined the channel
12:00 PM
warp
goodmorning!
12:02 PM
cjk32: regarding the session timeout, it's probably better to submit what you have, and add an editnote saying you will add the remaining discs later.
12:02 PM
still, it shoudln't "internal server error" ofcourse
12:22 PM
voiceinsideyou joined the channel
13:34 PM
voiceinsideyou joined the channel
13:53 PM
ocharles
PostgreSQL indexing and plperl just blew me away
13:53 PM
I can find all edit relationship edits that use a certain relationship type in....
13:53 PM
0.36ms
13:58 PM
luks
planning to use plperl in MB?
14:03 PM
ocharles
only for this json searching
14:03 PM
i can't see any other way to query it fast otherwise
14:03 PM
14:06 PM
bitmap_ joined the channel
14:14 PM
adhawkins
Does the android app use /ws/2 or /ws/1?
14:17 PM
If I search for release 'Aerial' and select the Kate Bush one, it only lists 5 matches, all for 'A Sky of Honey'. None for the other disc in the release
14:20 PM
The matches all have 16 tracks, whereas in reality it's two discs, one with 7, the other with 9.
15:30 PM
ocharles
15:32 PM
15:32 PM
echo "SELECT plainto_tsquery('mb_simple', '☺')" | ./admin/psql READWRITE just gives "NOTICE: text-search query contains only stop words or doesn't contain lexemes, ignored"
15:35 PM
warp
ocharles: when in the release editor you add a track to a VA release, the artist credit for that track will be empty.
15:35 PM
ocharles: if you submit that you will get a warning that the track needs an artist
15:36 PM
ocharles: but without these changes you can never submit a new artist, because while iterating over each credit 'current' will be falsy (because it is empty) for each credit.
15:36 PM
ocharles
hrm
15:37 PM
luks
ocharles: not very easy to fix, we always had that problem (mainly with !!! :))
15:37 PM
ocharles
well, I don't really get it but if it works the rest looks ok :)
15:37 PM
luks: yea
15:37 PM
I wondered if there was a way to just do a direct text comparison as well
15:38 PM
warp
ocharles: hrm, perhaps it would be cleaner and clearer to just compare to.names.length with from.names.length
15:38 PM
luks
well, you can do "... OR artist_name.name = ?" :)
15:38 PM
warp
ocharles: before the $.each() over to.names.
15:38 PM
ocharles
luks: yea, that's probably what I will be doing
15:38 PM
luks
but it definitely doesn't look like it needs to get fixed in 2011-08-08
15:38 PM
ocharles
but that should presumably rank at the very top too
15:39 PM
well, it's in there :)
15:39 PM
luks
warp put it there
15:39 PM
ocharles
I asked for other work yesterday, and didn't really get any
15:39 PM
yea
15:39 PM
luks
it's a very minor issue
15:39 PM
warp wouldn't consider it minor.
15:39 PM
MB had it since the beginning
15:40 PM
ocharles
15:40 PM
warp
sure, that doesn't make it any less serious :)
15:40 PM
luks
if we lived with it for 10 years, it can wait if there is more important work (which I'm sure there is)
15:40 PM
ocharles: all ModBot errors fixed? :)
15:40 PM
ocharles
all known ones
15:41 PM
not that it's too easy to filter a list of 700 tickets I have assigned to me :P
15:41 PM
warp
luks: ofcourse to some extent minor/critical is subjective. I have music my this particular artist in /mnt/music/tagged, so I'd more likely to be hit by it than most people :)
15:44 PM
luks
ocharles: go by the number of votes
15:44 PM
ocharles
15:44 PM
but I get told off for not working off my CI list :)
15:45 PM
luks
working on that search thing really seems like a waste of time to me
15:45 PM
ocharles
yep
15:45 PM
luks
or just adding to the list of exceptions, which currently contains only !!!
15:45 PM
add
15:46 PM
ocharles
we only do that for indexed search atm, not direct searches
15:46 PM
luks
oh, I thought the direct search also used it
15:47 PM
warp
but it really should be much work to allow the direct search to do exact matches as well.
15:47 PM
+not
15:48 PM
ocharles: if you don't feel like working on it, assign it to me and I'll look into it.
15:48 PM
ocharles
i don't mind working on it, I just kinda agree that we have more pressing things
15:48 PM
15:49 PM
warp
you cannot assign this artist to tracks and recordings, etc.. at all now. that seems pretty important.
15:50 PM
kepstin-laptop joined the channel
15:50 PM
bitmap joined the channel
16:05 PM
ocharles
right, time to wander home
16:54 PM
ruaok joined the channel
17:03 PM
voiceinsideyou1 joined the channel
17:07 PM
ruaok: we're getting a lot of 502 errors the last few days
17:08 PM
ruaok
yes, I've been hearing that.
17:08 PM
ocharles
ah, ok
17:08 PM
ruaok
not sure what to do about it.
17:08 PM
heard it on twitter, actually. ;)
17:08 PM
ocharles
yea, I saw that
17:08 PM
but also saw it mentioned in IRC the day before
17:08 PM
I thought it was due to having an open psql shell to totoro, but that's apparently not it
17:09 PM
ruaok
why would that do it?
17:09 PM
ocharles
connection count
17:09 PM
ruaok
the backend servers are all happy. nothing out of sorts when what I saw.
17:09 PM
voiceinsideyou joined the channel
17:09 PM
our connection count is nuts.
17:09 PM
ocharles
before I've accidently left a transaction open too, and that wrecked a bit of havoc
17:09 PM
but that wasn't the problem this time (there was no transaction open)
17:09 PM
ruaok
*that* will do it.
17:10 PM
but once you start hitting your connection limit, closing one connection won't help.
17:10 PM
ocharles
right
17:10 PM
ruaok
closing a 100 connections might have a positive effect.
17:10 PM
ocharles
it was only a wild guess, I doubt that's what it was
17:10 PM
ruaok
I think I will restart the front end proxy and see what that will do.
17:10 PM
ocharles
I think it was just coincidence 502s stopped briefly when I quit the shell
17:10 PM
ruaok nods
17:11 PM
reosarevokphone joined the channel
17:11 PM
ruaok
to diagnose 502s, here is your process:
17:11 PM
1. Are the back ends happy? if not, the front end requests are piling up for some reason. thus 502s.
17:11 PM
warp pays attention.
17:11 PM
ocharles
how do I measure happiness?
17:11 PM
tail the logs?
17:11 PM
ruaok
you look at server loads at the first clue.
17:12 PM
ocharles
ok
17:12 PM
ruaok
then you start looking at error/access logs
17:12 PM
but the mrtg graphs are your first line of insight.
17:12 PM
if the back ends are happy its likely that the proxy itself is having issues.
17:12 PM
which is kinda hard to diagose at times.
17:13 PM
but looking at the logs is the first thing to do.
17:13 PM
ocharles
other than just kick it and see what happens :)
17:13 PM
warp
ruaok: server load average should be < # of cores in the system?
17:13 PM
ruaok
ocharles: that used to be my preferred way of doing things, but rather ineffective. ;)
17:13 PM
ocharles
heh
17:13 PM
ruaok
warp: yeah.
17:13 PM
given that, astro and pingu sitting at load 6 is cake.
17:14 PM
totoro at 2... he's nearly napping he's so bored.
17:14 PM
ocharles
oh, talking of totoro, poke me when you're free later - need to discuss something with you
17:15 PM
nikki
totoro napping seems so fitting :P
17:15 PM
ocharles
haha
17:15 PM
ruaok
ocharles: after coffee. ;)
17:15 PM
2011/08/04 17:15:24 [warn] 26957#0: *1590920301 an upstream response is buffered to a temporary file
17:15 PM
ocharles
sure
17:15 PM
ruaok
we're seeing too many of those.
17:16 PM
did we just push out something that made the size of the /ws/1/release responses bigger?
17:20 PM
ok, I'll keep tailing the logs for 502s.
17:23 PM
nikki prods ocharles