some memory profiling, mostly, though it may be within postgres that the problem lies
2012-09-12 25657, 2012
ianmcorvidae
in fact, the weekly ones might be faster if the bottleneck is the download :)
2012-09-12 25649, 2012
ruaok
ianmcorvidae: I think it might be doing too many transactions.
2012-09-12 25604, 2012
ruaok
one for each XID might be the "correct" thing to do, but also slows things down.
2012-09-12 25615, 2012
ruaok
I wonder if we can safely batch more changes.
2012-09-12 25632, 2012
ianmcorvidae
I'm not sure
2012-09-12 25624, 2012
Lonewlf
ruaok : something like, "I see you are running a replication from more than a week back, would you like to apply the full dump? (This is much faster!!!)"
2012-09-12 25630, 2012
Lonewlf
and script it :)
2012-09-12 25649, 2012
ruaok
Lonewlf: its not quite that easy.
2012-09-12 25612, 2012
ruaok
for people who are running in mission critical environments, the replication is easier than swapping in a new DB.
2012-09-12 25613, 2012
Lonewlf
ruaok : no, it never is, but that's what you'd like it work like :P
2012-09-12 25620, 2012
Lonewlf
ruaok : indeed
2012-09-12 25634, 2012
ianmcorvidae
oh, hey, I have access to the musicbrainz-server repo, didn't know that
did cd musicbrainz-server then cd admin then ./psql READWRITE
2012-09-12 25610, 2012
ianmcorvidae
mapti89: carton install Statistics::Basic
2012-09-12 25615, 2012
ianmcorvidae
mapti89: you may be seeing a pattern here :)
2012-09-12 25617, 2012
Lonewlf
and now I'm stumped on the syntax fro dropping the db
2012-09-12 25649, 2012
ruaok
Lonewlf: you need to drop the DB as user postgres, outside of psql
2012-09-12 25652, 2012
ianmcorvidae
Lonewlf: sudo -u postgres dropdb musicbrainz_db
2012-09-12 25659, 2012
ianmcorvidae
I think that ruaok missed the '-u'
2012-09-12 25605, 2012
ruaok
oh, I normally do sudo su postgres
2012-09-12 25618, 2012
ruaok
I didn't even know about the -u flag. :)
2012-09-12 25619, 2012
Lonewlf
oh right ok
2012-09-12 25631, 2012
ianmcorvidae
ah :)
2012-09-12 25612, 2012
ianmcorvidae
ruaok: how kosher is it for me to poke at the frontend stuff for test? our deployment seems to have made some strange choices re: protocol support and ciphers and things
2012-09-12 25638, 2012
ruaok
ianmcorvidae: poke away!
2012-09-12 25650, 2012
ruaok
you've got the keys to the kingdom and you have sense in your head. poke it!
2012-09-12 25656, 2012
ianmcorvidae
k
2012-09-12 25614, 2012
ianmcorvidae
just still wary about touching frontend stuff, given the potential to accidentally burn the world :)
2012-09-12 25642, 2012
ruaok
you mean nginx on carl/lenny?
2012-09-12 25648, 2012
ruaok
nginx -t
2012-09-12 25650, 2012
ruaok
is your friend. ;)
2012-09-12 25607, 2012
ianmcorvidae
well, yes
2012-09-12 25610, 2012
ianmcorvidae
even so :)
2012-09-12 25640, 2012
ruaok
do you need some guideance on what to change?
2012-09-12 25630, 2012
ianmcorvidae
nah, I think for test I'm set
2012-09-12 25637, 2012
ruaok
k.
2012-09-12 25647, 2012
ruaok
we really need ingestr. like yesterday.
2012-09-12 25654, 2012
ianmcorvidae
disabling insecure SSL versions, improving the lists of ciphers, etc.
2012-09-12 25659, 2012
ruaok
more people want to send us data. and we have no place to put it. :(
2012-09-12 25626, 2012
ruaok
hopefully we can make some progress on this on Oct 22nd.
2012-09-12 25605, 2012
alastairp
ahhh. 22nf
2012-09-12 25609, 2012
alastairp
that's so close
2012-09-12 25609, 2012
ruaok
thats our day at the archive.
2012-09-12 25612, 2012
ruaok
not the MB summit, alastairp
2012-09-12 25617, 2012
alastairp
oh. so it is
2012-09-12 25622, 2012
alastairp
sigh. so much on
2012-09-12 25652, 2012
ianmcorvidae
ruaok: actually, I do have one question: how do I make nginx reload its config? :)
2012-09-12 25603, 2012
ruaok
cd /usr/local/nginx
2012-09-12 25604, 2012
ianmcorvidae
I realize we're not using plain sysvinit for that, so
2012-09-12 25605, 2012
ruaok
svc -h .
2012-09-12 25616, 2012
ruaok
we're using daemontools
2012-09-12 25654, 2012
ianmcorvidae
yeah, I've never used it before, hence the question :)
2012-09-12 25656, 2012
ianmcorvidae
thanks
2012-09-12 25642, 2012
jdamcd joined the channel
2012-09-12 25650, 2012
hawke_1 joined the channel
2012-09-12 25611, 2012
ianmcorvidae
hmph
2012-09-12 25615, 2012
ijabz joined the channel
2012-09-12 25648, 2012
Lonewlf
so, another question... having blown away my database so that I can run the import, did I shoot myself in the foot in some regard by only getting the 3 files suggested? should I have gotten all of them?
2012-09-12 25656, 2012
ijabz
plaintext: hi the inc analyis looks good but Im surprised there doesn't seem to be a section for releases
2012-09-12 25617, 2012
Lonewlf
I only goet mdump, the derived and the editor
2012-09-12 25633, 2012
nikki
those are the only ones you need
2012-09-12 25637, 2012
ijabz
i think this is the entity I use most, and I suspect others do as well
2012-09-12 25649, 2012
nikki
although the others are pretty small, so I normally import those anyway
2012-09-12 25654, 2012
ianmcorvidae
ijabz: the 'Summary' section is actually releases, I think we determined
2012-09-12 25603, 2012
ianmcorvidae
ijabz: with the wrong label obviously, but
2012-09-12 25611, 2012
plaintext
ijabz: I found the bug that causes this, and I'm working on it :)
2012-09-12 25624, 2012
plaintext
btw, I think Summary is just Summary
2012-09-12 25659, 2012
hawke joined the channel
2012-09-12 25620, 2012
ijabz
Is summary just the top ones over any entities, now I look at it some clearly seem to be for release and others clearly not
2012-09-12 25642, 2012
plaintext
yes it's the top for every entity
2012-09-12 25624, 2012
ianmcorvidae
just releases are the most common, I see
2012-09-12 25648, 2012
ianmcorvidae
bah c'mon nginx why won't you notice my config changes
2012-09-12 25616, 2012
ianmcorvidae
theeeere we go
2012-09-12 25638, 2012
Lonewlf
hey thanks guys, I'll pop in again if I blow myself up again
2012-09-12 25629, 2012
ianmcorvidae
other than our cert being self-signed we're doing pretty well on ssllabs' test now
2012-09-12 25600, 2012
ruaok
ianmcorvidae: why not use the new wildcard cert.
2012-09-12 25605, 2012
ruaok
the deets on are carl.
2012-09-12 25612, 2012
ianmcorvidae
ruaok: was working on other things first is all, that's next :)
2012-09-12 25616, 2012
ruaok
k
2012-09-12 25609, 2012
mapti89
Compilation failed in require at app.psgi line 21.
2012-09-12 25610, 2012
mapti89
BEGIN failed--compilation aborted at app.psgi line 21.
2012-09-12 25635, 2012
ruaok
carton install Catalyst::Utils
2012-09-12 25649, 2012
ianmcorvidae
catalyst::utils looks like it's already there
2012-09-12 25657, 2012
ianmcorvidae
it's failing in that file after all
2012-09-12 25600, 2012
ianmcorvidae
not sure what's going on there
2012-09-12 25643, 2012
mapti89
You have Catalyst::Utils (undef)
2012-09-12 25634, 2012
ianmcorvidae
whoo, test now using the real cert
2012-09-12 25636, 2012
ianmcorvidae
huh, apparently the wildcard has plain musicbrainz.org as a SAN
2012-09-12 25648, 2012
ijabz joined the channel
2012-09-12 25609, 2012
mapti89
someone got an idea?
2012-09-12 25618, 2012
plaintext
yay, bug fixed
2012-09-12 25628, 2012
plaintext
it feels nice when fixing a bug results in much cleaner code
2012-09-12 25641, 2012
ianmcorvidae
haha, yeah
2012-09-12 25652, 2012
ianmcorvidae
I love when I can delete huge swaths of code as part of a patch :D
2012-09-12 25602, 2012
ruaok
ok, I'm off to have lunch with my stalker.
2012-09-12 25603, 2012
plaintext
heheh
2012-09-12 25604, 2012
ianmcorvidae
ocharles, warp: could one of you pull in mbs-5301-ssl-gravatars and deploy it to test for me?
why is my firefox still telling me the cert is insecure
2012-09-12 25609, 2012
ianmcorvidae
answer seems to be "my firefox is poorly configured"
2012-09-12 25645, 2012
ianmcorvidae
mapti89: I'd try running plain 'carton install' and seeing if it pulls anything in
2012-09-12 25605, 2012
ianmcorvidae
mapti89: looking a bit deeper that error is being thrown when it can't load *something*, but unfortunately it's not printing what it's failing to load that I can see
2012-09-12 25616, 2012
jdamcd joined the channel
2012-09-12 25646, 2012
hawke joined the channel
2012-09-12 25639, 2012
mapti89
ianmcorvidae: after running carton install, did i have to run: "carton install --deployment"?
2012-09-12 25608, 2012
ianmcorvidae
they do largely the same thing; --deployment looks for specific versions while without it doesn't
2012-09-12 25614, 2012
ianmcorvidae
so no, you should just need one or the other
2012-09-12 25624, 2012
ianmcorvidae
see if there were any errors, though, of course :)
2012-09-12 25635, 2012
mapti89
yes ;-)
2012-09-12 25611, 2012
mapti89
the command install a lot of things that are missing!