the notion being that even if someone tries to abuse it it can't be more than an insignificant drop compared to our real traffic
2012-09-27 27121, 2012
kepstin
I assume it's blocked from search engines too?
2012-09-27 27126, 2012
ianmcorvidae
luckily things like updating from git.musicbrainz.org are nice and fast, and you don't have to do CPAN stuff because I have it set up to copy those from a different version
2012-09-27 27130, 2012
ianmcorvidae
yes
2012-09-27 27136, 2012
ianmcorvidae
robots.txt is hardcoded for everyone
2012-09-27 27140, 2012
ianmcorvidae
er, except navap actually
2012-09-27 27144, 2012
navap
Still?
2012-09-27 27148, 2012
ianmcorvidae
because he was playing with some search engine stuff
2012-09-27 27157, 2012
ianmcorvidae
well, I haven't bothered to revert it, so
2012-09-27 27113, 2012
navap
Oh, right I've got a file it's reading from. Well it's set to restrict all anyway
2012-09-27 27119, 2012
ianmcorvidae
yeah
2012-09-27 27129, 2012
kurtjx joined the channel
2012-09-27 27122, 2012
navap
Does nginx look for config files within the MB source tree, or are the nginx files within admin/nginx copied out to etc/nginx, or something else entirely?
2012-09-27 27133, 2012
ianmcorvidae
they're copied out, generally
2012-09-27 27138, 2012
ianmcorvidae
possibly symlinked though
2012-09-27 27124, 2012
navap
Well I made a change to MeB's nginx rewrites. I was wondering if that will take affect the next time ruaok does a git pull onto production or whether I need to remind him to copy the new file out
2012-09-27 27138, 2012
ianmcorvidae
hm
2012-09-27 27143, 2012
ianmcorvidae
no idea about metabrainz
2012-09-27 27150, 2012
ianmcorvidae
do you know which server that's on? I can go see how it's set up
2012-09-27 27157, 2012
navap
I don't
2012-09-27 27125, 2012
ianmcorvidae
hm
2012-09-27 27130, 2012
ianmcorvidae goes to investigate, syswiki may know
2012-09-27 27133, 2012
ianmcorvidae
pino, evidently
2012-09-27 27143, 2012
ianmcorvidae
cool, it's symlinked in
2012-09-27 27143, 2012
navap
Oh, I knew that.
2012-09-27 27148, 2012
ianmcorvidae
so it should be fine as soon as it gets pulled
2012-09-27 27102, 2012
navap
pino shows up in the git log
2012-09-27 27110, 2012
ianmcorvidae
ah
2012-09-27 27135, 2012
ianmcorvidae
aww, no fabric for that
2012-09-27 27144, 2012
ianmcorvidae
I guess I'd need to VPN it anyway
2012-09-27 27154, 2012
navap
I currently change the namespace in DBDefs when I want to "clear" memcached. Is there a more appropriate way to do it?
2012-09-27 27121, 2012
ianmcorvidae
I don't know that there's a nicely-packaged way
2012-09-27 27134, 2012
ianmcorvidae searches for a script to clear memcached keys by prefix
2012-09-27 27134, 2012
navap
What happens to a namespace once I change away from it? Does it eventually get discarded?
2012-09-27 27145, 2012
ianmcorvidae
it should, yes
2012-09-27 27154, 2012
ianmcorvidae
if nothing else sometimes I'll restart memcached and that clears everything
2012-09-27 27113, 2012
navap
Then I'll just keep changing namespaces when I need to. It's really easy to do, no fancy script to remember.
2012-09-27 27131, 2012
ianmcorvidae
yeah
2012-09-27 27147, 2012
ianmcorvidae
I was figuring I'd just write a script to stick in your home directory and run :)
2012-09-27 27100, 2012
ianmcorvidae
maybe even stick it into run.sh
2012-09-27 27108, 2012
ianmcorvidae
so it just clears the cache if you kill/restart run.sh
2012-09-27 27154, 2012
navap
What's run.sh?
2012-09-27 27101, 2012
ianmcorvidae
I guess you predate that
2012-09-27 27104, 2012
ianmcorvidae
it's just a script to start the server
2012-09-27 27115, 2012
ianmcorvidae
in your case it'd be a bit weird since you'd need two
2012-09-27 27140, 2012
navap
I just use the line you gave me many many moons ago
2012-09-27 27151, 2012
ianmcorvidae
yeah, that's pretty much all that's in run.sh
2012-09-27 27103, 2012
navap
When I need to I ctrl-c the server, press up, enter :)
2012-09-27 27149, 2012
kurtjx joined the channel
2012-09-27 27145, 2012
dinog joined the channel
2012-09-27 27124, 2012
dinog2 joined the channel
2012-09-27 27122, 2012
ianmcorvidae
navap: for your main install, you can now run clear-memcached.sh in your home directory
2012-09-27 27154, 2012
ianmcorvidae
if you want it for your second install, copy that script and change musicbrainz-server to musicbrainz-server2, as you may imagine
2012-09-27 27128, 2012
ianmcorvidae
navap: I've also copied over run.sh; I didn't include the memcached-clearing in that though
2012-09-27 27114, 2012
navap
I hope you didn't write dump.pl just for this
2012-09-27 27129, 2012
ianmcorvidae
I did, actually, but I've also wanted the same thing
2012-09-27 27143, 2012
ianmcorvidae
and the other thing it does, which is just printing out everything that's in the cache
2012-09-27 27101, 2012
ianmcorvidae
it's annoying to do by hand because, as you can see in the script, you have to do a 'stats items' and then a 'stats cachedump' on each slab
2012-09-27 27134, 2012
ianmcorvidae
I also wanted the same thing on a previous project I worked on
2012-09-27 27138, 2012
ianmcorvidae
because memcached is everywhere :P
2012-09-27 27159, 2012
ianmcorvidae
basically: that script will continue to be useful for quiiiiite a while, I suspect :)
2012-09-27 27159, 2012
ianmcorvidae
also you could use that script to dump anything that's a prefix, so e.g. all wikidocs pages
2012-09-27 27132, 2012
navap
hm, when I run it I get Can't locate Cache/Memcached.pm
2012-09-27 27149, 2012
ianmcorvidae
oh
2012-09-27 27150, 2012
ianmcorvidae
hm
2012-09-27 27152, 2012
ianmcorvidae
you probably need to cpanm it
2012-09-27 27109, 2012
ianmcorvidae
because that's only in the carton local directory, not anywhere dump.pl can see it
2012-09-27 27121, 2012
ianmcorvidae
alternatively do some bullshit to make it look in the musicbrainz-server local dir
2012-09-27 27147, 2012
ianmcorvidae
PERL5OPT='-Mlocal::lib=/home/navap/musicbrainz-server/local' should do it, I guess, but that's gross
2012-09-27 27156, 2012
warp
hello!
2012-09-27 27113, 2012
navap
Is it possible to stick that line in clear-memcached.sh?
2012-09-27 27116, 2012
navap
Moin warp!
2012-09-27 27104, 2012
ianmcorvidae
navap: heh, actually, I have a different solution
2012-09-27 27112, 2012
ianmcorvidae goes to add it
2012-09-27 27142, 2012
ianmcorvidae
navap: should work now
2012-09-27 27159, 2012
navap
What did you do?
2012-09-27 27106, 2012
ianmcorvidae
ran it with carton
2012-09-27 27115, 2012
ianmcorvidae
it runs 'carton exec -- perl ../dump.pl' now :P
2012-09-27 27126, 2012
navap
Ah
2012-09-27 27139, 2012
ianmcorvidae
since there's no actual restriction that you have to run stuff that's within the directory, you just have to run it *from* the directory
2012-09-27 27124, 2012
navap
Cool, it now clears memcached when I run run.sh from within my repos
2012-09-27 27133, 2012
ijabz joined the channel
2012-09-27 27113, 2012
ijabz_ joined the channel
2012-09-27 27109, 2012
ianmcorvidae
what's fun is that while that'll destroy sessions it won't log people out who have selected the 'remember me' checkbox :)
2012-09-27 27123, 2012
ianmcorvidae
which is a neat trick
2012-09-27 27136, 2012
ijabz joined the channel
2012-09-27 27157, 2012
ijabz
Im guessing that problem Spacey had last night is he is using a 32bit VM instead of a 64 bit, and 32bit VM can only memory map to 4GB so cannot map all indexes
2012-09-27 27116, 2012
ianmcorvidae
heh
2012-09-27 27138, 2012
ijabz
so his needs to swap to nfio by using ?init=nfio parameter or swap to 64bit jvm
2012-09-27 27108, 2012
ianmcorvidae
what's nfio?
2012-09-27 27147, 2012
ianmcorvidae
(and I'll pass that along next time I see him, also)
2012-09-27 27106, 2012
ijabz joined the channel
2012-09-27 27119, 2012
ijabz
nfio = new file io
2012-09-27 27124, 2012
ianmcorvidae
ah
2012-09-27 27125, 2012
ijabz
i.e regular files
2012-09-27 27137, 2012
reosarevok joined the channel
2012-09-27 27110, 2012
dinog joined the channel
2012-09-27 27143, 2012
ijabz joined the channel
2012-09-27 27107, 2012
Leftmost joined the channel
2012-09-27 27153, 2012
ruaok
navap: musicbrainz-server and metabrainz-server updated; nginx on pino restarted.
2012-09-27 27139, 2012
ianmcorvidae
ruaok: I'm contributing some hopefully-useful blathering to the doc you sent out earlier :)
2012-09-27 27143, 2012
ruaok
ijabz: that sounds quite plausible on Spacey
2012-09-27 27152, 2012
ruaok
sweet.
2012-09-27 27154, 2012
ruaok goes and looks
2012-09-27 27106, 2012
ianmcorvidae
I also chose a much nicer color this time, much as I love fuchsia :)
2012-09-27 27131, 2012
ruaok
thanks. :)
2012-09-27 27139, 2012
ruaok
oh yeah, perl6. :)
2012-09-27 27145, 2012
ianmcorvidae
haha
2012-09-27 27146, 2012
ianmcorvidae
yup
2012-09-27 27153, 2012
ijabz
ruaok assuming the search server crash last night wasn't at the same time as a load of new indexes ?
so they went wrong before that then, oh well I have to take kids to school biab
2012-09-27 27148, 2012
ruaok
midnight UTC is not 10pm your time is it?
2012-09-27 27154, 2012
ruaok
k, tt
2012-09-27 27136, 2012
ijabz
no its 11pm i think
2012-09-27 27147, 2012
ruaok
ianmcorvidae: please feel free to add more points to the lang pros and cons
2012-09-27 27109, 2012
ruaok
ianmcorvidae: on the general trend in that doc.
2012-09-27 27117, 2012
ruaok
I can see that we might want more than one language.
2012-09-27 27145, 2012
ruaok
but I want to prevent language proliferation. we already have three for the various bits of MB.
2012-09-27 27157, 2012
ruaok counts perl, python and java
2012-09-27 27110, 2012
ruaok
I would argue that we should not add *any* more languages.
2012-09-27 27128, 2012
ianmcorvidae
the question still remains -- are we looking for a replacement for perl, or one language to rule them all unless we really *can't* do what we want with whatever we choose?
2012-09-27 27110, 2012
ruaok
I think one language is not really feasible, nor really desirable.
2012-09-27 27121, 2012
ruaok
so, not one to rule them all.
2012-09-27 27151, 2012
ruaok
but in general I want to establish a policy that tells us when we should use what.
2012-09-27 27146, 2012
ruaok
as per your suggestion maybe we need to define common tasks we need these languages to carry out for us.
2012-09-27 27101, 2012
ruaok
and then define a language per task group/area/whatever
2012-09-27 27118, 2012
ianmcorvidae
perhaps
2012-09-27 27125, 2012
ianmcorvidae
I think that's a good way to get a large number of languages
2012-09-27 27117, 2012
ruaok
what do you think the goal should be?
2012-09-27 27127, 2012
ianmcorvidae
not sure.
2012-09-27 27133, 2012
uk
(Midnight UTC is 1am UK DST, not 11pm, BTW.)
2012-09-27 27121, 2012
ruaok
uk: i knew I should've looked it up. I can never get that one right.
2012-09-27 27124, 2012
ianmcorvidae
I think the easiest thing to define it as is "what do we want to replace perl with", but I'm not sure about our ultimate goal/order-of-operations
2012-09-27 27146, 2012
uk
Plus or minus, all the same. :)
2012-09-27 27109, 2012
ruaok
dyslexia sucks. :(
2012-09-27 27112, 2012
ianmcorvidae
e.g. the data access layer, whatever it is, will probably come first; that may merit a different language choice than the web interface; don't know if the webservice will be separate, etc.
2012-09-27 27138, 2012
ruaok
sounds like we're headed towards a lib for the DAL.
