#musicbrainz-devel

/

      • kepstin
        w/e, it works.
      • ianmcorvidae
        well, rika is throttled to 50kbps
      • for the entire thing
      • kepstin
        that would probably do it.
      • ianmcorvidae
        except for stuff within the MB firewall, but
      • the notion being that even if someone tries to abuse it it can't be more than an insignificant drop compared to our real traffic
      • kepstin
        I assume it's blocked from search engines too?
      • ianmcorvidae
        luckily things like updating from git.musicbrainz.org are nice and fast, and you don't have to do CPAN stuff because I have it set up to copy those from a different version
      • yes
      • robots.txt is hardcoded for everyone
      • er, except navap actually
      • navap
        Still?
      • ianmcorvidae
        because he was playing with some search engine stuff
      • well, I haven't bothered to revert it, so
      • navap
        Oh, right I've got a file it's reading from. Well it's set to restrict all anyway
      • ianmcorvidae
        yeah
      • kurtjx joined the channel
      • navap
        Does nginx look for config files within the MB source tree, or are the nginx files within admin/nginx copied out to etc/nginx, or something else entirely?
      • ianmcorvidae
        they're copied out, generally
      • possibly symlinked though
      • navap
        Well I made a change to MeB's nginx rewrites. I was wondering if that will take affect the next time ruaok does a git pull onto production or whether I need to remind him to copy the new file out
      • ianmcorvidae
        hm
      • no idea about metabrainz
      • do you know which server that's on? I can go see how it's set up
      • navap
        I don't
      • ianmcorvidae
        hm
      • ianmcorvidae goes to investigate, syswiki may know
      • pino, evidently
      • cool, it's symlinked in
      • navap
        Oh, I knew that.
      • ianmcorvidae
        so it should be fine as soon as it gets pulled
      • navap
        pino shows up in the git log
      • ianmcorvidae
        ah
      • aww, no fabric for that
      • I guess I'd need to VPN it anyway
      • navap
        I currently change the namespace in DBDefs when I want to "clear" memcached. Is there a more appropriate way to do it?
      • ianmcorvidae
        I don't know that there's a nicely-packaged way
      • ianmcorvidae searches for a script to clear memcached keys by prefix
      • navap
        What happens to a namespace once I change away from it? Does it eventually get discarded?
      • ianmcorvidae
        it should, yes
      • if nothing else sometimes I'll restart memcached and that clears everything
      • navap
        Then I'll just keep changing namespaces when I need to. It's really easy to do, no fancy script to remember.
      • ianmcorvidae
        yeah
      • I was figuring I'd just write a script to stick in your home directory and run :)
      • maybe even stick it into run.sh
      • so it just clears the cache if you kill/restart run.sh
      • navap
        What's run.sh?
      • ianmcorvidae
        I guess you predate that
      • it's just a script to start the server
      • in your case it'd be a bit weird since you'd need two
      • navap
        I just use the line you gave me many many moons ago
      • ianmcorvidae
        yeah, that's pretty much all that's in run.sh
      • navap
        When I need to I ctrl-c the server, press up, enter :)
      • kurtjx joined the channel
      • dinog joined the channel
      • dinog2 joined the channel
      • ianmcorvidae
        navap: for your main install, you can now run clear-memcached.sh in your home directory
      • if you want it for your second install, copy that script and change musicbrainz-server to musicbrainz-server2, as you may imagine
      • navap: I've also copied over run.sh; I didn't include the memcached-clearing in that though
      • navap
        I hope you didn't write dump.pl just for this
      • ianmcorvidae
        I did, actually, but I've also wanted the same thing
      • and the other thing it does, which is just printing out everything that's in the cache
      • it's annoying to do by hand because, as you can see in the script, you have to do a 'stats items' and then a 'stats cachedump' on each slab
      • I also wanted the same thing on a previous project I worked on
      • because memcached is everywhere :P
      • basically: that script will continue to be useful for quiiiiite a while, I suspect :)
      • also you could use that script to dump anything that's a prefix, so e.g. all wikidocs pages
      • navap
        hm, when I run it I get Can't locate Cache/Memcached.pm
      • ianmcorvidae
        oh
      • hm
      • you probably need to cpanm it
      • because that's only in the carton local directory, not anywhere dump.pl can see it
      • alternatively do some bullshit to make it look in the musicbrainz-server local dir
      • PERL5OPT='-Mlocal::lib=/home/navap/musicbrainz-server/local' should do it, I guess, but that's gross
      • warp
        hello!
      • navap
        Is it possible to stick that line in clear-memcached.sh?
      • Moin warp!
      • ianmcorvidae
        navap: heh, actually, I have a different solution
      • ianmcorvidae goes to add it
      • navap: should work now
      • navap
        What did you do?
      • ianmcorvidae
        ran it with carton
      • it runs 'carton exec -- perl ../dump.pl' now :P
      • navap
        Ah
      • ianmcorvidae
        since there's no actual restriction that you have to run stuff that's within the directory, you just have to run it *from* the directory
      • navap
        Cool, it now clears memcached when I run run.sh from within my repos
      • ijabz joined the channel
      • ijabz_ joined the channel
      • ianmcorvidae
        what's fun is that while that'll destroy sessions it won't log people out who have selected the 'remember me' checkbox :)
      • which is a neat trick
      • ijabz joined the channel
      • ijabz
        Im guessing that problem Spacey had last night is he is using a 32bit VM instead of a 64 bit, and 32bit VM can only memory map to 4GB so cannot map all indexes
      • ianmcorvidae
        heh
      • ijabz
        so his needs to swap to nfio by using ?init=nfio parameter or swap to 64bit jvm
      • ianmcorvidae
        what's nfio?
      • (and I'll pass that along next time I see him, also)
      • ijabz joined the channel
      • ijabz
        nfio = new file io
      • ianmcorvidae
        ah
      • ijabz
        i.e regular files
      • reosarevok joined the channel
      • dinog joined the channel
      • ijabz joined the channel
      • Leftmost joined the channel
      • ruaok
        navap: musicbrainz-server and metabrainz-server updated; nginx on pino restarted.
      • ianmcorvidae
        ruaok: I'm contributing some hopefully-useful blathering to the doc you sent out earlier :)
      • ruaok
        ijabz: that sounds quite plausible on Spacey
      • sweet.
      • ruaok goes and looks
      • ianmcorvidae
        I also chose a much nicer color this time, much as I love fuchsia :)
      • ruaok
        thanks. :)
      • oh yeah, perl6. :)
      • ianmcorvidae
        haha
      • yup
      • ijabz
        ruaok assuming the search server crash last night wasn't at the same time as a load of new indexes ?
      • ruaok
        ijabz: lets see
      • how many hours ago was that?
      • maybe 10pm your time?
      • ijabz
        approx, yes
      • ruaok
      • they swapped in shortly after midnight UTC
      • ijabz
        ianmcorvidae: where this new doc ?
      • ruaok
      • ijabz
        so they went wrong before that then, oh well I have to take kids to school biab
      • ruaok
        midnight UTC is not 10pm your time is it?
      • k, tt
      • ijabz
        no its 11pm i think
      • ruaok
        ianmcorvidae: please feel free to add more points to the lang pros and cons
      • ianmcorvidae: on the general trend in that doc.
      • I can see that we might want more than one language.
      • but I want to prevent language proliferation. we already have three for the various bits of MB.
      • ruaok counts perl, python and java
      • I would argue that we should not add *any* more languages.
      • ianmcorvidae
        the question still remains -- are we looking for a replacement for perl, or one language to rule them all unless we really *can't* do what we want with whatever we choose?
      • ruaok
        I think one language is not really feasible, nor really desirable.
      • so, not one to rule them all.
      • but in general I want to establish a policy that tells us when we should use what.
      • as per your suggestion maybe we need to define common tasks we need these languages to carry out for us.
      • and then define a language per task group/area/whatever
      • ianmcorvidae
        perhaps
      • I think that's a good way to get a large number of languages
      • ruaok
        what do you think the goal should be?
      • ianmcorvidae
        not sure.
      • uk
        (Midnight UTC is 1am UK DST, not 11pm, BTW.)
      • ruaok
        uk: i knew I should've looked it up. I can never get that one right.
      • ianmcorvidae
        I think the easiest thing to define it as is "what do we want to replace perl with", but I'm not sure about our ultimate goal/order-of-operations
      • uk
        Plus or minus, all the same. :)
      • ruaok
        dyslexia sucks. :(
      • ianmcorvidae
        e.g. the data access layer, whatever it is, will probably come first; that may merit a different language choice than the web interface; don't know if the webservice will be separate, etc.
      • ruaok
        sounds like we're headed towards a lib for the DAL.