#musicbrainz

/

      • radekdev
        inhouseuk: ;)
      • ruaok
        now its tapering off again
      • g0llum has quit
      • radekdev
        works here ok.
      • ruaok
        I also restarted it in the meantime.
      • radekdev
        you previously said about no resolving ip in apache logs
      • what about other directives, i mean Allow using hostnames?
      • ruaok
        yeah?
      • radekdev
        do You use sth like it?
      • ruaok
        sth?
      • inhouseuk
        something
      • radekdev
        something, i mean 'Allow from myhostname.com'
      • and not the 'Allow frmo 1.2.3.4'
      • ruaok
        I doubt iot
      • no names in Allows at all.
      • only ips
      • radekdev
        was anything modified recently in httpd.conf or apache conf?
      • inhouseuk
        from what I'm seeing, it's taking time to respond to the initial SYN
      • ruaok
        radekdev: not really
      • radekdev
        inhouseuk: rather not SYN but initial payload. synack was sent promptly.
      • inhouseuk: you can check this in zim.tcpdump.out file line 11
      • inhouseuk
        yeah, I can see it now
      • ruaok is consulting with an apache expert now
      • ruaok
        yup, we're plain using too many apache procs
      • and we can't up it since we do not have more memory.
      • off by a week you wankers!
      • yalaforge has quit
      • BGreeNZ joined the channel
      • BGreeNZ
        Hello all
      • Shepard
        hi
      • BGreeNZ tries out his new PageDeletorGroup priviledges, by deleting surplus attachments from http://wiki.musicbrainz.org/HowToMergeAlbums
      • donredman
        hi
      • BGreeNZ
        donredman: Thanks :)
      • Now I won't have to bug ppl to delete my attachments for me. ;-)
      • inhouseuk
        ruaok: too many apache procs for the number of db connections allowed?
      • ruaok
        we're simply at maxclients
      • djce wonders who are wankers
      • hi djce !
      • the digg wankers. :-)
      • djce
        hey
      • sysrq
        lol
      • ruaok
        djce: kevin is logged into zim right now.
      • and we just upped apache2 max clients to 100
      • djce
        well, maxclients might as well be 1 right now, given that we have zip in terms of bandwidth.
      • ruaok
        kevin used to tune friendster
      • he's qualified. :)
      • djce: its not a bandwidth issue
      • ftp works GREAT
      • yllona joined the channel
      • djce
        ruaok: really? scp sucked ass.
      • ruaok
        ya. worked fine.
      • things are certainly improving now.
      • almost usable again
      • djce
        the bandwidth graphs are climbing
      • ruaok
        yup.
      • kevin is a genius.
      • inhouseuk is still seeing slow ftp from zim
      • djce
        what was maxclients before?
      • inhouseuk
        I can normally get to fill my line
      • ruaok
        50
      • djce
        I'm getting 8Kb/s
      • toxickore joined the channel
      • Personally, I don't believe this is anything to do with zim's software configuration.
      • ruaok
        djce: what is your theory then?
      • inhouseuk
        lack of outbound bandwidth would cause the number of apache procs to climb
      • djce
        right, because they're all waiting to send their data.
      • inhouseuk
        yup
      • djce
        which is exactly what I was seeing earlier.
      • It's a bandwidth issue, plain and simple IMO.
      • maybe a NIC, maybe a cable, maybe a router, who knows.
      • but it's network throughput.
      • radekdev
        djce: not conviced about bandwith
      • djce
        why so?
      • radekdev
        djce: how can You explain that dumps shows 30s delay at eth0
      • ruaok
        we're not being throttled and HE is not experiecing any problems
      • radekdev
        with sending initial payload from apache - syn ,synack, ack were ok, than 30s
      • thats a plain sign of apache 'waiting for sth'
      • ruaok: as to the maxclients - what is strange for me, that in vmstat output you showed there was no information about processes waiting...
      • djce
        maybe the response isn't ready to send, because of bandwidth problems.
      • radekdev
        ruaok: thats why i didnt even ask for it ;)
      • djce: nope
      • djce: that was dump of server eth0
      • and there was plain silence.
      • djce
        Your logic doesn't necessarily follow.
      • radekdev
        so if we're talking about throttling it would have to be a throttling installed on the server itself.
      • djce: please explain me - maybe i'm wrong.
      • djce
        What HTTP request were you making during this test?
      • mb seems quite snappy now.
      • radekdev
        djce: could you look at files provided by ruaok ? it would be much simpler. look at difference between line 10 and 11 in zim file.
      • ruaok
        djce: we upped the back end max to 30
      • yup, things are almost acceptable now
      • inhouseuk
        that still doesn't explain the slow ftp transfer speeds
      • djce
        How do you plan to stop zim running out of memory?
      • ruaok
        kevin did some math and hopes this will keep us out of it
      • djce
        When MaxClients was higher before, zim kept running out of memory and killing stuff (e.g. sshd)
      • ruaok
        ick.
      • djce
        And in any case, mainly I'm curious to know what (presumably) changed at about 5.45am your time to cause things to go tits up.
      • ruaok
        djce: you and me both.
      • the only explanation I have is that traffic exceeded out capacity and things got 'stuck'
      • djce
        Hmmm.
      • (That's <hmmm type="sceptical">)
      • ruaok
        i'm with you and that.
      • none of this is making sense.
      • inhouseuk
        any response from the hosting center?
      • ruaok
        yes, no throttling and all systems normal
      • djce
        I'm still getting totally sucky ssh performance
      • ruaok
        ssh via catbus works great
      • djce
        exactly.
      • donredman has quit
      • radekdev
        ruaok: if that was not resolving issue, please revert back change to /etc/resolv.conf
      • ruaok
        tahnks for the reminder
      • well, I prefer learning about apache tuninig in a more sane fashion, but at least I learned a few things today. I think.
      • ClutchEr2 has quit
      • djce
        Yeah, you can't run a busy web server on sucky bandwidth :-/
      • ruaok
        well, I'll get the new machines installed tomorrow.
      • hopefully we can have everything configured by the weekend.
      • I'd love to cut over on sat.
      • then go fetch the other servers on sunday.
      • wolfsong_
        will that help with bandwidth?
      • ruaok
        we'll have 3mbit of our own bandwidth then.
      • and no one to share it with.
      • wolfsong_
        oic
      • ruaok
        and no one will share our bandwidth bill either. :-(
      • inhouseuk
        397331 bytes received in 01:10 (5.46 KB/s)
      • that's dialup speed :(
      • djce
        vrooom vrooomm clunk.
      • Jetpack
        can i hear anyone say "MP3 SERVER"
      • djce
        MP3 Server.
      • why?
      • Jetpack
        3mbit of own bandwidth, hehe
      • djce
        ah. :-) all legit mp3s, of course.
      • Jetpack
        course
      • wolfsong_ peers over the wall at Jetpack's allegedly legal stash
      • djce
        hey ho. enough fun for one day.
      • night all!
      • djce has quit
      • wolfsong_
        nite
      • Jetpack
        quick q, if an album is mixed by somebody, can you put (mixed by DJ xxx) in the album title?
      • inhouseuk
        ruaok: don't forget to ask djce to reduce the TTL on the dns records ready for the move to the new colo
      • ruaok
        inhouseuk: he already did that. :-)
      • inhouseuk
        10000 seconds is still high for a server move