#musicbrainz-devel

/

      • ianmcorvidae
        dmesg talks about possible SYN flooding
      • 2013-10-20 29326, 2013

      • ocharles
        it always does that
      • 2013-10-20 29326, 2013

      • ianmcorvidae
        we've just discovered
      • 2013-10-20 29310, 2013

      • rvedotrc
        well, sorta. it got a lot more chatty about that as of the start of this problem.
      • 2013-10-20 29315, 2013

      • ruaok
        dmesg on lenny is way more noisy than usual.
      • 2013-10-20 29320, 2013

      • rvedotrc
        correlation,causation,pinch of salt
      • 2013-10-20 29323, 2013

      • ruaok
        we need to catch s shuttle now
      • 2013-10-20 29330, 2013

      • ruaok
        back in a bit...
      • 2013-10-20 29308, 2013

      • ruaok-dwni joined the channel
      • 2013-10-20 29338, 2013

      • ruaok-dwni
        Walking and Ircing. Not smart.
      • 2013-10-20 29304, 2013

      • ruaok
        Oh right. This bus has WiFi.
      • 2013-10-20 29315, 2013

      • ianmcorvidae|n4 joined the channel
      • 2013-10-20 29306, 2013

      • ocharles
        heh
      • 2013-10-20 29358, 2013

      • misterswag joined the channel
      • 2013-10-20 29332, 2013

      • ruaok_ joined the channel
      • 2013-10-20 29347, 2013

      • ianmcorvidae
        okay, blocking that UA seems to be helping
      • 2013-10-20 29354, 2013

      • ianmcorvidae
        force-503ing it
      • 2013-10-20 29358, 2013

      • ianmcorvidae
        suddenly ssh is usable
      • 2013-10-20 29306, 2013

      • rvedotrc
        I got nothing to offer right now other than some not-yet-related observations from graphs.
      • 2013-10-20 29332, 2013

      • ruaok_bus
        what are those observations, rvedotrc?
      • 2013-10-20 29332, 2013

      • ianmcorvidae
        "Mozilla/5.0 (Windows; U; Windows NT 5.1; ru; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3" was causing a lot of traffic so I've force-503'd it at nginx
      • 2013-10-20 29338, 2013

      • ianmcorvidae
        we'll see what that improves
      • 2013-10-20 29301, 2013

      • ianmcorvidae
        (for context, since I don't think you were around when I was mentioning it before, rvedotrc)
      • 2013-10-20 29308, 2013

      • rvedotrc
        high load on the apps servers, slow responses on the search servers, high traffic on the ports already mentioned,
      • 2013-10-20 29321, 2013

      • rvedotrc
        and a few IPs hitting fairly hard
      • 2013-10-20 29325, 2013

      • rvedotrc
        but, same old same old.
      • 2013-10-20 29309, 2013

      • ruaok_bus
        how did you determine the IPs that are hitting hard?
      • 2013-10-20 29352, 2013

      • rvedotrc
        well, for some definition of hard. just the 'top' script on the ratelimit server.
      • 2013-10-20 29301, 2013

      • ruaok_bus
        rvedotrc: k
      • 2013-10-20 29322, 2013

      • ruaok_bus
        I think we're going to leave that UA block in place and check in in a little while.
      • 2013-10-20 29330, 2013

      • ruaok_bus
        but it might just be beer:30 now.
      • 2013-10-20 29316, 2013

      • rvedotrc
        Very interesting grepping for that UA in yesterday's log.
      • 2013-10-20 29345, 2013

      • ruaok_bus
        ya?
      • 2013-10-20 29312, 2013

      • rvedotrc
        one query at 18/Oct/2013:08:15:16
      • 2013-10-20 29326, 2013

      • rvedotrc
        then at 18/Oct/2013:09:15:15, boom, the flood starts.
      • 2013-10-20 29330, 2013

      • rvedotrc
        nothing in between.
      • 2013-10-20 29333, 2013

      • rvedotrc
        no ramp up.
      • 2013-10-20 29320, 2013

      • rvedotrc counts IPs
      • 2013-10-20 29322, 2013

      • rvedotrc1 joined the channel
      • 2013-10-20 29322, 2013

      • ruaok joined the channel
      • 2013-10-20 29301, 2013

      • rvedotrc1
        gonna bail for today. Maybe I'll check in tomorrow and see how things are.
      • 2013-10-20 29315, 2013

      • rvedotrc1
        nn
      • 2013-10-20 29320, 2013

      • ianmcorvidae
        okay
      • 2013-10-20 29324, 2013

      • ianmcorvidae
        oh, they're gone
      • 2013-10-20 29330, 2013

      • ianmcorvidae
        but anyway, hopefully that's a fix for now
      • 2013-10-20 29340, 2013

      • ruaok
        yeah. lets keep our eye on things for now.
      • 2013-10-20 29348, 2013

      • ruaok
        I'm going to head to the bar and find a beer.
      • 2013-10-20 29302, 2013

      • MBJenkins
        Project full-import build #153: STILL FAILING in 6 min 51 sec: http://ci.musicbrainz.org/job/full-import/153/
      • 2013-10-20 29349, 2013

      • misterswag joined the channel
      • 2013-10-20 29318, 2013

      • LordSputnik
        http://userscripts.org/scripts/show/180309 <- quite happy I've finally got round to making that
      • 2013-10-20 29320, 2013

      • LordSputnik
        :D
      • 2013-10-20 29307, 2013

      • Dremora joined the channel
      • 2013-10-20 29337, 2013

      • Mineo joined the channel
      • 2013-10-20 29301, 2013

      • marcooliveira joined the channel
      • 2013-10-20 29336, 2013

      • kepstin-laptop joined the channel
      • 2013-10-20 29335, 2013

      • misterswag joined the channel
      • 2013-10-20 29352, 2013

      • misterswag joined the channel
      • 2013-10-20 29355, 2013

      • mrswag joined the channel
      • 2013-10-20 29340, 2013

      • ianmcorvidae
        heh, almost three million requests from that bad UA
      • 2013-10-20 29357, 2013

      • ianmcorvidae
        (in the log for today, noting that that includes things after we blocked it since those still hit lenny)
      • 2013-10-20 29338, 2013

      • ianmcorvidae
        from a bit more than 300,000 different IP addresses
      • 2013-10-20 29321, 2013

      • ianmcorvidae
        more than half of those IPs only made one request, but
      • 2013-10-20 29326, 2013

      • ianmcorvidae
        and apparently the UA was at least semi-accurate one way, inasmuch as most of the IPs geoiplookup could actually resolve were in russia :P
      • 2013-10-20 29345, 2013

      • ianmcorvidae
        (~124k it couldn't find, ~122k russia, ~22k ukraine, ~13k USA, ~10k kazahkstan, ~7k belarus, ~2k germany, ~1.5k moldova, rest below 1000)
      • 2013-10-20 29309, 2013

      • Leftmost
        Does kind of sound like a DDoS.
      • 2013-10-20 29347, 2013

      • ianmcorvidae
        yeah, a bit :P
      • 2013-10-20 29354, 2013

      • ijabz joined the channel
      • 2013-10-20 29344, 2013

      • rvedotrc joined the channel
      • 2013-10-20 29350, 2013

      • andreypopp joined the channel
      • 2013-10-20 29304, 2013

      • FrederikSOlesen joined the channel
      • 2013-10-20 29347, 2013

      • marcooliveira joined the channel
      • 2013-10-20 29306, 2013

      • reodroid joined the channel
      • 2013-10-20 29339, 2013

      • reodroid2 joined the channel
      • 2013-10-20 29343, 2013

      • kepstin-laptop joined the channel
      • 2013-10-20 29308, 2013

      • reodroid joined the channel
      • 2013-10-20 29355, 2013

      • xlotlu joined the channel
      • 2013-10-20 29334, 2013

      • xlotlu
      • 2013-10-20 29357, 2013

      • luks
        hm, long discussion
      • 2013-10-20 29330, 2013

      • luks
        hm, long patch too :)
      • 2013-10-20 29355, 2013

      • kepstin-laptop
        hmm. I really should finish my patch for picard-259 and submit it
      • 2013-10-20 29356, 2013

      • mb-chat-logger
      • 2013-10-20 29307, 2013

      • kepstin-laptop
        just one minor cleanup I wanted to do to it.
      • 2013-10-20 29300, 2013

      • kepstin-laptop
        hmm, actually, no. it's good as-is.
      • 2013-10-20 29353, 2013

      • xlotlu
        luks: that was fast. :) ... 4 months in the waiting when all I had to do was nudge you
      • 2013-10-20 29358, 2013

      • luks
        well, ever expect I know about something :)
      • 2013-10-20 29304, 2013

      • luks
        *never
      • 2013-10-20 29324, 2013

      • luks
        I might have been away for a few days when you pinged me via the PR and I missed the mail
      • 2013-10-20 29307, 2013

      • Dremora joined the channel
      • 2013-10-20 29355, 2013

      • LordSputnik joined the channel
      • 2013-10-20 29346, 2013

      • misterswag joined the channel
      • 2013-10-20 29327, 2013

      • xlotlu
        heh, it wasn't me who did the pinging. I wondered what happened that there was no feedback, but I was afk-ish for 3 months so didn't bother too much about it. until today. :)
      • 2013-10-20 29341, 2013

      • Dremora joined the channel
      • 2013-10-20 29312, 2013

      • reodroid2 joined the channel
      • 2013-10-20 29315, 2013

      • luks
        fyi, this is the project I mentioned yesterday https://bitbucket.org/lalinsky/mbdata
      • 2013-10-20 29327, 2013

      • luks
        if I feel like it can be finished to some usable state, either mbslave will be merged to it, or this to mbslave
      • 2013-10-20 29301, 2013

      • luks
        that was always kind of my ultimate goal with mbslave, but I was never motivated to work on it beoynd the replication stuff
      • 2013-10-20 29304, 2013

      • voiceinsideyou joined the channel
      • 2013-10-20 29343, 2013

      • Jozo
        woh, I will use those SQLalchemy models... :) (I have started write SQLaclhemy reflected models... never finished)
      • 2013-10-20 29348, 2013

      • luks
        the models are the main reason why I started with this :)
      • 2013-10-20 29318, 2013

      • rvedotrc joined the channel
      • 2013-10-20 29318, 2013

      • luks
        then I started on the api and the website to have an excuse to have a look at angularjs :)
      • 2013-10-20 29355, 2013

      • fox61 joined the channel
      • 2013-10-20 29308, 2013

      • fox61 has left the channel
      • 2013-10-20 29323, 2013

      • reosarevok joined the channel
      • 2013-10-20 29340, 2013

      • andreypopp joined the channel
      • 2013-10-20 29323, 2013

      • voiceinsideyou1 joined the channel
      • 2013-10-20 29346, 2013

      • voiceinsideyou joined the channel
      • 2013-10-20 29314, 2013

      • rvedotrc joined the channel
      • 2013-10-20 29337, 2013

      • ruaok joined the channel
      • 2013-10-20 29306, 2013

      • ruaok joined the channel
      • 2013-10-20 29301, 2013

      • Mineo
        luks: from the readme: "you can use the mbdata.models module to get " ... get what?:)
      • 2013-10-20 29340, 2013

      • luks
        Mineo: left to reader's imagination :)
      • 2013-10-20 29347, 2013

      • sear joined the channel
      • 2013-10-20 29350, 2013

      • sear
        Hi everyone, I'm working on spinning up a musicbrainz server and I'm almost there, but when I bring up plack, it throws this warning: [warning] Unicode::Encoding plugin is auto-applied, please remove this from your appclass and make sure to define "encoding" config
      • 2013-10-20 29300, 2013

      • sear
        Then reports that it's accepting connections
      • 2013-10-20 29320, 2013

      • sear
        But on each subsequent request to plack, this error is thrown: [error] Couldn't render template "undef error - /home/jhill/musicbrainz/root/static/common.css: Does not exist at lib/MusicBrainz/Server/Data/FileCache.pm line 33.
      • 2013-10-20 29336, 2013

      • sear
        Any idea what might be going on, or if these two issues are related?
      • 2013-10-20 29332, 2013

      • Freso
        No clue what's going on, but they don't seem related.
      • 2013-10-20 29332, 2013

      • Freso
        Can you connect to it, or does it bail out because of that missing .css file?
      • 2013-10-20 29333, 2013

      • sear
        It bails out, and I get the same error reported in the browser.
      • 2013-10-20 29302, 2013

      • Freso
        ocharles: Should the CSS files get compiled "manually", or should that happen by itself?
      • 2013-10-20 29351, 2013

      • sear
        I've brought up an instance before without having to compile manually, but I'll go ahead and compile the less and see what happens
      • 2013-10-20 29300, 2013

      • Freso
        sear: We recently switched from using CSS to using... some pre-CSS system, which I can't remember the name of. I'm thinking your latter error might be related to that.
      • 2013-10-20 29328, 2013

      • sear
        Freso: It's less. Makes sense that I didn't get that error before, then
      • 2013-10-20 29330, 2013

      • Freso
        less, yeah.
      • 2013-10-20 29330, 2013

      • sear
        I'll compile it myself
      • 2013-10-20 29337, 2013

      • Freso
        :)
      • 2013-10-20 29329, 2013

      • sear
        Thanks <3
      • 2013-10-20 29340, 2013

      • Freso
        sear: Heh. You're welcome. :)
      • 2013-10-20 29314, 2013

      • ianmcorvidae
        sear: you shouldn't need to compile it if DEVELOPMENT_SERVER is set to 1; the unicode plugin error you can ignore
      • 2013-10-20 29338, 2013

      • ianmcorvidae
        (if that DBDefs option is set, it'll use less.js to do the compilation in the browser instead)
      • 2013-10-20 29342, 2013

      • sear
        ianmcorvidae: Ahh, that'll do it. I have it set to 0. I compiled it and it worked fine though
      • 2013-10-20 29314, 2013

      • ianmcorvidae
        yeah, once compiled it'd also work fin
      • 2013-10-20 29346, 2013

      • ianmcorvidae
        but you'll want to ensure you do it each time the .less files change, assuming you care about broken CSS:)
      • 2013-10-20 29321, 2013

      • andreypopp joined the channel
      • 2013-10-20 29320, 2013

      • Freso
        ianmcorvidae: Any ETA on when you'll get around to recovering the ModBot deleted places?
      • 2013-10-20 29310, 2013

      • ianmcorvidae
        Freso: not really, tonight/tomorrow likely
      • 2013-10-20 29319, 2013

      • nikki
        your time?
      • 2013-10-20 29320, 2013

      • Freso
        CatQuest: ^
      • 2013-10-20 29327, 2013

      • ianmcorvidae
        yes, my time
      • 2013-10-20 29335, 2013

      • ianmcorvidae
        once the GSoC mentor summit is over :P
      • 2013-10-20 29359, 2013

      • luks
        it's kind of nice to see sqlalchemy handling 5+ level deep relationships efficiently
      • 2013-10-20 29302, 2013

      • luks
      • 2013-10-20 29313, 2013

      • luks
        I've been wrong about ORMs for so long :/
      • 2013-10-20 29319, 2013

      • nikki
        oh?
      • 2013-10-20 29358, 2013

      • luks
        I always advocated using hand written SQL for working with MB
      • 2013-10-20 29318, 2013

      • luks
        MB server could have been much simpler with a good ORM
      • 2013-10-20 29325, 2013

      • Freso
        CallerNo6: *cough* ^
      • 2013-10-20 29332, 2013

      • ijabz joined the channel
      • 2013-10-20 29310, 2013

      • warp
        luks: the "good" part of "good orm" seems significant though.