#musicbrainz-devel

/

      • ruaok
        10mbits/s is out limit. after that we pay more.
      • 2012-08-01 21428, 2012

      • ruaok
        not interested in doing that for headphones
      • 2012-08-01 21437, 2012

      • ocharles
        ah
      • 2012-08-01 21424, 2012

      • ruaok
        what is weird is that we're using the same amount of bandwidth as a few months ago, but we're handling fewer requests.
      • 2012-08-01 21411, 2012

      • _flow_ joined the channel
      • 2012-08-01 21418, 2012

      • ruaok
        yep.
      • 2012-08-01 21437, 2012

      • Spacey
        Is there a limit on the amount of requests you can send to the ws per timeframe?
      • 2012-08-01 21450, 2012

      • ruaok
        we have the same amount of traffic now as we didi in jan when we did 25M hits per day.
      • 2012-08-01 21451, 2012

      • kepstin-work
        Spacey: average of one per second on the default limiter.
      • 2012-08-01 21459, 2012

      • ruaok
        now its only 18M.
      • 2012-08-01 21424, 2012

      • ruaok
        ocharles: did the amount data going out over the WS change recently?
      • 2012-08-01 21432, 2012

      • ocharles
        define recently?
      • 2012-08-01 21438, 2012

      • kepstin-work
        was something added to the webservice recently that made queries bigger? did gzip get accidentally disabled?
      • 2012-08-01 21438, 2012

      • ocharles
        but not really, but our data has changed
      • 2012-08-01 21443, 2012

      • ruaok
        betwen jan and now.
      • 2012-08-01 21459, 2012

      • ocharles
        if it did, you'd see a quite discernable bump
      • 2012-08-01 21405, 2012

      • ocharles
        but i can't think of anything
      • 2012-08-01 21407, 2012

      • ruaok
        I'm looking for it
      • 2012-08-01 21439, 2012

      • ruaok
      • 2012-08-01 21459, 2012

      • ruaok
        last friday in april seems to have a bump.
      • 2012-08-01 21409, 2012

      • Spacey
        kepstin-work: thanks.
      • 2012-08-01 21441, 2012

      • kepstin-work
      • 2012-08-01 21429, 2012

      • ocharles
        ruaok: ish, but it looks down the next month http://stats.musicbrainz.org/mrtg/95th-percentile…
      • 2012-08-01 21437, 2012

      • ruaok
        yeah.
      • 2012-08-01 21402, 2012

      • ocharles
        maybe we're serving more off /ws/2 now, which has larger responses
      • 2012-08-01 21407, 2012

      • ocharles
        due to inc suckiness
      • 2012-08-01 21431, 2012

      • ocharles
        when did picard move to /ws/2?
      • 2012-08-01 21434, 2012

      • ruaok
      • 2012-08-01 21449, 2012

      • kepstin-work
        ocharles: 0.15, I think.
      • 2012-08-01 21454, 2012

      • ruaok
        ah, yes.
      • 2012-08-01 21458, 2012

      • ruaok
        that would explain it.
      • 2012-08-01 21405, 2012

      • ijabz joined the channel
      • 2012-08-01 21421, 2012

      • ruaok
        the last graph is really telling.
      • 2012-08-01 21428, 2012

      • ruaok
        you can see where we turned on gzip.
      • 2012-08-01 21433, 2012

      • ruaok
        and then it creeps back up.
      • 2012-08-01 21446, 2012

      • ruaok
        in particular in the last two months.
      • 2012-08-01 21402, 2012

      • ocharles
        can rrd tools plot some better average lines?
      • 2012-08-01 21413, 2012

      • ruaok
        not sure
      • 2012-08-01 21405, 2012

      • kepstin-work wonders if the json webservice would actually use less bandwidth, or if gzip would negate any difference.
      • 2012-08-01 21430, 2012

      • ocharles
        kepstin-work: well volunteered!
      • 2012-08-01 21454, 2012

      • ruaok
      • 2012-08-01 21458, 2012

      • ruaok
        this is quite telling.
      • 2012-08-01 21405, 2012

      • ruaok
        see Top 30 of 9526377 Total URLs
      • 2012-08-01 21431, 2012

      • ocharles
        nice to see kb out is useless
      • 2012-08-01 21434, 2012

      • ocharles
        that's a shame
      • 2012-08-01 21448, 2012

      • ruaok
        kbF is fine.
      • 2012-08-01 21450, 2012

      • ocharles
        what is kbf?
      • 2012-08-01 21404, 2012

      • ruaok
        KB served for those number of hits.
      • 2012-08-01 21416, 2012

      • ruaok
        /ws/2/recording is 4% of hits, but 11% of traffice.
      • 2012-08-01 21441, 2012

      • ruaok
        /ws/1/track is 1.4% of hits, 1.77% of traffic.
      • 2012-08-01 21402, 2012

      • ruaok
        /ws/2/recording is an order of magnitude more bandwidth hungry. :(
      • 2012-08-01 21410, 2012

      • nikkimini imagines it includes work info
      • 2012-08-01 21417, 2012

      • reosarevok
        got seventy-something google hits
      • 2012-08-01 21424, 2012

      • reosarevok
        (as an URL)
      • 2012-08-01 21435, 2012

      • nikkimini
        since common relationships like composer/lyricist which used to be on tracks are now on works
      • 2012-08-01 21452, 2012

      • kepstin-work
        I was under the impression that picard does a single request on /ws/2/release for all information?
      • 2012-08-01 21454, 2012

      • ruaok
        I better find out what more bandwidth is going to cost.
      • 2012-08-01 21401, 2012

      • ruaok
        since this insn't anythning we can fix. :(
      • 2012-08-01 21429, 2012

      • ruaok
        kepstin-work: it used to. not sure now.
      • 2012-08-01 21444, 2012

      • ruaok
        but this seems to be the trend from ws/1 to ws/2
      • 2012-08-01 21404, 2012

      • kepstin-work
        we store more information, so the ws responses are bigger :/
      • 2012-08-01 21427, 2012

      • ocharles
        we can stop serving shitloads of artist tags and aliases
      • 2012-08-01 21435, 2012

      • ocharles
        but it is almost an api change
      • 2012-08-01 21444, 2012

      • reosarevok
        Or stop serving shitloads of headphones requests
      • 2012-08-01 21454, 2012

      • reosarevok
        Which are probably around 50% of our stuff
      • 2012-08-01 21401, 2012

      • ruaok
        its actually not that much headphones.
      • 2012-08-01 21408, 2012

      • ruaok
        our traffic has gone down quite a bit since those days.
      • 2012-08-01 21411, 2012

      • reosarevok
        "195867286 34.83%"
      • 2012-08-01 21418, 2012

      • ocharles
        picard is hardly a golden example
      • 2012-08-01 21418, 2012

      • ruaok
        to the tune of 10M hits less.
      • 2012-08-01 21425, 2012

      • ocharles
        requesting literally every single inc flag on every request
      • 2012-08-01 21448, 2012

      • reosarevok
        "195867286 34.83% headphones/0.0 python-musicbrainz-ngs/0.3devMODIFIED ( https://github.com/rembo10/headphones" and "76018109 13.52% python-headphones/0.7.3" still head the useragent table...
      • 2012-08-01 21401, 2012

      • kepstin-work
        ocharles: it only does that to work around the rate limit, instead of making separate smaller requests for each individual thing :)
      • 2012-08-01 21428, 2012

      • hawke_
        I think picard needs everything doesn’t it?
      • 2012-08-01 21438, 2012

      • hawke_
        (or bits from everything anyway)
      • 2012-08-01 21410, 2012

      • nikkimini
        pretty much. anything that isn't available soon gets requested
      • 2012-08-01 21414, 2012

      • kepstin-work
        hawke_: well, if you don't have the various "use x relationships" options checked, it doesn't.
      • 2012-08-01 21401, 2012

      • kepstin-work
        so if you don't care about having composers and lyricists in your tags, feel free to save musicbrainz some bandwidth :)
      • 2012-08-01 21417, 2012

      • ruaok
      • 2012-08-01 21447, 2012

      • nikkimini wonders where 38% came from
      • 2012-08-01 21457, 2012

      • hawke_
        kepstin-work: I do, though. :-)
      • 2012-08-01 21409, 2012

      • kepstin-work
        well, too bad :)
      • 2012-08-01 21415, 2012

      • reosarevok
        nikkimini: from a fast reading of 34.8 :p
      • 2012-08-01 21431, 2012

      • kepstin-work really doesn't have any good ideas for how to handle updates in picard, should he ever finish it :(
      • 2012-08-01 21437, 2012

      • ruaok
        34, 38? what the difference. :)
      • 2012-08-01 21453, 2012

      • ruaok
        reosarevok: by someone who is lysdexic
      • 2012-08-01 21403, 2012

      • nikkimini thought headphones was using 48.35%
      • 2012-08-01 21416, 2012

      • hawke_
        kepstin-work: besides, I doubt my personal usage is a significant part of this. :-D
      • 2012-08-01 21418, 2012

      • reosarevok
        nikkimini: the other 13% is already throttled
      • 2012-08-01 21420, 2012

      • reosarevok
        (I think)
      • 2012-08-01 21424, 2012

      • nikkimini
        it's still using it :P
      • 2012-08-01 21425, 2012

      • Spacey
        If I go to "http://musicbrainz.org/ws/1/artist/?type=xml&name=Coldplay&limit=10" I get 3 results, but there is some Asian name on a 100 score and I of course want "Coldplay" the 2nd result at a score of 86. Is there a way to work with this?
      • 2012-08-01 21433, 2012

      • ruaok
        yea, I was only talking about the unthrottled.
      • 2012-08-01 21436, 2012

      • nikkimini
        ah
      • 2012-08-01 21430, 2012

      • nikkimini
        Spacey: not related to your question, but we recommend using /ws/2 where possible, /ws/1 is deprecated
      • 2012-08-01 21448, 2012

      • Spacey
        I'd love to, but can't find a C# library for 2..
      • 2012-08-01 21453, 2012

      • nikkimini
        ah :/
      • 2012-08-01 21408, 2012

      • reosarevok
        Someone should probably write one
      • 2012-08-01 21416, 2012

      • nikkimini
        are you offering? :P
      • 2012-08-01 21438, 2012

      • reosarevok
        No, but maybe Spacey would, being a C# user :p
      • 2012-08-01 21443, 2012

      • Spacey
        I'm very much not the right guy for that..
      • 2012-08-01 21451, 2012

      • Spacey
        I'm just a casual coder playing around..
      • 2012-08-01 21453, 2012

      • ocharles
        i'd hate to see 'someone's todo list
      • 2012-08-01 21456, 2012

      • reosarevok would have no use for a C# library even if he knew how to do it
      • 2012-08-01 21453, 2012

      • reosarevok
        Guess I could tweet saying that the latest C# library is using the deprecated ws and we'd be very happy if someone feels like changing that :p
      • 2012-08-01 21411, 2012

      • hawke_
        I do find it a bit odd that the search results are so different between ws1 and ws2
      • 2012-08-01 21412, 2012

      • hawke_
      • 2012-08-01 21430, 2012

      • Spacey
        I agree..
      • 2012-08-01 21454, 2012

      • hawke_
        They should be using the same search behind the scenes, surely?
      • 2012-08-01 21419, 2012

      • Spacey
        You'd think.
      • 2012-08-01 21407, 2012

      • hawke_
        Spacey: Of course, there is no magical 'know what I want' search — searches will sometimes have the one that you want somewhere other than first, so you have to deal with that anyway.
      • 2012-08-01 21414, 2012

      • hawke_
        (obviously)
      • 2012-08-01 21438, 2012

      • nikkimini
      • 2012-08-01 21450, 2012

      • ijabz_ joined the channel
      • 2012-08-01 21451, 2012

      • nikkimini
        other than a lot more aliases and tags in /ws/2 they look the same
      • 2012-08-01 21455, 2012

      • Spacey
        Yeah, but I'm very demanding so it has to be an awesome algorithm :(
      • 2012-08-01 21445, 2012

      • ruaok
        oh, yeah. have I told you guys about the latest nutter we have?
      • 2012-08-01 21459, 2012

      • ruaok
        on Monday night at midnight as I am walking i the door my phone rings.
      • 2012-08-01 21402, 2012

      • ruaok
        from australia.
      • 2012-08-01 21416, 2012

      • reosarevok
        ruaok, you said don't use nutter! :p
      • 2012-08-01 21418, 2012

      • ruaok
        I answer and its an aussie guy accusing MusicBrainz of hacking his computer.
      • 2012-08-01 21426, 2012

      • reosarevok
        Ok
      • 2012-08-01 21428, 2012

      • ruaok
        reosarevok: unless they actually ARE nutters.
      • 2012-08-01 21431, 2012

      • reosarevok
        Complaint retired :p
      • 2012-08-01 21441, 2012

      • reosarevok wasn't expecting that
      • 2012-08-01 21442, 2012

      • ruaok
        you haven't finished listening.
      • 2012-08-01 21401, 2012

      • ruaok
        you were a little trigger happy with that label.
      • 2012-08-01 21424, 2012

      • ruaok
        in any case, this guy screams: "If you dont stop right now, I will destroy ALL OF YOUR SYSTEMS"
      • 2012-08-01 21430, 2012

      • ocharles
        o.O
      • 2012-08-01 21454, 2012

      • reosarevok
        Then he joined headphones' development team
      • 2012-08-01 21456, 2012

      • ruaok
        I just started laughing and told him to stop making international threats based on the things he was misinterpreting from his firewall.
      • 2012-08-01 21456, 2012

      • reosarevok
        :)
      • 2012-08-01 21420, 2012

      • ruaok
        I think the picard localhost web server was tripping his overly paranoid firewall setup.
      • 2012-08-01 21425, 2012

      • ruaok
        and he has no way of judging that.
      • 2012-08-01 21445, 2012

      • ruaok
        instead, he'll just make dozens of international calls to harrass me.
      • 2012-08-01 21459, 2012

      • ruaok loves the android "send to voicemail" feature.
      • 2012-08-01 21410, 2012

      • ruaok
        funny, that guy hasn't bothered me in days.
      • 2012-08-01 21439, 2012

      • ruaok
        wiley:~->/usr/local/ghc-7.4.1/bin/ghc --version
      • 2012-08-01 21440, 2012

      • ruaok
        The Glorious Glasgow Haskell Compilation System, version 7.4.1
      • 2012-08-01 21446, 2012

      • ruaok
        what was the command to install cabal now?
      • 2012-08-01 21446, 2012

      • plaintext joined the channel
      • 2012-08-01 21458, 2012

      • hawke_
        ruaok: Is this where you post a blog entry ridiculing him, with the offending voicemails embedded?
      • 2012-08-01 21407, 2012

      • ocharles
        ruaok: are you using the platform or not?
      • 2012-08-01 21424, 2012

      • ruaok
        ocharles: I installed the binary you linked to.
      • 2012-08-01 21433, 2012

      • ruaok
        hawke_: he's not actually bothered to leave any voicemails.
      • 2012-08-01 21449, 2012

      • hawke_
        awww :-/
      • 2012-08-01 21458, 2012

      • ocharles
        ruaok: ok, now you have to decide if you want to install the whole platform, or just enough to get github-backup
      • 2012-08-01 21407, 2012

      • ruaok
        the latter
      • 2012-08-01 21442, 2012

      • ocharles
        apparently you already have it
      • 2012-08-01 21449, 2012

      • ocharles
        'GHC 7.4.1 includes Cabal 1.14.0.'