#musicbrainz-devel

/

      • ianmcorvidae
        but yeah, 100 requests per second coming from headphones and beets-via-headphones

        • 2012-11-27 33208, 2012

      • ianmcorvidae
        since the latter wasn't being throttled, it wasn't getting ratelimited *at all* until fifteen minutes ago or whatever it was, because it was under the 50/s limit for python-musicbrainz/0.7.3

        • 2012-11-27 33229, 2012

      • reosarevok
        heh

        • 2012-11-27 33237, 2012

      • ianmcorvidae
        which is where it was getting binned, though apparently clients *actually* using that UA are now only about 3 requests per second :P

        • 2012-11-27 33243, 2012

      • reosarevok
        So tomorrow we'll have some people dropping by like "you broke our stuff again!"

        • 2012-11-27 33201, 2012

      • ianmcorvidae
        to which I think we respond "no, that was you, with ours" :P

        • 2012-11-27 33238, 2012

      • reosarevok
        We respond "implement a latest-changed in MB and then we'll see"

        • 2012-11-27 33246, 2012

      • reosarevok
        (if nobody wants to, bad luck for them :p)

        • 2012-11-27 33250, 2012

      • ianmcorvidae
        heh

        • 2012-11-27 33259, 2012

      • ianmcorvidae
        well, we have that partly done, I think rob's working further on it

        • 2012-11-27 33212, 2012

      • reosarevok
        Yeah, I guess it is useful for others too, not just headphones

        • 2012-11-27 33215, 2012

      • ianmcorvidae
        this doesn't solve the problem completely, of course -- ideally we'd be able to support our capacity

        • 2012-11-27 33237, 2012

      • reosarevok
        which means? :)

        • 2012-11-27 33244, 2012

      • reosarevok
        Not break up as we approach 10?

        • 2012-11-27 33249, 2012

      • reosarevok
        down rather than up :p

        • 2012-11-27 33259, 2012

      • ianmcorvidae
        ideally we wouldn't need to ratelimit people because we'd have enough money to pay for enough bandwidth :P

        • 2012-11-27 33205, 2012

      • reosarevok
        yes

        • 2012-11-27 33218, 2012

      • reosarevok
        Ideally people wouldn't make absolutely ridiculous requests and that wouldn't ever be a problem :p

        • 2012-11-27 33234, 2012

      • ianmcorvidae
        etc.

        • 2012-11-27 33240, 2012

      • reosarevok
        (and our replies wouldn't be ridiculously detailed without need, and the problem would be smaller)

        • 2012-11-27 33245, 2012

      • ianmcorvidae
        yeah

        • 2012-11-27 33200, 2012

      • ianmcorvidae
        there's many ways for us to fit better into our capacity, more money or better use of resources :P

        • 2012-11-27 33205, 2012

      • reosarevok
        But from what we have, I'm happy with the "throttle and let them pay for free WS" :p

        • 2012-11-27 33222, 2012

      • reosarevok
        I mean, since they're not paying any artist, they might as well pay someone :p

        • 2012-11-27 33227, 2012

      • ianmcorvidae
        :P

        • 2012-11-27 33244, 2012

      • reosarevok
        (or find stuff the slow way like the rest of us)

        • 2012-11-27 33258, 2012

      • ianmcorvidae
        also: anyone else who uses python-musicbrainz/0.7.3: a.) god damn upgrade your thing, and b.) you're welcome :P

        • 2012-11-27 33239, 2012

      • reosarevok wonders how big their userbase is

        • 2012-11-27 33244, 2012

      • ianmcorvidae
        heh, now it is actually blocking more than it's letting through

        • 2012-11-27 33248, 2012

      • ianmcorvidae
        they're not going to be pleased :P

        • 2012-11-27 33250, 2012

      • reosarevok
        How many of the requests come from unique sources?

        • 2012-11-27 33203, 2012

      • ianmcorvidae
        I'd need to do some log analysis to tell you that, heh

        • 2012-11-27 33208, 2012

      • reosarevok
        Is it a relatively small amount of people going nuts, or a huge amount of people going slightly less nuts?

        • 2012-11-27 33218, 2012

      • ianmcorvidae
        luckily my copy of the log is going a lot faster now at least

        • 2012-11-27 33219, 2012

      • ianmcorvidae
        well

        • 2012-11-27 33227, 2012

      • ianmcorvidae
        any individual IP can still only make one request per second

        • 2012-11-27 33233, 2012

      • ianmcorvidae
        we are getting 100 requests per second

        • 2012-11-27 33237, 2012

      • ianmcorvidae
        :P

        • 2012-11-27 33246, 2012

      • ianmcorvidae
        the per-IP ratelimit comes into effect *before* this one

        • 2012-11-27 33248, 2012

      • ianmcorvidae
        but they're using python-musicbrainz-ngs which deals with that ratelimit anyway, so

        • 2012-11-27 33220, 2012

      • reosarevok
        Well, 100 people aren't that many :p

        • 2012-11-27 33228, 2012

      • reosarevok
        So it can be 100, or it can be 10000 :p

        • 2012-11-27 33235, 2012

      • reosarevok
        We just know it's not less than 100

        • 2012-11-27 33243, 2012

      • ianmcorvidae
        yeah, fair enough

        • 2012-11-27 33244, 2012

      • reosarevok
        Which would be absolutely nuts

        • 2012-11-27 33248, 2012

      • reosarevok
        So it's good it isn't :p

        • 2012-11-27 33209, 2012

      • ianmcorvidae
        heh

        • 2012-11-27 33200, 2012

      • Freso
        reosarevok: RE: "latest-changed", if the Bottle ends up caching WS data anyway, the "latest-changed" could be utilised to selectively update the cache as-needed.

        • 2012-11-27 33220, 2012

      • reosarevok
        Certainly, that's what I mean with it having other uses

        • 2012-11-27 33225, 2012

      • Freso
        (Of course, being able to just cache properly in the first place would also be good...)

        • 2012-11-27 33234, 2012

      • reosarevok
        Speaking of proper cache

        • 2012-11-27 33240, 2012

      • reosarevok
        Any ideas on how to do the wikipedia thing?

        • 2012-11-27 33252, 2012

      • ianmcorvidae
        the wikipedia on entity pages on MB thing?

        • 2012-11-27 33255, 2012

      • ianmcorvidae
        there's a patch up for that already :P

        • 2012-11-27 33227, 2012

      • ianmcorvidae
        ocharles: speaking of which, please respond to my comment on http://codereview.musicbrainz.org/r/2393/

        • 2012-11-27 33252, 2012

      • reosarevok
        Oh, cool

        • 2012-11-27 33256, 2012

      • Freso
        ianmcorvidae: Are we out of polar season btw? Or won't it get tropical until the release is out?

        • 2012-11-27 33223, 2012

      • ianmcorvidae
        yeah, the release needs to happen

        • 2012-11-27 33237, 2012

      • Freso won't change topic then :)

        • 2012-11-27 33242, 2012

      • ianmcorvidae
        hopefully it'll be before thursday or whatever insane day it was last time :/

        • 2012-11-27 33244, 2012

      • Freso
        Also, I'd really like to get closure about raptekster.dk - but I keep missing Rob on IRC. Just a quick yay/nay would be good. :/

        • 2012-11-27 33258, 2012

      • ianmcorvidae
        what's the situation there?

        • 2012-11-27 33230, 2012

      • Freso
        ianmcorvidae: The RFV has passed, but I need a legal yes/no from the style grand chief, aka Rob, before putting it in code.

        • 2012-11-27 33244, 2012

      • Freso
        ianmcorvidae: As it's a lyrics site.

        • 2012-11-27 33228, 2012

      • reosarevok
        Mail him then

        • 2012-11-27 33233, 2012

      • reosarevok
        Hopefully he'll see it

        • 2012-11-27 33250, 2012

      • reosarevok
        (and if he does not you didn't lose anything since you can tell him when he's around)

        • 2012-11-27 33255, 2012

      • reosarevok
        Night!

        • 2012-11-27 33227, 2012

      • Freso
        I would mail him if my mail was behaving. :p

        • 2012-11-27 33234, 2012

      • Freso
        I guess I'll try again in the morrow.

        • 2012-11-27 33234, 2012

      • kepstin joined the channel

        • 2012-11-27 33240, 2012

      • stefans_ joined the channel

        • 2012-11-27 33209, 2012

      • kepstin-work joined the channel

        • 2012-11-27 33258, 2012

      • nikki_ joined the channel

        • 2012-11-27 33217, 2012

      • Leftmost joined the channel

        • 2012-11-27 33241, 2012

      • Leftmost joined the channel

        • 2012-11-27 33240, 2012

      • reosarevok joined the channel

        • 2012-11-27 33256, 2012

      • luks
        I wonder how exactly does headphones use mb

        • 2012-11-27 33243, 2012

      • reosarevok
        Badly

        • 2012-11-27 33250, 2012

      • reosarevok
        Well, fine, that's not "exactly" :)

        • 2012-11-27 33201, 2012

      • reosarevok
        Code is open though, you can check it

        • 2012-11-27 33212, 2012

      • reosarevok
        https://github.com/rembo10/headphones

        • 2012-11-27 33240, 2012

      • luks
        so I take the answer is "we don't know" :)

        • 2012-11-27 33206, 2012

      • ijabz joined the channel

        • 2012-11-27 33216, 2012

      • nikki
        my understanding from the conversations I've seen here was that it rechecks stuff every couple of days looking for changes

        • 2012-11-27 33228, 2012

      • dan_k joined the channel

        • 2012-11-27 33243, 2012

      • ocharles
        morning

        • 2012-11-27 33239, 2012

      • ocharles
        where 'stuff' is your entire music library

        • 2012-11-27 33242, 2012

      • nikki
        which is why I keep saying we should finish this recently updated entities thing :P

        • 2012-11-27 33232, 2012

      • ocharles
        ahh good, the track table is missing the 'delete_orphaned_recordings();' trigger

        • 2012-11-27 33211, 2012

      • warp
        ocharles: I believe I have found the problem with the failing test. master is building now on jenkins.

        • 2012-11-27 33217, 2012

      • ocharles
        yay!

        • 2012-11-27 33222, 2012

      • ocharles
        fingers crossed

        • 2012-11-27 33245, 2012

      • warp
        +@edits = nsort_by { $_->id } @edits;

        • 2012-11-27 33259, 2012

      • MBJenkins
        Project musicbrainz-server_master build #353: FIXED in 31 min: http://ci.musicbrainz.org/job/musicbrainz-server_…

        • 2012-11-27 33200, 2012

      • MBJenkins
        warp: Sort by edit ids correctly in Controller::Work::Create test.

        • 2012-11-27 33211, 2012

      • ocharles
        yea, i saw it on github

        • 2012-11-27 33258, 2012

      • warp
        ocharles: btw, a full test (with HTML5 validation) takes 16 minutes here.

        • 2012-11-27 33226, 2012

      • ocharles
        right, and hobbes is a bit slower than 'here', so call it 20 minutes. and a full test takes 30 minutes, so we're at almost an hour still :)

        • 2012-11-27 33227, 2012

      • warp
        so a faster and less memory constrained build server would help a lot.

        • 2012-11-27 33235, 2012

      • ocharles
        oh wait

        • 2012-11-27 33238, 2012

      • ocharles
        you meant 16 minutes in total

        • 2012-11-27 33246, 2012

      • ocharles
        indeed

        • 2012-11-27 33206, 2012

      • warp
        time prove t/tests.t > all.log 2>&1

        • 2012-11-27 33225, 2012

      • warp
        real 16m6.793s

        • 2012-11-27 33221, 2012

      • warp
        ocharles: anyway, build FIXED, when do you want to release? :)

        • 2012-11-27 33237, 2012

      • ocharles
        oh good, tis release time

        • 2012-11-27 33241, 2012

      • ocharles
        i can release when ever

        • 2012-11-27 33213, 2012

      • warp
        alright, let's do it now then.

        • 2012-11-27 33229, 2012

      • warp
        I'm logging in on lenny

        • 2012-11-27 33208, 2012

      • ocharles
        ok

        • 2012-11-27 33230, 2012

      • ocharles
        hm, 19380 orphaned recordings

        • 2012-11-27 33246, 2012

      • warp
        I'm ready!

        • 2012-11-27 33252, 2012

      • ocharles
        ok, go ahead

        • 2012-11-27 33218, 2012

      • warp
        astro is out.

        • 2012-11-27 33219, 2012

      • ocharles
        hmm, what a mess

        • 2012-11-27 33228, 2012

      • warp
        what happen?

        • 2012-11-27 33232, 2012

      • ocharles

        • 2012-11-27 33243, 2012

      • ocharles
        that one again

        • 2012-11-27 33249, 2012

      • warp
        so this DBDefs stuff is not working.

        • 2012-11-27 33208, 2012

      • ocharles
        or configured wrong

        • 2012-11-27 33235, 2012

      • warp
        well, DBDefs/Default attempts to set this automatically. that not working is what I'm saying.

        • 2012-11-27 33251, 2012

      • warp
        setting it to a simple value in DBDefs.pm should work.

        • 2012-11-27 33235, 2012

      • ocharles
        yea, but you can set it manually

        • 2012-11-27 33254, 2012

      • ocharles goes for attempt 2

        • 2012-11-27 33214, 2012

      • ocharles
        that looks better

        • 2012-11-27 33226, 2012

      • ocharles
        warp: astro done!

        • 2012-11-27 33229, 2012

      • warp
        yay!

        • 2012-11-27 33240, 2012

      • warp
        astro back, pingu out.

        • 2012-11-27 33247, 2012

      • ocharles
        ah

        • 2012-11-27 33255, 2012

      • ocharles
        I think astro might have broke because I did a 'git stash'

        • 2012-11-27 33202, 2012

      • ocharles
        but there are, as always, unstaged changes :)

        • 2012-11-27 33207, 2012

      • ocharles
        (this time to DBDefs/Default)

        • 2012-11-27 33208, 2012

      • warp
        uh oh

        • 2012-11-27 33224, 2012

      • warp
        so should I take astro out again?

        • 2012-11-27 33227, 2012

      • ocharles
        nah

        • 2012-11-27 33237, 2012

      • ocharles
        i did remember doing work on that, and when I opened it the file i was like 'huh, I thought this was changed?'

        • 2012-11-27 33241, 2012

      • ocharles
        so i'll get that commited to beta soon

        • 2012-11-27 33256, 2012

      • warp
        ok

        • 2012-11-27 33229, 2012

      • ocharles
        bah, pingu did the same :)

        • 2012-11-27 33237, 2012

      • ocharles goes to fix that one too

        • 2012-11-27 33212, 2012

      • ocharles
        [pingu] out: make: Entering directory `/home/musicbrainz/musicbrainz-server/po'

        • 2012-11-27 33213, 2012

      • ocharles
        [pingu] out: make: *** [attributes.de.mo] Error 127

        • 2012-11-27 33215, 2012

      • ocharles

        • 2012-11-27 33219, 2012

      • ocharles
        matters

        • 2012-11-27 33225, 2012

      • warp
        oh

        • 2012-11-27 33227, 2012

      • ocharles
        pingu done

        • 2012-11-27 33234, 2012

      • warp
        no idea

        • 2012-11-27 33244, 2012

      • warp
        pingu back, asterix out.

        • 2012-11-27 33210, 2012

      • nikki
        we don't have translations enabled on the main servers, so it shouldn't