but yeah, 100 requests per second coming from headphones and beets-via-headphones
since the latter wasn't being throttled, it wasn't getting ratelimited *at all* until fifteen minutes ago or whatever it was, because it was under the 50/s limit for python-musicbrainz/0.7.3
reosarevok
heh
ianmcorvidae
which is where it was getting binned, though apparently clients *actually* using that UA are now only about 3 requests per second :P
reosarevok
So tomorrow we'll have some people dropping by like "you broke our stuff again!"
ianmcorvidae
to which I think we respond "no, that was you, with ours" :P
reosarevok
We respond "implement a latest-changed in MB and then we'll see"
(if nobody wants to, bad luck for them :p)
ianmcorvidae
heh
well, we have that partly done, I think rob's working further on it
reosarevok
Yeah, I guess it is useful for others too, not just headphones
ianmcorvidae
this doesn't solve the problem completely, of course -- ideally we'd be able to support our capacity
reosarevok
which means? :)
Not break up as we approach 10?
down rather than up :p
ianmcorvidae
ideally we wouldn't need to ratelimit people because we'd have enough money to pay for enough bandwidth :P
reosarevok
yes
Ideally people wouldn't make absolutely ridiculous requests and that wouldn't ever be a problem :p
ianmcorvidae
etc.
reosarevok
(and our replies wouldn't be ridiculously detailed without need, and the problem would be smaller)
ianmcorvidae
yeah
there's many ways for us to fit better into our capacity, more money or better use of resources :P
reosarevok
But from what we have, I'm happy with the "throttle and let them pay for free WS" :p
I mean, since they're not paying any artist, they might as well pay someone :p
ianmcorvidae
:P
reosarevok
(or find stuff the slow way like the rest of us)
ianmcorvidae
also: anyone else who uses python-musicbrainz/0.7.3: a.) god damn upgrade your thing, and b.) you're welcome :P
reosarevok wonders how big their userbase is
heh, now it is actually blocking more than it's letting through
they're not going to be pleased :P
reosarevok
How many of the requests come from unique sources?
ianmcorvidae
I'd need to do some log analysis to tell you that, heh
reosarevok
Is it a relatively small amount of people going nuts, or a huge amount of people going slightly less nuts?
ianmcorvidae
luckily my copy of the log is going a lot faster now at least
well
any individual IP can still only make one request per second
we are getting 100 requests per second
:P
the per-IP ratelimit comes into effect *before* this one
but they're using python-musicbrainz-ngs which deals with that ratelimit anyway, so
reosarevok
Well, 100 people aren't that many :p
So it can be 100, or it can be 10000 :p
We just know it's not less than 100
ianmcorvidae
yeah, fair enough
reosarevok
Which would be absolutely nuts
So it's good it isn't :p
ianmcorvidae
heh
Freso
reosarevok: RE: "latest-changed", if the Bottle ends up caching WS data anyway, the "latest-changed" could be utilised to selectively update the cache as-needed.
reosarevok
Certainly, that's what I mean with it having other uses
Freso
(Of course, being able to just cache properly in the first place would also be good...)