anything not merged by the 13th I think is in trouble though
ruaok
ok.
keep me posted on how things are going.
worst case, I'll try and jump in.
clearly these outstanding tickets are now the top priority tickets for you and gentlecat.
but I think you knew that already.
bitmap
yeah, will do. I'd like to start a full upgrade test asap
hence 13th at the very very latest
ruaok
I'll send an email to chirlu, you and Gentlecat to make sure we're on track.
ok.
I should also be able to do some tests while you're in the air.
Freso
Perhaps include Leftmost just to be sure?
ruaok
Freso: k
thanks bitmap, thank Gentlecat
fin
Freso
Any last-minute items anyone feel like bringing up?
TOPIC: MetaBrainz Community and Development channel | MusicBrainz non-development: #musicbrainz | MeB meeting [at 19 UTC] agenda: Reviews. schema change (ruaok), freso
TOPIC: MetaBrainz Community and Development channel | MusicBrainz non-development: #musicbrainz | MeB meeting [at 19 UTC] agenda: Reviews. schema change (ruaok), freso's hair (ruaok)
ruaok looks shifty
ruaok: That's 'cause you are.
zas
i have more to add about ws rate limiting
Freso
zas: Shoot.
TOPIC: MetaBrainz Community and Development channel | MusicBrainz non-development: #musicbrainz | MeB meeting [at 19 UTC] agenda: Reviews
zas
i just tried something, which is 1 req/s per ip for all
Gentlecat
wonder if we'll have power next week
zas
our terms of service tell 50 req/s for some specific user agent, but atm we can't honor that, we don't have enough bandwidth
Freso
zas: I read that as for all users using that user agent.
zas
to give an idea, we have ~1000 req/s at the gateway, and until now, we only served 260 req/s as 200s
Freso
Not for every single one of them.
ruaok
Gentlecat: if not, back to my place. :(
Freso
zas: So if there's 60 Picard users sending a request at the same second, only 50 of those will be served.
zas
the new rate limiter allows us to increase to 340 req/s (200s) but even with that, we still only server 1/3 of incoming requests (ok, some are invalid, etc... but still)
Freso
*there're
zas
Freso: yes, this is what i understand
Freso
Okay.
zas
i think a simple rule for all is better, at least for the public and normal web service, until we have an api key based web service
Freso will defer to zas' judgement on this
about that, thx Gentlecast for the link you posted earlier, Kong is exactly what we need ;) -> https://getkong.org/ (bitmap have a look)
bitmap
I always assumed 1/req/s/ip was enforced regardless, and then of those we'd serve at least 50
zas
Gentlecat*
Yes, but atm we can't server all anyway, even at 1 req/s for all
bitmap
right, doesn't work that way in practice of course
zas
the openresty based limiter removed the bad amplification effect, and with the same load on web servers (and a bit more on totoro) we serve 90 req/s more as 200s
ruaok
\ΓΈ/
great news!
zas
but this is still not enough, NewHost + Api key is the way to go to significantly improve the situation
Freso
zag: ^ :)
ruaok
agreed.
fin?
zas
yup
ruaok pokes Freso
Freso
Thanks for your time everyone!
</BANG>
ruaok
:-)
Freso
That was a pretty nice meeting, I reckon.
ruaok nods
ruaok: Also note how people were much better at being brief in the reviews this week, so it didn't matter much that a couple when ~1 minute over time. :) (Also helps that we didn't have a lot on the agenda.)
*went
ruaok
srsly.
CallerNo6
It's like the meeting hired a life coach.
Freso
ruaok: What event was it you were at over the weekend?
ariscop has quit
bitmap
idk what's wrong with postgres on hobbes now
it starts, it's running, but it never creates /var/run/postgresql/.s.PGSQL.5432
ruaok
Freso: Barcelone Burning Bash.
you're going next year. I already decided that yesterday.