I fixed a very nasty issue causing occasional packet loss on gateways (due to iptables conntrack limits and high traffic), it was possibly the cause of reported 504s (and other undetected issues). It required careful tuning of kernel sysctl values, but it looks like it works well now. I increased the global rate limit, as requested by ruaok
2016-08-15 22847, 2016
zas
we are serving 700+ req/s (200s)
2016-08-15 22852, 2016
reosarevok
yay
2016-08-15 22853, 2016
ruaok
finally answering your question: I've not seen any 504s today. well done!
2016-08-15 22859, 2016
ruaok
\ø/
2016-08-15 22840, 2016
zas
i resumed on docker stuff, mostly collecting documentation on infrastructure and admin tasks
2016-08-15 22804, 2016
zas
i'm preparing the load balancer openresty container
2016-08-15 22818, 2016
zas
which is the main part
2016-08-15 22839, 2016
zas
use docker swarm + service discovery will be great
2016-08-15 22852, 2016
kepstin
conntrack limits huh? I hadn't thought of that. GJ figuring it out, zas :)
2016-08-15 22813, 2016
zas
kepstin: yes, it was a nasty thing
2016-08-15 22836, 2016
zas
but we have a lot of traffic
2016-08-15 22816, 2016
zas
ruaok: i think we should get few machines at hetzner now and start preparing them to host docker stuff
2016-08-15 22816, 2016
Freso has quit
2016-08-15 22829, 2016
ruaok
google not good enough?
2016-08-15 22844, 2016
chirlu notes that we had hit conntrack limits previously already.
2016-08-15 22801, 2016
Freso joined the channel
2016-08-15 22810, 2016
ruaok
chirlu: a pile of times, yes. I wish we would've licked them by now. :(
2016-08-15 22817, 2016
zas
well, to test containers yes, but physical nodes will need proper setup (firewall, kernel, sysctl, ...°
2016-08-15 22828, 2016
ruaok
ok, I see.
2016-08-15 22835, 2016
Freso
:|
2016-08-15 22846, 2016
ruaok
I think we should get closer to the date when we're happy with our docker stuff.
2016-08-15 22807, 2016
ruaok
at the point when all three of us shrug our shoulders and say: "this should work!" is probably the right time.
2016-08-15 22816, 2016
zas
ok
2016-08-15 22824, 2016
ruaok
then we'll have quite some time to actually get it right.
2016-08-15 22831, 2016
Freso
zas: Got more?
2016-08-15 22837, 2016
zas
nope, fin.
2016-08-15 22839, 2016
ruaok
I can call them and ask them what is easiest for them.
2016-08-15 22841, 2016
Freso
LordSputnik!
2016-08-15 22849, 2016
ruaok
I have to talk to them about babar and spike too.
2016-08-15 22858, 2016
ruaok
speaking of LordSputnik...
2016-08-15 22809, 2016
CatQuest
ugh yea LordSputnik
2016-08-15 22817, 2016
ruaok
LordSputnik: Leftmost: I believe you two are up for going to the GSoC Summit.
2016-08-15 22819, 2016
ruaok
wanna go?
2016-08-15 22835, 2016
Leftmost
When is that?
2016-08-15 22836, 2016
ruaok
oh well, I guess not.
2016-08-15 22839, 2016
ruaok
damn.
2016-08-15 22840, 2016
ruaok
:)
2016-08-15 22844, 2016
ruaok
end of oct.
2016-08-15 22850, 2016
Freso
No Leo_Verto. LordSputnik unresponsive...
2016-08-15 22853, 2016
Freso
alastairp!
2016-08-15 22807, 2016
ruaok
this was discussed at length on the mentors list. I see you're paying attention. :)
2016-08-15 22824, 2016
Leftmost
I'd go, but not at the expense of someone more core to the project.
2016-08-15 22826, 2016
CatQuest
:disapproving:
2016-08-15 22838, 2016
CatQuest
hmm
2016-08-15 22841, 2016
CatQuest
that didn't work
2016-08-15 22804, 2016
reosarevok
Leftmost: I think people "more core to the project" have all mostly gone there by now
2016-08-15 22817, 2016
reosarevok
(if you mean MeB generally)
2016-08-15 22831, 2016
Leftmost
I do.
2016-08-15 22832, 2016
Freso
No alastairp either. :|
2016-08-15 22841, 2016
CatQuest
ಠ_ಠ
2016-08-15 22841, 2016
Freso
CatQuest: Go!
2016-08-15 22849, 2016
ruaok
Leftmost: we're on a round robin basis and Google is paying. by the rules, you're up next.
2016-08-15 22855, 2016
CatQuest
Last week I did some instruments, as well as moving some "children of" rels to "subtypes" and "derivations".
That brought up translation questions: should disambiguations become translatable strings? how, (or why/why not?)
2016-08-15 22856, 2016
CatQuest
I agree with chirlu that descriptions being copypasta is problematic, and that perhaps they aught to be scrapped,
2016-08-15 22859, 2016
CatQuest
(but I think maybe they should be replaced by annotations/aliases/disambiguations? instead, see my comment on somewhat related style ticket: http://tickets.musicbrainz.org/browse/MBS-8764 as well as comments on the previous mentioned thread)
2016-08-15 22803, 2016
CatQuest
Then I created a task for myself http://tickets.musicbrainz.org/browse/INST-415 to research how those pianos hang together, welcome to comment or watch that ticket! To close of last week, I obtained a frikken sweet title courtesy of reosarevok! yaay!
2016-08-15 22807, 2016
CatQuest
This week I'vn't been able to add much - this week has gone by pretty fast with preparing for school that starts for me on the 24th, uncertainty about disambiguations, and fighting a cold:(
2016-08-15 22809, 2016
ruaok
of course you can so, no, but you should not feel bad about going.
2016-08-15 22814, 2016
CatQuest
Next week will be much of the same, but I hope to continue to squeeze in some more instruments.
2016-08-15 22816, 2016
CatQuest
Now as the test.bookbrainz.org is finally up? I've been doing some testing there too, but I'm a bit blocked by ben always being away when I have https://paste.ee/p/1uGw9 to tell him :P
2016-08-15 22819, 2016
CatQuest
eh sorry for the wall of text
2016-08-15 22826, 2016
Freso
CatQuest: Don't be. :)
2016-08-15 22832, 2016
reosarevok
thanks again for working on instruments, CatQuest :)
So all of my branches are mostly ready to merge, a few already have been
2016-08-15 22818, 2016
QuoraUK
just need checking over now
2016-08-15 22828, 2016
QuoraUK
Got the video of the system sorted
2016-08-15 22832, 2016
QuoraUK
and blog post mostly ready
2016-08-15 22849, 2016
QuoraUK
Just some tidy up and testing to go now :)
2016-08-15 22851, 2016
QuoraUK
fin
2016-08-15 22853, 2016
Freso
No hellska. :| kartikgupta0909, go!
2016-08-15 22801, 2016
CatQuest
and I've testedbadges, they work!
2016-08-15 22809, 2016
Freso
🙌
2016-08-15 22824, 2016
kartikgupta0909
Last week I worked on the code for evaluation of a dataset on a user machine
2016-08-15 22831, 2016
kartikgupta0909
Done with the basic version
2016-08-15 22841, 2016
kartikgupta0909
Need to get the pending PRs for the server API merged
2016-08-15 22801, 2016
kartikgupta0909
and then modify the evaluator script to use them instead of reading the datasets from files
2016-08-15 22801, 2016
kartikgupta0909
fin :)
2016-08-15 22846, 2016
Freso
armalcolite!
2016-08-15 22851, 2016
armalcolite
Hi!
2016-08-15 22856, 2016
Freso
🙋
2016-08-15 22859, 2016
armalcolite
This week was spent in rebasing the playing_now branch and then resolving a lot of issues. Issues that got introduced both via merge-conflicts and user_id schema change.
2016-08-15 22859, 2016
armalcolite
Then fixiing the tests, which had a wierd problem. They were failing because of no reason. I spent lot more time fixing them than i anticipated. But success!! :)
2016-08-15 22813, 2016
armalcolite
I spent a lot of time testing the new API(api_compat), hoping all the bugs get resolved before merge in the master.
2016-08-15 22815, 2016
Freso
🙌
2016-08-15 22826, 2016
armalcolite
And a simple addition, now api_compat's playing_now gets updated as per the duration of the song.
2016-08-15 22833, 2016
ruaok
armalcolite: I'll finish testing that branch tomorrow. and hopefully merge it.
2016-08-15 22838, 2016
armalcolite
And, my GSoC work got merged. Yippee!!
2016-08-15 22843, 2016
armalcolite
ruaok: awesome!
2016-08-15 22849, 2016
armalcolite
fin.
2016-08-15 22855, 2016
CatQuest looks forward to testing ListneBrainz stuff too
