Also helped a little bit with some of the smaller things with the move, but nothing compared to the devs.
2016-11-14 31930, 2016
Freso
And I upgraded Discourse.
2016-11-14 31946, 2016
Freso
fin, I think.
2016-11-14 31948, 2016
Freso
reosarevok: Go.
2016-11-14 31951, 2016
LordSputnik
Freso: Don't think Leftmost is here today - his review would probably be something like "Started reviewing large entity editing pull request, asked LordSputnik some questions, possibly did some sketches for new entity display UI"
2016-11-14 31910, 2016
Freso
LordSputnik: If he's not here, he's not here, and that's fine too.
2016-11-14 31940, 2016
reosarevok
I spent half of the week in Germany. The rest of the week was spent on support plus reviewing all the edits and whatnot that I didn't review in Germany
2016-11-14 31915, 2016
reosarevok
Btw, jira is not sending me style tickets anymore, or any mail really, which is bad. So we should update or fix
2016-11-14 31935, 2016
ruaok
as soon as we put out the other fires, sure.
2016-11-14 31955, 2016
chirlu is glad not to get mail, and had JIRA configured accordingly. ;-)
2016-11-14 31919, 2016
Freso
reosarevok: Wiki isn't either, AFAICT, so may be a wider problem.
2016-11-14 31924, 2016
reosarevok
Fun, anyway
2016-11-14 31928, 2016
reosarevok
Er. Fin
2016-11-14 31932, 2016
chirlu
I followed the NewHost migration and bossed people around to add banners, tweet things, change banners, remove n.* testing sites, remove banners, …
2016-11-14 31933, 2016
Freso
:p
2016-11-14 31941, 2016
Freso
!m chirlu
2016-11-14 31941, 2016
BrainzBot
You're doing good work, chirlu!
2016-11-14 31916, 2016
chirlu
In total, I was surprised how well the migration went. I had expected more serious issues with the new site.
2016-11-14 31939, 2016
Freso
Too bad about the replication packet(s). :(
2016-11-14 31919, 2016
chirlu
I also answered some things on Discourse and IRC.
2016-11-14 31957, 2016
chirlu
Furthermore, I closed a number of JIRA issues that were fixed or invalidated by the migration.
2016-11-14 31958, 2016
darwin
is there any data on before/after response times?
2016-11-14 31903, 2016
Leo_Verto did actually get some work done since the last meeting
2016-11-14 31903, 2016
zas
darwin: just very bad to very good... most slow things are now due to slow requests, or lack of software optimization
2016-11-14 31906, 2016
chirlu
I also finally removed the old defunct FreeDB gateway VM and set up an MB testing server again, which I hadn’t had since rika disappeared.
2016-11-14 31957, 2016
chirlu
Speaking of rika, I retrieved the reportstool data from it and plan to make that available again at some point.
2016-11-14 31922, 2016
Freso
🙌
2016-11-14 31948, 2016
chirlu
Finally, I changed the account creation CAPTCHA to make use of reCAPTCHA v2, making it more difficult for spammers and others.
2016-11-14 31956, 2016
chirlu
Fin.
2016-11-14 31957, 2016
Freso also fetched i18n and will try to set up a new i18n site when/if we get something similar to rika again
now i'm trying to get all metrics we need to proceed to optimizations
2016-11-14 31906, 2016
zas
also testing everything bits to detect issues, and trying to fix them
2016-11-14 31924, 2016
zas
i detected many small issues that will be addressed this week
2016-11-14 31902, 2016
zas
overall, the performance is very good, even though we have to dig why web servers are so cpu-bound, why some pages are still slow
2016-11-14 31906, 2016
zas
etc...
2016-11-14 31903, 2016
zas
i'm pretty happy with new infrastructure, even if many stuff is a bit hacky (we gave up on docker swarm for example)
2016-11-14 31954, 2016
zas
more to come, but we finally did it, in time, and apart the lost replication packet, emails problems, and plenty of minor things, it was pretty smooth.
2016-11-14 31909, 2016
zas
fin.
2016-11-14 31939, 2016
Freso
(People still up: ruaok alastairp? Leo_Verto?)
2016-11-14 31944, 2016
zas
ruaok ,
2016-11-14 31950, 2016
ruaok
k
2016-11-14 31903, 2016
ruaok
first off, I want to thank everyone who had a hand in the migration.
2016-11-14 31906, 2016
ruaok
THANK YOU!
2016-11-14 31925, 2016
ruaok
I know few of us got enough sleep and we all worked far too much.
2016-11-14 31946, 2016
zas
so true ;)
2016-11-14 31949, 2016
ruaok
I personally was so stressed in California that I never got more than about 5 hours of sleep the whole time I was there.
2016-11-14 31935, 2016
ruaok
I'm trying to muster the energy to carry on with the replication packet recovery nonsense. it is already hairy and complicated and getting worse by the minute.
2016-11-14 31938, 2016
ruaok
oh well.
2016-11-14 31907, 2016
ruaok
for most people restarting replication isn't a big deal -- I think the BBC will be most affected.
2016-11-14 31925, 2016
ruaok
still ongoing are the recovery efforts for the drive in cali.
2016-11-14 31936, 2016
ruaok
currently the disk is being cloned to a working disk
2016-11-14 31903, 2016
ruaok
once that process is done, my friend is going to run fsck on the drive and see what comes out the other end.
2016-11-14 31908, 2016
ruaok
we may get packets, we may not.
2016-11-14 31915, 2016
ruaok
in total there are two lost packets.
2016-11-14 31927, 2016
bitmap
your friend is a hero for doing all this
2016-11-14 31930, 2016
ruaok
we won't know for a few more hours since cloning a failing drive is a slow process.
2016-11-14 31935, 2016
ruaok
srsly.
2016-11-14 31945, 2016
ruaok
we'll have to sort out an appropriate thank you for him.
2016-11-14 31915, 2016
ruaok
once we push past the myriad of issues we need to address this week, we should stand on much more solid ground.
2016-11-14 31915, 2016
hibiscuskazeneko has quit
2016-11-14 31919, 2016
darwin
dd_rescue?
2016-11-14 31921, 2016
Freso
A metric ton of chocolate?
2016-11-14 31929, 2016
chirlu
darwin: Yes.
2016-11-14 31901, 2016
ruaok
we've gone through a massive revamp of the org and our infrastructure. I'm really looking forward to more normal day-to-day activities soon.
2016-11-14 31904, 2016
darwin
dd_rescue saved my ass once when I had two drives fail at once in a md raid5
2016-11-14 31934, 2016
ruaok
so, thanks team. thanks for kicking ass zas. thanks for rocking it Gentlecat. thanks for making it happen bitmap. thanks for being so bossy, chirlu.
2016-11-14 31951, 2016
ruaok
and thanks for everyone else who was helping and or at least making smart ass comments from the sidelines.
2016-11-14 31955, 2016
ruaok
fin.
2016-11-14 31900, 2016
ruaok
Freso: who is left, I forget.
2016-11-14 31903, 2016
bitmap
:)
2016-11-14 31909, 2016
Leo_Verto
✋
2016-11-14 31910, 2016
ruaok picks the first one on the list
2016-11-14 31913, 2016
ruaok
Leo_Verto:
2016-11-14 31915, 2016
Freso
Leo_Verto :)
2016-11-14 31916, 2016
zas
And thanks to ruaok :)
2016-11-14 31927, 2016
Leo_Verto
I redesigned https://chatlogs.metabrainz.org/ to better suit our use case (non-public logging) and added some fancy MeB branding. Fin.
2016-11-14 31933, 2016
Freso
🙌
2016-11-14 31944, 2016
Freso
"non-public logging"?
2016-11-14 31957, 2016
Freso
How is it non-public?
2016-11-14 31911, 2016
Leo_Verto
Well, botbotme is designed to allow anyone to add channels to be logged
2016-11-14 31948, 2016
Leo_Verto
they kinda removed most of their branding and the frontend for those features but their public repo is not a very nice state since that
2016-11-14 31955, 2016
Freso
Sure, but there must be a better name for that. The logs are still public. :)
2016-11-14 31905, 2016
Freso
Anyway. Carry on.
2016-11-14 31920, 2016
Freso
(And thank you!)
2016-11-14 31921, 2016
hibiscuskazeneko joined the channel
2016-11-14 31954, 2016
Leo_Verto
And working with botbot is always kind of a pain but nowhere close to migrating the entire meb infrastructure :P
2016-11-14 31908, 2016
Freso
:)
2016-11-14 31915, 2016
Leo_Verto
that's everything from me. fin (for real this time).
2016-11-14 31935, 2016
Freso
I don't think anyone else has spoken up, so...
2016-11-14 31941, 2016
Freso
Freso: GCI
2016-11-14 31944, 2016
Freso
Woo!
2016-11-14 31950, 2016
Freso
We got accepted again this year!
2016-11-14 31952, 2016
gcilou
🙌
2016-11-14 31958, 2016
Freso
(For anyone who didn't get the memo last week. :))
2016-11-14 31915, 2016
TOPIC: MetaBrainz Community and Development channel | MusicBrainz non-development: #musicbrainz | MeB meeting [20 UTC] agenda: Google Code-in (Freso), spam editor accounts (Freso), replication trouble (chirlu), DR: MBS-8830 (Gentlecat)
2016-11-14 31916, 2016
Freso
I've slowly been getting up to speed, but LordSputnik's already started adding tasks.
2016-11-14 31903, 2016
Freso
I added a handful of mentors to the GCI site this weekend, so if anyone's who's talked about being a mentor this year that I forgot about, please poke me.
2016-11-14 31938, 2016
Freso
And if we didn't talk but you still want to be a mentor, talk to me and we can likely make it happen. We can't really have too many mentors. :)
2016-11-14 31955, 2016
yvanz pokes Freso
2016-11-14 31959, 2016
Freso
More mentors who might want to mentor MBS coding tasks in particular would be amazing.
2016-11-14 31912, 2016
Freso
yvanz: :D Let's talk after the meeting. :)
2016-11-14 31954, 2016
Freso
Anyway. Just a heads up that it's on. If you think of something that might be a good GCI task, poke me, we can always use more tasks. :)
2016-11-14 31901, 2016
bitmap
when does gci start?
2016-11-14 31907, 2016
gcilou
Nov 28
2016-11-14 31907, 2016
Freso
Nov. 28th.
2016-11-14 31915, 2016
Leo_Verto
Two weeks from now
2016-11-14 31927, 2016
Freso
^ any of those three. :)
2016-11-14 31959, 2016
Freso
I feel like there was one more thing I wanted to talk about, but I forgot. So eh.
2016-11-14 31909, 2016
Freso
Freso: Spam editor accounts.
2016-11-14 31911, 2016
TOPIC: MetaBrainz Community and Development channel | MusicBrainz non-development: #musicbrainz | MeB meeting [20 UTC] agenda: spam editor accounts (Freso), replication trouble (chirlu), DR: MBS-8830 (Gentlecat)
2016-11-14 31931, 2016
Freso
There are *a lot* of obvious passive spam profiles.
2016-11-14 31917, 2016
Freso
chirlu's updated the registration captcha now, so hopefully the influx of spam accounts will be somewhat decreased now, but there's still 1000s of accounts (I'm guesstimating) from 2013 and to now.
2016-11-14 31937, 2016
chirlu
Hundreds of thousands.
2016-11-14 31940, 2016
Freso
Can anyone remember what we did in 2013 to clean up the accounts? A query or whatever?
2016-11-14 31907, 2016
Freso
Because it would be nice to do a massive clean-up again.
2016-11-14 31914, 2016
ruaok
yes. the accounts had a certain pattern in their usernames.
2016-11-14 31916, 2016
bitmap
didn't they all have very similar email addresses or something?
2016-11-14 31937, 2016
ruaok
we identified and nuked all the ones that met that criteria and were created within a certain timeframe.
2016-11-14 31941, 2016
Freso
Every once in a while the user admin editors will get flooded with someone getting zealous about reporting spam profiles.
2016-11-14 31926, 2016
Freso
bitmap: I've been keeping an eye on the mail addresses of the ones I've manually deleted. There's no pattern. Plenty of hotmail, gmail, yahoo, mail.ru, and plenty others. And some with no mail at all.
2016-11-14 31950, 2016
G0re joined the channel
2016-11-14 31909, 2016
ruaok
once things calm down a bit we should do an analysis of dormant accounts.
2016-11-14 31912, 2016
Freso
I doubt anyone is free to look into this for the next couple of weeks though.
2016-11-14 31915, 2016
Freso
Yeah.
2016-11-14 31922, 2016
bitmap
about gci, I have a responsibility to help with mbs stuff though I don't know if I can do 100% effort
2016-11-14 31926, 2016
Freso
I'll make a mental note to bring it up in December/January.
2016-11-14 31931, 2016
chirlu
Last time we discussed this, some ideas were collected in MBS-8735.
2016-11-14 31939, 2016
ruaok
figure out which ones we can nuke or finally implement a "no activity for 6 months on a new account = delete"
2016-11-14 31944, 2016
ruaok
policy
2016-11-14 31920, 2016
chirlu
BTW, reCAPTCHA can be tuned to be even more difficult. Needs someone with Google Webmaster Tools access for mb.o.
2016-11-14 31929, 2016
Freso
chirlu: Right. I had thought about that, but forgotten it again.
2016-11-14 31959, 2016
Freso
Anyway. Let's look at it in a few weeks/months again and move on for now.
2016-11-14 31900, 2016
Gore|home has quit
2016-11-14 31921, 2016
Freso
(I think I have webmaster tools access, maybe. I can check at least.)
2016-11-14 31936, 2016
Freso
chirlu: Replication trouble.
2016-11-14 31938, 2016
TOPIC: MetaBrainz Community and Development channel | MusicBrainz non-development: #musicbrainz | MeB meeting [20 UTC] agenda: replication trouble (chirlu), DR: MBS-8830 (Gentlecat)
2016-11-14 31953, 2016
chirlu
This was mentioned before already.
2016-11-14 31909, 2016
chirlu
On the migration, the newer replication packets got lost.
2016-11-14 31951, 2016
chirlu
This means that data users are in many cases stuck at a pre-migration state and can’t get their slave database updated.
2016-11-14 31929, 2016
chirlu
But I guess there is not much to discuss here now. We looked into various points the whole day today already.
2016-11-14 31958, 2016
chirlu
In the end, it depends on whether the missing files can be restored from the broken HD (via dd_rescue).
