ruaok, bitmap: How do we update (old) search server/indexer FTP downloads?
2018-07-09 19059, 2018
ruaok
we copy the jar/war files out to where the FTP dirs live.
2018-07-09 19011, 2018
ruaok
I forget which machine those live on. zas?
2018-07-09 19026, 2018
ruaok
(this happens on hetzner and they get synced from there)
2018-07-09 19034, 2018
zas
ruaok: on williams
2018-07-09 19001, 2018
dragonzeron
are we having a meeting today
2018-07-09 19010, 2018
ruaok
yep
2018-07-09 19015, 2018
dragonzeron
ok
2018-07-09 19031, 2018
zas
ruaok: /home/ftp/ftp/root
2018-07-09 19039, 2018
ruaok
yvanzo: ^^
2018-07-09 19044, 2018
ruaok
thanks zas
2018-07-09 19045, 2018
rsh7 has quit
2018-07-09 19022, 2018
kartikeyaSh
iliekcomputers: we have 2 functions in artist.py fetch_unclustered_gids_for_artist_mbids_using_recording_artist_join and fetch_unclustered_gids_for_artist_credit_mbids. So, using_x is kind of required. similar for other places. So, removing using_x doesnot seem like an easy task 😂. I renamed get_artist_gids_from_recording_using_mbids_and_recording_artist_join
2018-07-09 19058, 2018
ruaok
yvanzo: I'm about the leave the office -- got something for me to run?
2018-07-09 19054, 2018
yvanzo
ruaok: yes, go for it
2018-07-09 19056, 2018
yvanzo
ruaok: use the master branch of musicbrainz-vm
2018-07-09 19016, 2018
yvanzo
I did not update search server and indexer yet.
2018-07-09 19009, 2018
ruaok
so this is just another test then?
2018-07-09 19016, 2018
yvanzo
yes
2018-07-09 19032, 2018
yvanzo
Use sample-data if you prefer a short test
2018-07-09 19022, 2018
tombriden has quit
2018-07-09 19011, 2018
iliekcomputers
kartikeyaSh: yikes
2018-07-09 19023, 2018
iliekcomputers
😂
2018-07-09 19040, 2018
bukwurm joined the channel
2018-07-09 19039, 2018
tombriden joined the channel
2018-07-09 19050, 2018
tombriden_ joined the channel
2018-07-09 19051, 2018
tombriden has quit
2018-07-09 19019, 2018
tombriden_ is now known as tombriden
2018-07-09 19041, 2018
yvanzo
bitmap, samj1912: Why is mmd-schema/production is one year old? Is mmd-schema/master still compatible with old search server?
2018-07-09 19035, 2018
bitmap
the production branch should be what the search server uses, master is bleeding edge and may contain schema changes (but I wouldn't expect the old search to be broken with it)
2018-07-09 19055, 2018
bitmap
if the new search isn't using the prod branch that should be fixed, but samj1912 would know better
2018-07-09 19014, 2018
samj1912
It uses master
2018-07-09 19035, 2018
samj1912
But I don't think we have any breaking changes
2018-07-09 19045, 2018
samj1912
I don't see a prod branch?
2018-07-09 19008, 2018
samj1912
Oh, nvm
2018-07-09 19018, 2018
samj1912
It wasn't there on the overview
2018-07-09 19002, 2018
samj1912
The only difference in the commit that solr uses is updated plugins
People up: Freso, reosarevok, bitmap, zas, ruaok, yvanzo, samj1912, iliekcomputers, rsh7, bukwurm, Leo_Verto, chhavi_, kartikeyaSh – anyone else, please let me know ASAP.
2018-07-09 19002, 2018
Freso
Leo_Verto: go!
2018-07-09 19002, 2018
Freso
Leo_Verto says:
2018-07-09 19002, 2018
Freso
"""
2018-07-09 19003, 2018
Freso
as mentioned in my GSoC proposal, I won't be around for the meeting this and next week as I'm volunteering at a sort of summer camp but here's my review for last week:
2018-07-09 19003, 2018
Freso
This week I set up Celery as a task queue for SpamBrainz (thanks for the suggestion, samj1912!) as well as an API token system and then started writing tests for both.
2018-07-09 19004, 2018
Freso
After moving things around and renaming them way too much I'm finally happy with this setup and should be able to pretty much plug the machine learning and report writing code into it.
2018-07-09 19004, 2018
Freso
I've also spent some time working with docker and feel like I've got a much better grasp on it which helped quite a bit with making the config system ready for containers.
2018-07-09 19005, 2018
Freso
"""
2018-07-09 19019, 2018
Freso
chhavi_: Go!
2018-07-09 19001, 2018
Freso
Or… samj1912, go!
2018-07-09 19007, 2018
iliekcomputers
Hi
2018-07-09 19032, 2018
Freso
Or… iliekcomputers go!
2018-07-09 19042, 2018
iliekcomputers
Hi again!
2018-07-09 19045, 2018
Freso
:p
2018-07-09 19051, 2018
iliekcomputers
:)
2018-07-09 19027, 2018
samj1912
Hey
2018-07-09 19038, 2018
iliekcomputers
This week the biggest (or most expensive) bug I have written was uncovered.
2018-07-09 19044, 2018
iliekcomputers
😅
2018-07-09 19002, 2018
iliekcomputers
I guess ruaok will have more to say on that.
2018-07-09 19006, 2018
chhavi_
o/
2018-07-09 19011, 2018
iliekcomputers
Anyways, I've been dealing with the aftermath
2018-07-09 19012, 2018
reosarevok
Whoops.
2018-07-09 19051, 2018
iliekcomputers
Fixing logging and reporting more errors to sentry to make sure stuff like this doesn't happen.
2018-07-09 19011, 2018
iliekcomputers
Other than that, the usual PR reviews for kartikeyaSh and rsh7[m]
2018-07-09 19048, 2018
iliekcomputers
GSoC second evals start this week and rsh7[m] has a good PR up that im gonna get to soon.
2018-07-09 19054, 2018
iliekcomputers
Fin.
2018-07-09 19002, 2018
samj1912
o/
2018-07-09 19003, 2018
iliekcomputers
chhavi_: go
2018-07-09 19016, 2018
chhavi_
Hey
2018-07-09 19054, 2018
chhavi_
Helo :) Managed to be productive over the weekend make some components. Pinged people for reviews on mockups. Fin!
2018-07-09 19001, 2018
chhavi_
samj1912 go
2018-07-09 19033, 2018
samj1912
Hey, mostly spent the week relaxing, reading up on the new tasks and background solr management
2018-07-09 19041, 2018
samj1912
Mostly enjoying life in Bangalore :p
2018-07-09 19002, 2018
samj1912
I'll be tackling PG load balancing next
2018-07-09 19018, 2018
Dr-Flay joined the channel
2018-07-09 19042, 2018
samj1912
Solr has had a few improvement requests over this last week. Am going through them and fixing the ones that are high priority.
2018-07-09 19053, 2018
samj1912
Apart from that typical week
2018-07-09 19002, 2018
samj1912
bitmap: go
2018-07-09 19007, 2018
bitmap
hi
2018-07-09 19025, 2018
bitmap
I finished some prs for converting the event & series search results to react
2018-07-09 19038, 2018
bitmap
fixed an i18n bug related to the search form options being mistranslated
2018-07-09 19057, 2018
bitmap
worked on writing tests for the new i18n string parsing/interpolation code
2018-07-09 19024, 2018
bitmap
fixed a couple strings (instrument/link type descriptions) in the DB that had broken html and couldn't be parsed
2018-07-09 19051, 2018
bitmap
ah, and created a gdoc to compare some pg load balancing options
2018-07-09 19052, 2018
rsh7 joined the channel
2018-07-09 19013, 2018
bitmap
fin...go Freso!
2018-07-09 19019, 2018
Freso
🙋
2018-07-09 19002, 2018
Freso
Last week, I spent a lot of time going through reported (spam) editors and compiling them into a neat list for yvanzo's (and possibly Leo_Verto's) consumption.
2018-07-09 19022, 2018
Freso
A few more to go to clear my inbox of those, but far most of them are there.
2018-07-09 19003, 2018
Freso
Other than that, mostly being around and about and handling reported users and content.
it works well, we don't have any error, but response times degrade quite quickly during peak hours, we are cpu-bound atm
2018-07-09 19019, 2018
zas
samj1912 and i are investigating ways to improve the situation (without spawning more cpus)
2018-07-09 19010, 2018
zas
the whole system is very stable til now, and handle single node downtime well. The main issue is that a SOLR node down during peak hours will cause some slowdowns
2018-07-09 19029, 2018
zas
i'll experiment moving zookeeper on non-SOLR nodes this week
2018-07-09 19043, 2018
zas
but overall, we can say "it works!" ;)
2018-07-09 19050, 2018
Freso
🙌
2018-07-09 19056, 2018
ruaok
phew
2018-07-09 19013, 2018
zas
FYI, i'll be travelling on friday (to Malta)
2018-07-09 19024, 2018
iliekcomputers
!m zas and samj1912
2018-07-09 19024, 2018
BrainzBot
You're doing good work, zas and samj1912!
2018-07-09 19045, 2018
zas
fin. ruaok ?
2018-07-09 19049, 2018
ruaok
k
2018-07-09 19009, 2018
ruaok
last week was paying people, accounting (mostly transferwise accounting setup and writing data import scripts)
2018-07-09 19031, 2018
ruaok
I helped build VMs for yvanzo and worked on the conflict resolution protocol.
2018-07-09 19051, 2018
ruaok
more PRs on LB and MSB, on which I am behind yet again.
2018-07-09 19015, 2018
ruaok
then on friday I ran off to Nowhere for a short 36 hour stint to make sure my world isn't too calm and nice.
2018-07-09 19029, 2018
iliekcomputers
re PRs they were over the weekend so you can't be blamed :)
2018-07-09 19051, 2018
ruaok
saturday evening got a wee bit strange, chaotic, sad, frustrating and just WTF.
2018-07-09 19006, 2018
ruaok
never in my years or going to burning events has it gotten that far chaotic.
2018-07-09 19009, 2018
ruaok
it was great. :)
2018-07-09 19026, 2018
ruaok
oh yeah, and I had to do some cleanup on some monster BQ bill. lol.
2018-07-09 19041, 2018
ruaok
yvanzo: go!
2018-07-09 19045, 2018
yvanzo
hi!
2018-07-09 19002, 2018
TOPIC: MetaBrainz Community and Development channel | MusicBrainz non-development: #musicbrainz | GSoC https://goo.gl/7jsjG2 | Meeting agenda: Reviews
2018-07-09 19036, 2018
yvanzo
I worked on updating MusicBrainz VM mainly, opened a Vagrant Cloud account for further releases.
2018-07-09 19017, 2018
yvanzo
Also reviewed some PRs (thanks legoktm), and worked on usual React/Spam stuff.
2018-07-09 19006, 2018
yvanzo
FYI, I won’t be available on Friday either.
2018-07-09 19022, 2018
yvanzo
Finito, go rsh7?
2018-07-09 19033, 2018
rsh7
hey!
2018-07-09 19055, 2018
Freso
(Only bukwurm / bukwurm_ and kartikeyaSh left on my list. Last chance for anyone else to let me know they want to give review too!)
2018-07-09 19004, 2018
rsh7
I spent the starting days of the week working on iliekcomputers' reviews on #280 and #281, data insertion in musicbrainz schema was taking a lot of time initially which I have fixed now and it's pretty fast now.
2018-07-09 19021, 2018
rsh7
Then, I worked on keeping musicbrainz schema updated with the actual MB db and used replication packets for that and I have opened a PR for the same (AB-350).
This all was the major part of the project. We would next work on testing both the methods and then to decide which would be better for implementing features in AB.
