lucifer: one thing that I didn't remember from when we started this project - we manually create all of the related MB tables, we'll have to verify that nothing has changed in subsequent schema changes
2021-06-07 15819, 2021
lucifer
alastairp: oh! i'll look into that.
2021-06-07 15805, 2021
alastairp
although, I'm thinking out loud here: I think that the reason that we decided to go about it this way is so that we didn't have to make / replicate all of the tables. I guess the idea there was to minimise the amount of data that we stored that we didn't need
2021-06-07 15805, 2021
alastairp
that being said, is the tradeoff worth it? If we have to maintain this frankendb, is that more effort than just replicating the entire db (in which case we get to use all of the MB-server-based tools for creating tables, etc)?
2021-06-07 15831, 2021
elomatreb[m] joined the channel
2021-06-07 15824, 2021
yyoung[m] joined the channel
2021-06-07 15824, 2021
kepstin joined the channel
2021-06-07 15825, 2021
JuniorJPDJ joined the channel
2021-06-07 15836, 2021
akshaaatt[m] joined the channel
2021-06-07 15834, 2021
lucifer
alastairp: I see we need artist, recording, release, release-group, track and some related tables. can we check the size of these tables compared to complete db?
2021-06-07 15806, 2021
alastairp
it's mostly the relation tables I guess
2021-06-07 15806, 2021
lucifer
and would we need some more tables in future?
2021-06-07 15826, 2021
alastairp
I think we decided to reach that problem when (or if) it occurred
2021-06-07 15859, 2021
alastairp
I'm sure it felt like a great idea at the time, but I'm just terrified of the idea of maintaining a separate set of MB table definition files in AB
2021-06-07 15804, 2021
lucifer
yes, right.
2021-06-07 15830, 2021
lucifer
is it possible to configure partial replication in pg itself?
2021-06-07 15841, 2021
alastairp
this system is using the musicbrainz replication - we modified it so that it would skip updating a table if it didn't exist in the target db
alastairp, if the above query is correct, we are importing the two largest tables by a large margin anyways.
2021-06-07 15824, 2021
lucifer
i see we also have some logic to import process the data to maybe retain only data which has associated recordings in AB not sure if that's worth it as well though.
2021-06-07 15833, 2021
lucifer
(also i executed it on bono not sure if that is upto date with prod)
2021-06-07 15811, 2021
alastairp
lucifer: ohhh yeah, that was the other trick, we were only importing rows that had recordings in AB. that changes it a bit I guess
2021-06-07 15826, 2021
lucifer
do we have an estimate of how much recordings exist in MB but not in AB?
Others up for reviews: ruaok, zas,Freso, alastairp, bitmap, reosarevok, monkey, yvanzo, lucifer , akshaaatt, jasondk, akashgp09, CatQuest
2021-06-07 15835, 2021
Freso
ruaok: Go! :)
2021-06-07 15843, 2021
ruaok
right-o.
2021-06-07 15816, 2021
ruaok
just came back from a long weekend, so I'm just getting my MB brainz back on.
2021-06-07 15845, 2021
ruaok
last week was planing for machine upgrades, working on some MBID mapping stuff and some PRs.
2021-06-07 15803, 2021
ruaok
we also submitted the YouTube OAuth stuff again, heard nothing back.
2021-06-07 15835, 2021
ruaok
I did spend quite a bit of time dealing with admin BS for our spanish office.
2021-06-07 15822, 2021
ruaok
our bank was going to block out account again until we provided more useless docs, that they would reject and it would end up in me hiring the accountant to get the account unlocked again.
2021-06-07 15850, 2021
ruaok
so, I learned a few key things and moved all our utilities and rent to our belgian account, which took some doing
2021-06-07 15813, 2021
ruaok
in doing so, I switched us to an ethical mostly green power company and an ethical telecom for internet service.
2021-06-07 15825, 2021
Freso
\o/
2021-06-07 15838, 2021
ruaok
I feel very very happy about this. this should all be coming to a close this week and I can get back to hacking on more useful things.
2021-06-07 15839, 2021
CatQuest
notbad.png
2021-06-07 15843, 2021
ruaok
fin. Freso!
2021-06-07 15847, 2021
Freso
o/
2021-06-07 15826, 2021
Freso
Not a lot done this last week. Mostly enjoying sun and warm weather. :x I did spend a bit of time on some minor admin stuffs in the aftermath of the network move.
2021-06-07 15816, 2021
Freso
Yeah, I think that’s it. :p
2021-06-07 15818, 2021
Freso
fin!
2021-06-07 15822, 2021
Freso
zas: Go!
2021-06-07 15826, 2021
wargreen_ has quit
2021-06-07 15827, 2021
zas
Hey
2021-06-07 15847, 2021
Freso
(Others still up: alastairp, bitmap, reosarevok, monkey, yvanzo, lucifer, akshaaatt, jasondk, akashgp09, CatQuest – anyone else who want to give review, let me know ASAP. :))
2021-06-07 15855, 2021
zas
worked on planning servers upgrade round with ruaok
2021-06-07 15823, 2021
zas
Picard (huge) PRs code reviews
2021-06-07 15804, 2021
zas
which led us to the discovery of an annoying bug in 2.6.2, so we planned and did (today) 2.6.3
on Thursday I tried to upgrade LB redis and broke it, causing LB slowdowns for a few hours (lesson learned)
2021-06-07 15858, 2021
alastairp
reviewed a few PRs for lucifer, and also talked to him about some AB next projects
2021-06-07 15820, 2021
alastairp
end of last week I was putting out some fires regarding solr and spammers on Freesound, so wasn't around as much
2021-06-07 15823, 2021
alastairp
bitmap: next?
2021-06-07 15827, 2021
bitmap
hi
2021-06-07 15850, 2021
bitmap
last week I worked on https://github.com/metabrainz/musicbrainz-server/… which will resolve a lot of timeouts on large release pages that are impossible to load at best and cause server issues at worst
I also continued helping akashgp09_ with his GSoC project, and reviewed PRs for LB and BB.
2021-06-07 15821, 2021
monkey
And that's me ! akashgp09_ go !
2021-06-07 15848, 2021
akashgp09_
Hi Everyone
2021-06-07 15809, 2021
akashgp09_
After week long discussions with my mentor in the CB period finally we have finalized the DB schema and implemented the necessary ORM models.
2021-06-07 15831, 2021
akashgp09_
Meanwhile I have created the series entity /create and /edit routes and created the attributes components.
2021-06-07 15853, 2021
akashgp09_
Also created some helper functions which will be needed for relationship attributes like getAttributes, setAttributes, getNextAttributeSet.
2021-06-07 15804, 2021
akashgp09_
that's all from my side, thank you :)
2021-06-07 15837, 2021
akashgp09_
akshaaatt[m] next ?
2021-06-07 15843, 2021
akshaaatt[m]
Hi Everyone!
2021-06-07 15851, 2021
Freso
(Only lucifer and jasondk still left on my list. Last call for anyone else who may want to give review!)
2021-06-07 15805, 2021
akshaaatt[m]
I worked intensely on the tagger present in the MB Android App and am working towards stuff
2021-06-07 15805, 2021
akshaaatt[m]
to get the app in production on playstore with lucifer
2021-06-07 15816, 2021
akshaaatt[m]
I researched about a lot of new and cool things as well. And omg our organization is so amazing.
2021-06-07 15831, 2021
akshaaatt[m]
I read many previous blogs and was fascinated with the products we have lined up. I am excited to make our android app robust with even more technologies!
2021-06-07 15845, 2021
akshaaatt[m]
Other than that I appeared for a hackathon with my friends at college last week so I was preparing for that as well.
2021-06-07 15806, 2021
akshaaatt[m]
That's it from my side :) lucifer mentor you're up!
2021-06-07 15814, 2021
lucifer
Hi all!
2021-06-07 15851, 2021
lucifer
I worked on moving the remaining projects off Jenkins to GH Actions and also started setting up actions for BB.
2021-06-07 15832, 2021
lucifer
I reviewed a few LB PRs, helped in debugging ts writer metrics and worked on adding metrics to Spotify Reader.
2021-06-07 15808, 2021
lucifer
I also had a few discussions with akshaaatt[m] regarding MusicBrainz Android and reviewed some of his SoC PRs.
And I began writing the modules containing the related SQL query functions and tests. Other than that I mostly finished planning for the "flow" of the pinned tracks through our site.
2021-06-07 15803, 2021
jasondk
This week I begin full throttle!
2021-06-07 15809, 2021
jasondk
That's it from me :)
2021-06-07 15840, 2021
ruaok
great!
2021-06-07 15835, 2021
Freso
Oh.
2021-06-07 15852, 2021
Freso
Thank you everyone for your reviews!
2021-06-07 15815, 2021
Freso
I was just out filling up my water bottle - I hope y’all are staying hydrated too!
2021-06-07 15828, 2021
Freso
Thank you all for your time! Stay safe out there!
2021-06-07 15831, 2021
Freso
</BANG>
2021-06-07 15822, 2021
monkey
"This is the way the world ends. Not with a bang but a </BANG>." T. S. Eliot
2021-06-07 15840, 2021
yvanzo
Thanks!
2021-06-07 15836, 2021
alastairp
better than a whimper
2021-06-07 15813, 2021
wargreen joined the channel
2021-06-07 15824, 2021
Freso
alastairp: Just catching up on the pre-meeting backlog, it definitely sounds like you have _a lot_ of logic to handle the very AB specific MB-derived "MB" database… :|
