#metabrainz

/

      • yvanzo
        reosarevok: the blog post looks good to me
      • BrainzGit
        [listenbrainz-server] 14amCap1712 merged pull request #1901 (03master…amCap1712-patch-1): Update default rank for CF recommendations https://github.com/metabrainz/listenbrainz-serv...
      • reosarevok
        Ok :) bitmap: if you add a ticket I can add it there. If you feel it's useless, I can publish as-is
      • bitmap
        sure, one moment
      • added MBS-12248
      • BrainzBot
        MBS-12248: Allow specifying multiple Redis masters for DATASTORE_REDIS_ARGS https://tickets.metabrainz.org/browse/MBS-12248
      • lucifer
        mayhem: what iterations should we try? currently its 5 and 10
      • mayhem
        what value is currently chosen?
      • lucifer
        5 and 10
      • mayhem
        I mean, when we run it which number of iterations produces the best result?
      • lucifer
        ah ok, 10
      • mayhem
        bitmap: reosarevok yvanzo: Are you folks ready to post the schema change release blog post today?
      • lucifer
        10 and 20?
      • mayhem
        it should go out today or tomorrow.
      • 15, 25?
      • lucifer
        đź‘Ť
      • bitmap
        mayhem: yeah, it needs to be drafted still, but will definitely be posted by tomorrow or possibly today
      • mayhem
        great
      • yvanzo
        bitmap, reosarevok: we missed having a second meeting about the schema change btw;
      • reosarevok
        Well, we *are* all here today :)
      • yvanzo
        Do you want to discuss it now? Or tomorrow?
      • reosarevok
        I'm good with 15 min from now if you and bitmap are
      • bitmap
        sorry if we were supposed to schedule one, but yes if there's anything to be discussed let's do it now
      • yvanzo
        in 15min from now then
      • bitmap
        i'm adding any missing tickets now
      • CatQuest: thanks for entering MBS-12107 btw. that description is great!
      • BrainzBot
        MBS-12107: Replication with dbmirror2 https://tickets.metabrainz.org/browse/MBS-12107
      • bitmap
        i'll use this as the parent ticket for the schema changes
      • Freso
        (Just a heads up that meeting is in an hour, for bitmap and others that may be observing DST now.)
      • bitmap
        đź‘Ť Freso
      • BrainzGit
        [musicbrainz-docker] release 03v-2022-03-14 has been published by 14yvanzo: https://github.com/metabrainz/musicbrainz-docke...
      • lucifer
        mayhem: uh forgot to reply earlier. let's do mapping discussion tommorrow.
      • mayhem
        k
      • reosarevok
        yvanzo, bitmap: prod release finally done, blog post out etc :)
      • bitmap
        thanks!
      • I have six tickets assigned to me, which looks correct (I expected 5 but there's two for amazon cover art)
      • right now I'm updating the descriptions or leaving comments to summarize the schema changes and how they affect mirrors - let's do that for any tickets we're assigned
      • wargreen joined the channel
      • BrainzGit
        [data-set-hoster] 14mayhem opened pull request #5 (03master…add-query-summary): Add query summary https://github.com/metabrainz/data-set-hoster/p...
      • bitmap
        reosarevok: yvanzo: are there any schema changes we need to discuss that were decision-required? whether in or outside of that fix version
      • reosarevok
        I added the moods bit to that schema change fix version
      • yvanzo
        bitmap: About AC MBIDs, it seems pretty clear except the merge. It can be discussed later on thought, mostly implementation details.
      • reosarevok
        The main decision needed there is "should moods be its own entity just like genres are, or a hardcoded list of tags without MBIDs"
      • The only reason to go for the latter is because I understand mayhem and monkey are expecting a much smaller list that is controlled by MeB and without user requests, so avoiding the whole new-entity thing might be easier
      • That said, literally copying genre might still be easier just because of the less thinking required... :)
      • bitmap
        yvanzo: ok, let's discuss merging at some point
      • CatQuest
        bitmap: thnaks, it is mostly copy-pasta of your comments in the great "create tickets of stuff from the summit" doc tho :D
      • yvanzo
        bitmap, reosarevok: aliases MBIDs should be dropped for now, until clarified.
      • reosarevok
        I'm ok with that
      • bitmap
        reosarevok: hard to say -- I feel like a hard-coded list would be easier until we're sure how the entities should work
      • yvanzo
        (removed it)
      • bitmap
        CatQuest: good copy-pasta then :D
      • reosarevok
        bitmap: well, it'd just copy the genre code anyway, so it would work in the same way :)
      • I'm just not sure whether that's overkill or not
      • CatQuest
        I think I also asked reo for a link to your presnetation since I remember you had made one
      • bitmap
        I assume mbids and aliases would be useful to moods then?
      • monkey
        Yes :)
      • Certainly aliases at least
      • reosarevok
        Speaking of aliases, one thing we did talk about was adding edit support for genres
      • (and moods)
      • bitmap
        sounds likely we should copy genres then
      • BrainzGit
        [bookbrainz-site] 14MonkeyDo merged pull request #771 (03master…prefill-create): Feat(BB-86): Prepopulate entity editor with POST /create https://github.com/metabrainz/bookbrainz-site/p...
      • CatQuest
        edit support?
      • reosarevok
        bitmap: any reason *not* to add an edit_genre table, even if we don't yet use it, which can later be used for edits adding genres and genre aliases?
      • CatQuest
        oh there isn't an actual interface
      • yea that shoudl be in, makes it easier for reo to add these faster
      • reosarevok
        CatQuest: adding a genre now works like adding a medium format type or whatever, there's an edit interface but it doesn't create an edit
      • (so no edit history / notes / whatnot)
      • CatQuest
        huh
      • yvanzo
        Is there a design document about moods? or a state of the art? or anything?
      • CatQuest didn't know that (sicne can't edit those :D)
      • CatQuest
        I'm for creating edits of these tho
      • all these
      • bitmap
        reosarevok: we should definitely add edit_genre before the edits are implemented
      • reosarevok
        bitmap: sure, just making sure that implementing edits seems sensible and that there's no harm done in just adding edit_genre now so we can work on that without another schema change
      • Can you check the schema for a sec and make sure that I'm right that'd be the only needed addition?
      • If so, I'll make a ticket
      • bitmap
        just the table + index and FKs should be enough
      • monkey
        yvanzo: Not really, just a lot of notes I made. But I could assemble a document
      • reosarevok
        monkey: it wouldn't hurt, for when I work on it, although I expect it won't change much of the MBS implementation
      • bitmap: Ok. I see a few of the edit_$entity have a materialized status column, but most do not. Do you know why?
      • bitmap
        it would added to improve the performance of those but I'm not sure how relevant it is in our postgres anymore
      • it was*
      • apparently I already checked that MBS-10438
      • BrainzBot
        MBS-10438: Investigate if materialized status columns are needed on edit_artist and edit_label https://tickets.metabrainz.org/browse/MBS-10438
      • reosarevok
        Ok, so the new one should not have it
      • It'll be tiny anyway
      • I do wonder if edit_recording wouldn't get more use out of that than edit_artist, but :)
      • yvanzo
        bitmap, reosarevok: We also have to add non-MBS tickets related to the schema change: MBVM and SEARCH.
      • reosarevok
        Added MBS-12252 for edit_genre
      • BrainzBot
        MBS-12252: Add edit_genre table https://tickets.metabrainz.org/browse/MBS-12252
      • bitmap
        right. for SEARCH, at least the series ordering_attribute, moods, and artist credit mbids
      • zas
        atj: new server is up and ready, named rudi
      • CatQuest
        :O
      • zas
        bitmap: I noticed incorrect partition sizes on rakim (my fault), for now, not much an issue, but I'd like to resize them at some point, we'll need to move stuff from it elsewhere, we can use new server rudi for that (it's the one half of the future gateways), it is perhaps time to move to keydb and have some redundancy for those redis instances
      • CatQuest: rudi is first half of new gateways, second half will be rex ;)
      • bitmap
        heh, ok :) I can perhaps look into setting up a keydb cluster this week
      • CatQuest
        i noticed that
      • cool
      • :D
      • Revenant has quit
      • zas
        bitmap: great, I can give you an hand on this, as I configured redundant instances for gateways
      • one thing I didn't solve is dockerized haproxy + keepalived, which are used to provide automatic failover. I fall back on deploying them on host directly, don't remember what was the issue exactly though. We can have a look at this too.
      • bitmap
        sounds good, I'll ping you when I start looking at it
      • reosarevok
        bitmap: so, we'll want an update that adds edit_genre, pk and index for all, and one that adds the fks for standalone, right?
      • bitmap
        reosarevok: yup
      • reosarevok
        bitmap: oh! I remembered the other thing that I wanted to add for genres. rel tables, so we can at least relate them to urls
      • I guess I would need to add the whole set just in case though, not just l_genre_url
      • bitmap
        ah okay. if you can create a ticket and commit to working on that then it sounds fine
      • skelly37 joined the channel
      • reosarevok
        Sure
      • bitmap
        and we do have l_url_url so I think you are right, heh
      • reosarevok
        bitmap: MBS-11599 also mentions annotations, while I'm not sure how useful those are rn, I guess we might as well do that too - that would bring genre tables mostly to parity with other entities, I think
      • BrainzBot
        MBS-11599: Allow Wikidata Relationships and Annotations on Genre Pages https://tickets.metabrainz.org/browse/MBS-11599
      • bitmap
        genre annotations make sense to me
      • reosarevok
        Ok, let's add those tables too
      • I'll submit a 3-commit PR adding all three things
      • Already done with the edit_genre one anyway
      • Freso
        <BANG>
      • It’s Ď€ Monday!
      • No mailed in reviews, so people up: zas, monkey, atj, lucifer, yvanzo, akshaaatt, reosarevok, alastairp, bitmap, mayhem, CatQuest, Freso – anyone else who wish to give review, let me know ASAP!
      • zas: Go!
      • zas
        Hey
      • Sophist-UK joined the channel
      • Apart usual Picard PR reviews, edits, general maintenance and user support, I configured new server rakim
      • aerozol
        Moin!
      • zas
        and ordered another one to replace yehudi, we just received it
      • CatQuest
        aw
      • morena aerozol
      • zas
        yehudi is now retired, and new server was configured, welcome to rudi
      • fin. monkey ?
      • monkey
        hi!
      • Last week was quite busy, with more refactoring on LB and deploying/ announcing the new BrainzPlayer on beta
      • And many many PRs! Both on the LB front and on BB
      • Mostly the continuation of ongoing work, but new PRs, new fixes, new features also
      • It's all quite vague, but it ended up beign a mountain of work :)
      • That's it for me, yvanzo go !
      • yvanzo
        pi!
      • CatQuest
        lol
      • yvanzo
        Last week I helped with maintenance by moving some MB stuff to a new server and documenting this migration for the next time.
      • Made a few small changes to MB Docker.
      • There is one in particular that should be made to other projects as well:
      • Replacing the use of apt-key which is deprecated since last year.
      • Also started to integrate into SIR changes coded by ta264 from Lidarr.
      • Plus MBS PR reviews, tickets triage, support.
      • Fin. Go atj!
      • atj
        hello!