#metabrainz

/

      • ruaok
        alastairp: I dont have comparison numbers to hand.
      • 2020-05-18 13901, 2020

      • CatQuest
        apparently others disagree
      • 2020-05-18 13905, 2020

      • CatQuest
        strongly
      • 2020-05-18 13905, 2020

      • alastairp
        CatQuest: oddly, the top duplicate-sumitted track on AB is some B-side from a beatles single
      • 2020-05-18 13912, 2020

      • ruaok
        this was a pretty simple query I suspect that spark will be more flexible in the long run
      • 2020-05-18 13922, 2020

      • CatQuest
        oh ye?
      • 2020-05-18 13926, 2020

      • CatQuest
        what ?
      • 2020-05-18 13933, 2020

      • alastairp
        yeah, it was werid. I had never heard of it
      • 2020-05-18 13943, 2020

      • CatQuest
        what was it called?
      • 2020-05-18 13902, 2020

      • CatQuest
        is it that one with jimi hendrix on guitar? :D
      • 2020-05-18 13904, 2020

      • alastairp
        ruaok: right, but I guess spark requires shipping the whole database there too, before we can run any stats on it
      • 2020-05-18 13914, 2020

      • bitmap
        vacuumdb done!
      • 2020-05-18 13916, 2020

      • alastairp
        I guess it's no different to running timescale queries on a db replica
      • 2020-05-18 13920, 2020

      • CatQuest
        or that one super early instrumental one called tide something
      • 2020-05-18 13931, 2020

      • alastairp
        CatQuest: I don't recall, and I don't have the data easily to hand, sorry
      • 2020-05-18 13945, 2020

      • CatQuest
        ah. no worries. but if you do come over it again, i'd be interested in the name
      • 2020-05-18 13945, 2020

      • Mr_Monkey
        CatQuest: Sgt. Peppers for me !
      • 2020-05-18 13904, 2020

      • alastairp
        that data may have changed since I computed it again
      • 2020-05-18 13908, 2020

      • CatQuest
        hah my point exactly :D
      • 2020-05-18 13918, 2020

      • alastairp
        one of my near-term goals for AB is to get this kind of stats running
      • 2020-05-18 13924, 2020

      • CatQuest
        neeeat
      • 2020-05-18 13926, 2020

      • bitmap
        database seems to be operating normally, I'll take it out of consul maint mode
      • 2020-05-18 13927, 2020

      • ruaok
        alastairp: spark already has the whole DB.
      • 2020-05-18 13940, 2020

      • ruaok
        bitmap: vacuum done already??
      • 2020-05-18 13945, 2020

      • bitmap
        yupp
      • 2020-05-18 13947, 2020

      • bitmap
        crazy
      • 2020-05-18 13950, 2020

      • ruaok
        wow, yes
      • 2020-05-18 13903, 2020

      • CatQuest
        oh i remembered another "popular" and I thought was alright (listened one album): Pearl Jam
      • 2020-05-18 13912, 2020

      • CatQuest almost wrote "Perl Jam"
      • 2020-05-18 13912, 2020

      • alastairp
        ruaok: yeah, right. so in order to perform any kind of stats in spark we have to keep an entire duplicate of the db there, in addition to whatever other db we use primarily?
      • 2020-05-18 13926, 2020

      • ruaok
        yes.
      • 2020-05-18 13931, 2020

      • ruaok
        spark is considered disposable.
      • 2020-05-18 13939, 2020

      • bitmap
        leaving pink down since I need to resync that later
      • 2020-05-18 13947, 2020

      • CatQuest
        reosarevok: insert a pokemongo refrence (spark eg?)
      • 2020-05-18 13952, 2020

      • alastairp
        sure. it's not like we'd want to run background tasks on the main production database anyway I guess
      • 2020-05-18 13958, 2020

      • alastairp
        in order to prevent it from overloading
      • 2020-05-18 13908, 2020

      • ruaok
        yep.
      • 2020-05-18 13921, 2020

      • rdswift also likes Great Big Sea.
      • 2020-05-18 13921, 2020

      • alastairp
        so it's not like it's any more "innefficient" than any other way that we'd have to set up a stats infrastructure
      • 2020-05-18 13958, 2020

      • ruaok
        I'm so happy the stats infra is getting squared away.
      • 2020-05-18 13936, 2020

      • iliekcomputers
        it's been pretty stable the last few days.
      • 2020-05-18 13904, 2020

      • iliekcomputers
        i'm just waiting for a new data dump to complete so that we can import it.
      • 2020-05-18 13921, 2020

      • bitmap
        started sir-prod back up without issue
      • 2020-05-18 13930, 2020

      • bitmap
        starting caa-indexer
      • 2020-05-18 13942, 2020

      • ruaok
        time to start other services?
      • 2020-05-18 13956, 2020

      • bitmap
        yup
      • 2020-05-18 13907, 2020

      • ruaok
        doing trille, lemmy and hip
      • 2020-05-18 13906, 2020

      • bitmap
        done with serge
      • 2020-05-18 13940, 2020

      • ruaok
        LB up
      • 2020-05-18 13941, 2020

      • Mr_Monkey
        Done prince. BB looks fine (beta, prod and test)
      • 2020-05-18 13948, 2020

      • bitmap
        I'll do cage, ludwig, pink
      • 2020-05-18 13920, 2020

      • iliekcomputers
        for perf, our spark cluster takes around 6 min to calculate all artist listen counts for ALL users with basically no tuning rn.
      • 2020-05-18 13924, 2020

      • ruaok
        CB up, MeB up.
      • 2020-05-18 13940, 2020

      • iliekcomputers
        with some smart data partitioning, i'm pretty sure we could bring that down.
      • 2020-05-18 13944, 2020

      • ruaok
        MSB up.
      • 2020-05-18 13949, 2020

      • bitmap wonders if the "down": "yes" stuff never worked since he didn't revert that yet,heh
      • 2020-05-18 13913, 2020

      • bitmap
        guess so
      • 2020-05-18 13922, 2020

      • Mr_Monkey
        I guess so.
      • 2020-05-18 13928, 2020

      • CatQuest
        reosarevok: you've actually added quite a lot of BB-tickets for things I was going to do (but ofcoursely you've enunciated yourself much more eloquently than I could ever)
      • 2020-05-18 13936, 2020

      • ruaok
        wow, that took pretty much 1.5 hours.
      • 2020-05-18 13941, 2020

      • ruaok
        !m bitmap
      • 2020-05-18 13941, 2020

      • BrainzBot
        You're doing good work, bitmap!
      • 2020-05-18 13952, 2020

      • bitmap
        w00t
      • 2020-05-18 13956, 2020

      • jlh
        thanks for the hard work y'all!
      • 2020-05-18 13957, 2020

      • Mr_Monkey
        !m bitmap, smooth
      • 2020-05-18 13957, 2020

      • BrainzBot
        You're doing good work, bitmap, smooth!
      • 2020-05-18 13959, 2020

      • c1e0 joined the channel
      • 2020-05-18 13913, 2020

      • CatQuest
        there should be a script that writes !m bitmap in the chhan every so often by default :P
      • 2020-05-18 13925, 2020

      • CatQuest
        <3
      • 2020-05-18 13948, 2020

      • yvanzo
        something like BrainzThanksBitmapBot?
      • 2020-05-18 13952, 2020

      • CatQuest
        :D
      • 2020-05-18 13900, 2020

      • c1e0_ has quit
      • 2020-05-18 13939, 2020

      • Freso
        So given that you’ve just finished the db upgrade, do you want to call off meeting today? Otherwise we’re go in 12 min and I need to prepare. :)
      • 2020-05-18 13939, 2020

      • zas
        bitmap: did you restart telegraf on pink & floyd yet?
      • 2020-05-18 13952, 2020

      • bitmap
        nope, thanks for the reminder
      • 2020-05-18 13954, 2020

      • bitmap
        I'll do it
      • 2020-05-18 13929, 2020

      • bitmap
        done (though postgres-pink is still down for now)
      • 2020-05-18 13950, 2020

      • zas
        k, I'll recheck after a while if metrics are showing up
      • 2020-05-18 13951, 2020

      • Freso
        ruaok: Your call: meeting or no?
      • 2020-05-18 13907, 2020

      • iliekcomputers
        sentry is still down btw
      • 2020-05-18 13910, 2020

      • rdswift
        Can take down the banner on mb.o
      • 2020-05-18 13922, 2020

      • Freso
        Looks like there’s still some clean up going on, so maybe no?
      • 2020-05-18 13930, 2020

      • Freso
        *Sounds
      • 2020-05-18 13932, 2020

      • CatQuest
        Mr_Monkey: can we have a jira component "add/editing pages" (or add/editing interface) or similar?
      • 2020-05-18 13950, 2020

      • CatQuest
        Freso: personally I have nothing to report so...
      • 2020-05-18 13901, 2020

      • CatQuest
        (well other thna creating tickets and partying yesterday)
      • 2020-05-18 13914, 2020

      • yvanzo
        We want to know about the party.
      • 2020-05-18 13926, 2020

      • CatQuest
        17 Mai. look it up :P
      • 2020-05-18 13928, 2020

      • Freso prepares for meeting until being told otherwise anyway
      • 2020-05-18 13934, 2020

      • c1e0 has quit
      • 2020-05-18 13935, 2020

      • bitmap
        iliekcomputers: oh, I see what's wrong. will fix
      • 2020-05-18 13903, 2020

      • cleo joined the channel
      • 2020-05-18 13909, 2020

      • Freso
        yvanzo: It was World Telecommunication and Information Society Day yesterday, clearly a day of much rejoicing.
      • 2020-05-18 13926, 2020

      • cleo is now known as Guest45208
      • 2020-05-18 13929, 2020

      • zas
        bitmap: good, metrics are there for pg instances
      • 2020-05-18 13938, 2020

      • bitmap
        great
      • 2020-05-18 13944, 2020

      • zas
        not pink though
      • 2020-05-18 13909, 2020

      • CatQuest
        Freso: ಠ_ಠ
      • 2020-05-18 13934, 2020

      • bitmap
        I'll restore pink soon
      • 2020-05-18 13908, 2020

      • ruaok
        I'm stunned at how smooth this was. well done!
      • 2020-05-18 13920, 2020

      • CatQuest
        :/
      • 2020-05-18 13922, 2020

      • CatQuest
      • 2020-05-18 13939, 2020

      • Lotheric_
        here it's a holiday today
      • 2020-05-18 13941, 2020

      • Lotheric_
      • 2020-05-18 13954, 2020

      • CatQuest
        Lotheric_: ok! have some cake too!
      • 2020-05-18 13956, 2020

      • Lotheric_ is now known as Lotheric
      • 2020-05-18 13903, 2020

      • CatQuest had soem left over :D
      • 2020-05-18 13922, 2020

      • Lotheric
        I spoiled myself with a takeout breakfast/brunch :P
      • 2020-05-18 13928, 2020

      • shivam-kapila
        CatQuest: Ship that to me. I want some cake 😂
      • 2020-05-18 13949, 2020

      • alastairp
        iliekcomputers: ah, cool. that's what I was interested in knowing (stats computation time)
      • 2020-05-18 13912, 2020

      • CatQuest
        i uh. ate it already 😕
      • 2020-05-18 13912, 2020

      • alastairp
        but it sounds like there's also other implicit time required there (time needed to do a dump, time needed to import it)
      • 2020-05-18 13926, 2020

      • CatQuest
        :|
      • 2020-05-18 13929, 2020

      • alastairp
        any idea if we can stream data to spark from postgres as it comes in?
      • 2020-05-18 13952, 2020

      • ruaok
        alastairp: possible yes, but we haven't done that yet.
      • 2020-05-18 13902, 2020

      • Freso
        <BANG>
      • 2020-05-18 13902, 2020

      • Freso
        It’s No Dirty Dishes Monday!
      • 2020-05-18 13902, 2020

      • Freso
      • 2020-05-18 13902, 2020

      • Freso
        People up for reviews: pristine__, Freso, reosarevok, zas, yvanzo, alastairp, bitmap, ruaok, Mr_Monkey, ishaanshah[m], shivam-kapila, Cyna[m], _lucifer – anyone else who wants to give a review, please let me know ASAP!
      • 2020-05-18 13902, 2020

      • Freso
        pristine__: Go!
      • 2020-05-18 13913, 2020

      • alastairp
        cool, if that's possible then that'd be a great future improvement
      • 2020-05-18 13909, 2020

      • CatQuest
        ...
      • 2020-05-18 13909, 2020

      • Freso
        No pristine__? reosarevok, go!
      • 2020-05-18 13953, 2020

      • reosarevok
        Hi!
      • 2020-05-18 13959, 2020

      • CatQuest
        hi
      • 2020-05-18 13927, 2020

      • reosarevok
        Last week I mostly worked on making it so that when a URL is rejected as a relationship
      • 2020-05-18 13937, 2020

      • reosarevok
        The user is actually told why in cases that can be confusing
      • 2020-05-18 13910, 2020

      • reosarevok
        "why can't I add this allmusic link on the release" "why can't I add a bandcamp album to the artist" etc
      • 2020-05-18 13938, 2020

      • reosarevok
        That's the main thing, although I also did some refactoring and whatnot and some reviews
      • 2020-05-18 13959, 2020

      • reosarevok
        CatQuest: wanna go at all? If not Freso
      • 2020-05-18 13911, 2020

      • CatQuest
        hi
      • 2020-05-18 13938, 2020

      • CatQuest
        I don't have anything except adding tickets for BB (and commenting on reosarevoks tickets :P) and aprtying yesterday
      • 2020-05-18 13943, 2020

      • CatQuest
        partying*
      • 2020-05-18 13946, 2020

      • CatQuest
        next freso?
      • 2020-05-18 13953, 2020

      • Freso
        🙋
      • 2020-05-18 13955, 2020

      • Freso
        Spent a good chunk of time looking into and dealing with reported editors. Also was around and about.
      • 2020-05-18 13925, 2020

      • Freso
        fin.
      • 2020-05-18 13931, 2020

      • Freso
        zas: Go!
      • 2020-05-18 13938, 2020

      • zas
        Hey
      • 2020-05-18 13954, 2020

      • zas
        Not much to say, usual supervision, upgrades and maintenance
      • 2020-05-18 13930, 2020

      • zas
        also reviewed a lot of Picard PRs stuff (mainly an incoming patch that will boost UI reactivity)
      • 2020-05-18 13941, 2020

      • zas
        fin. yvanzo ?
      • 2020-05-18 13935, 2020

      • yvanzo
        Hi!
      • 2020-05-18 13950, 2020

      • yvanzo
        Last week, I published the first release of MusicBrainz Docker Compose files.
      • 2020-05-18 13954, 2020

      • Freso
        (People still up for reviews: alastairp, bitmap, ruaok, Mr_Monkey, ishaanshah[m], shivam-kapila, Cyna[m], _lucifer – anyone else who wants to give a review, please let me know ASAP!)
      • 2020-05-18 13958, 2020

      • yvanzo
      • 2020-05-18 13903, 2020

      • yvanzo
      • 2020-05-18 13933, 2020

      • ruaok
        !m yvanzo
      • 2020-05-18 13933, 2020

      • BrainzBot
        You're doing good work, yvanzo!
      • 2020-05-18 13951, 2020

      • yvanzo
        Otherwise released a new version of MBS, including a patch by navap!