#metabrainz

/

      • zas
        when it is supposed to be executed?
      • 2020-07-07 18936, 2020

      • bitmap
        yeah
      • 2020-07-07 18937, 2020

      • bitmap
        every sunday I think?
      • 2020-07-07 18903, 2020

      • zas
        yes, it is configured like this
      • 2020-07-07 18906, 2020

      • bitmap
        it was working for a while
      • 2020-07-07 18941, 2020

      • zas
        Jul 7 15:21:01 williams cron[10248]: (*system*barman-backup) INSECURE MODE (group/other writable) (/etc/cron.d/barman-backup)
      • 2020-07-07 18946, 2020

      • zas
        ^^hint ;)
      • 2020-07-07 18909, 2020

      • bitmap
        :(
      • 2020-07-07 18925, 2020

      • bitmap
        I wonder how that happened
      • 2020-07-07 18952, 2020

      • bitmap
        it was working from the image before and other than that I only used crontab -e to edit it
      • 2020-07-07 18918, 2020

      • zas
      • 2020-07-07 18940, 2020

      • bitmap
        nope, that was the version before I added logging
      • 2020-07-07 18957, 2020

      • zas
        We can change the crontab for it to run today in few mins
      • 2020-07-07 18902, 2020

      • zas
        so we are sure it works
      • 2020-07-07 18907, 2020

      • zas
        let me do that
      • 2020-07-07 18911, 2020

      • bitmap
        cool
      • 2020-07-07 18952, 2020

      • bitmap
        I cleared a bit of space first
      • 2020-07-07 18948, 2020

      • zas
        It should run in 2 minutes
      • 2020-07-07 18943, 2020

      • bitmap
        I'm running rebuild-xlogdb after deleting some WAL files, so that might interfere with it
      • 2020-07-07 18920, 2020

      • zas
        it seems to run, check
      • 2020-07-07 18931, 2020

      • zas
        at least cron executed it
      • 2020-07-07 18940, 2020

      • bitmap
        yeah, it did
      • 2020-07-07 18958, 2020

      • bitmap
        failed with "ERROR: Impossible to start the backup." but I'm guessing that's from running rebuild-xlogdb concurrently
      • 2020-07-07 18923, 2020

      • alastairp
      • 2020-07-07 18924, 2020

      • BrainzBot
        LB-641: Allow users to select their timezone so that times and graphs can be localised
      • 2020-07-07 18933, 2020

      • alastairp
        and LB-642
      • 2020-07-07 18934, 2020

      • BrainzBot
        LB-642: Specify a field for "local time" for listens https://tickets.metabrainz.org/browse/LB-642
      • 2020-07-07 18941, 2020

      • Mr_Monkey
        Thx
      • 2020-07-07 18918, 2020

      • bitmap
        zas: thanks, we can probably revert it to run again next sunday now
      • 2020-07-07 18926, 2020

      • zas
        bitmap: ok, I'll set it to run on sunday again
      • 2020-07-07 18904, 2020

      • zas
        ok done, sunday at 0:30 UTC
      • 2020-07-07 18940, 2020

      • zas
        you may want to copy the file to your container setup (and ensure it has 640 mode)
      • 2020-07-07 18955, 2020

      • zas
        644 works too
      • 2020-07-07 18954, 2020

      • jmp_music has quit
      • 2020-07-07 18933, 2020

      • alastairp
        Mr_Monkey: LB-656
      • 2020-07-07 18934, 2020

      • BrainzBot
        LB-656: Provide coarser listen navigation tools (month/year) https://tickets.metabrainz.org/browse/LB-656
      • 2020-07-07 18938, 2020

      • iliekcomputers
        ishaanshah: hey
      • 2020-07-07 18953, 2020

      • ishaanshah
        Hi!
      • 2020-07-07 18900, 2020

      • ishaanshah
        How are you?
      • 2020-07-07 18916, 2020

      • iliekcomputers
        i'm good
      • 2020-07-07 18939, 2020

      • ishaanshah
        I opened LB-657 and LB-658
      • 2020-07-07 18941, 2020

      • BrainzBot
        LB-657: Show top 10 entities on reports page https://tickets.metabrainz.org/browse/LB-657
      • 2020-07-07 18941, 2020

      • BrainzBot
        LB-658: Add "Daily Activity" statistics (Spark + DB + API) https://tickets.metabrainz.org/browse/LB-658
      • 2020-07-07 18903, 2020

      • iliekcomputers
        oh awesome
      • 2020-07-07 18918, 2020

      • ishaanshah
        657 will take 2 days
      • 2020-07-07 18933, 2020

      • ishaanshah
        sure
      • 2020-07-07 18928, 2020

      • iliekcomputers
        ok
      • 2020-07-07 18936, 2020

      • iliekcomputers
        sorry about that
      • 2020-07-07 18943, 2020

      • ishaanshah
        oh, no worries
      • 2020-07-07 18953, 2020

      • iliekcomputers
        so question
      • 2020-07-07 18909, 2020

      • iliekcomputers
        what do you want to do about LB-637 and LB-636
      • 2020-07-07 18910, 2020

      • BrainzBot
        LB-637: Show the time range for which stats have been calculated on "Charts" page https://tickets.metabrainz.org/browse/LB-637
      • 2020-07-07 18910, 2020

      • BrainzBot
        LB-636: Add "Play This" links to recording chart https://tickets.metabrainz.org/browse/LB-636
      • 2020-07-07 18938, 2020

      • iliekcomputers
        i'm sorry, i didn't remember we had LB-637 in the sprint, otherwise I'd have told you to do that today in the afternoon
      • 2020-07-07 18949, 2020

      • ishaanshah
        I had that in mind
      • 2020-07-07 18926, 2020

      • ishaanshah
        but the thing is, there are some changes to made to the charts page after listening_activity PR gets merged
      • 2020-07-07 18949, 2020

      • ishaanshah
        so I though I would do all these minor improvements in one PR itself
      • 2020-07-07 18901, 2020

      • iliekcomputers
        ah
      • 2020-07-07 18902, 2020

      • iliekcomputers
        ok
      • 2020-07-07 18916, 2020

      • ishaanshah
        as for 636, I would say we hold it for a while
      • 2020-07-07 18924, 2020

      • iliekcomputers
        I'll just put them both in the backlog then
      • 2020-07-07 18947, 2020

      • ishaanshah
        right now we will have to squeeze the graph for recording only, which is not ideal
      • 2020-07-07 18906, 2020

      • ishaanshah
        the redesign has a dedicated space for player
      • 2020-07-07 18919, 2020

      • ishaanshah
        we just have to plug it in then
      • 2020-07-07 18927, 2020

      • iliekcomputers
        right, that makes sense
      • 2020-07-07 18903, 2020

      • iliekcomputers
        I'll pull in LB-657
      • 2020-07-07 18904, 2020

      • BrainzBot
        LB-657: Show top 10 entities on reports page https://tickets.metabrainz.org/browse/LB-657
      • 2020-07-07 18923, 2020

      • ishaanshah
        so the listening activity PR will be 1 more day ig
      • 2020-07-07 18931, 2020

      • iliekcomputers
        I'm not sure about LB-658
      • 2020-07-07 18931, 2020

      • BrainzBot
        LB-658: Add "Daily Activity" statistics (Spark + DB + API) https://tickets.metabrainz.org/browse/LB-658
      • 2020-07-07 18948, 2020

      • ishaanshah
        yeah me too
      • 2020-07-07 18907, 2020

      • ishaanshah
        lets pull LB-639
      • 2020-07-07 18907, 2020

      • BrainzBot
        LB-639: Request consumer dropping some stats https://tickets.metabrainz.org/browse/LB-639
      • 2020-07-07 18921, 2020

      • ishaanshah
        LB-654
      • 2020-07-07 18921, 2020

      • BrainzBot
        LB-654: Skip entities with incorrect data while calculating entity statistics. https://tickets.metabrainz.org/browse/LB-654
      • 2020-07-07 18947, 2020

      • ishaanshah
        a pr is open for 639 and ready for review
      • 2020-07-07 18952, 2020

      • iliekcomputers
        makes sense.
      • 2020-07-07 18956, 2020

      • iliekcomputers
        so one task that I had in mind
      • 2020-07-07 18900, 2020

      • ishaanshah
        I worked on 654 for some time today
      • 2020-07-07 18909, 2020

      • ishaanshah
        so one more day would be good
      • 2020-07-07 18917, 2020

      • iliekcomputers
        did you see how the dump import messed up the data in the cluster?
      • 2020-07-07 18926, 2020

      • ishaanshah
        Yeah
      • 2020-07-07 18928, 2020

      • iliekcomputers
        I figure we should make the import reversible.
      • 2020-07-07 18958, 2020

      • ishaanshah
        meaning?
      • 2020-07-07 18959, 2020

      • iliekcomputers
        basically "import into a different folder, if successful, copy over old data, if fails, don't change the old data"
      • 2020-07-07 18940, 2020

      • ishaanshah
        Oh, ya that makes sense
      • 2020-07-07 18958, 2020

      • ruaok
        iliekcomputers: ping me when you and ishaanshah are done. I wanna chat dumps/timescale with you.
      • 2020-07-07 18906, 2020

      • ishaanshah
        I am not familiar with the import code, but I will have a look at it.
      • 2020-07-07 18929, 2020

      • iliekcomputers
        ruaok: i have a meeting at 5:30, so probably not today. Tomorrow?
      • 2020-07-07 18940, 2020

      • iliekcomputers
        ishaanshah: great, thanks!
      • 2020-07-07 18944, 2020

      • iliekcomputers
        can you open a ticket for it?
      • 2020-07-07 18950, 2020

      • ishaanshah
        yep will do
      • 2020-07-07 18929, 2020

      • iliekcomputers
        i think that should be enough for this week, i'll just start the sprint and you can pull in the dump task when you open it.
      • 2020-07-07 18932, 2020

      • ishaanshah
        Can we pull in LB-629 too
      • 2020-07-07 18932, 2020

      • BrainzBot
        LB-629: Buggy grouping of releases https://tickets.metabrainz.org/browse/LB-629
      • 2020-07-07 18940, 2020

      • ishaanshah
        pr is open for thath
      • 2020-07-07 18908, 2020

      • iliekcomputers
        so the PRs that are open, I'll just merge as is, and close the tickets, don't need to pull them in or anything.
      • 2020-07-07 18909, 2020

      • ishaanshah
        iliekcomputers: Yeah I will do that
      • 2020-07-07 18932, 2020

      • ishaanshah
        > so the PRs that are open, I'll just merge as is, and close the tickets, don't need to pull them in or anything.
      • 2020-07-07 18932, 2020

      • ishaanshah
        ok, cool
      • 2020-07-07 18949, 2020

      • iliekcomputers
        cool, do you have anything else you wanted to chat about?
      • 2020-07-07 18958, 2020

      • ishaanshah
        nah nothing else
      • 2020-07-07 18905, 2020

      • ishaanshah
        opened LB-659
      • 2020-07-07 18905, 2020

      • BrainzBot
        LB-659: Add ability to revert back to older dump if the import fails https://tickets.metabrainz.org/browse/LB-659
      • 2020-07-07 18926, 2020

      • iliekcomputers
        thanks, i started the sprint, feel free to pull it in.
      • 2020-07-07 18930, 2020

      • ishaanshah
        Have a nice evening
      • 2020-07-07 18932, 2020

      • ishaanshah
        :)
      • 2020-07-07 18934, 2020

      • iliekcomputers
        you too!
      • 2020-07-07 18953, 2020

      • ruaok
        iliekcomputers: got 30 seconds?
      • 2020-07-07 18958, 2020

      • iliekcomputers
        yes!
      • 2020-07-07 18902, 2020

      • ruaok
        kewl.
      • 2020-07-07 18914, 2020

      • ruaok
        so, I know of no other bugs in the timescale migration stuff.
      • 2020-07-07 18923, 2020

      • ruaok
        we should get an attempt at a migration going.
      • 2020-07-07 18928, 2020

      • iliekcomputers
        ++++
      • 2020-07-07 18934, 2020

      • iliekcomputers
        sounds great to me!
      • 2020-07-07 18941, 2020

      • ruaok
        which from my perspective means setting up a new exchange for RMQ incoming.
      • 2020-07-07 18952, 2020

      • ruaok
        once that is live, shortly thereafter you need to trigger a new dump.
      • 2020-07-07 18956, 2020

      • ruaok
        (without spark)
      • 2020-07-07 18914, 2020

      • ruaok
        I can do that rest. including calming zas down about this queue growing scarily.
      • 2020-07-07 18943, 2020

      • ruaok
        when should we aim to do this?
      • 2020-07-07 18948, 2020

      • iliekcomputers
        sure, sounds good.
      • 2020-07-07 18905, 2020

      • ruaok
        how is your schedule for tomorrow?
      • 2020-07-07 18957, 2020

      • iliekcomputers
        let's aim for thursday, if that's ok.
      • 2020-07-07 18912, 2020

      • iliekcomputers
        thursday evening*
      • 2020-07-07 18914, 2020

      • ruaok
        sure.
      • 2020-07-07 18930, 2020

      • ruaok
        actually that works, I have no plans thursday.
      • 2020-07-07 18934, 2020

      • ruaok
        cool, thanks!
      • 2020-07-07 18939, 2020

      • iliekcomputers
        sure!
      • 2020-07-07 18941, 2020

      • iliekcomputers
        oh btw
      • 2020-07-07 18953, 2020

      • iliekcomputers
        the influx dumps have been causing concerns...
      • 2020-07-07 18918, 2020

      • iliekcomputers
        the last two full dumps over sundays have co-incided with very high loads for some reason.
      • 2020-07-07 18919, 2020

      • ruaok
        do I even want to ask?
      • 2020-07-07 18933, 2020

      • ruaok
        oh those were the 100+ load issues?
      • 2020-07-07 18950, 2020

      • iliekcomputers
        they did happen on sunday which is the day we trigger dumps
      • 2020-07-07 18900, 2020

      • ruaok
        let's make thursday count!
      • 2020-07-07 18903, 2020

      • iliekcomputers
        i'd be surprised if it was something else.
      • 2020-07-07 18924, 2020

      • iliekcomputers
        so yeah, hopefully it works out thursday, but i just wanted to set expectations beforehand :D
      • 2020-07-07 18952, 2020

      • ruaok
        I'm glad the whole thursday evening is free then.
      • 2020-07-07 18904, 2020

      • ruaok
        fingers crossed that we can get rid of influx soon.
      • 2020-07-07 18914, 2020

      • iliekcomputers
        that'd be awesome
      • 2020-07-07 18921, 2020

      • ruaok
        we'll have to rebase the timescale branch once more, but shivam-kapila and I are pro's at that now.
      • 2020-07-07 18921, 2020

      • iliekcomputers
        :D
      • 2020-07-07 18949, 2020

      • iliekcomputers
        i'll try to deploy latest master tomorrow or today too I guess.
      • 2020-07-07 18958, 2020

      • iliekcomputers
        so that we only have the timescale changes to deploye
      • 2020-07-07 18919, 2020

      • ruaok
        there will be no deployment tomorrow.
      • 2020-07-07 18929, 2020

      • ruaok
        really, all I need to do is create the exchange.
      • 2020-07-07 18909, 2020

      • iliekcomputers
        i have to drop, can we pick this up again later?
      • 2020-07-07 18913, 2020

      • ruaok
        and then do the import once the dump is around. and that amounts of 5 commands and hours of time.
      • 2020-07-07 18921, 2020

      • ruaok
        np, bye!
      • 2020-07-07 18937, 2020

      • iliekcomputers
        👋🏽