#metabrainz

/

      • holycow23[m] uploaded an image: (63KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/matrix.org/ugNsORxWKMGkoicxDlSFKbCC/image.png >
      • 2025-06-03 15430, 2025

      • lucifer[m]
        yes, let me know if it updates in another minute or so
      • 2025-06-03 15428, 2025

      • holycow23[m]
        the logs are still the same
      • 2025-06-03 15459, 2025

      • lucifer[m]
        Nothing else in spark reader logs too?
      • 2025-06-03 15439, 2025

      • holycow23[m]
        Nope
      • 2025-06-03 15447, 2025

      • holycow23[m]
        just the empty internal thingy
      • 2025-06-03 15449, 2025

      • lucifer[m]
        okay, let's try one more thing.
      • 2025-06-03 15412, 2025

      • lucifer[m]
        ./develop.sh spark down, ./develop.sh spark up -d, ./develop.sh manage spark request_compact_listens
      • 2025-06-03 15413, 2025

      • ahvalmissaamine has quit
      • 2025-06-03 15411, 2025

      • holycow23[m]
        Okay
      • 2025-06-03 15432, 2025

      • holycow23[m]
        Now I wait?
      • 2025-06-03 15402, 2025

      • lucifer[m]
        monitor request_consumer logs
      • 2025-06-03 15434, 2025

      • holycow23[m]
        Yep on it
      • 2025-06-03 15416, 2025

      • ahvalmissaamine joined the channel
      • 2025-06-03 15420, 2025

      • kuno has quit
      • 2025-06-03 15410, 2025

      • mukti has quit
      • 2025-06-03 15419, 2025

      • holycow23[m]
        It has stopped at
      • 2025-06-03 15419, 2025

      • holycow23[m]
        [Stage 0:> (0 + 1) / 1]
      • 2025-06-03 15428, 2025

      • Zhele has quit
      • 2025-06-03 15435, 2025

      • lucifer[m]
        share the full logs
      • 2025-06-03 15426, 2025

      • holycow23[m]
      • 2025-06-03 15431, 2025

      • lucifer[m]
        okay, try running ./develop.sh manage spark request_user_stats --type listening_activity --range this_week again
      • 2025-06-03 15432, 2025

      • kuno joined the channel
      • 2025-06-03 15444, 2025

      • _BrainzGit
        [musicbrainz-server] 14mwiencek opened pull request #3553 (03master…silence-wikipedia-extracts): Silence Wikipedia extract load failures https://github.com/metabrainz/musicbrainz-server/…
      • 2025-06-03 15424, 2025

      • holycow23[m]
      • 2025-06-03 15446, 2025

      • holycow23[m]
        It ran it seems?
      • 2025-06-03 15449, 2025

      • lucifer[m]
        holycow23: okay cool, i think i know what the issue is.
      • 2025-06-03 15459, 2025

      • mukti joined the channel
      • 2025-06-03 15402, 2025

      • lucifer[m]
        will try to fix and get back to you.
      • 2025-06-03 15407, 2025

      • holycow23[m]
        okay
      • 2025-06-03 15412, 2025

      • holycow23[m]
        okay
      • 2025-06-03 15438, 2025

      • Zhele joined the channel
      • 2025-06-03 15404, 2025

      • lucifer[m]
        holycow23: can you pull the `fix-local-spark-dev` branch and try it?
      • 2025-06-03 15407, 2025

      • _BrainzGit
        [listenbrainz-server] 14amCap1712 opened pull request #3293 (03master…fix-local-spark-dev): Handle missing partial aggregate in incremental stats https://github.com/metabrainz/listenbrainz-server…
      • 2025-06-03 15416, 2025

      • holycow23[m]
        lucifer: what exactly do I run on the branch?
      • 2025-06-03 15415, 2025

      • lucifer[m]
        holycow23: first of all stop, rebuild and restart the spark containers, `./develop.sh spark down`, `./develop.sh spark build`, `./develop.sh spark up`
      • 2025-06-03 15412, 2025

      • holycow23[m]
        OKay
      • 2025-06-03 15459, 2025

      • holycow23[m]
        Done
      • 2025-06-03 15411, 2025

      • holycow23[m]
        <lucifer[m]> "./develop.sh manage spark..." <- this now?
      • 2025-06-03 15422, 2025

      • lucifer[m]
        yes
      • 2025-06-03 15458, 2025

      • holycow23[m]
        Okay
      • 2025-06-03 15406, 2025

      • holycow23[m]
        Now?
      • 2025-06-03 15414, 2025

      • holycow23[m] uploaded an image: (137KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/matrix.org/FoyYRxBrHZACkwfxPsWYFDPF/image.png >
      • 2025-06-03 15416, 2025

      • lucifer[m]
        logs of the request consumer
      • 2025-06-03 15436, 2025

      • lucifer[m]
        it should be done in a minute or two
      • 2025-06-03 15447, 2025

      • holycow23[m]
        Its been here since the past 5 minutes actually
      • 2025-06-03 15421, 2025

      • holycow23[m]
        holycow23[m]: the message came in at 8:04 and its 8:09 rn
      • 2025-06-03 15423, 2025

      • lucifer[m]
        did you rebuild the container?
      • 2025-06-03 15435, 2025

      • holycow23[m]
        the main listenbrainz container?
      • 2025-06-03 15438, 2025

      • holycow23[m]
        or spark?
      • 2025-06-03 15441, 2025

      • lucifer[m]
        spark
      • 2025-06-03 15449, 2025

      • holycow23[m]
        yes I did
      • 2025-06-03 15432, 2025

      • lucifer[m]
        okay, can you stop the spark containers and run spark tests locally. ./test.sh spark
      • 2025-06-03 15449, 2025

      • holycow23[m]
        Should I stop the listenbrainz server as well once?
      • 2025-06-03 15452, 2025

      • lucifer[m]
        sure
      • 2025-06-03 15410, 2025

      • holycow23[m]
        its done
      • 2025-06-03 15430, 2025

      • holycow23[m]
        623 passed
      • 2025-06-03 15452, 2025

      • lucifer[m]
        i see. okay let's try again tomorrow on a meet i guess.
      • 2025-06-03 15441, 2025

      • holycow23[m]
        Okay
      • 2025-06-03 15429, 2025

      • Kladky has quit
      • 2025-06-03 15418, 2025

      • rozlav8 has quit
      • 2025-06-03 15429, 2025

      • rozlav8 joined the channel