#metabrainz

/

      • bitmap[m]
        hmm, I think the problem is that the LB web container didn't reload uwsgi when I put the old pgbouncer container into maintenance mode. this template block in /etc/consul-template-uwsgi.conf looks suspect since it has no command/exec setting:... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/WbdSJBGpthvZKDDwkdRNiXPy>)
      • 2025-02-20 05151, 2025

      • bitmap[m]
        lucifer: is my understanding of the consul-template config correct? if so, can it be changed to reload uwsgi when config.py changes?
      • 2025-02-20 05109, 2025

      • derat[m] has quit
      • 2025-02-20 05131, 2025

      • snobdiggy29283 has quit
      • 2025-02-20 05156, 2025

      • allen has quit
      • 2025-02-20 05134, 2025

      • minimal has quit
      • 2025-02-20 05140, 2025

      • ansh[m] has quit
      • 2025-02-20 05113, 2025

      • lucifer[m]
      • 2025-02-20 05108, 2025

      • lucifer[m]
      • 2025-02-20 05101, 2025

      • bitmap[m]
        that seems problematic since the workers have to be restarted if the config changes, right?
      • 2025-02-20 05119, 2025

      • bitmap[m]
        zas: hey, can you configure gmail to allow exim relay on isaac? (logging off now but I can move them tomorrow)
      • 2025-02-20 05107, 2025

      • lucifer[m]
        yes, i think so. i'll discuss with monkey on the rationale.
      • 2025-02-20 05136, 2025

      • aerozol[m]
        mayhem: 🥳 v
      • 2025-02-20 05148, 2025

      • Aerozol[m]1 joined the channel
      • 2025-02-20 05149, 2025

      • Aerozol[m]1 uploaded an image: (17KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/zcAxxQAkKnBzmftKQlQTuboT/image.png >
      • 2025-02-20 05157, 2025

      • pite has quit
      • 2025-02-20 05125, 2025

      • dabeglavins3 has quit
      • 2025-02-20 05145, 2025

      • dabeglavins3 joined the channel
      • 2025-02-20 05121, 2025

      • BrainzGit
        [bookbrainz-site] 14shalini-bhandari opened pull request #1154 (03master…replace-twitter): fix: Replaced Twitter logo and link with Mastodon and Bluesky https://github.com/metabrainz/bookbrainz-site/pul…
      • 2025-02-20 05130, 2025

      • Kladky joined the channel
      • 2025-02-20 05134, 2025

      • allen joined the channel
      • 2025-02-20 05133, 2025

      • adhawkins has quit
      • 2025-02-20 05101, 2025

      • adhawkins joined the channel
      • 2025-02-20 05158, 2025

      • holycow23[m] joined the channel
      • 2025-02-20 05158, 2025

      • holycow23[m]
        I wanted to work on the user-stats is there any method by which I can get some stats in my local spark so I could test the generation and retrieval of new stats?
      • 2025-02-20 05142, 2025

      • elkiensad[m] joined the channel
      • 2025-02-20 05142, 2025

      • elkiensad[m]
        <Aerozol[m]1> "image.png" <- yeah the lists are getting better
      • 2025-02-20 05130, 2025

      • mayhem[m]
        elkiensad[m]: and that is only because new users joining. we haven't made any improvements.
      • 2025-02-20 05150, 2025

      • elkiensad[m]
        The number of listens of persons I have made a create account on ListenBrainz has reached around ~1012364
      • 2025-02-20 05123, 2025

      • elkiensad[m]
        2 of them are in the top 2 rows of my similarity chart with 24% and 26%
      • 2025-02-20 05149, 2025

      • elkiensad[m]
        and i can tell generated lists are mostly copying their tastes at this moment
      • 2025-02-20 05141, 2025

      • reosarevok[m]
        Oh, so it's an Estonian/Finnish paradise
      • 2025-02-20 05154, 2025

      • reosarevok[m]
        Get music recommendations from your friends without actually having to talk to them!
      • 2025-02-20 05140, 2025

      • BrainzGit
        [listenbrainz-server] 14amCap1712 opened pull request #3189 (03master…optimize-fresh-releases): Optimize fresh releases generation https://github.com/metabrainz/listenbrainz-server…
      • 2025-02-20 05114, 2025

      • mayhem[m]
        lucifer: would you do me a favor and see why daily jams failed last night?
      • 2025-02-20 05123, 2025

      • lucifer[m]
        Not enough listens in playlist, [@mayhem:chatbrainz.org](https://matrix.to/#/@mayhem:chatbrainz.org)
      • 2025-02-20 05149, 2025

      • mayhem[m]
        ah, yes. I could've foreseen that. ok, thanks for checking.
      • 2025-02-20 05102, 2025

      • kellnerd[m] joined the channel
      • 2025-02-20 05103, 2025

      • kellnerd[m]
        I couldn't believe there is no ticket for a faster MB API endpoint to lookup multiple URLs and map them to MBIDs (or at least I couldn't find it), so I finally created MBS-13943.
      • 2025-02-20 05104, 2025

      • BrainzBot
        MBS-13943: Lookup multiple URLs at once with the API https://tickets.metabrainz.org/browse/MBS-13943
      • 2025-02-20 05151, 2025

      • BrainzGit
        [listenbrainz-server] 14amCap1712 opened pull request #3190 (03master…fix-intermediate-stats): Fix get_intermediate_stats_df https://github.com/metabrainz/listenbrainz-server…
      • 2025-02-20 05116, 2025

      • BrainzGit
        [listenbrainz-server] 14amCap1712 merged pull request #3189 (03master…optimize-fresh-releases): Optimize fresh releases generation https://github.com/metabrainz/listenbrainz-server…
      • 2025-02-20 05148, 2025

      • BrainzGit
        [listenbrainz-server] 14amCap1712 merged pull request #3190 (03master…fix-intermediate-stats): Fix get_intermediate_stats_df https://github.com/metabrainz/listenbrainz-server…
      • 2025-02-20 05101, 2025

      • suvid[m] has quit
      • 2025-02-20 05119, 2025

      • allen has quit
      • 2025-02-20 05101, 2025

      • lucifer[m]
        mayhem: hi, can you please review https://github.com/metabrainz/listenbrainz-server… ?
      • 2025-02-20 05117, 2025

      • mayhem[m]
        done
      • 2025-02-20 05122, 2025

      • lucifer[m]
        thanks
      • 2025-02-20 05137, 2025

      • BrainzGit
        [listenbrainz-server] 14amCap1712 merged pull request #3188 (03master…delete-users-record): Add a table to record listen history deletion https://github.com/metabrainz/listenbrainz-server…
      • 2025-02-20 05118, 2025

      • BrainzGit
        [listenbrainz-server] release 03v-2025-02-20.0 has been published by 14github-actions[bot]: https://github.com/metabrainz/listenbrainz-server…
      • 2025-02-20 05142, 2025

      • bitmap[m]
        mayhem: lucifer: we'll run the database switchover in about an hour if there are any cron jobs you need to pause
      • 2025-02-20 05141, 2025

      • mthax has quit
      • 2025-02-20 05106, 2025

      • mthax joined the channel
      • 2025-02-20 05143, 2025

      • mthax has quit
      • 2025-02-20 05103, 2025

      • mthax joined the channel
      • 2025-02-20 05159, 2025

      • mayhem[m]
        lucifer: you about?
      • 2025-02-20 05130, 2025

      • mayhem[m]
        If a Cron job fires up during the outage, will it mess with your setup, bitmap?
      • 2025-02-20 05141, 2025

      • mayhem[m]
        If the jobs fail, no biggie for me
      • 2025-02-20 05159, 2025

      • bitmap[m]
        I don't think so, just a safety precaution
      • 2025-02-20 05103, 2025

      • lucifer[m]
        mayhem: yes
      • 2025-02-20 05121, 2025

      • mayhem[m]
        bitmap[m]: Ok, will do.
      • 2025-02-20 05151, 2025

      • mayhem[m]
        lucifer: can you prepare your side of Cron jobs for the downtime?
      • 2025-02-20 05101, 2025

      • lucifer[m]
        i stopped both cron containers.
      • 2025-02-20 05117, 2025

      • mayhem[m]
        I'll take the mapping container down before the outage
      • 2025-02-20 05138, 2025

      • lucifer[m]
        i stopped the mapping cron container already.
      • 2025-02-20 05147, 2025

      • lucifer[m]
        the mapping writer is still running though.
      • 2025-02-20 05148, 2025

      • bitmap[m]
        thx, the scripts that shutdown the db will forcibly terminate existing connections, so just making sure it doesn't cause a mess of any active scripts
      • 2025-02-20 05114, 2025

      • mayhem[m]
        Ok
      • 2025-02-20 05150, 2025

      • reosarevok[m]
        Aerozol: when you have some time, see MBS-13944 - it's not urgent, but I'd really like some advice. Open to others too, of course :)
      • 2025-02-20 05151, 2025

      • BrainzBot
        MBS-13944: Make empty select rows more accessible https://tickets.metabrainz.org/browse/MBS-13944
      • 2025-02-20 05143, 2025

      • bitmap[m]
        I'll bring services down on the gateway in a minute
      • 2025-02-20 05137, 2025

      • bitmap[m]
        done, going through the switchover steps now
      • 2025-02-20 05137, 2025

      • bitmap[m]
        mayhem: lucifer: you may have to restart the lb web container again
      • 2025-02-20 05136, 2025

      • mayhem[m]
        restarting.
      • 2025-02-20 05138, 2025

      • lucifer[m]
        done
      • 2025-02-20 05110, 2025

      • mayhem[m]
        LB back up.
      • 2025-02-20 05123, 2025

      • bitmap[m]
        MB is back
      • 2025-02-20 05136, 2025

      • mayhem[m]
        is the whole changeover done?
      • 2025-02-20 05142, 2025

      • mayhem[m]
        can we restart cron containers?
      • 2025-02-20 05142, 2025

      • monkey[m]
        BB back up to, forgot to say
      • 2025-02-20 05119, 2025

      • bitmap[m]
        mayhem[m]: yeah, everything's back up an running, feel free to restart cron
      • 2025-02-20 05126, 2025

      • mayhem[m]
        k
      • 2025-02-20 05112, 2025

      • mayhem[m]
        lucifer: mapping container started.
      • 2025-02-20 05104, 2025

      • zas[m] joined the channel
      • 2025-02-20 05104, 2025

      • zas[m]
        bitmap: tell me once we have one of jimmy or hendrix free, so I can retire them.
      • 2025-02-20 05129, 2025

      • bitmap[m]
        zas: jimmy is now free, hendrix still has containers that need to be moved
      • 2025-02-20 05132, 2025

      • bitmap[m]
        btw did you see my message about exim relays?
      • 2025-02-20 05139, 2025

      • zas[m]
        ah nope, missed it, I'll check that right now
      • 2025-02-20 05117, 2025

      • BrainzGit
        [listenbrainz-server] 14MonkeyDo opened pull request #3191 (03master…fix-add-listens-modal): LB-1735: Rework recording/album search regular expressions https://github.com/metabrainz/listenbrainz-server…
      • 2025-02-20 05156, 2025

      • nbin has quit
      • 2025-02-20 05113, 2025

      • monkey[m]
        That switchover was smooth as butter 👏
      • 2025-02-20 05130, 2025

      • nbin joined the channel
      • 2025-02-20 05147, 2025

      • mayhem[m]
        yes, very impressive @bitmap!
      • 2025-02-20 05140, 2025

      • bitmap[m]
        yeah, repmgr makes everything pretty easy nowadays 🙂
      • 2025-02-20 05157, 2025

      • zas[m]
        bitmap: check if email relays work, I added the config now
      • 2025-02-20 05123, 2025

      • mayhem[m]
        zas: outsidecontext juliam and anyone else who might know.... uwsgi (python app server) uses a multi-process model and not a multi-threading model.
      • 2025-02-20 05136, 2025

      • mayhem[m]
        is the primary motivation for this the GIL?
      • 2025-02-20 05141, 2025

      • BrainzGit
        [listenbrainz-server] 14amCap1712 opened pull request #3192 (03master…fix-dump-entry): Fix dump entry sequence https://github.com/metabrainz/listenbrainz-server…
      • 2025-02-20 05105, 2025

      • zas[m]
        mayhem: very likely
      • 2025-02-20 05107, 2025

      • outsidecontext[m
        mayhem: very likely
      • 2025-02-20 05111, 2025

      • outsidecontext[m
        :D
      • 2025-02-20 05114, 2025

      • zas[m]
        ahah
      • 2025-02-20 05120, 2025

      • mayhem[m]
        because for the new fuzzy mapping server, making a multi-process version is going to be a serious pain, but deploying with python 13 with no GIL would be possible
      • 2025-02-20 05144, 2025

      • mayhem[m]
        nice to get very clear answers. :)
      • 2025-02-20 05121, 2025

      • zas[m]
        but 3.13 no GIL is still experimental, so perhaps a bit too soon
      • 2025-02-20 05112, 2025

      • mayhem[m]
        yeah, a bit worried about that.
      • 2025-02-20 05134, 2025

      • mayhem[m]
        but making a multi-process version of this would mean using shared memory, which might be impossible to accomplish.
      • 2025-02-20 05104, 2025

      • outsidecontext[m
        I'm really curious about how this performs in various scenarios, but I haven't tested it yet myself. But according to the release notes single threaded performance seems to be rather highly impacted by this, and there is a lot they want to improve for 3.14.
      • 2025-02-20 05123, 2025

      • outsidecontext[m
        mayhem: Yes. This is roughly how the discussion about using processes in Picard instead of threads because of GIL came to a halt
      • 2025-02-20 05148, 2025

      • zas[m]
      • 2025-02-20 05140, 2025

      • mayhem[m]
        zas: we use some serious magic libs to make this matching happen (nmslib) and it would need to support buffers being passed in so that everything could be running on shared memory.
      • 2025-02-20 05156, 2025

      • mayhem[m]
        this code is amazing, unsupported and doesn't even have support for being serialized out to disk.
      • 2025-02-20 05111, 2025

      • mayhem[m]
        its its hands down better and faster than anything else I've ever used.
      • 2025-02-20 05123, 2025

      • mayhem[m]
        s/its/and/
      • 2025-02-20 05144, 2025

      • mayhem[m]
        I might need to write this thing in C++ then.
      • 2025-02-20 05156, 2025

      • mayhem[m]
        maybe I can do it and see and save my dignity
      • 2025-02-20 05103, 2025

      • mayhem[m]
        s/see/C/
      • 2025-02-20 05128, 2025

      • mayhem[m]
        3.14.0 final: Tuesday, 2025-10-07
      • 2025-02-20 05133, 2025

      • mayhem[m]
        8 months out. oy.
      • 2025-02-20 05109, 2025

      • BrainzGit
        [musicbrainz-server] 14reosarevok opened pull request #3482 (03master…punish-bad-children): Don't ignore disallowed children HTML errors https://github.com/metabrainz/musicbrainz-server/…
      • 2025-02-20 05144, 2025

      • reosarevok[m]
        bitmap: MBS-13943 seems sensible, I guess - do you have any suggestions about how many it should allow in one go, or any reasons why it'll be a mess? :)
      • 2025-02-20 05144, 2025

      • BrainzBot
        MBS-13943: Lookup multiple URLs at once with the API https://tickets.metabrainz.org/browse/MBS-13943
      • 2025-02-20 05126, 2025

      • bitmap[m]
        the default max limit of 100 seems sensible to me. and we def. have a ticket for looking up multiple entities at once, just not one for URLs specifically I guess
      • 2025-02-20 05108, 2025

      • kellnerd[m]
        There is a ticket for lookups by multiple MBIDs, but nothing related to browse requests (of which URL is a special case where it is beneficial to have this).
      • 2025-02-20 05132, 2025

      • BrainzGit
        [listenbrainz-server] 14amCap1712 merged pull request #3192 (03master…fix-dump-entry): Fix dump entry sequence https://github.com/metabrainz/listenbrainz-server…
      • 2025-02-20 05106, 2025

      • kellnerd[m]
        I've linked it on Jira
      • 2025-02-20 05110, 2025

      • bitmap[m]
        oh I'm not sure why the docs classify that as a browse request, it only returns a single entity
      • 2025-02-20 05124, 2025

      • minimal joined the channel
      • 2025-02-20 05159, 2025

      • pite joined the channel
      • 2025-02-20 05146, 2025

      • bitmap[m]
        zas: looks like exim is working on isaac, thanks
      • 2025-02-20 05150, 2025

      • julian45[m]
        yvanzo: FYI, Jira still shows a banner (at least on the main page) for yesterday's maintenance
      • 2025-02-20 05128, 2025

      • zas[m]
        julian45: I removed the banner
      • 2025-02-20 05145, 2025

      • julian45[m]
        Speaking of Jira, are we running Server or Data Center? Just taking a look at release notes for a couple versions
      • 2025-02-20 05107, 2025

      • julian45[m]
        * we running/licensed, * for Server or
      • 2025-02-20 05136, 2025

      • mayhem[m]
        I forget where we are at with that -- yvanzo would know.
      • 2025-02-20 05151, 2025

      • julian45[m]
        Roger that. If it happens to be Data Center already, the current installed version (9.12.18, latest of 9.12.x LTS series) hit EoS almost exactly a year ago and will hit full EoL later this year. Atlassian has put out a 10.x series, with 10.3 being the LTS release; summary of changes across versions here: https://confluence.atlassian.com/adminjiraserver/…
      • 2025-02-20 05140, 2025

      • julian45[m]
        ...and if we're on Server, 9.12 is the last Jira version to support that license type, which is fun.
      • 2025-02-20 05113, 2025

      • julian45[m]
        Theoretically they have a planner/health checker/etc. in the Jira admin interface already, but I don't have that level of access in our Jira instance
      • 2025-02-20 05108, 2025

      • SothoTalKer__ has quit
      • 2025-02-20 05122, 2025

      • SothoTalKer joined the channel
      • 2025-02-20 05144, 2025

      • yvanzo[m]
        We have a Data Center instance.
      • 2025-02-20 05104, 2025

      • yvanzo[m]
        The EoL for the current 9.12.x (which is an LTS) is 29 November 2025.
      • 2025-02-20 05153, 2025

      • yvanzo[m]
        We should indeed upgrade to the next LTS 10.3.x (released on 05 Dec 2024) before that.
      • 2025-02-20 05101, 2025

      • yvanzo[m]
        Ideally, we should also have this handled through Ansible.
      • 2025-02-20 05139, 2025

      • yvanzo[m]
      • 2025-02-20 05140, 2025

      • BrainzBot
        OTHER-373: Migrate Tickets from Jira Server
      • 2025-02-20 05124, 2025

      • yvanzo[m]
        julian45: I just added you to Jira admins so that you can check whatever you want to. 🐞
      • 2025-02-20 05156, 2025

      • julian45[m]
        Thanks!
      • 2025-02-20 05127, 2025

      • yvanzo[m]
        You’re very welcome!
      • 2025-02-20 05110, 2025

      • BrainzGit
        [musicbrainz-server] 14mwiencek opened pull request #3483 (03master…mbs-13943): MBS-13943: Lookup multiple URLs at once with the API https://github.com/metabrainz/musicbrainz-server/…