#metabrainz

/

      • bitmap[m]
        hmm, I think the problem is that the LB web container didn't reload uwsgi when I put the old pgbouncer container into maintenance mode. this template block in /etc/consul-template-uwsgi.conf looks suspect since it has no command/exec setting:... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/...>)
      • lucifer: is my understanding of the consul-template config correct? if so, can it be changed to reload uwsgi when config.py changes?
      • derat[m] has quit
      • snobdiggy29283 has quit
      • allen has quit
      • minimal has quit
      • ansh[m] has quit
      • lucifer[m]
      • bitmap[m]
        that seems problematic since the workers have to be restarted if the config changes, right?
      • zas: hey, can you configure gmail to allow exim relay on isaac? (logging off now but I can move them tomorrow)
      • lucifer[m]
        yes, i think so. i'll discuss with monkey on the rationale.
      • aerozol[m]
        mayhem: 🥳 v
      • Aerozol[m]1 joined the channel
      • Aerozol[m]1 uploaded an image: (17KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/zcAxxQAkKnBzmftKQlQTuboT/image.png >
      • pite has quit
      • dabeglavins3 has quit
      • dabeglavins3 joined the channel
      • BrainzGit
        [bookbrainz-site] 14shalini-bhandari opened pull request #1154 (03master…replace-twitter): fix: Replaced Twitter logo and link with Mastodon and Bluesky https://github.com/metabrainz/bookbrainz-site/p...
      • Kladky joined the channel
      • allen joined the channel
      • adhawkins has quit
      • adhawkins joined the channel
      • holycow23[m] joined the channel
      • holycow23[m]
        I wanted to work on the user-stats is there any method by which I can get some stats in my local spark so I could test the generation and retrieval of new stats?
      • elkiensad[m] joined the channel
      • elkiensad[m]
        <Aerozol[m]1> "image.png" <- yeah the lists are getting better
      • mayhem[m]
        elkiensad[m]: and that is only because new users joining. we haven't made any improvements.
      • elkiensad[m]
        The number of listens of persons I have made a create account on ListenBrainz has reached around ~1012364
      • 2 of them are in the top 2 rows of my similarity chart with 24% and 26%
      • and i can tell generated lists are mostly copying their tastes at this moment
      • reosarevok[m]
        Oh, so it's an Estonian/Finnish paradise
      • Get music recommendations from your friends without actually having to talk to them!
      • BrainzGit
        [listenbrainz-server] 14amCap1712 opened pull request #3189 (03master…optimize-fresh-releases): Optimize fresh releases generation https://github.com/metabrainz/listenbrainz-serv...
      • mayhem[m]
        lucifer: would you do me a favor and see why daily jams failed last night?
      • lucifer[m]
        Not enough listens in playlist, [@mayhem:chatbrainz.org](https://matrix.to/#/@mayhem:chatbrainz.org)
      • mayhem[m]
        ah, yes. I could've foreseen that. ok, thanks for checking.
      • kellnerd[m] joined the channel
      • kellnerd[m]
        I couldn't believe there is no ticket for a faster MB API endpoint to lookup multiple URLs and map them to MBIDs (or at least I couldn't find it), so I finally created MBS-13943.
      • BrainzBot
        MBS-13943: Lookup multiple URLs at once with the API https://tickets.metabrainz.org/browse/MBS-13943
      • BrainzGit
        [listenbrainz-server] 14amCap1712 opened pull request #3190 (03master…fix-intermediate-stats): Fix get_intermediate_stats_df https://github.com/metabrainz/listenbrainz-serv...
      • [listenbrainz-server] 14amCap1712 merged pull request #3189 (03master…optimize-fresh-releases): Optimize fresh releases generation https://github.com/metabrainz/listenbrainz-serv...
      • [listenbrainz-server] 14amCap1712 merged pull request #3190 (03master…fix-intermediate-stats): Fix get_intermediate_stats_df https://github.com/metabrainz/listenbrainz-serv...
      • suvid[m] has quit
      • allen has quit
      • lucifer[m]
        mayhem: hi, can you please review https://github.com/metabrainz/listenbrainz-serv... ?
      • mayhem[m]
        done
      • lucifer[m]
        thanks
      • BrainzGit
        [listenbrainz-server] 14amCap1712 merged pull request #3188 (03master…delete-users-record): Add a table to record listen history deletion https://github.com/metabrainz/listenbrainz-serv...
      • [listenbrainz-server] release 03v-2025-02-20.0 has been published by 14github-actions[bot]: https://github.com/metabrainz/listenbrainz-serv...
      • bitmap[m]
        mayhem: lucifer: we'll run the database switchover in about an hour if there are any cron jobs you need to pause
      • mthax has quit
      • mthax joined the channel
      • mthax has quit
      • mthax joined the channel
      • mayhem[m]
        lucifer: you about?
      • If a Cron job fires up during the outage, will it mess with your setup, bitmap?
      • If the jobs fail, no biggie for me
      • bitmap[m]
        I don't think so, just a safety precaution
      • lucifer[m]
        mayhem: yes
      • mayhem[m]
        bitmap[m]: Ok, will do.
      • lucifer: can you prepare your side of Cron jobs for the downtime?
      • lucifer[m]
        i stopped both cron containers.
      • mayhem[m]
        I'll take the mapping container down before the outage
      • lucifer[m]
        i stopped the mapping cron container already.
      • the mapping writer is still running though.
      • bitmap[m]
        thx, the scripts that shutdown the db will forcibly terminate existing connections, so just making sure it doesn't cause a mess of any active scripts
      • mayhem[m]
        Ok
      • reosarevok[m]
        Aerozol: when you have some time, see MBS-13944 - it's not urgent, but I'd really like some advice. Open to others too, of course :)
      • BrainzBot
        MBS-13944: Make empty select rows more accessible https://tickets.metabrainz.org/browse/MBS-13944
      • bitmap[m]
        I'll bring services down on the gateway in a minute
      • done, going through the switchover steps now
      • mayhem: lucifer: you may have to restart the lb web container again
      • mayhem[m]
        restarting.
      • lucifer[m]
        done
      • mayhem[m]
        LB back up.
      • bitmap[m]
        MB is back
      • mayhem[m]
        is the whole changeover done?
      • can we restart cron containers?
      • monkey[m]
        BB back up to, forgot to say
      • bitmap[m]
        mayhem[m]: yeah, everything's back up an running, feel free to restart cron
      • mayhem[m]
        k
      • lucifer: mapping container started.
      • zas[m] joined the channel
      • zas[m]
        bitmap: tell me once we have one of jimmy or hendrix free, so I can retire them.
      • bitmap[m]
        zas: jimmy is now free, hendrix still has containers that need to be moved
      • btw did you see my message about exim relays?
      • zas[m]
        ah nope, missed it, I'll check that right now
      • BrainzGit
        [listenbrainz-server] 14MonkeyDo opened pull request #3191 (03master…fix-add-listens-modal): LB-1735: Rework recording/album search regular expressions https://github.com/metabrainz/listenbrainz-serv...
      • nbin has quit
      • monkey[m]
        That switchover was smooth as butter 👏
      • nbin joined the channel
      • mayhem[m]
        yes, very impressive @bitmap!
      • bitmap[m]
        yeah, repmgr makes everything pretty easy nowadays 🙂
      • zas[m]
        bitmap: check if email relays work, I added the config now
      • mayhem[m]
        zas: outsidecontext juliam and anyone else who might know.... uwsgi (python app server) uses a multi-process model and not a multi-threading model.
      • is the primary motivation for this the GIL?
      • BrainzGit
        [listenbrainz-server] 14amCap1712 opened pull request #3192 (03master…fix-dump-entry): Fix dump entry sequence https://github.com/metabrainz/listenbrainz-serv...
      • zas[m]
        mayhem: very likely
      • outsidecontext[m
        mayhem: very likely
      • :D
      • zas[m]
        ahah
      • mayhem[m]
        because for the new fuzzy mapping server, making a multi-process version is going to be a serious pain, but deploying with python 13 with no GIL would be possible
      • nice to get very clear answers. :)
      • zas[m]
        but 3.13 no GIL is still experimental, so perhaps a bit too soon
      • mayhem[m]
        yeah, a bit worried about that.
      • but making a multi-process version of this would mean using shared memory, which might be impossible to accomplish.
      • outsidecontext[m
        I'm really curious about how this performs in various scenarios, but I haven't tested it yet myself. But according to the release notes single threaded performance seems to be rather highly impacted by this, and there is a lot they want to improve for 3.14.
      • mayhem: Yes. This is roughly how the discussion about using processes in Picard instead of threads because of GIL came to a halt
      • zas[m]
      • mayhem[m]
        zas: we use some serious magic libs to make this matching happen (nmslib) and it would need to support buffers being passed in so that everything could be running on shared memory.
      • this code is amazing, unsupported and doesn't even have support for being serialized out to disk.
      • its its hands down better and faster than anything else I've ever used.
      • s/its/and/
      • I might need to write this thing in C++ then.
      • maybe I can do it and see and save my dignity
      • s/see/C/
      • 3.14.0 final: Tuesday, 2025-10-07
      • 8 months out. oy.
      • BrainzGit
        [musicbrainz-server] 14reosarevok opened pull request #3482 (03master…punish-bad-children): Don't ignore disallowed children HTML errors https://github.com/metabrainz/musicbrainz-serve...
      • reosarevok[m]
        bitmap: MBS-13943 seems sensible, I guess - do you have any suggestions about how many it should allow in one go, or any reasons why it'll be a mess? :)
      • BrainzBot
        MBS-13943: Lookup multiple URLs at once with the API https://tickets.metabrainz.org/browse/MBS-13943
      • bitmap[m]
        the default max limit of 100 seems sensible to me. and we def. have a ticket for looking up multiple entities at once, just not one for URLs specifically I guess
      • kellnerd[m]
        There is a ticket for lookups by multiple MBIDs, but nothing related to browse requests (of which URL is a special case where it is beneficial to have this).
      • BrainzGit
        [listenbrainz-server] 14amCap1712 merged pull request #3192 (03master…fix-dump-entry): Fix dump entry sequence https://github.com/metabrainz/listenbrainz-serv...
      • kellnerd[m]
        I've linked it on Jira
      • bitmap[m]
        oh I'm not sure why the docs classify that as a browse request, it only returns a single entity
      • minimal joined the channel
      • pite joined the channel
      • zas: looks like exim is working on isaac, thanks
      • julian45[m]
        yvanzo: FYI, Jira still shows a banner (at least on the main page) for yesterday's maintenance
      • zas[m]
        julian45: I removed the banner
      • julian45[m]
        Speaking of Jira, are we running Server or Data Center? Just taking a look at release notes for a couple versions
      • * we running/licensed, * for Server or
      • mayhem[m]
        I forget where we are at with that -- yvanzo would know.
      • julian45[m]
        Roger that. If it happens to be Data Center already, the current installed version (9.12.18, latest of 9.12.x LTS series) hit EoS almost exactly a year ago and will hit full EoL later this year. Atlassian has put out a 10.x series, with 10.3 being the LTS release; summary of changes across versions here: https://confluence.atlassian.com/adminjiraserve...
      • ...and if we're on Server, 9.12 is the last Jira version to support that license type, which is fun.
      • Theoretically they have a planner/health checker/etc. in the Jira admin interface already, but I don't have that level of access in our Jira instance
      • SothoTalKer__ has quit
      • SothoTalKer joined the channel
      • yvanzo[m]
        We have a Data Center instance.
      • The EoL for the current 9.12.x (which is an LTS) is 29 November 2025.
      • We should indeed upgrade to the next LTS 10.3.x (released on 05 Dec 2024) before that.
      • Ideally, we should also have this handled through Ansible.
      • BrainzBot
        OTHER-373: Migrate Tickets from Jira Server
      • yvanzo[m]
        julian45: I just added you to Jira admins so that you can check whatever you want to. 🐞
      • julian45[m]
        Thanks!
      • yvanzo[m]
        You’re very welcome!
      • BrainzGit
        [musicbrainz-server] 14mwiencek opened pull request #3483 (03master…mbs-13943): MBS-13943: Lookup multiple URLs at once with the API https://github.com/metabrainz/musicbrainz-serve...