#metabrainz

/

      • mayhem[m]
        if its ok for you, then lets wait and go for RAID-1.
      • 2025-08-12 22441, 2025

      • mayhem[m]
        <zas[m]> "It isn't very convenient to work..." <- absolute since start is fine.
      • 2025-08-12 22409, 2025

      • SigHunter has quit
      • 2025-08-12 22418, 2025

      • SigHunter joined the channel
      • 2025-08-12 22444, 2025

      • lucifer[m]
        mayhem: i think both solutions are raid-1, just 16tb vs 22tb.
      • 2025-08-12 22445, 2025

      • mayhem[m]
        ah, sorry. I think 16TB is enough
      • 2025-08-12 22448, 2025

      • mayhem[m]
        but its not a lot of growth space. let me see if can estimate the potential disk usage. hang on.
      • 2025-08-12 22401, 2025

      • petitminion joined the channel
      • 2025-08-12 22458, 2025

      • mayhem[m]
        woah. that sucked 221G of disk overnight.
      • 2025-08-12 22440, 2025

      • mayhem[m]
        assuming that what has been downloaded is representative of what will be downloaded, we would need 11.3TB of disk.
      • 2025-08-12 22439, 2025

      • mayhem[m]
        4.7TB free space would allows us to grow 2.8M more covers. which is nearly 50%.
      • 2025-08-12 22402, 2025

      • mayhem[m]
        zas: I 16TB of space will be enough. please proceed with that option.
      • 2025-08-12 22439, 2025

      • mayhem[m] used math taught by in 3rd grade to calculate that, lol.
      • 2025-08-12 22407, 2025

      • zas[m]
        Ok, I'll order
      • 2025-08-12 22456, 2025

      • zas[m]
        Ordered, once ready I'll set it up and I'll tell you when ready
      • 2025-08-12 22453, 2025

      • mayhem[m]
        I'll finish the monitor and put it into a docker container.
      • 2025-08-12 22418, 2025

      • d4rkie has quit
      • 2025-08-12 22448, 2025

      • d4rkie joined the channel
      • 2025-08-12 22438, 2025

      • d4rkie has quit
      • 2025-08-12 22404, 2025

      • d4rkie joined the channel
      • 2025-08-12 22422, 2025

      • mamanullah7[m] joined the channel
      • 2025-08-12 22422, 2025

      • mamanullah7[m]
        Hey lucifer any update about fw! Everything is working for me! https://github.com/metabrainz/listenbrainz-server…
      • 2025-08-12 22445, 2025

      • mayhem[m]
        zas: this is the monitoring endpoints output:
      • 2025-08-12 22446, 2025

      • mayhem[m]
        {... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/FieJIRwgkYlhKxngfkBAqseF>)
      • 2025-08-12 22453, 2025

      • mayhem[m]
        look ok?
      • 2025-08-12 22426, 2025

      • zas[m]
        What are each field exactly?
      • 2025-08-12 22416, 2025

      • mayhem[m]
        rate == current download rate per second.
      • 2025-08-12 22426, 2025

      • mayhem[m]
        errors == how many files failed to download
      • 2025-08-12 22434, 2025

      • mayhem[m]
        downdloaded == how many succeeded
      • 2025-08-12 22451, 2025

      • mayhem[m]
        total == total to download since start.
      • 2025-08-12 22400, 2025

      • mayhem[m]
        happy to rename them if you wish
      • 2025-08-12 22416, 2025

      • zas[m]
        Well, the measurement can be file_download or smt, so file_download.rate / errors / ... makes sense
      • 2025-08-12 22456, 2025

      • zas[m]
        rate isn't strictly needed (if we have a number of downloads since start it can be calculated)
      • 2025-08-12 22414, 2025

      • mayhem[m]
        remove it then?
      • 2025-08-12 22427, 2025

      • mayhem[m]
        actually, no I prefer to use this one.
      • 2025-08-12 22444, 2025

      • mayhem[m]
        because it accurate over what is doing on. more so than from stats.
      • 2025-08-12 22448, 2025

      • mayhem[m]
        derived stats
      • 2025-08-12 22412, 2025

      • zas[m]
        np in keeping it
      • 2025-08-12 22424, 2025

      • mayhem[m]
        {... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/RVxtCDhlCIEVczjMYZIaPaef>)
      • 2025-08-12 22426, 2025

      • mayhem[m]
        how is that?
      • 2025-08-12 22409, 2025

      • d4rkie has quit
      • 2025-08-12 22453, 2025

      • d4rkie joined the channel
      • 2025-08-12 22452, 2025

      • mayhem[m]
        lucifer: around?
      • 2025-08-12 22443, 2025

      • mayhem[m]
        bitmap: zas : anyone around to help with a quick consul config in python question?
      • 2025-08-12 22403, 2025

      • mayhem[m]
        mingus:~/metabrainz/caa-backup->ls docker/
      • 2025-08-12 22403, 2025

      • mayhem[m]
        consul_config.py.ctmpl consul-template.conf
      • 2025-08-12 22426, 2025

      • mayhem[m]
        I've got these two consul config files. my Dockerfile contains:
      • 2025-08-12 22437, 2025

      • mayhem[m]
        COPY ./docker/consul-template.conf /etc/consul-template.conf
      • 2025-08-12 22457, 2025

      • mayhem[m]
        but no config file gets generated when the container starts. I am missing a step -- which one?
      • 2025-08-12 22420, 2025

      • petitminion has quit
      • 2025-08-12 22442, 2025

      • zas[m]
        Around
      • 2025-08-12 22455, 2025

      • mayhem[m]
        see above plz
      • 2025-08-12 22401, 2025

      • mayhem[m]
        is the /etc/consul-template.conf enough to invoke consul to create the config files?
      • 2025-08-12 22435, 2025

      • bitmap[m]
        mayhem: I think consul-template needs to be ran, the Dockerfile just has `CMD python3 ./caa_downloader.py`
      • 2025-08-12 22445, 2025

      • mayhem[m]
        do you know of an example I can look at?
      • 2025-08-12 22454, 2025

      • mayhem[m]
        the LB container doesn't seem to have that.
      • 2025-08-12 22457, 2025

      • mayhem[m]
        COPY ./docker/mapper.service /etc/service/mapper/run
      • 2025-08-12 22403, 2025

      • mayhem[m]
        maybe that?
      • 2025-08-12 22449, 2025

      • bitmap[m]
        yeah, likely
      • 2025-08-12 22452, 2025

      • bitmap[m]
      • 2025-08-12 22455, 2025

      • mayhem[m]
        yes, that leads to what I am loking for.
      • 2025-08-12 22456, 2025

      • mayhem[m]
        thanks!
      • 2025-08-12 22459, 2025

      • bitmap[m]
        consul-template might have trouble restarting this process though (with the threading and all)
      • 2025-08-12 22430, 2025

      • mayhem[m]
        I did end up cleaning that up, but we'll see if that is enough.
      • 2025-08-12 22459, 2025

      • monkey[m]
        Huh. Github had a brief stroke and almost gave me one...
      • 2025-08-12 22401, 2025

      • monkey[m] uploaded an image: (36KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/xOSDQMOULLJLSkoSfKgqLtfc/image.png >
      • 2025-08-12 22423, 2025

      • Jade[m]
        GitHub UI feels like it's just getting worse and worse
      • 2025-08-12 22400, 2025

      • mayhem[m]
        and with the github CEO gone, its only a matter of time.
      • 2025-08-12 22425, 2025

      • julian45[m]
        Jade[m]: i read somewhere that all new github UI development for some time has been in react... so not surprised that not only is it getting slower and slower, shit like this is happening
      • 2025-08-12 22403, 2025

      • reosarevok[m]
        Yeah, they should be using Template Toolkit!
      • 2025-08-12 22420, 2025

      • mayhem[m]
        wow. reosarevok
      • 2025-08-12 22413, 2025

      • julian45[m]
        that said, we in MeB (well, not me, more like reosarevok , bitmap et al) have done a good job IMO of keeping MB's react-ified areas snappy, but it seems like it's unfortunately very easy to make react-heavy sites slow if one isn't careful to avoid that
      • 2025-08-12 22407, 2025

      • bitmap[m]
        true, it's very easy to use improperly where clicking a button causes the whole page to re-render lol
      • 2025-08-12 22424, 2025

      • mayhem[m]
        bitmap: do you understand the consul_config.ctmp format?
      • 2025-08-12 22425, 2025

      • mayhem[m]
        {{if service "pgbouncer-slave"}}... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/YsZUJopEAlesiRAtdnlPuPMR>)
      • 2025-08-12 22439, 2025

      • mayhem[m]
        I just need a connect string for the pg-slave.
      • 2025-08-12 22445, 2025

      • mayhem[m]
        the above errors out with:
      • 2025-08-12 22408, 2025

      • mayhem[m]
        2025-08-12T15:16:21.376Z [WARN] (view) health.service(pgbouncer-slave|passing): Get "http://127.0.0.1:8500/v1/health/service/pgbouncer-slave?passing=1&stale=&wait=60000ms": dial tcp 127.0.0.1:8500: connect: connection refused (retry attempt 2 after "500ms")
      • 2025-08-12 22409, 2025

      • mayhem[m]
        2025-08-12T15:16:21.376Z [ERR] (runner) sending server error back to caller
      • 2025-08-12 22405, 2025

      • bitmap[m]
        hmm, which host is the container on?
      • 2025-08-12 22419, 2025

      • mayhem[m]
        mingus for now, but will be on newhost soon.
      • 2025-08-12 22410, 2025

      • bitmap[m]
        looks like it's having trouble connecting to consul on port 8500 at all
      • 2025-08-12 22408, 2025

      • mayhem[m]
        ok, thanks. let me pester @zas about it.
      • 2025-08-12 22416, 2025

      • bitmap[m]
        I think you need to use the private 10.10.x IP for the consul host
      • 2025-08-12 22427, 2025

      • bitmap[m]
        rather than 127.0.0.1
      • 2025-08-12 22442, 2025

      • mayhem[m]
        where is the sepcified?
      • 2025-08-12 22450, 2025

      • mayhem[m]
        services.sh?
      • 2025-08-12 22415, 2025

      • mayhem[m]
        ah, I dont pass those evn params!
      • 2025-08-12 22437, 2025

      • bitmap[m]
        that run-consul-template script passes it via CONSUL_HOST env variable: https://github.com/metabrainz/docker-consul-templ…
      • 2025-08-12 22441, 2025

      • zas[m]
        Yes, use 10.10.10.73:8500
      • 2025-08-12 22458, 2025

      • mayhem[m]
        that does it. thanks @zas, bitmap
      • 2025-08-12 22441, 2025

      • monkey[m]
        A new low for the Spotify developer forums, now we can't share workarounds for long-standing bugs:
      • 2025-08-12 22443, 2025

      • monkey[m] uploaded an image: (20KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/KiWHrUvREoACZHjFPGFQRoLv/image.png >
      • 2025-08-12 22407, 2025

      • mayhem[m]
        evil is as evil does.
      • 2025-08-12 22426, 2025

      • julian45[m]
        kellnerd: sorry to bug you again, but apple music seems to be throwing harmony off kilter again
      • 2025-08-12 22451, 2025

      • kellnerd[m]
        Hmm, this time it's not the usual, unexplained HTTP 403 errors but HTTP 502 Bad Gateway
      • 2025-08-12 22453, 2025

      • kellnerd[m]
        The website still doesn't show HTTP status codes as part of the message, right?
      • 2025-08-12 22433, 2025

      • bwebbo[m] joined the channel
      • 2025-08-12 22433, 2025

      • bwebbo[m]
        Hello! I'm using postgres data dumps - would someone please be able to advise which dump should contain data for the "*_first_release_date" tables?
      • 2025-08-12 22400, 2025

      • lucifer[m]
        mayhem: around now
      • 2025-08-12 22424, 2025

      • mayhem[m]
        lucifer[m]: thanks, but I got unstuck. :)
      • 2025-08-12 22453, 2025

      • lucifer[m]
        👍️
      • 2025-08-12 22436, 2025

      • bitmap[m]
        <bwebbo[m]> "Hello! I'm using postgres data..." <- hi, those aren't contained in a dump, but have to be built manually; you can do that with a command:... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/NhrmJmuNkxROJZlXzwJLnPbP>)
      • 2025-08-12 22406, 2025

      • bitmap[m]
        (this is documented in INSTALL.md)
      • 2025-08-12 22434, 2025

      • bwebbo[m]
        Thanks for your help!
      • 2025-08-12 22402, 2025

      • __BrainzGit
        [listenbrainz-server] 14MonkeyDo opened pull request #3340 (03master…LB-1815): LB-1815: "Open in MusicBrainz" sohuld open in MB https://github.com/metabrainz/listenbrainz-server…
      • 2025-08-12 22403, 2025

      • BrainzBot
        LB-1815: 'Open in MusicBrainz' listen menu item opens recording in ListenBrainz https://tickets.metabrainz.org/browse/LB-1815
      • 2025-08-12 22458, 2025

      • milkii
        https://github.com/mixxxdj/mixxx/issues/14897 re new Mixxx multi-genre PRs, fyi fwiw
      • 2025-08-12 22407, 2025

      • petitminion joined the channel
      • 2025-08-12 22415, 2025

      • petitminion has quit
      • 2025-08-12 22431, 2025

      • suvid[m]
        Hi monkey
      • 2025-08-12 22431, 2025

      • suvid[m]
        I need some help in starting writing frontend tests for the listens importer
      • 2025-08-12 22431, 2025

      • suvid[m]
        As I can see there exists no tests for user data export as well, or I may be missing something
      • 2025-08-12 22404, 2025

      • suvid[m]
        lucifer: I completed all the backend improvements you suggested
      • 2025-08-12 22404, 2025

      • suvid[m]
        Just the tests part is left
      • 2025-08-12 22404, 2025

      • suvid[m]
        It seems a bit boring ngl 😅
      • 2025-08-12 22438, 2025

      • petitminion joined the channel
      • 2025-08-12 22459, 2025

      • lucifer[m]
        fair but its mandatory to ensure the feature doesn't break out of the blue.
      • 2025-08-12 22421, 2025

      • suvid[m]
        yes, definitely
      • 2025-08-12 22405, 2025

      • mamanullah7[m]
        lucifer: is there any update on fw part
      • 2025-08-12 22453, 2025

      • lucifer[m]
        m.amanullah7: not yet
      • 2025-08-12 22403, 2025

      • lucifer[m]
        will get to it this week
      • 2025-08-12 22453, 2025

      • rayyan_seliya123 joined the channel
      • 2025-08-12 22454, 2025

      • rayyan_seliya123
        <rayyan_seliya123> "Hey lucifer: I worked on..." <- Hey lucifer: I have updated the backend code in this new pr can have a look also updated some frontend part too waiting for your review!
      • 2025-08-12 22409, 2025

      • mamanullah7[m]
        @lucifer sure! I’ll start working on navidrome part from tomorrow can’t sit long on screen now until I fully recover!
      • 2025-08-12 22427, 2025

      • lucifer[m]
        no worries, take care!
      • 2025-08-12 22405, 2025

      • mamanullah7[m]
        I need some suggestion also regarding md5 hashing and storing user credentials and handling random salts while requesting each time !! Will discuss about this when u have moment later this week or next week when u have some moments!
      • 2025-08-12 22440, 2025

      • rayyan_seliya123
        Hey monkey: can have a look into my frontend pr fixed some volume bar issue also the toggling effect-colour of internet archive https://github.com/metabrainz/listenbrainz-server…
      • 2025-08-12 22405, 2025

      • mamanullah7[m]
        * next week!
      • 2025-08-12 22445, 2025

      • julian45[m]
        <kellnerd[m]> "The website still doesn't show..." <- correct
      • 2025-08-12 22450, 2025

      • __BrainzGit
        [musicbrainz-server] 14mwiencek opened pull request #3607 (03master…mbs-14125): MBS-14125: Handle redirected MBIDs in the autocomplete's recent items https://github.com/metabrainz/musicbrainz-server/…
      • 2025-08-12 22450, 2025

      • BrainzBot
        MBS-14125: If the "Recent Items" contains merged (to another) entities, JS try to load that entity infinitely https://tickets.metabrainz.org/browse/MBS-14125
      • 2025-08-12 22414, 2025

      • __BrainzGit
        [musicbrainz-server] 14mwiencek opened pull request #3608 (03master…mbs-12524): MBS-12524: Improve performance of cover art uploader https://github.com/metabrainz/musicbrainz-server/…
      • 2025-08-12 22414, 2025

      • BrainzBot
        MBS-12524: Improve performance of cover art uploader https://tickets.metabrainz.org/browse/MBS-12524