zas: thanks, I'm happy to move test.mb somewhere else, just not sure where...it used to run on aretha, but was unusable there (most requests would just time out)
2025-08-12 22411, 2025
d4rkie has quit
2025-08-12 22443, 2025
d4rkie joined the channel
2025-08-12 22442, 2025
bitmap[m]
only these nodes don't have a musicbrainz-website-prod container: aretha, cesaria, gaga, kiss, mingus, quest, rex, rudi
2025-08-12 22439, 2025
Maxr1998_ has quit
2025-08-12 22416, 2025
Maxr1998 joined the channel
2025-08-12 22401, 2025
aerozol[m]
Hi Chris! You can make tickets to add new social media and streaming service links. It's helpful if you include a bit of a blurb as to why it should be added. You can clone an existing ticket and then edit it to fit, like: https://tickets.metabrainz.org/browse/STYLE-2479
2025-08-12 22401, 2025
BrainzBot
STYLE-2479: Add audioculture.co.nz to the other databases whitelist
2025-08-12 22448, 2025
Chris[m]12
<aerozol[m]> "Hi Chris! You can make tickets..." <- Thanks! I'll do that soon!
2025-08-12 22457, 2025
d4rkie has quit
2025-08-12 22427, 2025
d4rkie joined the channel
2025-08-12 22417, 2025
d4rkie has quit
2025-08-12 22403, 2025
d4rkie joined the channel
2025-08-12 22425, 2025
__BrainzGit
[bookbrainz-site] 14dependabot[bot] opened pull request #1177 (03master…dependabot/npm_and_yarn/elastic/elasticsearch-9.1.1): chore(deps): bump @elastic/elasticsearch from 5.6.22 to 9.1.1 https://github.com/metabrainz/bookbrainz-site/pul…
2025-08-12 22427, 2025
__BrainzGit
[bookbrainz-site] 14dependabot[bot] closed pull request #1176 (03master…dependabot/npm_and_yarn/elastic/elasticsearch-9.1.0): chore(deps): bump @elastic/elasticsearch from 5.6.22 to 9.1.0 https://github.com/metabrainz/bookbrainz-site/pul…
<aerozol[m]> "suvid: question for you btw..." <- Let me look into it in the evening today
2025-08-12 22423, 2025
SigHunter has quit
2025-08-12 22440, 2025
SigHunter joined the channel
2025-08-12 22453, 2025
lusciouslover has quit
2025-08-12 22442, 2025
lusciouslover joined the channel
2025-08-12 22434, 2025
d4rkie has quit
2025-08-12 22414, 2025
d4rkie joined the channel
2025-08-12 22429, 2025
Zhele has quit
2025-08-12 22434, 2025
Zhele joined the channel
2025-08-12 22434, 2025
zas[m]
mayhem: caa backup on mingus eats all disk space, causing forums to fail
2025-08-12 22459, 2025
zas[m]
I reclaimed a bit of disk space and killed caa_downloader.py
2025-08-12 22448, 2025
zas[m]
I'm thinking about getting a new machine to run musicbrainz-website-test (to isolate it), we could also use it for caa backup (which could be on a storage)
2025-08-12 22426, 2025
zas[m]
ping me when caffeinated enough
2025-08-12 22415, 2025
d4rkie has quit
2025-08-12 22441, 2025
d4rkie joined the channel
2025-08-12 22406, 2025
mayhem[m]
Shit, already? Sorry!
2025-08-12 22422, 2025
mayhem[m]
Coffee soon, just waking up
2025-08-12 22456, 2025
mayhem[m]
coffee in hand, not in veins. :)
2025-08-12 22451, 2025
mayhem[m]
CAA backup is going to need a LOT of disk over 10TB, IIRC. I think a hetzner storage box is required. so, if we connect that to mingus and never write to local disk the forums will never know.
2025-08-12 22403, 2025
zas[m]
It can work, getting a storage box is the way to go, I can set it up, and link it to mingus if you're ok
2025-08-12 22434, 2025
mayhem[m]
yes, but. Samba connection are unreliable. I've always had problems with them.
2025-08-12 22443, 2025
mayhem[m]
let me review what other options we have.
2025-08-12 22456, 2025
mayhem[m]
(for storage box conn)
2025-08-12 22412, 2025
zas[m]
ok, I was also thinking about getting a new machine
2025-08-12 22428, 2025
mayhem[m]
Bx41 is what we need
2025-08-12 22429, 2025
zas[m]
to separate mb test containers from prod servers
2025-08-12 22409, 2025
mayhem[m]
storage boxes have an HTTPS interface. I wonder if that is for storage as well as fetching.
2025-08-12 22441, 2025
mayhem[m]
go ahead and get the BX41 storage box.
2025-08-12 22403, 2025
mayhem[m]
if we do a SAMBA connection, is there a way to monitor it?
2025-08-12 22425, 2025
mayhem[m]
if hetzner does maintenance, it disconnects and then needs to be reconnected.
2025-08-12 22430, 2025
mayhem[m]
it feels brittle.
2025-08-12 22449, 2025
zas[m]
mingus out of disk space again, can you delete some stuff so at least forums still work
2025-08-12 22421, 2025
mayhem[m]
85% space now.
2025-08-12 22436, 2025
d4rkie has quit
2025-08-12 22458, 2025
lucifer[m]
mayhem: it seems https access is only through webdav.
2025-08-12 22404, 2025
d4rkie joined the channel
2025-08-12 22414, 2025
mayhem[m]
yeah, not great.
2025-08-12 22425, 2025
lucifer[m]
but there's also scp and rsync.
2025-08-12 22431, 2025
mayhem[m]
I need to periodically scan the collection and webdav would be PAINFUL
2025-08-12 22453, 2025
mayhem[m]
lucifer[m]: even painfuller.
2025-08-12 22427, 2025
mayhem[m]
I think SMB with some monitoring and we could be ok
2025-08-12 22428, 2025
lucifer[m]
should be possible to download a 1GB/1000 items on mingus then scp/rsync it. delete local dir and loop again.
It isn't very convenient to work with dates as values, but we can have number of items fetched (absolute since start), so we can easily have a rate and check if no fetched items since a while (rate = 0 for a certain time -> alert)
2025-08-12 22406, 2025
zas[m]
feasible?
2025-08-12 22448, 2025
zas[m]
redis command count can work perhaps
2025-08-12 22440, 2025
zas[m]
mayhem: such config would take few days to set up, would 2x16Tb be enough (one can be set up in few minutes)?
2025-08-12 22401, 2025
zas[m] uploaded an image: (80KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/matrix.org/OhDbqkHOzeFwgYugdseYbqCj/image.png >
2025-08-12 22406, 2025
zas[m]
"Processing time: usually several working days"
2025-08-12 22430, 2025
zas[m] uploaded an image: (82KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/matrix.org/qtDkNLeXLGyURjmpfOSvFZgy/image.png >
2025-08-12 22404, 2025
zas[m]
If not urgent, I guess few days isn't an issue
2025-08-12 22445, 2025
mayhem[m]
how comfortable are we having the CAA backup without redudancy?
