jasje: did you answer the LB login error email? Can I archive it? :)
2025-12-01 33516, 2025
_BrainzGit
[listenbrainz-server] 14amCap1712 merged pull request #3415 (03master…cache-donors): is_user_eligible_donor should be called with mb row id not lb id https://github.com/metabrainz/listenbrainz-server…
reosarevok: jasje had replied just to me, i replied to the user now.
2025-12-01 33529, 2025
jasje[m] joined the channel
2025-12-01 33529, 2025
jasje[m]
<reosarevok[m]> "jasje: did you answer the LB..." <- I did reply, but to lucifer’s email.
2025-12-01 33519, 2025
reosarevok[m]
Ok, thanks!
2025-12-01 33545, 2025
tykling_ is now known as Tykling
2025-12-01 33501, 2025
rcombs has quit
2025-12-01 33551, 2025
rcombs joined the channel
2025-12-01 33543, 2025
monkey[m] joined the channel
2025-12-01 33543, 2025
TOPIC: MetaBrainz Community and Development channel | MusicBrainz non-development: #musicbrainz | BookBrainz: #bookbrainz | Channel is logged and not empty as it is bridged to IRC; see https://musicbrainz.org/doc/ChatBrainz for details | Agenda: Reviews, LLM code contribution guidelines
lucifer: LB prod is returning 500's, and I see the logs are filling very very fast with a redis error. Can you please have a look?
2025-12-01 33540, 2025
monkey[m]
MISCONF Redis is configured to save RDB snapshots, but it's currently unable to persist to disk. Commands that may modify the data set are disabled, because this instance is configured to report errors during writes if RDB snapshotting fails
2025-12-01 33512, 2025
monkey[m]
I think listens submission might be borked because of that too
2025-12-01 33501, 2025
monkey[m]
cc mayhem
2025-12-01 33559, 2025
mayhem[m]
Related to kiss being out of disk?
2025-12-01 33509, 2025
monkey[m]
Something related to how we increment the ratelimit in redis
2025-12-01 33516, 2025
mayhem[m]
Let me remove an old dump to free space
2025-12-01 33538, 2025
monkey[m]
This is throwing on all /submit-listen POST requests cache.increment(self.key, namespace=ratelimit_cache_namespace)
2025-12-01 33533, 2025
mayhem[m]
the rate limits for users are being stored in redis, so yes.
2025-12-01 33547, 2025
mayhem[m]
ok, no longer out of disk space. thats a start.
2025-12-01 33521, 2025
lucifer[m]
monkey, mayhem: yes it was disk space.
2025-12-01 33534, 2025
lucifer[m]
i'll check and see what can be moved around.
2025-12-01 33542, 2025
mayhem[m]
have things recovered now?
2025-12-01 33543, 2025
lucifer[m]
i stopped the ongoing dump to fix it.
2025-12-01 33559, 2025
mayhem[m]
ok, if you're on it, then I'll leave you to it.
2025-12-01 33501, 2025
ansh[m] joined the channel
2025-12-01 33501, 2025
ansh[m]
<lucifer[m]> "[@mayhem:chatbrainz.org](https:/..." <- Works for me
2025-12-01 33506, 2025
mayhem[m] is operating on 1/2 brain cell
2025-12-01 33507, 2025
lucifer[m]
yes
2025-12-01 33513, 2025
lucifer[m]
back up now
2025-12-01 33508, 2025
lucifer[m]
hmm, i wonder if we should remove the ratelimit on submit-listen endpoint if redis fails.