zas: not sure why, but these errors have become fairly common inside the json dumps container on isaac (happened 22 times this month): "Can't connect to metabrainz.org:443 (Connection reset by peer)"
2025-10-21 29442, 2025
bitmap[m]
I'm adding some retry logic to admin/replication/LoadReplicationChanges so that it doesn't crash the script
When did the format of the CAA JSON change? The 'id' for an image used to be a string, it now appears to be a number. libcaa is broken for retrieving that as a result.
So I expect it was somewhere in between those years?
2025-10-21 29436, 2025
reosarevok[m]
But if that's the case, libcaa should have been broken for a long time 😅
2025-10-21 29422, 2025
adhawkins
reosarevok[m]: I suspect it has been, and just nobody uses it!
2025-10-21 29435, 2025
adhawkins
I use it in flactag, but currently only to request '/front' which doesn't require the ID.
2025-10-21 29450, 2025
pite_ has quit
2025-10-21 29407, 2025
reosarevok[m]
Oh, I see
2025-10-21 29448, 2025
reosarevok[m]
In that case, maybe! bitmap might still know more but given how old that is... I think accepting both makes sense, but we might want to try and reindex old images to have a number everywhere, bitmap?
2025-10-21 29401, 2025
pite joined the channel
2025-10-21 29427, 2025
adhawkins
To be honest, handling both is less of a change to libcaa, otherwise the interface and ABI changes due to the different return type.
2025-10-21 29401, 2025
Maxr1998_ has quit
2025-10-21 29447, 2025
Maxr1998 joined the channel
2025-10-21 29406, 2025
bitmap[m]
adhawkins (IRC): I would guess it changed to consistently output numbers when we deployed the Python artwork-indexer in 2024. though I don't think the previous Perl CAA-indexer consistently outputted them as strings, either (that's a common problem with JSON encoding in Perl if you don't force the context, which we weren't doing)
I agree number makes more sense in theory, though those are bigints (64-bit) which some languages will have trouble parsing by default
2025-10-21 29448, 2025
bitmap[m]
though currently the biggest cover art ID is only 1348490566944, which is between 2^40 and 2^41, so less than MAX_SAFE_INTEGER in JS (2^53 - 1) at least
2025-10-21 29401, 2025
bitmap[m]
adhawkins (IRC): anyway, I would certainly handle both cases as we aren't going to be reindexing everything anytime soon
I know it's late so don't expect an answer anytime soon, but since I see your emoji reaction... when you have a moment, could you please make a thumbnail for the art creator page that we can put on the explore page? I think it's time to promote the art creator so that it's not hidden at the bottom of the page.
please help me i am having this error while running the web server "" Checking docker compose version... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/OZnUbkAqqXdDdYfXnxfrfmEn>)
2025-10-21 29410, 2025
fettuccinae[m]
<TalibHussain[m]> "please help me i am having..." <- Can you check if there's any docker containers running?
2025-10-21 29440, 2025
fettuccinae[m]
* check if already there's any, * containers running on port 5432?
2025-10-21 29423, 2025
TalibHussain[m]
<fettuccinae[m]> "Can you check if there's any..." <- no container using port 5432
2025-10-21 29407, 2025
fettuccinae[m]
TalibHussain[m]: Oh, Something else (postgres on your os maybe) using that port?
2025-10-21 29437, 2025
TalibHussain[m]
fettuccinae[m]: postgres is using 5432
2025-10-21 29437, 2025
fettuccinae[m]
TalibHussain[m]: Can you try to stop it and retry development setup?
2025-10-21 29456, 2025
TalibHussain[m]
<fettuccinae[m]> "Can you try to stop it and retry..." <- i am having this issue now may be a redis port conflict or something "" Created0.1s... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/tzNOOHYarzjfnfhkTufqjXiV>)
monkey[m]: So as we already discussed that it would be very great to expand the mb database for the ia recordings for 78rpm and cylinder coz currently there is not much recordings present on mb to directly get search on lb and there is no awareness about these recordings that they can be listen and played on lb... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/IamPMistvuRwFjOrdWslIyhc>)
2025-10-21 29450, 2025
rayyan_seliya[m]
<rayyan_seliya[m]> "So as we already discussed..." <- and would it be better to create the editorr dashboard as a standalone tool like other mb community tools or it should be integrated into mb directly ?
2025-10-21 29400, 2025
rayyan_seliya[m]
* So as we already discussed that it would be very great to expand the mb database for the ia recordings for 78rpm and cylinder coz currently there is not much recordings present on mb to directly get search on lb and there is no awareness about these recordings that they can be listen and played on lb but... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/lCdwfBjvyXXOpAYADFzwJcgc>)
2025-10-21 29439, 2025
monkey[m]
rayyan_seliya[m]: So I had a think about your proposal, and I think the closest I can think of was a 2023 GSOC project to create a bot to automatically update and add new geographical areas from Wikidata: https://community.metabrainz.org/t/automate-areas…... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/VfdFQBeauusSMfunuWfZELgg>)
2025-10-21 29444, 2025
v6lur joined the channel
2025-10-21 29443, 2025
monkey[m]
monkey[m]: I haven't seen anyone propose a community-driven push for adding data as a GSOC project, and it's not very clear to me how we would judge the goals of the project.
2025-10-21 29443, 2025
monkey[m]
I am also not sure there would be enough work there to fill up a GSOC project.
2025-10-21 29444, 2025
monkey[m]
I suggest having a look at importer userscripts used to add a button on a website you want to import from. The button then seeds a MB page. You will see that they are usually pretty small.
monkey[m]: I am also missing some context. For example what does the IA crawler do?
2025-10-21 29423, 2025
monkey[m]
When you talk about this editor dashboard and of unmatched recordings, would that be more of a MusicBrainz or a ListenBrainz project?
2025-10-21 29427, 2025
v6lur has quit
2025-10-21 29451, 2025
monkey[m]
monkey[m]: All in all I am not convinced you can put together a GSOC proposal along those lines.
2025-10-21 29451, 2025
monkey[m]
It seems to me to either be replicating existing processes (community-driven campaigns, userscript seeders), or be too IA-specific to fit in either MB or LB
2025-10-21 29425, 2025
v6lur joined the channel
2025-10-21 29437, 2025
rayyan_seliya[m]
monkey[m]: > <@monkey:chatbrainz.org> I am also missing some context. For example what does the IA crawler do?... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/OwNhNhfJjQLWapiVvOGHdZYX>)
2025-10-21 29417, 2025
monkey[m]
rayyan_seliya[m]: > harvest this information from the IA metadata api
2025-10-21 29417, 2025
monkey[m]
But where is that information stored? What do we do with it exactly?
2025-10-21 29415, 2025
monkey[m]
monkey[m]: > Listenbrainz would just provide a platform for these recordings to be played search efficiently !
2025-10-21 29415, 2025
monkey[m]
That seems to me to already be the case. You can't search for it directly on LB (if the recording doesn't exist on MB) but you can already submit listens with the metadata and play them back.
2025-10-21 29403, 2025
rayyan_seliya[m]
monkey[m]: It is mainly stored in a database as in our implementation it was stored in postgresql and the in the redis cache to get the results using ia api ... And if the cache matches the recording metadata it can be played using Brainzplayer ..
2025-10-21 29441, 2025
rayyan_seliya[m]
monkey[m]: How but it would be a manual effort for submitting listens or is there any other approach present ?
2025-10-21 29450, 2025
monkey[m]
rayyan_seliya[m]: Currently, for example I go to the IA website and play a recording, my scrobbler browser extension will submit a listen with some metadata.
2025-10-21 29450, 2025
monkey[m]
That is how most LB users use the website. There isn't much searching for recordings manually as far as I know, but I can guarantee that searching for 78's is going to be a very, very niche use case
2025-10-21 29434, 2025
rayyan_seliya[m]
monkey[m]: So the project idea is not feasible as far I can understand ..
2025-10-21 29435, 2025
rayyan_seliya[m]
monkey[m]: From your perspective !!
2025-10-21 29419, 2025
rayyan_seliya[m]
rayyan_seliya[m]: what about the cylinder recordings u were mentioning to add on mb ?
2025-10-21 29448, 2025
monkey[m]
rayyan_seliya[m]: I think creating a bot to add IA collections (such as the 78 collection) to MusicBrainz is the only one that would make sense in our setup. I am not sure however that there is enough information on the IA to automate this addition of 180.000 recordings cleanly
2025-10-21 29453, 2025
rayyan_seliya[m]
<monkey[m]> "I think creating a bot to add IA..." <- Thxs for your feedback .It seems my current idea might not be feasible. Given the data and workflow challenges, what kind of project or approach would you suggest that's more practical for MusicBrainz and ListenBrainz?
2025-10-21 29453, 2025
rayyan_seliya[m]
Also, about the cylinder recordings you mentioned , would creating a bot for that collection be a good approach, or do you recommend another way to add them properly?
2025-10-21 29453, 2025
rayyan_seliya[m]
I want to find a realistic project that helps expand IA recordings presence in the MetaBrainz ecosystem. Appreciate ur advice on this ..
2025-10-21 29434, 2025
mthax has quit
2025-10-21 29416, 2025
mthax joined the channel
2025-10-21 29410, 2025
monkey[m]
rayyan_seliya[m]: I think an automated bot is the only realistic option I see, but I am not the right person to tell you if it is a good idea or not, I lack all the knowledge on this...
2025-10-21 29428, 2025
rayyan_seliya[m]
monkey[m]: I appreciate your efforts in helping me would research on this keeping in mind about the feasibility of the project. To create an automated bot for the. Collections.. and can u recommend a right person for this ? To discuss ..
2025-10-21 29457, 2025
monkey[m]
rayyan_seliya[m]: Just for more information, this is usually the way things go for this sort of project: someone proposed a big addition/cleanup campaign to other interested editors (for example https://community.metabrainz.org/t/community-clea…) and coordinated by the community. the MetaBrainz team is usually not directly involved in this in terms of development, and it is a manual process
