in your case, just make sure of one thing. create an entry for the user in the listens_importer table with the spotify service to ensure the update works otherwise there won't be anything to update
2025-06-05 15630, 2025
zas[m] joined the channel
2025-06-05 15630, 2025
zas[m]
I will have to reboot yamaoka, it is spamming logs with kern messages related to pci aer, it was almost disk full. I took measures to limit log sizes, but the core issue will likely need at least one reboot. I just reclaimed 800G
2025-06-05 15627, 2025
zas[m]
MeB team: There are various non-redundant services running there
2025-06-05 15622, 2025
zas[m]
I mitigated the disk space issue, but the reboot is rather urgent, so please have a look asap and move stuff if needed
2025-06-05 15655, 2025
davic has quit
2025-06-05 15614, 2025
lucifer[m]
zas: suggestion for which server to move CB to from yamaoka?
2025-06-05 15623, 2025
zas[m]
Perhaps selda
2025-06-05 15624, 2025
davic joined the channel
2025-06-05 15601, 2025
lucifer[m]
moved CB.
2025-06-05 15617, 2025
lucifer[m]
zas: can you check if the CB gateways config is fine? i migrated to selda and the containers are running fine but the website returns a 502.
2025-06-05 15627, 2025
lucifer[m]
or if there is nothing else important on yamaoka might as well reboot it and i'll move CB back.
2025-06-05 15629, 2025
zas[m]
Fixed, there was an issue with serviceregistrator on selda, restarted, and the service appeared
hey lucifer i'm having trouble in verifying `OAuth2` implementation as well as i cant validate api becoz funkwhale setup when i tried to login with superuser funkwhale i'm getting `access denied`
2025-06-05 15630, 2025
mamanullah7[m]
how can fix this?
2025-06-05 15630, 2025
mamanullah7[m]
should i push this commit ?
2025-06-05 15626, 2025
reosarevok[m]
yvanzo: I suspect SEARCH-745 is an oversight, but can you confirm it's not intentional?
<mamanullah7[m]> "hey lucifer i'm having trouble..." <- > <@m.amanullah7:matrix.org> hey lucifer i'm having trouble in verifying `OAuth2` implementation as well as i cant validate api becoz funkwhale setup when i tried to login with superuser funkwhale i'm getting `access denied`... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/zmTiXJeOAlPyGuGypfgWGGTh>)
_BrainzGit: Hey lucifer: just added my indexer script for your review let me know if any changes needed I tried to run the script but it was giving me redis connection errors even my docker was running used `./develop.sh build ` and` ./develop.sh up ` and running `python -m listenbrainz.metadata_cache.internetarchive.ia_indexer` 🙂
2025-06-05 15625, 2025
petitminion joined the channel
2025-06-05 15619, 2025
_BrainzGit
[metabrainz.org] 14mayhem merged pull request #507 (03metabrainz-notifications…notification-table): Add fetch, mark and delete endpoints for notifications https://github.com/metabrainz/metabrainz.org/pull…
2025-06-05 15653, 2025
mamanullah7[m]
<lucifer[m]> "> <@m.amanullah7:matrix.org> hey..." <- lucifer: Done u can check now! and do let me know if any changes! its untested from my end i hope it dont have much errors or issues!!
well spotted, but not a cause for alarm. The package in question is unidecode that attempts to come up with a stable ASCII serialization for all "non ascii words". The point is never to put these in front of humans, since they are a ton of garbage.
2025-06-05 15637, 2025
mayhem[m]
they are, however , quite useful for making search indexes, where the search results will need to be checked against the original strings and not the index garbage.
[musicbrainz-server] 14reosarevok opened pull request #3558 (03master…MBS-13983): MBS-13983: Load primary aliases in more places for autocomplete / ws::js https://github.com/metabrainz/musicbrainz-server/…
holycow23: Listens have msid so I will need a mapping of msid to the mbid, yes but they can also have mbids. there are multiple cases possible. listens with only msid - no mapped mbid, listens with msid - mapped to a mbid. listens with a msid and user specified mbid. rest is correct.
2025-06-05 15608, 2025
petitminion joined the channel
2025-06-05 15631, 2025
holycow23[m]
I am talking about the moment when a user plays a song, it comes in as a listen just with the msid right, then it is mapped to the correspoding mbid
2025-06-05 15630, 2025
petitminion has quit
2025-06-05 15618, 2025
lucifer[m]
[@holycow23:matrix.org](https://matrix.to/#/@holycow23:matrix.org) it's assigned a msid and we try to map it to a mbid but a match may not be found always.
mayhem: @fettuccinae:matrix.org will need this for the auth parts of his project at some point ^
2025-06-05 15612, 2025
holycow23[m]
lucifer: I have a code snippet below, so these are the queries being used right now in the `listening_activity` stats... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/pAloqZqETSjGdOLzOOGIdWJe>)
2025-06-05 15624, 2025
holycow23[m]
* lucifer: I have a code snippet below, so these are the queries being used right now in the `listening_activity` stats... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/ECRFtVXBRxslxDppKBfuxPKj>)
2025-06-05 15633, 2025
holycow23[m]
* lucifer: I have a code snippet below, so these are the queries being used right now in the `listening_activity` stats... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/SZmlBYnwpYnWThwdJbzgWMtO>)
2025-06-05 15620, 2025
holycow23[m]
* lucifer: I have a code snippet below, so these are the queries being used right now in the `listening_activity` stats... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/GuOaskzqJGyxhVXPqzkBNbNR>)
2025-06-05 15653, 2025
lucifer[m]
holycow23: if you are running it on spark then it doesn't involve timescaledb at all. but yes this particular query could be run on timescaledb by accessing listens from listens table if you wanted to.
2025-06-05 15600, 2025
lucifer[m]
we don't run stats queries on timescaledb at all to avoid slowing down the rest of the website.
2025-06-05 15618, 2025
holycow23[m]
lucifer[m]: So is data being sent over from timescaleDB to Spark in those specific table format?
2025-06-05 15618, 2025
lucifer[m]
the data is sent in a parquet files, for instance you can download this dump https://data.metabrainz.org/pub/musicbrainz/listenbrainz/incremental/listenbrainz-dump-2156-20250605-000003-incremental/listenbrainz-spark-dump-2156-20250605-000003-incremental.tar, extract it and get parquet files.
2025-06-05 15642, 2025
lucifer[m]
you can load those parquet files in pandas or duckdb etc and explore their content.
rayyan_seliya123: did you run the `python -m listenbrainz.metadata_cache.internetarchive.ia_indexer` command inside the docker container or outside?
2025-06-05 15635, 2025
lucifer[m]
try running ./develop.sh exec web python -m listenbrainz.metadata_cache.internetarchive.ia_indexer
2025-06-05 15614, 2025
JadedBlueEyes has quit
2025-06-05 15642, 2025
JadedBlueEyes joined the channel
2025-06-05 15657, 2025
rayyan_seliya123
<lucifer[m]> "rayyan_seliya123: did you run..." <- I think outside !
2025-06-05 15644, 2025
rayyan_seliya123
<lucifer[m]> "try running ./develop.sh exec..." <- Okk let me try this or should i also need to run `./develop.sh `build and up ?
2025-06-05 15632, 2025
lucifer[m]
rayyan_seliya123: your docker containers need to up when you run this so if they are not already running you need to run `./develop.sh up` yes.
2025-06-05 15652, 2025
lucifer[m]
if your docker containers are running already then just run the exec command.
2025-06-05 15611, 2025
rayyan_seliya123
lucifer[m]: Okk I am building and running it
2025-06-05 15640, 2025
lucifer[m]
the code inside listenbrainz directory is volume mapped to the container so it will update automatically. you need to run build only if you add a python or javascript dependency.
2025-06-05 15645, 2025
rayyan_seliya123
lucifer[m]: Sure !
2025-06-05 15632, 2025
rostiku[m] joined the channel
2025-06-05 15632, 2025
rostiku[m]
Hi guys, can I ask a question here about track filtering?
2025-06-05 15648, 2025
rayyan_seliya123 uploaded an image: (45KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/matrix.org/ObjbaRuIhPfkZKTAtDocvGWz/image.png >
2025-06-05 15609, 2025
rayyan_seliya123
rayyan_seliya123: i am getting this after build and up and that command
2025-06-05 15644, 2025
lucifer[m]
<rayyan_seliya123> "image.png" <- you need to import it as listenbrainz.metadata_cache.internetarchive
2025-06-05 15648, 2025
lucifer[m]
<rostiku[m]> "Hi guys, can I ask a question..." <- sure
2025-06-05 15649, 2025
rostiku[m]
hey lucifer
2025-06-05 15616, 2025
rostiku[m]
this question isnt really about metabrainz, but musicbrainz database structure
2025-06-05 15625, 2025
lucifer[m]
musicbrainz dev team is in the channel so they can answer your questions.
2025-06-05 15648, 2025
rostiku[m]
I see musicbrainz categorizes albums into release_group entries, and then a release_group can have many releases. I'm looking for a way to filter for the original release in a release_group. As I can see that some releases belonging to a release_group can be versions from Japan / Europe, which I am not interested in, but they are still marked as "official" in release_status
2025-06-05 15653, 2025
lucifer[m]
bitmap, reosarevok ^
2025-06-05 15654, 2025
rostiku[m]
I would come up with a sketchy way to do this myself, but looking to see an expert opinion :P
2025-06-05 15655, 2025
lucifer[m]
i don't think there is a concept of the original release but it should be possible to find the earliest release.
2025-06-05 15649, 2025
rostiku[m]
thats kind of what I'm thinking, it looks like the "original" release would be the one that came first, and since we have release dates, we can filter out that way
2025-06-05 15630, 2025
reosarevok[m]
That sounds about right
2025-06-05 15617, 2025
reosarevok[m]
Feel free to just filter by earliest if you prefer. Selecting by min date would work probably?
2025-06-05 15642, 2025
rostiku[m]
well they can also sometimes share dates
2025-06-05 15657, 2025
bitmap[m]
you can join with release_first_release_date to do that
2025-06-05 15618, 2025
rostiku[m]
release_first_release_date is a table?
2025-06-05 15619, 2025
bitmap[m]
if you want to prioritize certain countries, too, you can join with the release_event view
2025-06-05 15654, 2025
bitmap[m]
(or just the release_country table if you want to exclude releases without any country set)
re that DMARC report ticket by the way, there's a fair chance that it isn't our issue at all and is in fact someone else trying to send email from the metabrainz domain
2025-06-05 15626, 2025
Jade[m]
I've got DMARC reports coming in on a domain which I know isn't sending any emails now, for example
2025-06-05 15618, 2025
spynxic has quit
2025-06-05 15640, 2025
spynxic joined the channel
2025-06-05 15642, 2025
Jade[m]
Also julian45 you mentioned when we were talking that it was HAProxy? Got sent this today, perhaps it'll be useful https://progress.opensuse.org/news/125
hi. I am finally getting around to writing a bot for Remix relationships. and by "I" of course I mean vibe coding by Claude.ai. any advice on whether I should do one bot like murdos_bot or one bot per function or etc?
