yes, the gid was accessed by one of the convert function but not added to searchpaths so it would have led to multiple sql queries. it was caught by the raiseloads adding in the new pr.
2025-05-20 14002, 2025
lucifer[m]
s/adding/added/
2025-05-20 14011, 2025
reosarevok[m]
Oh, ok
2025-05-20 14032, 2025
reosarevok[m]
I wasn't sure if it was needed because a lot of things seemed to be missing from there
2025-05-20 14011, 2025
reosarevok[m]
I think in the end I added some but didn't even think about track medium
2025-05-20 14020, 2025
lucifer[m]
yeah its not very intuitive, that's why added i the raiseload to catch these errors.
[musicbrainz-docker] 14yvanzo opened pull request #305 (03master…mbdb30-legacy-solr7): Upgrade MB DB schema version to 30 and downgrade Solr version to 7 https://github.com/metabrainz/musicbrainz-docker/…
Currently reindexing url, only recording will be left after that.
2025-05-20 14056, 2025
lucifer[m]
that will take ~45-50 mins i think.
2025-05-20 14037, 2025
lucifer[m]
i couldn't test recording on trille because it hasn't been updated to latest schema change yet.
2025-05-20 14049, 2025
yvanzo[m]
I will test that on hip.
2025-05-20 14002, 2025
lucifer[m]
thanks
2025-05-20 14000, 2025
bitmap[m]
<yvanzo[m]> "bitmap: I opened a PR for each..." <- thanks! there was an existing PR at https://github.com/metabrainz/musicbrainz-docker/… too. I think we should delegate these tasks more clearly next time to avoid duplicating our efforts
we should probably redeploy sir with that soon, it might help debug the solr connection issues.
2025-05-20 14012, 2025
lucifer[m]
yvanzo: before indexing recording in prod, can you please change the logging level to debug? we have some debug logs already in the solr submission code which might help see how many, if any, documents are not being indexed?
bitmap: docker compose release notes are up for review
2025-05-20 14058, 2025
zas[m]
What does sir in this case? I guess the connection was refused because the node was too busy
2025-05-20 14021, 2025
lucifer[m]
submits a batch of documents to the solr node for indexing.
2025-05-20 14038, 2025
zas[m]
It should retry after a delay, and do few attempts before giving up
2025-05-20 14012, 2025
lucifer[m]
yeah i was checking the same whether pysolr the library we use for making these api calls does that or not
2025-05-20 14031, 2025
zas[m]
since indexes update use quite a lot of resources on solr nodes, connections are maintained during a long time, which increase the risk of reaching limits (250 simultaneous connections per node)
looks good to me otherwise, though I haven't tested them
2025-05-20 14020, 2025
yvanzo[m]
OK, I'm about to test that.
2025-05-20 14044, 2025
yvanzo[m]
Can you please update the blog post draft accordingly meanwhile?
2025-05-20 14013, 2025
bitmap[m]
I just fixed the git tags for MBS and MB docker, removed the Indexed Search section, and added the list of translators from ./po/list_translators v-2025-05-05.0...production
2025-05-20 14045, 2025
bitmap[m]
I think it looks good now
2025-05-20 14046, 2025
yvanzo[m]
lucifer: stopping your mb docker instance on trille, for schema change tests.
2025-05-20 14052, 2025
lucifer[m]
sure
2025-05-20 14005, 2025
dseomn has quit
2025-05-20 14025, 2025
dseomn joined the channel
2025-05-20 14042, 2025
Jade[m] has quit
2025-05-20 14037, 2025
yvanzo[m]
url successfully imported in 44min, got disconnected two times only.
2025-05-20 14038, 2025
_BrainzGit
[sir] 14amCap1712 opened pull request #166 (03defer-column-property…solr-retry): Add retry-enabled requests session for Solr connections https://github.com/metabrainz/sir/pull/166
2025-05-20 14027, 2025
lucifer[m]
yvanzo: i haven't been able to test this yet but if might be useful for recording core ^
2025-05-20 14007, 2025
yvanzo[m]
bitmap: Got this from running `upgrade-db-schema.sh`:... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/CaoXmpukWAgqmwwTktNhIhky>)
2025-05-20 14036, 2025
yvanzo[m]
bitmap: Does this issue come from the prebuilt image?
2025-05-20 14043, 2025
bitmap[m]
yvanzo: looks like it's running the schema 29 upgrade from last year
2025-05-20 14004, 2025
bitmap[m]
is DB_SCHEMA_SEQUENCE up to date?
2025-05-20 14050, 2025
yvanzo[m]
No
2025-05-20 14035, 2025
yvanzo[m]
I'm rebuilding a new image.
2025-05-20 14026, 2025
Kladky has quit
2025-05-20 14023, 2025
yvanzo[m]
Started reindexing recording with solr-retry patch.
