<lucifer[m]> "i also needed to expose the 987..." <- You must have imported the `get_listens_metadata()` function right?
lucifer[m]
[@holycow23:matrix.org](https://matrix.to/#/@holycow23:matrix.org) yes. It's in the updated gist but the modifications are patching listenbrainz_spark.config to make it work outside the container.
holycow23[m] uploaded an image: (28KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/matrix.org/lwmYTSMlcRtGwQyaipNeyNQz/image.png >
holycow23[m]
I meant the gist doesn't have anything with you importing the function, I mean fine I will import it but it does need to be imported right
I tried using get_incremental_listens_df to get the listens but getting ConnectionRefusedError: [Errno 111] Connection refused
Else could you assist me with how to fetch the listens using the document path returned by get_listens_metadata
suvid[m] has quit
Kladky joined the channel
d4rk-ph0enix has quit
d4rk-ph0enix joined the channel
d4rk-ph0enix has quit
d4rk-ph0enix joined the channel
dabeglavins6071 joined the channel
dabeglavins607 has quit
dabeglavins6071 is now known as dabeglavins607
lucifer[m]
<holycow23[m]> "I meant the gist doesn't have..." <- uhh my bad, let me fix that
holycow23: running with increased driver memory seems to fix it, note the java heap space error before the connection refused `pyspark --driver-memory 8g` seems to fix it.
yvanzo: I'm surprised I didn't find anything for SEARCH-746 with `project = SEARCH AND text ~ "aliases" AND resolution = Unresolved` - is this really a newly raised issue or am I failing to search? 😅
hey. the MB mirror on wolf is down because of port conflicts.
funkwhale is sitting on port 5432, where the DB mirror should be.
lucifer[m]
Oh i see.
Hmm, funkwhale db should not be exposing a db port at all
mayhem[m]
can you please take funkwhale down, so I can restart mb-docker?
lucifer[m]
Sure
mayhem[m]
then we can see what FW conflicts with and move it.
lucifer[m]
stopped FW
it was the a PG db running on wolf directly.
mayhem[m]
thanks. MB docker still not coming up.
lucifer[m]
its up now
mayhem[m]
confirmed, thanks!
rayyan_seliya123 uploaded an image: (53KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/matrix.org/JpLUyAEttWcUZTPBhVgUEzRz/Screenshot%202025-06-13%20162105.png >
rayyan_seliya123 uploaded an image: (91KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/matrix.org/QSnyYJDMrSgDutPxoXVNfXSN/Screenshot%202025-06-13%20161358.png >
rayyan_seliya123
hey lucifer I have updated my internetarchive folder on my local by developing a new `ia_seeder.py` file for seeding the data and then updating my `ia_indexer.py` file and successfully run both seeder and indexer and it was running as expected first seeding->rabbitmq queue->indexer see the screenshots above... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/...>)
lucifer[m]
rayyan_seliya123: please use a gist in future for long messages. at a first look this seems fine to me. i'll suggest to continue refactoring the indexer to match other ones.
Jade[m] joined the channel
Jade[m]
Also for a codeblock to work consistently you have to put it on its own line
Cause that's all on one line for me :(
rayyan_seliya123
<lucifer[m]> "rayyan_seliya123: please use a..." <- For sure I'll use gist for long msgs in future so I'll push the code to that pr for your detailed review and what exactly I have to continue refactoring it to match the other ones ?
lucifer[m]
rayyan_seliya123: you can push the changes, and i'll take a look on what's pending.