Something in Lidarr broke because of the schema change, and their wording is kind of vague on whose “fault” it was. Sounds like people who rely on MB so heavily need to subscribe to the blog tbh. https://github.com/Lidarr/Lidarr/issues/5498
2025-06-02 15328, 2025
aerozol[m]
Not a big deal but thought I’d mention it.
2025-06-02 15311, 2025
reosarevok[m] joined the channel
2025-06-02 15311, 2025
reosarevok[m]
Back from hols. julian45 now available to test things too
reosarevok: can you please add all the GSoC contributors to weekly meeting reviews list (if not already there): m.amanullah7 , suvid , holycow23 , @fettuccinae:matrix.org and Hemang Mishra
2025-06-02 15352, 2025
lucifer[m]
(jade is already on the list)
2025-06-02 15307, 2025
reosarevok[m]
Sure!
2025-06-02 15318, 2025
lucifer[m]
thanks!
2025-06-02 15343, 2025
reosarevok[m]
Done :)
2025-06-02 15311, 2025
holycow23[m] joined the channel
2025-06-02 15311, 2025
holycow23[m]
<_BrainzGit> "[listenbrainz-server] amCap1712..." <- lucifer: thanks for this, could you share the dump and if possible guide me on how to go ahead with using the dump
2025-06-02 15358, 2025
lucifer[m]
holycow23: first of all setup the spark cluster locally by running `./develop.sh spark up` and then run `./develop.sh spark format` in another terminal.
2025-06-02 15305, 2025
lucifer[m]
then run ./develop.sh manage spark request_import_sample to import the sample dump.
2025-06-02 15330, 2025
lucifer[m]
after this you should import a few incremental dumps by running ./develop.sh manage spark request_import_incremental --dump-id DUMP_ID HERE, the dump ids should be available here: https://data.metabrainz.org/pub/musicbrainz/liste… (2123 - 2153).
2025-06-02 15325, 2025
lucifer[m]
this command may fail, if it does let me know and i'll try to fix that.
2025-06-02 15326, 2025
lucifer[m]
in future, i am thinking to include a bunch of listens in the spark sample dumps but there's a few things to discuss about it first.
2025-06-02 15329, 2025
holycow23[m]
Okay running the first 2 queries right now
2025-06-02 15342, 2025
snobdiggy292838 has quit
2025-06-02 15313, 2025
holycow23[m]
<lucifer[m]> "this command may fail, if it..." <- It ran without an error
2025-06-02 15349, 2025
lucifer[m]
okay, try to run some stats: ./develop.sh manage spark request_user_stats --entity artists --type entity --range all_time
2025-06-02 15348, 2025
holycow23[m]
Done, now do I start the server?
2025-06-02 15335, 2025
lucifer[m]
ensure that api_url in your config is set to localhost and start the server and you should see some stats.
2025-06-02 15356, 2025
lucifer[m]
you can take a look at logs of the request_consumer container to ensure it ran successfully
2025-06-02 15307, 2025
holycow23[m]
yes its set to localhost, testing the stats right now
2025-06-02 15338, 2025
holycow23[m]
I don't see the stats, and for some reason the container seems to have closed
2025-06-02 15355, 2025
lucifer[m]
try starting the container again and share its logs.
2025-06-02 15342, 2025
holycow23[m]
Do I try rebuilding the entire thing?
2025-06-02 15336, 2025
holycow23[m]
Also just noticed that ./develop.sh spark format was trying to ping Redis which didn't work
2025-06-02 15354, 2025
holycow23[m]
And can
2025-06-02 15303, 2025
holycow23[m]
* And can't see the spark container
2025-06-02 15342, 2025
snobdiggy292838 joined the channel
2025-06-02 15349, 2025
lucifer[m]
holycow23: run `./develop.sh up -d web`
2025-06-02 15355, 2025
lucifer[m]
then run the two spark commands again
2025-06-02 15332, 2025
holycow23[m]
When I run the second command it terminates the first one that's fine right?
2025-06-02 15315, 2025
holycow23[m]
And the spark containers have again vanished
2025-06-02 15346, 2025
snobdiggy292838 has quit
2025-06-02 15311, 2025
holycow23[m]
<lucifer[m]> "after this you should import a..." <- also I think this is `--id` and not `--dump-id`
2025-06-02 15305, 2025
lucifer[m]
holycow23: yes that is fine, you can start the spark containers again after format.
2025-06-02 15310, 2025
lucifer[m]
--id is fine
2025-06-02 15337, 2025
holycow23[m]
I did the same process but the spark container's aren't there
2025-06-02 15355, 2025
lucifer[m]
even after running ./develop.sh spark up again?
2025-06-02 15332, 2025
holycow23[m]
Yeah unless I am going wrong somewhere
2025-06-02 15332, 2025
holycow23[m]
Do I need to run the spark up command again
2025-06-02 15338, 2025
lucifer[m]
yeah try once again, the containers should start or you should see an error
2025-06-02 15348, 2025
lucifer[m]
do you see any stopped spark containers in docker ps -a
2025-06-02 15357, 2025
holycow23[m]
yes
2025-06-02 15312, 2025
holycow23[m] uploaded an image: (23KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/matrix.org/nwQqsMjrjKzpHGbpxygsUhew/image.png >
2025-06-02 15317, 2025
holycow23[m]
The first one
2025-06-02 15325, 2025
lucifer[m]
share its logs.
2025-06-02 15340, 2025
holycow23[m] uploaded an image: (36KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/matrix.org/WjcVYNSQrYCxZRQpERVcXuON/image.png >
2025-06-02 15355, 2025
lucifer[m]
rayyan_seliya123: hi! let me know when you are around to discuss your project.
<lucifer[m]> "holycow23: you need to create..." <- lucifer: I rechecked the process, re-did the entire process again the containers are running but I can't see the stats
2025-06-02 15352, 2025
lucifer[m]
holycow23: share the logs of the spark container
2025-06-02 15341, 2025
holycow23[m] uploaded an image: (58KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/matrix.org/aFtZWQgJYieKBlSnVHndqgFU/image.png >
2025-06-02 15350, 2025
holycow23[m]
Its been returning empty internal queue
2025-06-02 15358, 2025
holycow23[m]
For every call
2025-06-02 15317, 2025
lucifer[m]
the request consumer container
2025-06-02 15328, 2025
holycow23[m] uploaded an image: (295KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/matrix.org/sVyyMotzFkfmcmnWjAfYEIWW/image.png >
holycow23: try restarting the request consumer container and then running the command again.
2025-06-02 15337, 2025
lucifer[m]
if it still doesn't work then share the new logs again.
2025-06-02 15349, 2025
holycow23[m]
<holycow23[m]> "https://gist.github.com/granth23..." <- I have updated the logs
2025-06-02 15333, 2025
holycow23[m]
lucifer[m]: I stopped both the dockers ran the command you gave and re ran the two commands
2025-06-02 15341, 2025
lucifer[m]
which two commands?
2025-06-02 15354, 2025
holycow23[m]
./develop.sh up and ./develop.sh spark up
2025-06-02 15314, 2025
reosarevok[m]
<BANG>
2025-06-02 15334, 2025
lucifer[m]
holycow23: i see, let's continue after the meeting.
2025-06-02 15340, 2025
reosarevok[m]
Welcome to another MetaBrainz Monday Meeting!
2025-06-02 15327, 2025
reosarevok[m]
I seem to have two mailed reviews today
2025-06-02 15332, 2025
reosarevok[m]
suvid says:
2025-06-02 15349, 2025
reosarevok[m]
"implemented import-files endpoint and logic for uploading files and checks for file size and extension. will implement background task very soon"
2025-06-02 15306, 2025
reosarevok[m]
And mayhem says:
2025-06-02 15308, 2025
reosarevok[m]
'''
2025-06-02 15316, 2025
reosarevok[m]
Today I'll be out playing with blinking lights, trying to trap musicians. :)
2025-06-02 15327, 2025
reosarevok[m]
Last week was pretty short for me, since I was out Monday/Tuesday. The
2025-06-02 15327, 2025
reosarevok[m]
rest of the week was spent on mentoring, PR review, MetaBrainz tasks and
2025-06-02 15327, 2025
reosarevok[m]
just a little bit of programming on the new mapper.
2025-06-02 15341, 2025
reosarevok[m]
Just adding a library to query postgres took me more than a day to get working since package management on C++ basically doesn't exist. Super fun. As of
2025-06-02 15341, 2025
reosarevok[m]
right now half of all the tough test cases that were submitted pass and I have a plan on how to fix the rest.
2025-06-02 15345, 2025
reosarevok[m]
The person wearing a green shirt (or closest to it) goes next!
