monkey ansh ooooh new graph!! Really cool. Love the colours
2025-03-14 07303, 2025
aerozol[m]
P.S. I wonder if we should be careful of not dropping the artist country graph down too far? We’ve had a few people shout that out as particular useful/different to other services
leftmostcat (UTC-8): hiya! Are you the author of the perl module unidecode?
2025-03-14 07359, 2025
\- has quit
2025-03-14 07306, 2025
lucifer[m]
zas: hi! i think the spark servers upgrade didn't go right? marlon shows only 450G of total space
2025-03-14 07340, 2025
lucifer[m]
all servers i checked actually.
2025-03-14 07305, 2025
zas[m]
that's the storage they have (2 SSDs of ~500gb in RAID1)
2025-03-14 07319, 2025
lucifer[m]
i remember it used to 1TB before the server upgrade
2025-03-14 07329, 2025
lucifer[m]
on each server
2025-03-14 07325, 2025
mayhem[m] suspects RAID-0 vs RAID-1 issue
2025-03-14 07334, 2025
mayhem[m]
they were striped, not mirrored, right?
2025-03-14 07308, 2025
lucifer[m]
i see yeah that's possible. i think we can do RAID-0 for spark servers because HDFS does provide redundancy for the data in the spark cluster.
2025-03-14 07310, 2025
zas[m]
oh, that would explain this
2025-03-14 07326, 2025
lucifer[m]
that said there have been disk issues with the cluster in the past.
2025-03-14 07328, 2025
lucifer[m]
but 1 TB of storage is needed on almost all nodes to avoid running into disk issues. so we'd have to add new disks if we want to keep RAID-1.
2025-03-14 07336, 2025
zas[m]
ok, I'll see if we can convert without reinstalling, perhaps tricky, but I can try
2025-03-14 07346, 2025
zas[m]
I can perhaps do it from rescue, can I stop marlon in order to test?
2025-03-14 07324, 2025
zas[m]
lucifer: ?^^
2025-03-14 07332, 2025
lucifer[m]
zas: its currently running a job but i don't think it will succeed with the current diskspace anyway. so yup feel free to restart any/all of the spark servers.
2025-03-14 07357, 2025
zas[m]
ok, let's see
2025-03-14 07329, 2025
zas[m]
I'll try with marlon
2025-03-14 07318, 2025
minimal joined the channel
2025-03-14 07308, 2025
zas[m]
It worked:... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/XByBFIVygzOKKwzZxeRvtkoW>)
2025-03-14 07322, 2025
mayhem[m]
noice!
2025-03-14 07355, 2025
zas[m]
ok, that's a bit slow because it has to rebuild the array, it takes around 30 minutes per server, but I can do the 5 remaining ones in parallel
[@zas666:matrix.org](https://matrix.to/#/@zas666:matrix.org) another question, we need about 8 VMs for spark processing of MLHD dumps for probably about a week
2025-03-14 07316, 2025
lucifer[m]
Whwn do you think we can do that?
2025-03-14 07351, 2025
zas[m]
If mayhem is ok (money-wise), we can. Which VM specs do you need?
2025-03-14 07328, 2025
lucifer[m]
yup [@mayhem:chatbrainz.org](https://matrix.to/#/@mayhem:chatbrainz.org) suggested it during LB earlier this week
2025-03-14 07325, 2025
mayhem[m]
but, really, lets keep an eye on these servers. lets really keep it a week and not forget them, please.
2025-03-14 07357, 2025
lucifer[m]
[@mayhem:chatbrainz.org](https://matrix.to/#/@mayhem:chatbrainz.org) how about less servers but bigger ones? I see there are ones with 192G of ram
2025-03-14 07326, 2025
mayhem[m]
ram is what we need, so, go for it.
2025-03-14 07356, 2025
lucifer[m]
zas: okay let's coordinate this on monday. i want to make some changes to import the mlhd dumps faster.
2025-03-14 07326, 2025
minimal has quit
2025-03-14 07342, 2025
leftmostcatUTC-8 joined the channel
2025-03-14 07342, 2025
leftmostcatUTC-8
<mayhem[m]> "leftmostcat (UTC-8): hiya! Are..." <- That's my Doppelgänger. He's written a bunch of Perl stuff and was rude enough to steal my name and interests before I even got to them.
2025-03-14 07320, 2025
mayhem[m]
lolwut. that's pretty cool on the whole. its an amazing module and we rely on the python version. but there is a C++ version which might be important to me soon.
2025-03-14 07329, 2025
leftmostcatUTC-8
He seems like a pretty cool guy, and I'm not just saying that because our interests really are weirdly aligned.
2025-03-14 07331, 2025
mayhem[m]
<leftmostcatUTC-8> "He seems like a pretty cool guy,..." <- have you ever contacted him?
2025-03-14 07318, 2025
leftmostcatUTC-8
I have! We've been in touch a few times.
2025-03-14 07341, 2025
leftmostcatUTC-8
My first email to him, I introduced myself by pointing out which of the people on his list I was. 😁
I'm thinking we should publish these every friday on the created for you page.
2025-03-14 07326, 2025
monkey[m]
Yes absolutely
2025-03-14 07323, 2025
SothoTalKer has quit
2025-03-14 07333, 2025
mayhem[m]
zas: , bitmap reosarevok MB is freaking out.
2025-03-14 07353, 2025
mayhem[m]
very slow with loads of closed connection errors
2025-03-14 07314, 2025
zas[m]
yes, we're on it (since one hour or so), blocking a lot of IPs
2025-03-14 07335, 2025
mayhem[m]
ah, sorry. been deep in code.
2025-03-14 07306, 2025
zas[m]
np, it should be better now btw
2025-03-14 07316, 2025
mayhem[m]
it is! <3
2025-03-14 07355, 2025
SothoTalKer joined the channel
2025-03-14 07324, 2025
zas[m]
wolf is about to use all the disk space
2025-03-14 07340, 2025
minimal joined the channel
2025-03-14 07324, 2025
ApeKattQuest has quit
2025-03-14 07349, 2025
ApeKattQuest joined the channel
2025-03-14 07349, 2025
ApeKattQuest has quit
2025-03-14 07349, 2025
ApeKattQuest joined the channel
2025-03-14 07303, 2025
GautamShorewala[ joined the channel
2025-03-14 07303, 2025
GautamShorewala[
jasje: akshaaatt i was looking into the current ExoPlayer implementation in the LB app as part of my GSoC proposal on integrating 'Listening Now' and fixing bugs in BrainzPlayer. I was considering whether we could migrate to Media3, as I have experience working with it. I was also thinking of including this in my GSoC proposal. Let me know your thoughts
2025-03-14 07329, 2025
jasje[m] joined the channel
2025-03-14 07329, 2025
jasje[m]
GautamShorewala[: As of now we have no plans to migrate to Media3. Afaik, its undocumented for the large part. Plus that project does not deal with exoplayer that much
2025-03-14 07354, 2025
jasje[m]
jasje[m]: There is some refactoring that would take place, but it would not be huge
2025-03-14 07313, 2025
pite has quit
2025-03-14 07315, 2025
dseomn has quit
2025-03-14 07304, 2025
dseomn joined the channel
2025-03-14 07328, 2025
Kladky has quit
2025-03-14 07325, 2025
BrainzGit
[musicbrainz-server] 14mwiencek opened pull request #3498 (03master…mbs-12170): MBS-12170: Output containing country code for all artists in web service https://github.com/metabrainz/musicbrainz-server/…
