monkey ansh ooooh new graph!! Really cool. Love the colours
P.S. I wonder if we should be careful of not dropping the artist country graph down too far? We’ve had a few people shout that out as particular useful/different to other services
leftmostcat (UTC-8): hiya! Are you the author of the perl module unidecode?
\- has quit
lucifer[m]
zas: hi! i think the spark servers upgrade didn't go right? marlon shows only 450G of total space
all servers i checked actually.
zas[m]
that's the storage they have (2 SSDs of ~500gb in RAID1)
lucifer[m]
i remember it used to 1TB before the server upgrade
on each server
mayhem[m] suspects RAID-0 vs RAID-1 issue
mayhem[m]
they were striped, not mirrored, right?
lucifer[m]
i see yeah that's possible. i think we can do RAID-0 for spark servers because HDFS does provide redundancy for the data in the spark cluster.
zas[m]
oh, that would explain this
lucifer[m]
that said there have been disk issues with the cluster in the past.
but 1 TB of storage is needed on almost all nodes to avoid running into disk issues. so we'd have to add new disks if we want to keep RAID-1.
zas[m]
ok, I'll see if we can convert without reinstalling, perhaps tricky, but I can try
I can perhaps do it from rescue, can I stop marlon in order to test?
lucifer: ?^^
lucifer[m]
zas: its currently running a job but i don't think it will succeed with the current diskspace anyway. so yup feel free to restart any/all of the spark servers.
[@zas666:matrix.org](https://matrix.to/#/@zas666:matrix.org) another question, we need about 8 VMs for spark processing of MLHD dumps for probably about a week
Whwn do you think we can do that?
zas[m]
If mayhem is ok (money-wise), we can. Which VM specs do you need?
lucifer[m]
yup [@mayhem:chatbrainz.org](https://matrix.to/#/@mayhem:chatbrainz.org) suggested it during LB earlier this week
mayhem[m]
but, really, lets keep an eye on these servers. lets really keep it a week and not forget them, please.
lucifer[m]
[@mayhem:chatbrainz.org](https://matrix.to/#/@mayhem:chatbrainz.org) how about less servers but bigger ones? I see there are ones with 192G of ram
mayhem[m]
ram is what we need, so, go for it.
lucifer[m]
zas: okay let's coordinate this on monday. i want to make some changes to import the mlhd dumps faster.
minimal has quit
leftmostcatUTC-8 joined the channel
leftmostcatUTC-8
<mayhem[m]> "leftmostcat (UTC-8): hiya! Are..." <- That's my Doppelgänger. He's written a bunch of Perl stuff and was rude enough to steal my name and interests before I even got to them.
mayhem[m]
lolwut. that's pretty cool on the whole. its an amazing module and we rely on the python version. but there is a C++ version which might be important to me soon.
leftmostcatUTC-8
He seems like a pretty cool guy, and I'm not just saying that because our interests really are weirdly aligned.
mayhem[m]
<leftmostcatUTC-8> "He seems like a pretty cool guy,..." <- have you ever contacted him?
leftmostcatUTC-8
I have! We've been in touch a few times.
My first email to him, I introduced myself by pointing out which of the people on his list I was. 😁
