#metabrainz

/

      • aerozol[m]
        monkey ansh ooooh new graph!! Really cool. Love the colours
      • P.S. I wonder if we should be careful of not dropping the artist country graph down too far? We’ve had a few people shout that out as particular useful/different to other services
      • dabeglavins has quit
      • dabeglavins joined the channel
      • Kladky joined the channel
      • vardhan has quit
      • vardhan joined the channel
      • SigHunter has quit
      • SigHunter joined the channel
      • BrainzGit
        [musicbrainz-server] 14reosarevok merged pull request #3496 (03master…ac-diff-warnings): Fix key warnings in diffArtistCredits https://github.com/metabrainz/musicbrainz-serve...
      • Strykar has quit
      • Strykar joined the channel
      • MyNetAz has quit
      • MyNetAz joined the channel
      • MyNetAz has quit
      • MyNetAz joined the channel
      • relaxo[m] has quit
      • monkey[m]
        Happy Holi to everyone who celebrates it !
      • jasje[m] has quit
      • BrainzGit
        [troi-recommendation-playground] 14mayhem opened pull request #167 (03main…fix-unresolved-releases): Minor cleanup https://github.com/metabrainz/troi-recommendati...
      • d4rkie has quit
      • d4rkie joined the channel
      • fettuccinae[m] has quit
      • MyNetAz has quit
      • [musicbrainz-server] 14reosarevok opened pull request #3497 (03master…MBS-10563): MBS-10563: Add autoselect + sidebar for AWA URLs https://github.com/metabrainz/musicbrainz-serve...
      • MyNetAz joined the channel
      • mayhem[m]
        leftmostcat (UTC-8): hiya! Are you the author of the perl module unidecode?
      • \- has quit
      • lucifer[m]
        zas: hi! i think the spark servers upgrade didn't go right? marlon shows only 450G of total space
      • all servers i checked actually.
      • zas[m]
        that's the storage they have (2 SSDs of ~500gb in RAID1)
      • lucifer[m]
        i remember it used to 1TB before the server upgrade
      • on each server
      • mayhem[m] suspects RAID-0 vs RAID-1 issue
      • mayhem[m]
        they were striped, not mirrored, right?
      • lucifer[m]
        i see yeah that's possible. i think we can do RAID-0 for spark servers because HDFS does provide redundancy for the data in the spark cluster.
      • zas[m]
        oh, that would explain this
      • lucifer[m]
        that said there have been disk issues with the cluster in the past.
      • but 1 TB of storage is needed on almost all nodes to avoid running into disk issues. so we'd have to add new disks if we want to keep RAID-1.
      • zas[m]
        ok, I'll see if we can convert without reinstalling, perhaps tricky, but I can try
      • I can perhaps do it from rescue, can I stop marlon in order to test?
      • lucifer: ?^^
      • lucifer[m]
        zas: its currently running a job but i don't think it will succeed with the current diskspace anyway. so yup feel free to restart any/all of the spark servers.
      • zas[m]
        ok, let's see
      • I'll try with marlon
      • minimal joined the channel
      • It worked:... (full message at <https://matrix.chatbrainz.org/_matrix/media/v3/...>)
      • mayhem[m]
        noice!
      • zas[m]
        ok, that's a bit slow because it has to rebuild the array, it takes around 30 minutes per server, but I can do the 5 remaining ones in parallel
      • https://github.com/metabrainz/syswiki/blob/mast...
      • lucifer: I'll proceed with others servers
      • lucifer[m]
        zas: :+LupinIII (IRC)
      • * zas: :+1:
      • zas[m]
        I'll disable alerts for those servers
      • lucifer[m]
        sure
      • zas[m]
        lucifer: should we convert randy too? It has more diskspace
      • lucifer[m]
        [@zas666:matrix.org](https://matrix.to/#/@zas666:matrix.org) yes I think it makes sense to convert randy too
      • zas[m]
        ok, rebuilding arrays atm
      • Jigen
        hello?
      • lucifer[m]: what is it :)
      • lucifer[m]
        Sorry had tagged by error
      • Jigen
        ok no problem! ^_^
      • d4rkie has quit
      • d4rkie joined the channel
      • zas[m]
        lucifer: all servers ready :)
      • lucifer[m]
        [@zas666:matrix.org](https://matrix.to/#/@zas666:matrix.org) thanks!
      • [@zas666:matrix.org](https://matrix.to/#/@zas666:matrix.org) another question, we need about 8 VMs for spark processing of MLHD dumps for probably about a week
      • Whwn do you think we can do that?
      • zas[m]
        If mayhem is ok (money-wise), we can. Which VM specs do you need?
      • lucifer[m]
        yup [@mayhem:chatbrainz.org](https://matrix.to/#/@mayhem:chatbrainz.org) suggested it during LB earlier this week
      • mayhem[m]
        but, really, lets keep an eye on these servers. lets really keep it a week and not forget them, please.
      • lucifer[m]
        [@mayhem:chatbrainz.org](https://matrix.to/#/@mayhem:chatbrainz.org) how about less servers but bigger ones? I see there are ones with 192G of ram
      • mayhem[m]
        ram is what we need, so, go for it.