#metabrainz

<02UltimateRiff> I was just about to ask the same thing, relaxoMob~

relaxoMob, UltimateRiff: hopefully it can be deployed to beta tomorrow, and then have an extended testing period, probably being released to production on June 3rd

there will be an API available at https://eventartarchive.org/event/

mostly identical to the CAA API, yes

Beta tomorrow (maybe)??? 😱😱😱

Huge

hope so, just need to submit a couple more PRs (one to make sure the new edit types don't ISE if you try to load them on the main site, and another to update some configuration)

[musicbrainz-server] 14mwiencek opened pull request #3271 (03master…eaa-edits-prod-stub): Add display placeholder for EAA edits in production https://github.com/metabrainz/musicbrainz-serve...

!m bitmap

You're doing good work, bitmap!

Looking forward to it so hard. FestivalGuide looks so ... Boring... without any images ;)

<02ericd23_> mayhem: can i get an irccloud account? (saw it on wiki)

[data-set-hoster] 14amCap1712 merged pull request #18 (03master…dependabot/pip/werkzeug-3.0.3): Bump werkzeug from 3.0.1 to 3.0.3 https://github.com/metabrainz/data-set-hoster/p...

ericd23_: Yes, good reminder, I will add them in a bit.

yvanzo: hi! i took care of the alerts on datasethoster but we haven't really updated brainzbot-core in a year or so because it is very outdated and the original repo we forked it is not maintained anymore. for the short term, i think we should leave it as is and in the longer term, we will probably have to rewrite our own bot from scratch.

zas, atj: hi! when would you be available to discuss about setting up our matrix homeserver?

awww yisss, please.

I think we settled on getting two VMs to get the job done.

yup. need to go over the details of the setup once, setting up backups and possibly co-ordinating with libera.chat admins for extended rate limits so on.

lucifer: now?

sure

did you already define resources needed in terms of disk space/cpu/ram?

hi lucifer, fair enough, thanks for having looked at it :)

zas: looking at some of the cloud offerings for hosting matrix homeservers, i am thinking 8GB ram and 250GB storage.

we intend to use dedicated hetzner vms right?

CPX31, CCX23 hetzner VMs look good to me.

do you know if the matrix is CPU intensive?

because I see the dedicated instances as not a good deal.

well, they weren't a good deal, but hetzner no longer has a 30eur/month bare metal machines. :(

two CPX31s do seem like a pretty good idea.

how about CAX21 or CAX31? I hear good things about the arm64 server. but I am not sure that everything we need to install is available for arm64

reading from other people's experiences online, it doesn't seem to be cpu intensive.

great. then lets not get a dedicated instance, shouldn't be needed.

yeah i saw the arm ones. but i am not sure everything supports it at the moment.

how difficult would it be to check that>

?

I could get you a test machine and if its a pain, we dump it and move to amd

sure could try that.

would need a domain too though i think.

I registered chatbrainz.org

I think, let me check.

let me get you a CAX21, then check the domain

okay cool

remind me which ssk key would you like me to use?

Would be 2 VMs + load balancer ok? how's redundancy ensured?

do you still need the machine I made for you 2 weeks ago?

deleteme-20240601 ?

mayhem: yes i didn't get the time to fully work out the spark upgrades yet. need it for another 2 weeks

k

Now that's a fish

zas: did we ever figure out if we still need musicbrainz-docker-test ?

zas: should be okay i think. as for redundancy, let me check.

been created 3 years ago.

lucifer: 65.21.242.117

log in as root.

thanks!

zas: do you know if our metabrainz server setup routine can run on arm64?

what do you mean by metabrainz server setup routine?

ansible bootstrap or something else?

lucifer: there are arm64 docker images AFAICS

atj: not familiar with all the ansible bits... but the process that takes a bare machine and makes it a metabrainz machine with all the accounts, firewall, etc.

yes, that's the ansible bootstrap

atj: yes, https://github.com/spantaleev/matrix-docker-ans.... but it says some components might not. in our case, that should probably only be the irc bridge.

have you tried running it on arm64?

i had to make a couple of tweaks when setting up the new solr cluster but i think only one was due to the architecture change

so yes, it works on the Hetzner ARM VMs at least

great!

that is really really making me happy. I mean I'm happy to have amd machines, but arm is even better. cheaper, more efficient.

intel finally is poised to leave me life. after... 40 years of torture from that fucking company.

zas, atj: i didn't find anything on how to manage redundancy with matrix. i'll ask in matrix dev channels and see if i can gather more info

lucifer: confirmed, we have chatbrainz.org

once we decide on the VMs, I can point the domain there.

zas, atj: it seems redundancy is not easy/possible with matrix. there isn't much public documentation on how to achieve other than https://matrix.org/blog/2020/11/03/how-we-fixed... and https://github.com/element-hq/synapse/blob/mast...

and both of those focus on scalability instead of high availability/redundancy.

backups are easy to configure though.

looks like the best option is just to use monolith mode and focus on taking good backups

I assume scalability issues are unlikely as we won't be supporting that many users?

yeah, i don't expect scalability issues.

and high availability isn't that important. we have IRC as a backup

mayhem: can you point chatbrainz to the vm with a short ttl?

on it

also, a `CNAME element matrix.chatbrainz.org`

<lucifer> "zas, atj: it seems redundancy is..." <- I have my synapse in a VM and the whole VM in HA-setup. redundancy would mean more workers/reverse proxies or those in a combination of these synapse workers. but downtime isn't that big issue, every federation caches and pulls the delta when it comes back online.

maybe dendrite could be worth a shot, dunno, never tried it

mr44er[m]: i see, do the VMs share a database?

I use dendrite for a personal homeserver and it's missing a lot of features

<lucifer> "mr44er: i see, do the VMs..." <- the db is exclusive for synapse within the VM, but it would not be necessary

I was just lazy and like everything in the VM

i think to be fully HA we would need a db on each VM too. so iiuc the way your setup is running atm.

if I remember correctly ~10 days of downtime was default to keep/pull messages back

how do the synapse instances on multiple VMs sync with each other?

like every federation/matrix server

but true HA from within synapse isn't possible afaik.

but multiple postgresql-servers should be possible. if you point synapse to front/mainserver it should work.

a bit confused right now. i am looking for HA outside of synapse.

to be clear.

but the two options i found were HA within synapse which seems hard to get.

I have one instance, one VM with synapse and postegresql.

makes sense. how do you get HA with it?

and this (whole) VM configured as HA, independently from synapse etc

proxmox cluster

ah i see, never heard the name before but is it like vm snapshotting in almost real time?

one server goes down, no problem. VM switches server, no downtime, no ping lost

yes

got it, makes sense.

true HA, no downtime, I recommend ceph 😉

hehe. i think too much complexity for our use case.

i was hoping for something like a postgres master/standby system where we could flip a switch to failover manually or maybe automatically.

yeah, this would be the best solution. a combination of this I use with opnsense in addition to the HA. updates without downtime, because instance1 or instance2 always overtakes automatically

with postgres it would work, but synapse is only single instance right now

right i meant if synapse could function like that. but that doesn't seem possible.

the options you have mentioned look good too but i personally have no idea if its worth the additional maintenance effort needed. probably the best for zas or atj to decide.

lucifer: no, just use a single instance and be done with it

cool

if this were critical functionality then it might be worth investing the effort to achieve HA

makes sense

thanks for help though mr44er[m]! :)

if you want me to bootstrap a server let me know

<lucifer> "the options you have mentioned..." <- it is my workaround for the lack of synapse's feature regarding redundancy/HA whatsoever 🙂

atj: the latest vm that mayhem created today.

`65.21.242.117`

ok

can you add my key to root's `authorized_keys`?

sure

do we have a name?