<02UltimateRiff> I was just about to ask the same thing, relaxoMob~
2024-05-23 14434, 2024
bitmap
relaxoMob, UltimateRiff: hopefully it can be deployed to beta tomorrow, and then have an extended testing period, probably being released to production on June 3rd
hope so, just need to submit a couple more PRs (one to make sure the new edit types don't ISE if you try to load them on the main site, and another to update some configuration)
ericd23_: Yes, good reminder, I will add them in a bit.
2024-05-23 14458, 2024
lucifer
yvanzo: hi! i took care of the alerts on datasethoster but we haven't really updated brainzbot-core in a year or so because it is very outdated and the original repo we forked it is not maintained anymore. for the short term, i think we should leave it as is and in the longer term, we will probably have to rewrite our own bot from scratch.
2024-05-23 14412, 2024
lucifer
zas, atj: hi! when would you be available to discuss about setting up our matrix homeserver?
2024-05-23 14429, 2024
mayhem
awww yisss, please.
2024-05-23 14454, 2024
mayhem
I think we settled on getting two VMs to get the job done.
2024-05-23 14453, 2024
lucifer
yup. need to go over the details of the setup once, setting up backups and possibly co-ordinating with libera.chat admins for extended rate limits so on.
2024-05-23 14438, 2024
zas
lucifer: now?
2024-05-23 14451, 2024
lucifer
sure
2024-05-23 14402, 2024
zas
did you already define resources needed in terms of disk space/cpu/ram?
2024-05-23 14441, 2024
yvanzo
hi lucifer, fair enough, thanks for having looked at it :)
2024-05-23 14406, 2024
lucifer
zas: looking at some of the cloud offerings for hosting matrix homeservers, i am thinking 8GB ram and 250GB storage.
2024-05-23 14445, 2024
lucifer
we intend to use dedicated hetzner vms right?
2024-05-23 14457, 2024
lucifer
CPX31, CCX23 hetzner VMs look good to me.
2024-05-23 14428, 2024
mayhem
do you know if the matrix is CPU intensive?
2024-05-23 14417, 2024
mayhem
because I see the dedicated instances as not a good deal.
2024-05-23 14429, 2024
mayhem
well, they weren't a good deal, but hetzner no longer has a 30eur/month bare metal machines. :(
2024-05-23 14423, 2024
mayhem
two CPX31s do seem like a pretty good idea.
2024-05-23 14420, 2024
mayhem
how about CAX21 or CAX31? I hear good things about the arm64 server. but I am not sure that everything we need to install is available for arm64
2024-05-23 14421, 2024
lucifer
reading from other people's experiences online, it doesn't seem to be cpu intensive.
2024-05-23 14438, 2024
mayhem
great. then lets not get a dedicated instance, shouldn't be needed.
2024-05-23 14404, 2024
lucifer
yeah i saw the arm ones. but i am not sure everything supports it at the moment.
2024-05-23 14425, 2024
mayhem
how difficult would it be to check that>
2024-05-23 14426, 2024
mayhem
?
2024-05-23 14440, 2024
mayhem
I could get you a test machine and if its a pain, we dump it and move to amd
zas: did we ever figure out if we still need musicbrainz-docker-test ?
2024-05-23 14451, 2024
lucifer
zas: should be okay i think. as for redundancy, let me check.
2024-05-23 14458, 2024
mayhem
been created 3 years ago.
2024-05-23 14428, 2024
mayhem
lucifer: 65.21.242.117
2024-05-23 14433, 2024
mayhem
log in as root.
2024-05-23 14439, 2024
lucifer
thanks!
2024-05-23 14452, 2024
mayhem
zas: do you know if our metabrainz server setup routine can run on arm64?
2024-05-23 14459, 2024
atj
what do you mean by metabrainz server setup routine?
2024-05-23 14410, 2024
atj
ansible bootstrap or something else?
2024-05-23 14451, 2024
atj
lucifer: there are arm64 docker images AFAICS
2024-05-23 14434, 2024
mayhem
atj: not familiar with all the ansible bits... but the process that takes a bare machine and makes it a metabrainz machine with all the accounts, firewall, etc.
<lucifer> "zas, atj: it seems redundancy is..." <- I have my synapse in a VM and the whole VM in HA-setup. redundancy would mean more workers/reverse proxies or those in a combination of these synapse workers. but downtime isn't that big issue, every federation caches and pulls the delta when it comes back online.
2024-05-23 14444, 2024
mr44er[m]
maybe dendrite could be worth a shot, dunno, never tried it
2024-05-23 14424, 2024
lucifer
mr44er[m]: i see, do the VMs share a database?
2024-05-23 14426, 2024
atj
I use dendrite for a personal homeserver and it's missing a lot of features
2024-05-23 14418, 2024
mr44er[m]
<lucifer> "mr44er: i see, do the VMs..." <- the db is exclusive for synapse within the VM, but it would not be necessary
2024-05-23 14446, 2024
mr44er[m]
I was just lazy and like everything in the VM
2024-05-23 14414, 2024
lucifer
i think to be fully HA we would need a db on each VM too. so iiuc the way your setup is running atm.
2024-05-23 14404, 2024
mr44er[m]
if I remember correctly ~10 days of downtime was default to keep/pull messages back
2024-05-23 14415, 2024
lucifer
how do the synapse instances on multiple VMs sync with each other?
2024-05-23 14434, 2024
mr44er[m]
like every federation/matrix server
2024-05-23 14414, 2024
mr44er[m]
but true HA from within synapse isn't possible afaik.
2024-05-23 14446, 2024
mr44er[m]
but multiple postgresql-servers should be possible. if you point synapse to front/mainserver it should work.
2024-05-23 14458, 2024
lucifer
a bit confused right now. i am looking for HA outside of synapse.
2024-05-23 14407, 2024
lucifer
to be clear.
2024-05-23 14428, 2024
lucifer
but the two options i found were HA within synapse which seems hard to get.
2024-05-23 14444, 2024
mr44er[m]
I have one instance, one VM with synapse and postegresql.
2024-05-23 14411, 2024
lucifer
makes sense. how do you get HA with it?
2024-05-23 14414, 2024
mr44er[m]
and this (whole) VM configured as HA, independently from synapse etc
2024-05-23 14419, 2024
mr44er[m]
proxmox cluster
2024-05-23 14406, 2024
lucifer
ah i see, never heard the name before but is it like vm snapshotting in almost real time?
2024-05-23 14409, 2024
mr44er[m]
one server goes down, no problem. VM switches server, no downtime, no ping lost
2024-05-23 14419, 2024
mr44er[m]
yes
2024-05-23 14429, 2024
lucifer
got it, makes sense.
2024-05-23 14446, 2024
mr44er[m]
true HA, no downtime, I recommend ceph 😉
2024-05-23 14442, 2024
lucifer
hehe. i think too much complexity for our use case.
2024-05-23 14415, 2024
lucifer
i was hoping for something like a postgres master/standby system where we could flip a switch to failover manually or maybe automatically.
2024-05-23 14438, 2024
mr44er[m]
yeah, this would be the best solution. a combination of this I use with opnsense in addition to the HA. updates without downtime, because instance1 or instance2 always overtakes automatically
2024-05-23 14404, 2024
mr44er[m]
with postgres it would work, but synapse is only single instance right now
2024-05-23 14452, 2024
lucifer
right i meant if synapse could function like that. but that doesn't seem possible.
2024-05-23 14457, 2024
lucifer
the options you have mentioned look good too but i personally have no idea if its worth the additional maintenance effort needed. probably the best for zas or atj to decide.
2024-05-23 14412, 2024
atj
lucifer: no, just use a single instance and be done with it
2024-05-23 14424, 2024
lucifer
cool
2024-05-23 14444, 2024
atj
if this were critical functionality then it might be worth investing the effort to achieve HA
2024-05-23 14404, 2024
lucifer
makes sense
2024-05-23 14434, 2024
lucifer
thanks for help though mr44er[m]! :)
2024-05-23 14440, 2024
atj
if you want me to bootstrap a server let me know
2024-05-23 14451, 2024
mr44er[m]
<lucifer> "the options you have mentioned..." <- it is my workaround for the lack of synapse's feature regarding redundancy/HA whatsoever 🙂
