zas, they will all have things like that, at least they aren't hiding it
ruaok
zas: all but the downloading platform might get us.
but we still have OSUOSL for the US downloads
zas
ruaok: well, we have to make things clear from start with OVH, because they are used to promise a lot, and often reality is a bit under ;)
ruaok
reosarevok: when research money gets handed out, everyone in the vicinity holds out their hands and wants money. everything gets really expensive really fast.
reosarevok shrugs. I guess I shouldn't be surprised everyone everywhere are crooks :p
zas: yeah, having a higher guarantees might be good then. that will get us what we need.
we should also keep google cloud hosting in mind.
I thin jira could live there.
probably other things. since we have a budget for that stuff.
at the current $45/month rate it is going to take us a long time to use our $10k donation from google. :)
zas
Perhaps we could move discourse to it too
KodeStar
ruaok: they will all promise the earth, I think on the budget side of things (hetzner, online.net, ovh) your experiences are going to be similar with all of them
ruaok
likely yes.
zas
KodeStar: true, though i think OVH proposes superior technical solutions atm
ruaok
I just want to avoid the hidden charges that hetnzer seem fond of.
reosarevok
Is this like the Ryanair of hosting?
ruaok
the vrack alone is a big deal.
reosarevok: starting to look that way.
zas
Exactly.
ruaok
one server is VERY cheap.
two servers (I want a seat) much more expensive.
if you want to have luggage or go to the loo, eeek!
zas
Easyjet business model ;)
KodeStar
it's been a long long time since I had a hetzner server, so I can't really talk about them, just that every time I look at them they don't seem that appealing, I have had servers with ovh(SYS) for 5-6 years, and online.net for 2-3years
ruaok
not really, easyjet doesn't do stupid shit like that.
their fees are all printed on the tin.
ruaok says he as he waits for his SleasyJet flight
At 4pm it is time to go back to the airport distillery.
I'm really glad we're having this conversation and I appreciate your input KodeStar
KodeStar
ovh definitely have the more interesting technical solutions at the moment
Freso is glad he lured KodeStar into this channel :D
lol
ruaok
does CI need to be with the rest or can it go to Google cloud?
zas
I dunno. bitmap ^^
That said, i think it should be possible.
ruaok: i wonder about IP load balancing provided by some NewHost candidates, perhaps this is something we could use to improve scalability of our system, the thing bothering me is the current gateway setup, where all traffic goes through one machine. If we have possibility to load balance IPs we could split traffic over more gateway machines (we already have
HA, it would need to be adjusted a bit to have more machines). I'm not sure how yet, but getting rid of this single point of failure would be great
ruaok
worth investigating.
zas
OVH allows to load balance per "region", and together with vRack it could be a way to have servers near users
KodeStar
zas, thats always been my issue with load balancing, the fact everything goes through a single machine
Hmmm, "The Load Balancing IP will soon be compatible with the vRack." written in small at the end of page
reosarevok
Soon(TM)?
KodeStar
i've only set it up with vps's at the moment zas
and haven't actually used it, was going to test running our 300million requests a month from vp's with a load balancing ip
*vps's
but haven't got round to it, been busy trying to build the new site
does it need vrack support? Surely you can still target the individual machines within the vrack?
question for them though
zas / ruaok, have you considered using proxmox and virtualising some of you infrastructure, you will probably get more efficient use of the servers
zas
I don't kown anything about proxmox yet
But we are using Xen (in fact, not much, because it is getting old)
MajorLurker has quit
KodeStar
lxc are a lot more efficient than xen though
you can also create xen containers with proxmox though
iirc
I have 7 lxc containers on my SYS(OVH) server, it has 64GB of RAM, and the API server (receiving 200 - 400 requests a second at peak times), this quassel instance I'm talking from now, api images downloads, the new dev site, the new dev database and the site forums all run off it without any skipping a beat
although I should qualify that, while it runs smoothly I want to move the images off it onto a cheap small dedicated server as it causes unnecessary iowait
what os do you use on the servers?
zas
I prefer small dedicated servers of virutal ones, mostly because hardware failures have much less impact.
Ubuntu 14.04 for now
KodeStar
zas, that is true of course, but you could always have backups, you can also have proxmox clusters, so you can move vms between nodes with no downtime(never tried this myself though)
it uses debian (8 iirc) for the host os, most of my vm's are debian, but I have ubunto 16.04 on the dev vm because of the performance increases php7 provides
ruaok
chrisskye: we've received 3 payments from customers to the new account so far. very good.
and as predicted the $50k send from our CA account is still nowhere to be seen. it should've arrived today.
CallerNo6 joined the channel
it makes me a little twitchy that our net worth is $50k less than it was at the beginning of the week. It isn't in any of our accounts and just sorta in limbo.
yay thpain!
KodeStar: do you have any appreciation for the latency between vrack nodes? compared to a regular switch?
KodeStar
no, I don't have an vrack machines at the moment
*any
ruaok
that would be my only concern.
app servers need speedy connections to postgres.
KodeStar
if the servers are in the same dc I would imagine latency would be low
might be worth asking them if you could test a couple of servers
upgrading it to 1gbps costs an extra 35 euro a month
is the only issue with that one
but honestly, I would imagine the ovh vrack would be as low latency as most regular switches
The Cisco ASR 9000 devices serve as a bridge for the vRack. They are at the gateway to each datacentre and linked to each other in order to route the data without passing through the public network. The Nexus 6000s and Nexus 2000s act as network gateways to interconnect your different servers.
the latency better be low between nodes in the same data center. :)
I am more concerned about latency than speed.
the speed is almost certainly going to exceed our needs for the next 2-3 years. I think.
but if there is a 1ms increased latency between nodes, that adds 2ms for each round trip to our DB server.
and devs get kinda pissy when WS requests take more than 50ms
ruaok rolls his eyes exaggeratedly
KodeStar
well according to that link
Roubaix => Beauharnois: 40 ms
Gravelines => Strasbourg: 9 ms
40 ms france to canada is pretty good
minteria joined the channel
anthony25_ joined the channel
Freso
Oh, btw/ftr/psa: I'm about to leave to perform at another festival thingy tomorrow. I'll back sometime Sunday, hopefully not too late. Got mobile and laptop with me, so I'll be reachable in case of emergency.
kurros has quit
typhoe has quit
kepstin has quit
anthony25 has quit
anthony25_ is now known as anthony25
kurros joined the channel
typhoe joined the channel
kepstin joined the channel
kanha has quit
ruaok wonders if it is gin time yet.
Slurpee joined the channel
madmouser1 joined the channel
reosarevok
ruaok: gindulge yourself
ruaok
groan.
Gentlecat
ruaok: why not reuse the same sign up system?
ruaok
that is what I was suggesting as one of the possibilities.
it would need more caching because number of requests between the two is vastly different.
Gentlecat
as in just change the wording to say that API key is also for our services
not only for getting the replication packets from meb.org
BTW, I think we should distribute all of our data dumps there
including CB, mbspotify, whatever else
ruaok
I think a common download place makes sense, yes. that would play well into chrisskye's comments from yesterday.
Gentlecat
I think it makes sense to have a central place for people to get data
ruaok
but it would be against our charter to require an access key for everything.
Gentlecat
we can choose what requires a key and what doesn't
ruaok nods
I don't see why we need it for everything
ruaok
yeah.
so given the plans that zas and I are making, we'll need to have this code working for the move to the EU
Gentlecat
CB dumps aren't updated hourly, for example
though you are saying that MB WS needs to work with that, but I'm not yet sure how that would work reliably and fast
minteria has quit
ruaok
you have to allow for some sloppiness in that.
given the context of the window i was discussing earlier, you could choose to lookup and check the key once per window.
meaning that we could to X requests before checking it again.
that would likely still be a quite a lot.
we could check the validity of a key every n minutes
and then store the "currently" good keys in redis.
so, if you revoke a key, you will still provide service for n minutes.
which is fine, as long as n isn't stupidly long.
and even then they offending key could be removed from redis menually.