-
CatQuest
:sad beep:
2016-05-26 14756, 2016
-
ruaok
R2 doesn't go where we need it to go.
2016-05-26 14757, 2016
-
alastairp
CatQuest: r2 goes to the airport
2016-05-26 14706, 2016
-
alastairp
And is the one I travel on the most
2016-05-26 14721, 2016
-
CatQuest thinks neither ruaok not alastairp knows why i wrote "r2"
2016-05-26 14737, 2016
-
CatQuest
it ends with "deetoo"
2016-05-26 14740, 2016
-
gcilou
"d2"?
2016-05-26 14742, 2016
-
alastairp
Also, when I travel on the others, I start closer to the edge of the city so never pass through that station
2016-05-26 14744, 2016
-
gcilou
ha
2016-05-26 14747, 2016
-
ruaok
yeah, i suppose if someone wants to use the train for the airport T2 they can use the R2 and change at sants. also not bad.
2016-05-26 14748, 2016
-
CatQuest
gcilou: gets a point!
2016-05-26 14752, 2016
-
gcilou
woohoo
2016-05-26 14700, 2016
-
alastairp
Anyway. Too much talk about commuter trains
2016-05-26 14717, 2016
-
CatQuest
(I honestly thought the ":sad beep:" would make people go "ooooh")
2016-05-26 14734, 2016
-
CatQuest
alastairp: these are not the trains you're looking for
2016-05-26 14721, 2016
-
gcilou
the train knowledge is strong in that one
2016-05-26 14723, 2016
-
fc7_ joined the channel
2016-05-26 14701, 2016
-
fc7_
hi there
2016-05-26 14734, 2016
-
ruaok
sorry, we're not home.
2016-05-26 14743, 2016
-
CatQuest is going ot bed
2016-05-26 14744, 2016
-
ruaok
i mean, I there. :)
2016-05-26 14757, 2016
-
fc7_
ey
2016-05-26 14702, 2016
-
CatQuest
ruaok: you where?
2016-05-26 14726, 2016
-
fc7_
I'm deploying a musicbrainz mirror
2016-05-26 14729, 2016
-
CatQuest
(i's also a pun)
2016-05-26 14736, 2016
-
CatQuest
yes i am ,a phun
2016-05-26 14738, 2016
-
CatQuest
so phunny
2016-05-26 14744, 2016
-
CatQuest
now i am a bed. so bedding
2016-05-26 14746, 2016
-
fc7_
and I wanted to ask a question about the rate limit
2016-05-26 14750, 2016
-
CatQuest
very duvet
2016-05-26 14754, 2016
-
ruaok
shoot, Freso
2016-05-26 14711, 2016
-
fc7_
is it possible to tune or disable the rate limit?
2016-05-26 14714, 2016
-
CatQuest
I'm catcat! you're getting scnadinavians confused
2016-05-26 14742, 2016
-
ruaok
our software as shipped does not have a rate limit feature.
2016-05-26 14743, 2016
-
fc7_
I'm only planning to use the webservice V2
2016-05-26 14749, 2016
-
ruaok
that is part of our setup.
2016-05-26 14755, 2016
-
ruaok
so, no need to disable anything
2016-05-26 14757, 2016
-
fc7_
oh allright
2016-05-26 14705, 2016
-
fc7_
then I need to go and check again
2016-05-26 14714, 2016
-
fc7_
but I'm getting a lot of 503 errors :(
2016-05-26 14718, 2016
-
ruaok
now, did you setup the search server?
2016-05-26 14727, 2016
-
fc7_
no just the mirror
2016-05-26 14734, 2016
-
ruaok
that is your problem.
2016-05-26 14734, 2016
-
fc7_
db replication
2016-05-26 14735, 2016
-
fc7_
etc
2016-05-26 14742, 2016
-
fc7_
oh thanks!
2016-05-26 14743, 2016
-
ruaok
when you make a search, it uses our search servers.
2016-05-26 14752, 2016
-
ruaok
which are rate limited.
2016-05-26 14701, 2016
-
fc7_
will go now and check how to deploy the search on the same server
2016-05-26 14707, 2016
-
fc7_
thank you very much!
2016-05-26 14713, 2016
-
ruaok
np
2016-05-26 14724, 2016
-
fc7_
btw
2016-05-26 14735, 2016
-
fc7_
i installed redis and memcached on the same VM
2016-05-26 14750, 2016
-
fc7_
do I need to enable it in the configuration file?
2016-05-26 14708, 2016
-
fc7_
to make use of it?
2016-05-26 14712, 2016
-
ruaok
possibly. have a look, the file is pretty self explanatory.
2016-05-26 14721, 2016
-
ruaok
if you used default setups, it might just work.
2016-05-26 14732, 2016
-
fc7_
ok
2016-05-26 14745, 2016
-
fc7_
thanks :)
2016-05-26 14737, 2016
-
fc7_
is it a good idea to run the server and the search server on the same VM?
2016-05-26 14705, 2016
-
ruaok
depends on how much ram you have in your VM and how many requests/s you want.
2016-05-26 14727, 2016
-
ruaok
we have 15 or so machines to handle 500 requests/sec
2016-05-26 14710, 2016
-
ruaok
so, nearly everything is duplicated one way or another.
2016-05-26 14745, 2016
-
fc7_
thanks for tip
2016-05-26 14759, 2016
-
Freso shoots ruaok
2016-05-26 14721, 2016
-
ruaok
?
2016-05-26 14743, 2016
-
Freso
2016-05-26 14708, 2016
-
fc7_
i just started with the minimum (2 vcpus 2GB of RAM) and build on top of that
2016-05-26 14729, 2016
-
ruaok
you'll want more ram.
2016-05-26 14739, 2016
-
ruaok
with 2GB things will be very very slow
2016-05-26 14747, 2016
-
fc7_
i was expecting that ;)
2016-05-26 14735, 2016
-
fc7_
but to be honest we don't have a clue about how many reqs/sec we expect
2016-05-26 14752, 2016
-
fc7_
so we will need to build a baseline
2016-05-26 14711, 2016
-
ruaok
who is your target audience?
2016-05-26 14755, 2016
-
fc7_
2016-05-26 14710, 2016
-
fc7_
it's a media server like plex
2016-05-26 14726, 2016
-
Freso
2016-05-26 14712, 2016
-
fc7_
:)
2016-05-26 14735, 2016
-
fc7_
I will discuss that with the project leaders, I'm just doing a small part
2016-05-26 14706, 2016
-
fc7_
so we started using musicbrainz to get metadata for users music libraries
2016-05-26 14734, 2016
-
fc7_
but due to the rate-limitation on the service, library scans for users takes a long long time
2016-05-26 14759, 2016
-
fc7_
so to overcome that we thought about offloading your servers by deploying some mirrors
2016-05-26 14726, 2016
-
fc7_
so the idea is to start with one server to create a baseline of what kind of investment will be to support all our users on our own mirrors
2016-05-26 14753, 2016
-
fc7_
in terms of cloud compute services....
2016-05-26 14709, 2016
-
fc7_
how many VMs, with which amount of resources....etc
2016-05-26 14747, 2016
-
Freso
Setting up mirrors is usually our recommendation too, FWIW.
2016-05-26 14725, 2016
-
fc7_
absolutelly
2016-05-26 14759, 2016
-
fc7_
now we need to see how many we need and if we can afford that
2016-05-26 14724, 2016
-
fc7_
to keep up with the load at a decent service level
2016-05-26 14714, 2016
-
fc7_
btw is there any documentation I can check regarding performance tuning?
2016-05-26 14723, 2016
-
fc7_
like memcached and redis configurations
2016-05-26 14725, 2016
-
fc7_
etc
2016-05-26 14727, 2016
-
fc7_
?
2016-05-26 14759, 2016
-
fc7_
i mean specific for musicbrainz server
2016-05-26 14710, 2016
-
Freso
zas, bitmap, chirlu, ruaok: ^
2016-05-26 14746, 2016
-
Freso
2016-05-26 14759, 2016
-
bitmap
not aware of any specific config tweaks we've made from the defaults for those
2016-05-26 14741, 2016
-
bitmap
redis isn't performance critical, mostly just used for logins
2016-05-26 14705, 2016
-
bitmap
just make sure DEVELOPMENT_SERVER is disabled in DBDefs.pm
2016-05-26 14713, 2016
-
fc7_
done
2016-05-26 14724, 2016
-
fc7_
same for CATALYST_DEBUG
2016-05-26 14745, 2016
-
fc7_
and DB_STAGING_SERVER
2016-05-26 14712, 2016
-
fc7_
anyway I think we will only be publishing the V2 webservice, so no logins or any other thing but queries for the webservice
2016-05-26 14732, 2016
-
fc7_
to retrieve metadata
2016-05-26 14733, 2016
-
minteria joined the channel
2016-05-26 14718, 2016
-
ruaok
what are your use cases? who are you setting this up for?
2016-05-26 14742, 2016
-
ruaok
memcached and redis configs matter less than RAM overall.
2016-05-26 14706, 2016
-
fc7_
is for Emby users that will retrieve metadata to feed their music libraries
2016-05-26 14717, 2016
-
fc7_
using the webservice
2016-05-26 14746, 2016
-
ruaok
heh.
2016-05-26 14755, 2016
-
fc7_
problem is I don't know how many users we are talking about.... (yes it's very early stages)
2016-05-26 14704, 2016
-
ruaok
well, I guarantee you that 2GB won't make for an effective mirror.
2016-05-26 14710, 2016
-
fc7_
hahaha
2016-05-26 14715, 2016
-
fc7_
got that ruaok
2016-05-26 14733, 2016
-
ruaok
srsly, the kodi realm of things tends to generate a LOT of hits.
2016-05-26 14747, 2016
-
fc7_
how much memory do you suggest?
2016-05-26 14751, 2016
-
fc7_
to start with
2016-05-26 14755, 2016
-
ruaok
so many that we have to throttle them. we can't afford the resources.
2016-05-26 14756, 2016
-
fc7_
8GB?
2016-05-26 14725, 2016
-
pingupingu joined the channel
2016-05-26 14726, 2016
-
ruaok
and I have a sneaky feeling that you're setting up a mirror because people are unhappy with our level of service currently.
2016-05-26 14743, 2016
-
fc7_
nah they don't
2016-05-26 14758, 2016
-
ruaok
and if that hunch is anywhere near right, then its not matter of how many GBs, but how many servers.
2016-05-26 14719, 2016
-
fc7_
sorry, some of them are unhappy
2016-05-26 14720, 2016
-
ruaok
let's do some math.
2016-05-26 14740, 2016
-
fc7_
but they don't know about the rate-limit on mb servers....
2016-05-26 14746, 2016
-
ruaok
if you have 10 users, each making 1 request a second (like our limit) that is 10 requests a second.
2016-05-26 14729, 2016
-
ruaok
a VM that is running app server, database and search server isn't likely going to serve more than 10 requests a second.
2016-05-26 14747, 2016
-
ruaok
really, I'm just guessing at shit to try and paint some sort of picture to help you along.
2016-05-26 14702, 2016
-
fc7_
no worries man
2016-05-26 14710, 2016
-
fc7_
I don't expect help on that
2016-05-26 14716, 2016
-
fc7_
we can figure it out ourselves...
2016-05-26 14723, 2016
-
ruaok
so, if you're setting up a mirror for 10 people, why not just use our service. (it recently got a lot better, btw)
2016-05-26 14728, 2016
-
fc7_
when we start to see the servers melt down...believe me...
2016-05-26 14747, 2016
-
ruaok
I'm trying to save you a pile of trouble, is what I am saying.
2016-05-26 14703, 2016
-
fc7_
yeah I get it and I appreciate it
2016-05-26 14714, 2016
-
fc7_
:)
2016-05-26 14714, 2016
-
ruaok
if you come out and say: Look, we have a mirror and 1000 people come and try and use it, you'll have 1000 unhappy people.
2016-05-26 14743, 2016
-
ruaok
so, try and ask more questions about expected use and then come back and we'll chat more.
2016-05-26 14751, 2016
-
ruaok
zas would be another good person to chat to about this.
2016-05-26 14756, 2016
-
fc7_
thanks man
2016-05-26 14711, 2016
-
ruaok
2016-05-26 14711, 2016
-
fc7_
another question (I was reading "the state of the onion" link)
2016-05-26 14718, 2016
-
ruaok
this is 1 part of our hosting setup.
2016-05-26 14725, 2016
-
ruaok
the machines that run the web front ends.
2016-05-26 14725, 2016
-
fc7_
you guys have offices in Spain?
2016-05-26 14734, 2016
-
ruaok
yep.
2016-05-26 14746, 2016
-
ruaok
as soon as we get power from endesa we'll actually be in business. :)
2016-05-26 14703, 2016
-
ruaok
so far I can power the fiber connection off the solar panel for a few hours a day. :)
2016-05-26 14700, 2016
-
fc7_
lol
