16:55 PM
ruaok
I can tell. Its written in "proper" english. :)
2011-11-14 31802, 2011
16:56 PM
ruaok composes a strong follow-up email
2011-11-14 31856, 2011
16:56 PM
Swarup
hi ruaok!
2011-11-14 31826, 2011
16:57 PM
ruaok
I dont think I really understood your last email to me. try me again, please?
2011-11-14 31854, 2011
16:58 PM
Swarup
basically when we shutdown all our webservice apps (apprx 5-6) on multiple hosts....response is fine now with single user test..
2011-11-14 31817, 2011
16:59 PM
ruaok
ah, I see.
2011-11-14 31832, 2011
16:59 PM
ruaok
we need to check some configs then to see where the bottle neck might be.
2011-11-14 31837, 2011
16:59 PM
ruaok
ah!
2011-11-14 31850, 2011
16:59 PM
ruaok
you're still running the mb_server inside the VM, right?
2011-11-14 31800, 2011
17:00 PM
Swarup
so i recall warp or someone mentioned on Friday chat..that MB server looks for it's clients that requests came from..
2011-11-14 31813, 2011
17:00 PM
Swarup
yes
2011-11-14 31841, 2011
17:00 PM
Swarup
and we've our webservice on top that connects to this mb server..
2011-11-14 31855, 2011
17:00 PM
ruaok
did you ever change the web server inside the VM?
2011-11-14 31804, 2011
17:01 PM
ruaok
because right now its using a dev server setup.
2011-11-14 31810, 2011
17:01 PM
bitmap joined the channel
2011-11-14 31828, 2011
17:01 PM
ruaok
but since we're now actually deploying this, you ought to install nginx inside the VM and deploy the mb-server app inside that.
2011-11-14 31848, 2011
17:01 PM
ruaok
I think I may switch to this method for an upcoming release of the VM.
2011-11-14 31857, 2011
17:01 PM
ruaok
or at least allow both to be done easily.
2011-11-14 31836, 2011
17:02 PM
Swarup
change webserver? didn't get that..like what?
2011-11-14 31801, 2011
17:03 PM
ruaok
so, the VM comes setup with a catalyst based development server.
2011-11-14 31812, 2011
17:03 PM
ruaok
that isn't meant to handle more than 1-2 clients connecting to it.
2011-11-14 31832, 2011
17:03 PM
Swarup
ha ok..
2011-11-14 31837, 2011
17:03 PM
ruaok
so, we need to deploy a better web server inside the Vm that has more throughput.
2011-11-14 31800, 2011
17:04 PM
Swarup
no we didn't change on that side..only thing we changed was point to our own external postgres mb db host, and search server
2011-11-14 31803, 2011
17:04 PM
ruaok
have you ever used nginx?
2011-11-14 31810, 2011
17:04 PM
ruaok
ah, ok.
2011-11-14 31815, 2011
17:04 PM
ruaok
yeah, we need to tweak that then.
2011-11-14 31854, 2011
17:04 PM
Swarup
no ..but i can try..
2011-11-14 31811, 2011
17:05 PM
ruaok
all the hard stuff is done for you, since we deploy to nginx
2011-11-14 31819, 2011
17:06 PM
ruaok
log into the VM
2011-11-14 31821, 2011
17:06 PM
ruaok
then
2011-11-14 31827, 2011
17:06 PM
ruaok
apt-get install nginx
2011-11-14 31840, 2011
17:06 PM
Swarup
k
2011-11-14 31855, 2011
17:06 PM
ruaok
ping me when that's done so we can configure the server.
2011-11-14 31806, 2011
17:07 PM
Leftmost joined the channel
2011-11-14 31809, 2011
17:07 PM
Swarup
i guess i need to be root ..right?
2011-11-14 31815, 2011
17:07 PM
ruaok
yep
2011-11-14 31823, 2011
17:07 PM
ruaok
sudo su -
2011-11-14 31831, 2011
17:07 PM
ruaok
password is musicbrainz, unless you folks changed that
2011-11-14 31808, 2011
17:08 PM
Swarup
done
2011-11-14 31842, 2011
17:09 PM
ruaok
cd /etc/nginx
2011-11-14 31821, 2011
17:10 PM
ruaok
hmmm.
2011-11-14 31841, 2011
17:10 PM
ruaok
all the config files are in ~musicbrainz/admin/nginx
2011-11-14 31853, 2011
17:10 PM
ruaok
so we're going to link to those files with symlinks.
2011-11-14 31819, 2011
17:11 PM
ruaok
gimme a sec while I fire up an instance.
2011-11-14 31838, 2011
17:11 PM
Swarup
ok
2011-11-14 31824, 2011
17:19 PM
reosarevok
2011-11-14 31826, 2011
17:19 PM
ocharles
moin ruaok !
2011-11-14 31832, 2011
17:19 PM
reosarevok considers mailing them and asking for it to stop :p
2011-11-14 31834, 2011
17:19 PM
ruaok
moin ocharles
2011-11-14 31810, 2011
17:20 PM
nikki
ruaok: "proper" english? does that mean I write in such a british way or that reosarevok can't speak english? :P
2011-11-14 31823, 2011
17:20 PM
ruaok
nikki: a little of both. :)
2011-11-14 31843, 2011
17:20 PM
Leftmost
reosarevok, you'll probably just get sucked into a cult if you do that. :P
2011-11-14 31848, 2011
17:20 PM
reosarevok goes cry in the corner
2011-11-14 31855, 2011
17:20 PM
reosarevok
:p
2011-11-14 31859, 2011
17:20 PM
ruaok
awww, sorry reosarevok
2011-11-14 31846, 2011
17:21 PM
reosarevok
Leftmost, I can't, I'm already in the MB cult :p
2011-11-14 31820, 2011
17:22 PM
Leftmost
Where we worship consistent data.
2011-11-14 31827, 2011
17:23 PM
reosarevok won't mail them because he doesn't want to get sent sect stuff daily anyway
2011-11-14 31842, 2011
17:23 PM
reosarevok guesses they'd see it as a "PLZ SUBSCRIBE ME TO YR NEWZLETTA"
2011-11-14 31803, 2011
17:26 PM
reosarevok
ruaok: funnily enough, someone requested something pretty similar to what we were talking about on Style yesterday :p
2011-11-14 31826, 2011
17:26 PM
reosarevok
(completely independently)
2011-11-14 31839, 2011
17:26 PM
ruaok finally gets the VM to boot
2011-11-14 31840, 2011
17:28 PM
ruaok
Swarup: lets continue.
2011-11-14 31851, 2011
17:28 PM
Swarup
k
2011-11-14 31855, 2011
17:28 PM
ruaok
cd /etc/nginx/sites-available
2011-11-14 31821, 2011
17:29 PM
Swarup
done
2011-11-14 31836, 2011
17:29 PM
ruaok
ln -s ~musicbrainz/musicbrainz-server/admin/nginx/001-musicbrainz .
2011-11-14 31857, 2011
17:29 PM
ruaok
cd ../sites-enabled/
2011-11-14 31804, 2011
17:30 PM
ruaok
rm default
2011-11-14 31825, 2011
17:30 PM
ruaok
ln -s ../sites-available/001-musicbrainz .
2011-11-14 31853, 2011
17:30 PM
warp
2011-11-14 31820, 2011
17:31 PM
ocharles
warp: okie doke
2011-11-14 31835, 2011
17:31 PM
Swarup
ruaok..done
2011-11-14 31839, 2011
17:31 PM
ruaok
Swarup:
2011-11-14 31842, 2011
17:31 PM
ruaok
cd ..
2011-11-14 31849, 2011
17:31 PM
ruaok
mv nginx.conf nginx.conf.default
2011-11-14 31841, 2011
17:32 PM
Swarup
done
2011-11-14 31808, 2011
17:33 PM
ruaok
that may be all we need to do, but I need to double check that. hold on
2011-11-14 31845, 2011
17:33 PM
ruaok
ln -s ~musicbrainz/musicbrainz-server/admin/nginx/mbserver-rewrites.conf .
2011-11-14 31825, 2011
17:34 PM
zacd joined the channel
2011-11-14 31836, 2011
17:34 PM
ruaok
uh oh.
2011-11-14 31840, 2011
17:34 PM
zacd
Mmm?
2011-11-14 31841, 2011
17:34 PM
ruaok
the posse slowly rolls in.
2011-11-14 31853, 2011
17:34 PM
ruaok
hi zacd! :)
2011-11-14 31805, 2011
17:35 PM
zacd
Took me a while to run an extension cord outside the fence. Port 6667 is blocked on the office net.
2011-11-14 31820, 2011
17:35 PM
ruaok
lol
2011-11-14 31824, 2011
17:35 PM
ruaok
Swarup:
2011-11-14 31826, 2011
17:35 PM
ruaok
/etc/init.d/nginx stop
2011-11-14 31829, 2011
17:35 PM
ruaok
/etc/init.d/nginx start
2011-11-14 31836, 2011
17:35 PM
kepstin-netbook
zacd: freenode has a web irc client that just uses port 80.
2011-11-14 31843, 2011
17:35 PM
ruaok
ah, before you do that, stop the dev server, Swarup
2011-11-14 31851, 2011
17:35 PM
Swarup
ok
2011-11-14 31800, 2011
17:36 PM
ruaok
might be ok, since dev server runs on a different port, but still.
2011-11-14 31828, 2011
17:36 PM
ruaok
now if you go to the servers address you should get a 502 bad gateway error.
2011-11-14 31819, 2011
17:37 PM
Swarup
got this..probably some setup issue..
2011-11-14 31830, 2011
17:37 PM
Swarup
../etc/init.d/nginx start Starting nginx: [emerg]: open() "/etc/nginx/nginx.conf" failed (2: No such file or directory) configuration file /etc/nginx/nginx.conf test failed
2011-11-14 31843, 2011
17:38 PM
zacd
What're you guys trying to do, exactly?
2011-11-14 31813, 2011
17:39 PM
Swarup
setting up nginx on mb vm ..to handle throughput..
2011-11-14 31851, 2011
17:39 PM
ruaok
Swarup: ls /etc/nginx
2011-11-14 31806, 2011
17:40 PM
zacd
But like...
2011-11-14 31811, 2011
17:40 PM
ruaok
you should have a symlink from nginx.conf going to /home/musicbrainz/musicbrainz-server/admin/nginx/nginx.conf
2011-11-14 31821, 2011
17:40 PM
zacd
We're not running out of host resources from what I can tell...
2011-11-14 31822, 2011
17:40 PM
Swarup
ls /etc/nginx conf.d fastcgi_params koi-utf koi-win mbserver-rewrites.conf mime.types nginx.conf.default scgi_params sites-available sites-enabled uwsgi_params win-utf
2011-11-14 31827, 2011
17:40 PM
zacd
What are we running out of?
2011-11-14 31830, 2011
17:40 PM
ruaok
zacd: the server that ships with the VM is a dev server not setup for a great amount of throughput.
2011-11-14 31858, 2011
17:40 PM
ruaok
not sure of the exact thing we're running out of, but we were doing it wrong for this case.
2011-11-14 31809, 2011
17:41 PM
ruaok
so we're setting up nginx, to do it right.
2011-11-14 31827, 2011
17:41 PM
ruaok
then we can check to see the throughput. that should improve things a lot.
2011-11-14 31844, 2011
17:41 PM
ruaok
Swarup: cd /etc/nginx
2011-11-14 31801, 2011
17:42 PM
ruaok
ln -s ~musicbrainz/musicbrainz-server/admin/nginx/nginx.conf .
2011-11-14 31805, 2011
17:42 PM
Swarup
y on it
2011-11-14 31806, 2011
17:42 PM
ruaok
then try the start again
2011-11-14 31808, 2011
17:42 PM
ruaok
k
2011-11-14 31825, 2011
17:42 PM
kepstin-laptop joined the channel
2011-11-14 31812, 2011
17:43 PM
Swarup
../etc/init.d/nginx start Starting nginx: [emerg]: open() "/etc/nginx/site-name.conf" failed (2: No such file or directory) in /etc/nginx/sites-enabled/001-musicbrainz:3 configuration file /etc/nginx/nginx.conf test failed
2011-11-14 31833, 2011
17:43 PM
ruaok
ah, I think my vm is a bit behind the times.
2011-11-14 31837, 2011
17:43 PM
Swarup
should i add same sym link for it too..
2011-11-14 31808, 2011
17:44 PM
ruaok
that file isn't in git.
2011-11-14 31810, 2011
17:44 PM
ruaok
one sec.
2011-11-14 31848, 2011
17:44 PM
ocharles
warp: ship ship ship
2011-11-14 31800, 2011
17:45 PM
warp
ocharles: yay!
2011-11-14 31810, 2011
17:45 PM
ruaok
Swarup: create the file and have it contain only one line:
2011-11-14 31811, 2011
17:45 PM
ruaok
2011-11-14 31819, 2011
17:45 PM
Swarup
k
2011-11-14 31828, 2011
17:45 PM
ruaok
thats for our server. put whatever valid DNS name you intent to use in there.
2011-11-14 31830, 2011
17:45 PM
ruaok
then restart
2011-11-14 31806, 2011
17:46 PM
ruaok
(nginx that is)
2011-11-14 31833, 2011
17:46 PM
Swarup
../etc/init.d/nginx start Starting nginx: [warn]: duplicate MIME type "text/html" in /etc/nginx/sites-enabled/001-musicbrainz:16 [warn]: duplicate MIME type "text/html" in /etc/nginx/sites-enabled/001-musicbrainz:29 nginx.
2011-11-14 31842, 2011
17:46 PM
Swarup
warnings..is that ok..
2011-11-14 31810, 2011
17:47 PM
ruaok
yeah. I'll leave that to you to clean up. ;)
2011-11-14 31821, 2011
17:47 PM
Swarup
k
2011-11-14 31802, 2011
17:48 PM
ruaok
ok, we're half done.
2011-11-14 31819, 2011
17:48 PM
ruaok
apt-get install daemontools daemontools-run
2011-11-14 31834, 2011
17:49 PM
Swarup
done
2011-11-14 31844, 2011
17:49 PM
ruaok
cd /usr/local
2011-11-14 31852, 2011
17:49 PM
ruaok
mkdir musicbrainz-server
2011-11-14 31858, 2011
17:49 PM
ruaok
cd musicbrainz-server/
2011-11-14 31815, 2011
17:50 PM
Swarup
k
2011-11-14 31825, 2011
17:50 PM
Swarup
done
2011-11-14 31851, 2011
17:50 PM
ruaok
cp ~musicbrainz/musicbrainz-server/admin/nginx/service/run .
2011-11-14 31855, 2011
17:50 PM
ruaok
edit run
2011-11-14 31800, 2011
17:51 PM
ruaok
look for nproc
2011-11-14 31804, 2011
17:51 PM
ruaok
its set to 5
2011-11-14 31817, 2011
17:51 PM
ruaok
that is the number of processes to start
2011-11-14 31822, 2011
17:51 PM
ruaok
how much ram does the VM have?
2011-11-14 31835, 2011
17:53 PM
Swarup
done..command to check ram..let me see..
2011-11-14 31856, 2011
17:53 PM
ruaok
free
2011-11-14 31833, 2011
17:54 PM
Swarup
total used free shared buffers cached Mem: 1024968 617204 407764 0 105868 426012 -/+ buffers/cache: 85324 939644 Swap: 1044476 3800 1040676
2011-11-14 31857, 2011
17:54 PM
ruaok
that will also be a problem for you guys.
