No, I mean 'Buying another mini as an index server' , but opkay
2011-01-12 01258, 2011
ruaok
sent.
2011-01-12 01227, 2011
ruaok gives ijabz a chance to read it
2011-01-12 01218, 2011
ijabz
read it
2011-01-12 01245, 2011
ruaok
ok, lets see if we can summarize whats going on.
2011-01-12 01253, 2011
ruaok
great on a macbook pro and a mini.
2011-01-12 01202, 2011
ruaok
everyone else is lagging behind.
2011-01-12 01236, 2011
ruaok
I've run it on fatty: 12gb, 4 proc xeon box from 7 years ago.
2011-01-12 01250, 2011
ruaok
hobbes: latest gen mini with 8GB ram.
2011-01-12 01204, 2011
ruaok
rump: 4gb ram PC, with quad cores.
2011-01-12 01219, 2011
ruaok
hobbes, the cheap $900 machine beats all.
2011-01-12 01253, 2011
ruaok
each setup was using PG 9.0.x compiled from source with pretty much only shared segements tuned.
2011-01-12 01206, 2011
ijabz
its not often Macs get called cheap !
2011-01-12 01233, 2011
ruaok
I find them cheap, when you amortize its cost over its longer lifetime when compared to non-apple products.
2011-01-12 01237, 2011
ruaok
then it becomes cheap.
2011-01-12 01245, 2011
ruaok
but for a server, the mini is amazing.
2011-01-12 01258, 2011
ruaok
10W of power consumption with very little space usage.
2011-01-12 01256, 2011
ijabz_ joined the channel
2011-01-12 01205, 2011
ruaok
wb
2011-01-12 01214, 2011
ruaok
not sure where you dropped off. read the chatlogs?
2011-01-12 01225, 2011
ijabz_
yep, done so
2011-01-12 01213, 2011
ruaok
WTF?
2011-01-12 01250, 2011
ruaok
on hobbes the release_index took 583 seconds to build with PG optimized for 4GB.
2011-01-12 01208, 2011
ruaok
then with it changed to 8Gb, it took 612 seconds.
2011-01-12 01213, 2011
ruaok sighs
2011-01-12 01225, 2011
ruaok
its hard to draw conclusions from this wildy varying data.
2011-01-12 01228, 2011
ocharles
slapping more ram on stuff doesn't necessarily make it faster though
2011-01-12 01237, 2011
ocharles
the optimizer might decide to do things differently
2011-01-12 01245, 2011
ijabz_
Yes, exactly, maybe you are hiting a limit somewhere else by putting all the memory to shared buffers
2011-01-12 01258, 2011
djce joined the channel
2011-01-12 01259, 2011
ruaok
ocharles: understood.
2011-01-12 01211, 2011
ruaok
but I would love to derive a rule of thumb that would tell us what is up.
2011-01-12 01238, 2011
ruaok waves at djce
2011-01-12 01247, 2011
ocharles
yea, can't help you there :(
2011-01-12 01249, 2011
djce
%T!
2011-01-12 01204, 2011
ruaok
ijabz_: not all. I usually only give PG 1/4 of RAM for shared buffers.
2011-01-12 01215, 2011
ruaok
and 1/4 - 1/3 is recommended.
2011-01-12 01227, 2011
ijabz_
I thought shared_buffers was more for when you had many users on a system, perhaps work_mem is more what we need
2011-01-12 01230, 2011
ruaok shrugs
2011-01-12 01250, 2011
ijabz_
But regardless, going with the premise that the macmini is still consistenlty the quickest
2011-01-12 01200, 2011
ruaok
yes.
2011-01-12 01215, 2011
ijabz_
what do you want to do
2011-01-12 01219, 2011
ruaok
I'm half tempted to buy another one and make it the index builder. shit, we could even run a replcated DB on it .
2011-01-12 01226, 2011
ruaok
and keep the load off the main DB.
2011-01-12 01239, 2011
ruaok
ijabz_: I would like to take a few more stabs at tweaking the config on hobbes.
2011-01-12 01245, 2011
ruaok
see if we can learn more.
2011-01-12 01211, 2011
ruaok
I'll just make various tweaks one setting at a time over the course of the day. and I'll comment on the bug about them.
2011-01-12 01221, 2011
ijabz_
Right, yes you need the db on the mac to get the good performance
2011-01-12 01238, 2011
ruaok
which is also doesn't really make sense
2011-01-12 01253, 2011
ruaok
but its quite desirable so we don't bog down the main server.
2011-01-12 01214, 2011
ruaok
so, let me collect more data today.
2011-01-12 01256, 2011
ijabz_
I still think we should consider this release_puid table trigger idea because results show conistently it was reduce release index build time by about 30%
2011-01-12 01228, 2011
ijabz_
Also, I wil turn my attention to recoridng_index whihc is still quite slow even on hobbes
2011-01-12 01202, 2011
ruaok
then lets review the data and chat more tomorrow.
2011-01-12 01212, 2011
ruaok
sounds very good.
2011-01-12 01220, 2011
ruaok
but excellent job on getting the release index this fast.
2011-01-12 01226, 2011
ruaok hands ijabz_ a virtual beer
2011-01-12 01203, 2011
ijabz_
Well thx, I didn't feel it was going so well, I supping now
2011-01-12 01216, 2011
ruaok
bon appetit
2011-01-12 01217, 2011
ruaok
djce: with syswiki in git, will we still keep it runnning under syswiki.mb org ?
2011-01-12 01233, 2011
ruaok
or do I need to setup my own locally?
2011-01-12 01249, 2011
djce
Personally, I'm going for neither.
2011-01-12 01200, 2011
djce
Just a plain git clone, edit and read with vim.
2011-01-12 01224, 2011
ruaok
then why not ditch moin altogether and just have text files?
2011-01-12 01230, 2011
djce
I did :-)
2011-01-12 01238, 2011
ruaok
without moin syntax, silly.
2011-01-12 01258, 2011
ruaok
the wiki is kinda in they way for that anyway. I
2011-01-12 01259, 2011
djce
Ah. Well, whatever. They are now just "files". Let's do whatever we see fit.
2011-01-12 01205, 2011
ruaok
'd be ok with going straight to flat text files.
2011-01-12 01219, 2011
ruaok
(without moin markup)
2011-01-12 01241, 2011
djce
Not fussed. Strip out the moinisms if you wish. Use pod if you wish.
2011-01-12 01248, 2011
djce
Whatever is easy to edit, diff, merge, and read.
2011-01-12 01246, 2011
ruaok imagines djce keeping syswiki indexed on a series of rice kernels, reading them with a magnifying glass
2011-01-12 01256, 2011
ruaok
all zen master like
2011-01-12 01257, 2011
djce
You're weird :-)
2011-01-12 01212, 2011
ruaok
pot. kettle. black. :)
2011-01-12 01233, 2011
djce
I must be going soft in my old age. I just blatted a Win 7 install on a fresh new net-top, and felt a bit guilty.
2011-01-12 01256, 2011
ruaok
I'm going to be doing that in about 3 hours. but here there will be no guilt. only glee
2011-01-12 01215, 2011
ruaok is expecting a lenovo mini laptop.
2011-01-12 01233, 2011
djce
Or maybe I just felt guilty at myself 'cos I /paid/ for that software and I've got to show for it is a Microfoo valid key sticker thingy.
2011-01-12 01248, 2011
ruaok
ok, that I'm with you on.
2011-01-12 01257, 2011
ruaok
I looked hard for one with no OS, but no luck.
2011-01-12 01249, 2011
djce
When I bought my eeeeeeeepc I got the Linux one, lived with Xandros for about a day, then splatted it with Debian. I assume Revo's don't come with Linux.
2011-01-12 01230, 2011
djce
If anyone knows otherwise, where you can get a Revo for £50 cheaper cos it has no Windows on it, SHUT THE HELL UP NOW :-D
2011-01-12 01251, 2011
ruaok
lol
2011-01-12 01259, 2011
djce goes back to playing with SEX
2011-01-12 01214, 2011
ruaok heh
2011-01-12 01231, 2011
ruaok
I think thats a great naming scheme. the folks at DWNI have already commented on it.
