#musicbrainz-devel

ocharles: ping?

ruaok: just to double check.... you don't need any of the files from the fat32 partition of SEX do you?

correct.

ok... fdisk here we come

I had never actually bothered to connect it to a machine until wiley got it

and the other drives will be the same

ok

wow. hobbes is wicked fast building indexes.

Im aound

should I just respond here?

I'll actually keep it in email...

ijabz: http://jira.musicbrainz.org/browse/SEARCH-49

another comment posted to it

ruaok: you pinged me

well, yesterday :)

yeah, I got it.

er, meaning I figured out the problem.

heh, cool

I need to be in the habit of double checking your quitck and dirty moose templates you make for me. )

was it typotastic? :)

there were a couple of minor syntax errors that causes the craziest error mesages down the road that wasted a lot of time. :(

isa => Map[ Str => Int ];

should've been

isa => Map[ Str, Int ],

subtle, but it didn't error out. it just made stuff down the line impossible and not fun to debug.

ruaok, all quite confusing, I'll wait for your email then

yeah and it gets more confusing. :)

the pg.conf on hobbes still assumes that hobbes has 4gb of ram. it now has 8.

let me tune that and re-re-run the data.

shared_buffers = 2048MB

:-)

ruaok: ah yea, sorry bout that. so used to seeing the error now I pick it up straight away

no worries. :)

I look at the postgresql.conf myself, I think max_prepared_transactions should be set to 20, I think it defaults to 5 whihc is not enough

And I thjink temp_buffers should be increased, although dont really understand it

I think work_mem is a good one to increase.

ijabz: ya know, if hobbes is so kick ass I might buy another mini as the index server. :)

err index creator

Isnt it quick because it is running the database, not the indexing code (or is that what you mean)

wow. artist index goes from 197s to 117s

i.e Postgres run better on hobbes than the others

hobbes is running both db and indexer.

Yeah, but in production what are you considering this new machine running

only test.mb.org

let me finish the email. :)

No, I mean 'Buying another mini as an index server' , but opkay

sent.

read it

ok, lets see if we can summarize whats going on.

great on a macbook pro and a mini.

everyone else is lagging behind.

I've run it on fatty: 12gb, 4 proc xeon box from 7 years ago.

hobbes: latest gen mini with 8GB ram.

rump: 4gb ram PC, with quad cores.

hobbes, the cheap $900 machine beats all.

each setup was using PG 9.0.x compiled from source with pretty much only shared segements tuned.

its not often Macs get called cheap !

I find them cheap, when you amortize its cost over its longer lifetime when compared to non-apple products.

then it becomes cheap.

but for a server, the mini is amazing.

10W of power consumption with very little space usage.

wb

not sure where you dropped off. read the chatlogs?

yep, done so

WTF?

on hobbes the release_index took 583 seconds to build with PG optimized for 4GB.

then with it changed to 8Gb, it took 612 seconds.

its hard to draw conclusions from this wildy varying data.

slapping more ram on stuff doesn't necessarily make it faster though

the optimizer might decide to do things differently

Yes, exactly, maybe you are hiting a limit somewhere else by putting all the memory to shared buffers

ocharles: understood.

but I would love to derive a rule of thumb that would tell us what is up.

%T!

ijabz_: not all. I usually only give PG 1/4 of RAM for shared buffers.

and 1/4 - 1/3 is recommended.

I thought shared_buffers was more for when you had many users on a system, perhaps work_mem is more what we need

But regardless, going with the premise that the macmini is still consistenlty the quickest

yes.

what do you want to do

I'm half tempted to buy another one and make it the index builder. shit, we could even run a replcated DB on it .

and keep the load off the main DB.

ijabz_: I would like to take a few more stabs at tweaking the config on hobbes.

see if we can learn more.

I'll just make various tweaks one setting at a time over the course of the day. and I'll comment on the bug about them.

Right, yes you need the db on the mac to get the good performance

which is also doesn't really make sense

but its quite desirable so we don't bog down the main server.

so, let me collect more data today.

I still think we should consider this release_puid table trigger idea because results show conistently it was reduce release index build time by about 30%

Also, I wil turn my attention to recoridng_index whihc is still quite slow even on hobbes

then lets review the data and chat more tomorrow.

sounds very good.

but excellent job on getting the release index this fast.

Well thx, I didn't feel it was going so well, I supping now

bon appetit

djce: with syswiki in git, will we still keep it runnning under syswiki.mb org ?

or do I need to setup my own locally?

Personally, I'm going for neither.

Just a plain git clone, edit and read with vim.

then why not ditch moin altogether and just have text files?

I did :-)

without moin syntax, silly.

the wiki is kinda in they way for that anyway. I

Ah. Well, whatever. They are now just "files". Let's do whatever we see fit.

'd be ok with going straight to flat text files.

(without moin markup)

Not fussed. Strip out the moinisms if you wish. Use pod if you wish.

Whatever is easy to edit, diff, merge, and read.

all zen master like

You're weird :-)

pot. kettle. black. :)

I must be going soft in my old age. I just blatted a Win 7 install on a fresh new net-top, and felt a bit guilty.

I'm going to be doing that in about 3 hours. but here there will be no guilt. only glee

Or maybe I just felt guilty at myself 'cos I /paid/ for that software and I've got to show for it is a Microfoo valid key sticker thingy.

ok, that I'm with you on.

I looked hard for one with no OS, but no luck.

When I bought my eeeeeeeepc I got the Linux one, lived with Xandros for about a day, then splatted it with Debian. I assume Revo's don't come with Linux.

If anyone knows otherwise, where you can get a Revo for £50 cheaper cos it has no Windows on it, SHUT THE HELL UP NOW :-D

lol

I think thats a great naming scheme. the folks at DWNI have already commented on it.

it is great :)

ocharles: you might read http://jira.musicbrainz.org/browse/SEARCH-49

for some interesting stats.

hobbes is kicking butt.