My code was taking too long, so he wrote a perl script to parse the pg data dump and kick out the proper XML document.
2004-04-20 11111, 2004
yalaforge
hm, well. as long as it works :-)
2004-04-20 11120, 2004
ruaok
faster than mine. :-)
2004-04-20 11144, 2004
yalaforge
the database was involved. that's always slow
2004-04-20 11105, 2004
ruaok
plus the Pending and PendingData tables have no indexes.
2004-04-20 11113, 2004
ruaok
Thus they are painfully slow.
2004-04-20 11115, 2004
yalaforge
oh, that explains
2004-04-20 11137, 2004
yalaforge
how big is an XML dump for one hour?
2004-04-20 11148, 2004
yalaforge
I hope it isn't too slow to apply it
2004-04-20 11107, 2004
ruaok
djce forced a data cleanup, which caused a huge update packet.
2004-04-20 11120, 2004
ruaok
quick to dump the data, 20 mins to dump the XML.
2004-04-20 11144, 2004
yalaforge
hm, too bad I can't use the packet for tests
2004-04-20 11154, 2004
yalaforge
but it's out of context
2004-04-20 11155, 2004
ruaok
I'm sure he still has it around.
2004-04-20 11103, 2004
ruaok
oh yeah.
2004-04-20 11154, 2004
yalaforge
at the moment, I'm working on the index updating
2004-04-20 11115, 2004
yalaforge
I think I solved the problems, the rest is boring implemenation work
2004-04-20 11117, 2004
ruaok
I'm adding a plugin system to libtp.
2004-04-20 11122, 2004
djce is back (gone 00:27:50)
2004-04-20 11125, 2004
yalaforge
djce: hi!
2004-04-20 11133, 2004
yalaforge
ruaok: using libtool?
2004-04-20 11119, 2004
ruaok
yes.
2004-04-20 11125, 2004
yalaforge
libtool comes with a minimal dlopen wrapper that works cross-platform
2004-04-20 11131, 2004
yalaforge
did you have a look at it?
2004-04-20 11137, 2004
ruaok
I'm using it. :-)
2004-04-20 11148, 2004
yalaforge
cool. you did your homework :-)
2004-04-20 11155, 2004
ruaok
I originally used it for bitzi's bitcollider two years ago.
2004-04-20 11108, 2004
ruaok
And since that code is Public Domain, its now our code. :-)
2004-04-20 11109, 2004
yalaforge
might be useful for the playlist stuff, too
2004-04-20 11121, 2004
ruaok
very much so.
2004-04-20 11137, 2004
yalaforge
but lucene has my top priority ATM
2004-04-20 11105, 2004
ruaok
we just got some mail to helpwanted@ :
2004-04-20 11106, 2004
ruaok
that I could help with.
2004-04-20 11121, 2004
yalaforge
hm
2004-04-20 11122, 2004
ruaok
yalaforge, djce: any good ideas to respond with?
2004-04-20 11134, 2004
djce
yeah, I just read that.
2004-04-20 11144, 2004
djce
nothing springs to mind straight away
2004-04-20 11154, 2004
djce
but I'll have a think and see what comes to mind
2004-04-20 11156, 2004
yalaforge
sorry, nothing here either
2004-04-20 11124, 2004
yalaforge has to write some unit tests for the lucene stuff
2004-04-20 11141, 2004
yalaforge
it's cool. I always wanted to learn how to do that :-)
2004-04-20 11140, 2004
djce
I think it's nice to have that rep-packet -to-xml stuff, because it's a nice way of reading the data without postgres. There might be applications other than lucene.
2004-04-20 11152, 2004
djce
and having portable, flexible data is nice :-)
2004-04-20 11118, 2004
yalaforge
it would also be useful to have an XML data dump to initialize the index
2004-04-20 11139, 2004
djce
in the same format?
2004-04-20 11102, 2004
djce
i.e. lots of <insert>s?
2004-04-20 11103, 2004
yalaforge
hm, I'm not sure about that. it's rather inefficient
2004-04-20 11120, 2004
yalaforge
joined documents would be best for initializing
2004-04-20 11135, 2004
yalaforge
the update|insert|delete is the only option we have for updating the index, however
2004-04-20 11145, 2004
djce
That's probably best done using postgres then -
2004-04-20 11106, 2004
lukeprog
ok, just tried MusicBrainz again. It actually worked this time (at least, it moved most files to the identified tab). But now, according to the tutorial, there should be a "submit tags" button, but there is none. Also, does MusicBrainz even gather/write genre and year tags?
2004-04-20 11110, 2004
djce
- i.e. you download a full db export ("core" set only) corresponding to a replication point
2004-04-20 11117, 2004
djce
then do a join, select, export as xml
2004-04-20 11124, 2004
djce
then eat replication data thereafter
2004-04-20 11128, 2004
yalaforge
yup. the problem is that we also need artists that have no albums at the moment
2004-04-20 11141, 2004
ruaok
lukeprog: the submit tags button is enabled only if the tagger has gathered information to submit to the server.
2004-04-20 11142, 2004
yalaforge
and albums that have no tracks yet
2004-04-20 11147, 2004
djce
lukeprog: short answers first: genre: no
2004-04-20 11153, 2004
ruaok
If it is not enabled, don't worry about it.
2004-04-20 11157, 2004
GuySmiley joined the channel
2004-04-20 11115, 2004
lukeprog
oh, it looks like "submit info" is greyed out, actually
2004-04-20 11118, 2004
djce
yalaforge: big left join then?
2004-04-20 11132, 2004
yalaforge
yup, probably
2004-04-20 11139, 2004
djce
if you import the four core tables into Postgres, it's entirely up to you.
2004-04-20 11146, 2004
lukeprog
ah, okay, then - forget it. Thanks anyway.
2004-04-20 11146, 2004
djce is away: dinner... back later.
2004-04-20 11146, 2004
ruaok
lukeprog: the year information feature has been in place a few weeks only, thus we have not collected a lot of data.
2004-04-20 11156, 2004
yalaforge
djce: see you tomorrow :-)
2004-04-20 11102, 2004
yalaforge
it's 22:44 here
2004-04-20 11102, 2004
lukeprog
ok
2004-04-20 11100, 2004
lukeprog
maybe I'll check out MusicBrainz again in six months or so. Feature requests: genre tags, option to automatically choose earliest album for files that come up with multiple matching albums.
2004-04-20 11126, 2004
yalaforge
lukeprog: make it ten years
2004-04-20 11128, 2004
lukeprog
ha, ouch
2004-04-20 11152, 2004
lukeprog
at leaset the audiofingerprint analyzing is quite fast
2004-04-20 11106, 2004
lukeprog
ok, thanks for all your help, people.
2004-04-20 11113, 2004
lukeprog has quit
2004-04-20 11124, 2004
yalaforge has quit
2004-04-20 11117, 2004
GuySmiley
I just found and downloaded MB today. What a great program! I've tagged a few albums and added some unfound discs to the database. I've configured directories for moving and naming. When I click the Save icon to submit my data the files aren't moved to my "move" directory. The FAQ says this is what should be happening. Am I missing a step?
2004-04-20 11156, 2004
GuySmiley
My move folder is on a UNC path if that matters.
2004-04-20 11125, 2004
GuySmiley
I'm high. Forget everything I just asked.
2004-04-20 11134, 2004
lgonze joined the channel
2004-04-20 11143, 2004
djce is back (gone 01:17:57)
2004-04-20 11146, 2004
jwatk03 joined the channel
2004-04-20 11100, 2004
GuySmiley
Somebody mentioned a while ago that the year information is in place now. Is there a place in the tagger UI for this?
2004-04-20 11143, 2004
ruaok
what kind of 'place in the tagger' feature are you looking for?
2004-04-20 11157, 2004
ruaok
The tagger writes year information into the tags if the info is available.
2004-04-20 11111, 2004
ruaok
But the tagger is not a tool for submitting this info -- do that via the web pages.
2004-04-20 11130, 2004
bkdelong has quit
2004-04-20 11139, 2004
GuySmiley
I didn't mean to be able to interact or set the year information. I meant to be able to see it. When I just submitted a couple new discs, for instance, I never saw an indication of the year info.
2004-04-20 11112, 2004
ruaok
the only place to see it is in the embedded web pages.
2004-04-20 11126, 2004
ruaok
But we should ask for the release year when the CD is entered.
2004-04-20 11141, 2004
GuySmiley
ok, right
2004-04-20 11101, 2004
ruaok
I just added a request for enhancement on that.
2004-04-20 11152, 2004
GuySmiley
thanks!
2004-04-20 11127, 2004
ruaok
sweet. I got myself a gmail account. :-)
2004-04-20 11115, 2004
croakur
did I mention how cool musicbrainz is
2004-04-20 11123, 2004
ruaok
:-)
2004-04-20 11109, 2004
croakur
ruaok: cool! did you have a connection at google or did you fill out the interested form?
2004-04-20 11119, 2004
croakur
I haven't gotten a response to my interest, yet ...
2004-04-20 11145, 2004
ruaok
MB has a friend at Google. :-)
2004-04-20 11106, 2004
croakur
nice
2004-04-20 11130, 2004
croakur
I bet you're on that borscht or orkut thing or whatever too!
2004-04-20 11141, 2004
ruaok
nope. I refused that.
2004-04-20 11115, 2004
croakur
any particular reason?
2004-04-20 11155, 2004
ruaok
I already neglect my friendster account, so why setup another one?
2004-04-20 11140, 2004
croakur
... cause you could neglect your 'cool-people-only' account now too :)
2004-04-20 11156, 2004
jwatk03
I wish Novell would open myrealbox.com back up for new accounts... webmail gets old after awhile with all the ads and the slow logins
2004-04-20 11103, 2004
jwatk03 has left the channel
2004-04-20 11134, 2004
GuySmiley
Is there a way to submit an unpublished/hidden track for a released album? When I import the album data from FreeDB it's missing this hidden track. This track is on the ablum, but isn't printed in the liner notes.
2004-04-20 11129, 2004
lgonze has quit
2004-04-20 11145, 2004
lgonze joined the channel
2004-04-20 11136, 2004
djce
ruaok: I just did another sizeable replication packet (this time after running the ModBot to make a bunch of changes)....
2004-04-20 11145, 2004
ruaok
k
2004-04-20 11155, 2004
djce
this time it exported the rows in <2 sec
2004-04-20 11102, 2004
djce
and did the XML in <5 sec :-)
2004-04-20 11106, 2004
ruaok
sweet.
2004-04-20 11110, 2004
djce
11 sec end-to-end!
2004-04-20 11123, 2004
djce
I think I'll stick with that. It seems to work.
2004-04-20 11108, 2004
djce
now just there's just a whole slew of stuff to commit to CVS...
2004-04-20 11115, 2004
ruaok
:-)
2004-04-20 11120, 2004
djce
then I've still got to test the slave auto-loading of rep. data
2004-04-20 11142, 2004
djce
The stuff which is on the rep. branch - is that ditchable now?
2004-04-20 11150, 2004
djce
apart from "ProcessReplicationChanges"
2004-04-20 11153, 2004
djce
?
2004-04-20 11135, 2004
ruaok
if you have a slave loading data, then everything on the replication branch can go.
2004-04-20 11148, 2004
djce
Not yet. but I have some outline code I'm working on.
2004-04-20 11156, 2004
djce
it will use ProcessRepChanges, from the branch.
2004-04-20 11104, 2004
ruaok
ok, then everything else can go.
2004-04-20 11107, 2004
djce
k
2004-04-20 11156, 2004
GuySmiley
Is there a way to submit an unpublished/hidden track for a released album? When I import the album data from FreeDB it's missing this hidden track. This track is on the ablum, but isn't printed in the liner notes.
2004-04-20 11157, 2004
ruaok
can you find the CD with the hidden track in freedb?
2004-04-20 11111, 2004
ruaok
that would be best.
2004-04-20 11123, 2004
ruaok
Otherwise, enter a new CD that contains the hidden track.
2004-04-20 11144, 2004
GuySmiley
When I query freedb it always lists the 14 tracks printed on the liner only, minus the hidden track
2004-04-20 11156, 2004
GuySmiley
ok enter a whole new CD.
2004-04-20 11104, 2004
ruaok
yeah...
2004-04-20 11109, 2004
GuySmiley
thank you
2004-04-20 11113, 2004
ruaok
np
2004-04-20 11119, 2004
GuySmiley
Sorry for my lameness. Does that mean I should move the 14 standard tracks from the Identified tab back to the Unidentified tab? Then I can somehow group them as a new CD submission?
2004-04-20 11128, 2004
ruaok
if you move them to the unidentified tab and tag all the tracks by clicking on the tag icons for each track, will give you the best results.
2004-04-20 11114, 2004
GuySmiley
I have 15 tracks, 14 of which freedb knows about. I moved all 15 tracks to the Unidentified tab. I clicked through the tag icon and 14 of the tracks are now on the Identified tab. I'm left with track 15, which is a hidden track that freedb doesn't know about. How do I now submit a whole new album, adding this track as "Hidden Track" ?
2004-04-20 11131, 2004
GuySmiley
I can go through the Add Album UI in the lower part of the interface, but do I then have to type in all 15 track titles manually?
