#musicbrainz

/

      • enjayhch
        I wasn't involved in the implementation, so I don't know

        • 2005-03-11 07058, 2005

      • enjayhch
        one of the reasons to import MusicBrainz would be to see how well it performs

        • 2005-03-11 07013, 2005

      • enjayhch
        we have a dump from ages ago, but it would be good to keep up to date

        • 2005-03-11 07037, 2005

      • yalaforge
        then I'd import a snapshot and write a simple script to put it into triple store

        • 2005-03-11 07053, 2005

      • enjayhch
        yup

        • 2005-03-11 07000, 2005

      • yalaforge
        going over an RDF snapshot is probably not necessary

        • 2005-03-11 07020, 2005

      • yalaforge
        and make sure to turn off referential integrity checking, or you'll wait forever :-)

        • 2005-03-11 07041, 2005

      • enjayhch
        our main concern is staying up to date

        • 2005-03-11 07058, 2005

      • enjayhch
        it takes a very long time importing the data

        • 2005-03-11 07009, 2005

      • enjayhch
        and really thrashes the server

        • 2005-03-11 07019, 2005

      • yalaforge
        it takes 2 hours on my laptop :-)

        • 2005-03-11 07042, 2005

      • yalaforge
        MB publishes replication packages

        • 2005-03-11 07043, 2005

      • enjayhch
        so need a nice mechanism to reliably stay up to date

        • 2005-03-11 07054, 2005

      • enjayhch
        what form are those in ?

        • 2005-03-11 07003, 2005

      • yalaforge
        simple XML. wait a minute ...

        • 2005-03-11 07009, 2005

      • yalaforge
        ftp://ftp.musicbrainz.org/pub/musicbrainz/data/re…

        • 2005-03-11 07021, 2005

      • enjayhch
        looks out of date ?

        • 2005-03-11 07050, 2005

      • yalaforge
        hm ...

        • 2005-03-11 07021, 2005

      • yalaforge
        the timestamps on the files look old, right

        • 2005-03-11 07029, 2005

      • enjayhch
        is the nl.mb sever downloading a full export then ?

        • 2005-03-11 07045, 2005

      • yalaforge
        no

        • 2005-03-11 07045, 2005

      • dupuy joined the channel

        • 2005-03-11 07001, 2005

      • cikkolata
        http://ftp.musicbrainz.org/pub/musicbrainz/data/r… has them all I think

        • 2005-03-11 07017, 2005

      • cikkolata
        I can't tell because the page is so huge that opera is threatening to commit suicide on me.

        • 2005-03-11 07025, 2005

      • enjayhch
        lol

        • 2005-03-11 07038, 2005

      • yalaforge
        cikkolata: great, thanks!

        • 2005-03-11 07041, 2005

      • cikkolata
        aha, 11th march is the last (#7399)

        • 2005-03-11 07048, 2005

      • enjayhch
        yeah :)

        • 2005-03-11 07058, 2005

      • yalaforge
        firefox is dying :-(

        • 2005-03-11 07011, 2005

      • enjayhch
        Safari coped well :-D

        • 2005-03-11 07014, 2005

      • Pipian joined the channel

        • 2005-03-11 07027, 2005

      • cikkolata
        my computer's feeling sorry for itself

        • 2005-03-11 07032, 2005

      • cikkolata
        I keep running stuff that eats it

        • 2005-03-11 07001, 2005

      • cikkolata
        w3m loaded it fine though :D

        • 2005-03-11 07005, 2005

      • yalaforge
        anyway, those replication packages can be either fed to a local postgres db to keep it up to date

        • 2005-03-11 07031, 2005

      • enjayhch
        ok, cool, so could write the script to convert the XML dump into MB RDF and import it into the triplestore

        • 2005-03-11 07035, 2005

      • yalaforge
        or you can parse the lucene.xml file to update your triplestore

        • 2005-03-11 07041, 2005

      • enjayhch
        :)

        • 2005-03-11 07053, 2005

      • yalaforge
        yup. I hope it works

        • 2005-03-11 07037, 2005

      • enjayhch
        hum, I guess in an ideal world we could host uk.musicbrainz.org, but not sure if that would happen

        • 2005-03-11 07050, 2005

      • yalaforge
        heh, my firefox survived :-)

        • 2005-03-11 07056, 2005

      • cikkolata
        opera did too

        • 2005-03-11 07058, 2005

      • cikkolata
        barely

        • 2005-03-11 07024, 2005

      • yalaforge
        perhaps I still have a DTD of the xml format around

        • 2005-03-11 07026, 2005

      • yalaforge looks

        • 2005-03-11 07036, 2005

      • enjayhch
        maybe could write a Lite version of MB website to browse a triplestore

        • 2005-03-11 07048, 2005

      • enjayhch
        and respond to Web service queries

        • 2005-03-11 07011, 2005

      • enjayhch
        for the initial import, what do I need to download ?

        • 2005-03-11 07022, 2005

      • enjayhch
        can I ignore the moderations ?

        • 2005-03-11 07049, 2005

      • enjayhch
        and what is mbdump-artistrelation.tar.bz2 ?

        • 2005-03-11 07057, 2005

      • yalaforge
        one sec

        • 2005-03-11 07041, 2005

      • yalaforge
        that's the DTD. I hope it is up to date :-) -> http://www.stud.uni-karlsruhe.de/~uy7l/changes.dtd

        • 2005-03-11 07013, 2005

      • yalaforge
        the lucene.xml file only contains base table data (artist, album, track, albumjoin)

        • 2005-03-11 07056, 2005

      • enjayhch
        albumjoin ?

        • 2005-03-11 07008, 2005

      • enjayhch
        I think that might be all that we need

        • 2005-03-11 07023, 2005

      • duncf joined the channel

        • 2005-03-11 07026, 2005

      • enjayhch
        just interested in the actually confirmed data, rather than how it got to that state

        • 2005-03-11 07050, 2005

      • yalaforge
        to set up a minimal DB (no mods, no relations etc) you need mbdump.tar.bz2 and mbdump-derived.tar.bz2

        • 2005-03-11 07017, 2005

      • enjayhch
        relations ?

        • 2005-03-11 07036, 2005

      • yalaforge
        mbdump-artistrelations.tar.bz2 contains data for the "related artists" feature, donated by agent arts

        • 2005-03-11 07038, 2005

      • enjayhch
        sorry don't know much about the very inners of MusicBrainz

        • 2005-03-11 07045, 2005

      • enjayhch
        ahh, ok

        • 2005-03-11 07055, 2005

      • yalaforge
        you don't need the relations

        • 2005-03-11 07015, 2005

      • yalaforge
        re albumjoin: that joins albums and tracks

        • 2005-03-11 07032, 2005

      • enjayhch
        ok, cool

        • 2005-03-11 07039, 2005

      • enjayhch
        ooh, which reminds me

        • 2005-03-11 07047, 2005

      • yalaforge
        there's an m:n relation between album and track

        • 2005-03-11 07056, 2005

      • enjayhch
        yup

        • 2005-03-11 07005, 2005

      • enjayhch
        http://www.surgeradio.co.uk/feeds/playlist_a.xml

        • 2005-03-11 07008, 2005

      • enjayhch
        (RSS feed)

        • 2005-03-11 07015, 2005

      • yalaforge
        but at the moment we only use an 1:n relationship

        • 2005-03-11 07034, 2005

      • enjayhch
        ok, wondered about that

        • 2005-03-11 07047, 2005

      • enjayhch
        will be good when it is m:n

        • 2005-03-11 07016, 2005

      • enjayhch
        do you know anyone else who has tried putting MusicBrainz RDF in an RSS feed ?

        • 2005-03-11 07017, 2005

      • yalaforge
        yes, but that requires quite some work for developers and the user community

        • 2005-03-11 07023, 2005

      • enjayhch
        yeah

        • 2005-03-11 07039, 2005

      • yalaforge
        no, I don't know

        • 2005-03-11 07052, 2005

      • enjayhch
        well I am trying to make it as full as possible

        • 2005-03-11 07003, 2005

      • enjayhch
        and have the MB RDF as well as the base RSS

        • 2005-03-11 07043, 2005

      • yalaforge doesn't know much about RSS

        • 2005-03-11 07058, 2005

      • enjayhch
        well I learnt yesterday that it is a bit of a mess !

        • 2005-03-11 07026, 2005

      • yalaforge
        AFAIK it's a fixed serialization of RDF. at least one version

        • 2005-03-11 07044, 2005

      • yalaforge
        no good idea, IMHO

        • 2005-03-11 07044, 2005

      • enjayhch
        yup, version 1.0 is best for RDF

        • 2005-03-11 07002, 2005

      • enjayhch
        well it is quite handy for a list of things

        • 2005-03-11 07004, 2005

      • enjayhch
        anything really

        • 2005-03-11 07030, 2005

      • enjayhch
        but the tool implementations that exists are quite fixed in their usage

        • 2005-03-11 07042, 2005

      • enjayhch
        all News Headline style

        • 2005-03-11 07055, 2005

      • enjayhch
        and lots of assumptions

        • 2005-03-11 07057, 2005

      • yalaforge
        yup. if you don't have to support them, it's pretty cool, I guess

        • 2005-03-11 07009, 2005

      • yalaforge
        most probably parse the RDF as XML :-(

        • 2005-03-11 07033, 2005

      • enjayhch
        well that was the main problem initially, is that they used both XML schema and RDF

        • 2005-03-11 07007, 2005

      • enjayhch
        ah well

        • 2005-03-11 07009, 2005

      • yalaforge
        which doesn't work. RDF+XML can't be described using a schema

        • 2005-03-11 07037, 2005

      • yalaforge
        anyway, I've got to go for a while

        • 2005-03-11 07049, 2005

      • yalaforge is away: I'm busy

        • 2005-03-11 07055, 2005

      • enjayhch
        well I thought it might be worth publishing some interesting data, and see if anyone can do anything cool with it

        • 2005-03-11 07059, 2005

      • enjayhch
        thanks for your help

        • 2005-03-11 07009, 2005

      • yalaforge
        np, cu

        • 2005-03-11 07053, 2005

      • cikkolata
        hmm

        • 2005-03-11 07010, 2005

      • cikkolata
        it would be funny to list all 46 members of h.p. all stars separately.

        • 2005-03-11 07040, 2005

      • DJKC
        hah

        • 2005-03-11 07048, 2005

      • DJKC
        with AR you mean?

        • 2005-03-11 07004, 2005

      • DJKC
        or as one monstrous tag from hell?

        • 2005-03-11 07015, 2005

      • cikkolata
        AR

        • 2005-03-11 07037, 2005

      • cikkolata
        I tried adding some of the groups as members, but it's just not as evilly funny.

        • 2005-03-11 07048, 2005

      • cikkolata
        although a monstrous tag wouldbe funny too

        • 2005-03-11 07037, 2005

      • DJKC
        yes it would

        • 2005-03-11 07040, 2005

      • DJKC
        hmmm

        • 2005-03-11 07053, 2005

      • DJKC
        any recommendation for msn messenger client for linux?

        • 2005-03-11 07000, 2005

      • DJKC
        friend is asking me despite the fact that I don't use msn

        • 2005-03-11 07022, 2005

      • DJKC
        apparently on the basis that I know stuff, so thus should know a nice client for msn for linux -_-;

        • 2005-03-11 07055, 2005

      • cikkolata
        gaim does msn

        • 2005-03-11 07021, 2005

      • cikkolata
        kopete does too, if they want a kde client

        • 2005-03-11 07048, 2005

      • cikkolata
        and centericq does if they fancy a command line for some weird reason.

        • 2005-03-11 07012, 2005

      • Pipian has quit

        • 2005-03-11 07038, 2005

      • DJKC
        the exact email was along the lines of "help I'm home for the weekend and my damn brother installed linux on the computer here, what I can use for msn"

        • 2005-03-11 07058, 2005

      • DJKC
        so I have no idea if kde is even installed, although I seriously doubt command line is desired

        • 2005-03-11 07007, 2005

      • cikkolata
        ah

        • 2005-03-11 07020, 2005

      • cikkolata
        gaim or kopete then.

        • 2005-03-11 07018, 2005

      • cikkolata
        urls for those being gaim.sf.net and kopete.kde.org, but any sane linux distro should have it packaged in their package thing

        • 2005-03-11 07033, 2005

      • DJKC
        yeah, "should"

        • 2005-03-11 07008, 2005

      • cikkolata
        heh

        • 2005-03-11 07014, 2005

      • cikkolata
        do you know which linux?

        • 2005-03-11 07040, 2005

      • yalaforge is back (gone 00:38:51)

        • 2005-03-11 07054, 2005

      • cikkolata
        arrrrgh.

        • 2005-03-11 07019, 2005

      • cikkolata
        omgi is annoying me.

        • 2005-03-11 07032, 2005

      • yalaforge
        what or who is omgi?

        • 2005-03-11 07039, 2005

      • cikkolata
        person on mb

        • 2005-03-11 07050, 2005

      • cikkolata
        they keep adding turkish stuff without choosing the right encoding

        • 2005-03-11 07002, 2005

      • enjayhch
        heh

        • 2005-03-11 07004, 2005

      • yalaforge
        there are quite a few annoying people on mb lately

        • 2005-03-11 07011, 2005

      • cikkolata
        s

        • 2005-03-11 07033, 2005

      • cikkolata
        I've been over it before, the main reason it annoys me is because most people have no idea that it's wrong.

        • 2005-03-11 07049, 2005

      • yalaforge
        like me

        • 2005-03-11 07009, 2005

      • cikkolata
        turkish doesn;t use the thorn or y with an acute accent

        • 2005-03-11 07023, 2005

      • cikkolata
        the only language that uses the thorn that I know of is icelandic

        • 2005-03-11 07028, 2005

      • yalaforge shakes his head sadly

        • 2005-03-11 07033, 2005

      • yalaforge
        I had *no* idea!

        • 2005-03-11 07035, 2005

      • yalaforge
        :-)

        • 2005-03-11 07042, 2005

      • cikkolata giggles

        • 2005-03-11 07001, 2005

      • bramp has quit

        • 2005-03-11 07011, 2005

      • cikkolata
        and it's more annoying because I've left mod notes before pointing out that they should be more careful, but they just keep adding more badly encoded stuff anyway

        • 2005-03-11 07030, 2005

      • yalaforge
        you need a few no votes?

        • 2005-03-11 07036, 2005

      • cikkolata
        nah

        • 2005-03-11 07039, 2005

      • cikkolata
        I can fix them

        • 2005-03-11 07055, 2005

      • yalaforge
        unfortunately, you don't scale

        • 2005-03-11 07008, 2005

      • cikkolata
        true

        • 2005-03-11 07027, 2005

      • cikkolata
        I'm subscribed to all of the turkish stuff that I know of and I'm not having trouble yet

        • 2005-03-11 07053, 2005

      • DJKC
        [12:15 03/11/05] <yalaforge> unfortunately, you don't scale <--- well, she could but I understand there has to be a guy involved, plus it takes quite a while to build and setup