#musicbrainz

/

      • aCiD2
        I'm curious how people think it should be handled though :)
      • 2008-07-21 20341, 2008

      • aCiD2
        ruaok: do you think mb will ever start hiring people?
      • 2008-07-21 20348, 2008

      • ruaok
        yes.
      • 2008-07-21 20350, 2008

      • ruaok
        this fall.
      • 2008-07-21 20353, 2008

      • aCiD2
        mb offices with a bunch of people hacking away would be awesome
      • 2008-07-21 20358, 2008

      • aCiD2
        really!? awesomeness :D
      • 2008-07-21 20315, 2008

      • ruaok
        yes. we should have money to throw at a dedicated mb_server dev
      • 2008-07-21 20315, 2008

      • aCiD2
        I assume still internet based, but still cool
      • 2008-07-21 20332, 2008

      • ruaok
        yep.
      • 2008-07-21 20333, 2008

      • ruaok
        aCiD2: do you have libofa install on your linux box?
      • 2008-07-21 20341, 2008

      • ruaok
        would you mind trying to test a new tarball for me?
      • 2008-07-21 20343, 2008

      • aCiD2
        yup, installed it earlier I believe
      • 2008-07-21 20345, 2008

      • ruaok
        would anyone?
      • 2008-07-21 20345, 2008

      • aCiD2
        sure
      • 2008-07-21 20347, 2008

      • ruaok
      • 2008-07-21 20303, 2008

      • ruaok
        its not anything new -- I just need to sanity check this tarball.
      • 2008-07-21 20334, 2008

      • aCiD2
        slowest 500kb download evar -_-
      • 2008-07-21 20345, 2008

      • ruaok
        ya, sorry.
      • 2008-07-21 20313, 2008

      • ruaok
        ga, fucked up the timestamps.
      • 2008-07-21 20319, 2008

      • ruaok
        clock on that box is bork
      • 2008-07-21 20305, 2008

      • aCiD2
        checking whether build environment is sane... configure: error: newly created file is older than distributed files!
      • 2008-07-21 20309, 2008

      • aCiD2
        that what you mean re: clock?
      • 2008-07-21 20315, 2008

      • ruaok
        ya. one sec.
      • 2008-07-21 20322, 2008

      • ruaok
        lemme fix the time and rebuild. :)
      • 2008-07-21 20325, 2008

      • aCiD2
        ):
      • 2008-07-21 20314, 2008

      • ruaok
        aCiD2: re-download please.
      • 2008-07-21 20307, 2008

      • LotR
        aCiD2 has become an official build-guinea-pig :)
      • 2008-07-21 20358, 2008

      • aCiD2
        good enough for me!
      • 2008-07-21 20311, 2008

      • milosz
        milosz is now known as deadchp
      • 2008-07-21 20352, 2008

      • ruaok
        the title of guniea pig or the tarball?
      • 2008-07-21 20313, 2008

      • aCiD2
        haha, the title so far :P
      • 2008-07-21 20319, 2008

      • aCiD2
        make was fine
      • 2008-07-21 20302, 2008

      • aCiD2
        ruaok: make ran without errors, do you have a test target or anything I should run too?
      • 2008-07-21 20316, 2008

      • ruaok
        naw, make is what I am mostly concerned with.
      • 2008-07-21 20318, 2008

      • ruaok
        thx!
      • 2008-07-21 20321, 2008

      • aCiD2
        np :)
      • 2008-07-21 20323, 2008

      • Kerensky97
        What is the wiki markup for adding sig to a mbwiki page?
      • 2008-07-21 20334, 2008

      • murdos joined the channel
      • 2008-07-21 20346, 2008

      • ruaok
        bonjour murdos!
      • 2008-07-21 20301, 2008

      • murdos
        hallo ruaok!
      • 2008-07-21 20307, 2008

      • ruaok
        :-)
      • 2008-07-21 20326, 2008

      • ruaok
        aCiD2 did a write up of the summit: http://docs.google.com/Doc?id=dfbhxt9d_236fj386vh
      • 2008-07-21 20337, 2008

      • ruaok
        I need to flesh that out and post it somewhere
      • 2008-07-21 20355, 2008

      • murdos
        \o/
      • 2008-07-21 20313, 2008

      • aCiD2
        yo murdos :)
      • 2008-07-21 20317, 2008

      • murdos
        good news!
      • 2008-07-21 20324, 2008

      • murdos
        hi aCiD2 :)
      • 2008-07-21 20338, 2008

      • murdos goes reading the report ;)
      • 2008-07-21 20308, 2008

      • aCiD2
        i'm not very good with words, so it may well be a little verbose at points... that or just make absolutely no sense :P
      • 2008-07-21 20315, 2008

      • aCiD2
        it needs to be on the wika
      • 2008-07-21 20340, 2008

      • murdos
        don't seem complete: dmppanda said to me there were gin tonic and nightclubs ;)
      • 2008-07-21 20347, 2008

      • aCiD2
        :P
      • 2008-07-21 20355, 2008

      • ruaok
        loi
      • 2008-07-21 20305, 2008

      • ruaok
        that was the afterhours afterhours.
      • 2008-07-21 20314, 2008

      • murdos
        lol
      • 2008-07-21 20341, 2008

      • murdos
        so the plan is that BBC start to work on NGS from the TemplateToolkit version?
      • 2008-07-21 20303, 2008

      • aCiD2
        oh good point actually murdos, I meant to ask you this ruaok... what is the status about the BBC working alongside my work?
      • 2008-07-21 20324, 2008

      • ruaok
        I haven't heard much since leaving london.
      • 2008-07-21 20330, 2008

      • ruaok
        so, I don't know.
      • 2008-07-21 20332, 2008

      • aCiD2
        anyone I should email?
      • 2008-07-21 20343, 2008

      • ruaok
        the only thing I was worried about was them getting ahead of you.
      • 2008-07-21 20344, 2008

      • ruaok
        naw.
      • 2008-07-21 20351, 2008

      • murdos
        :)
      • 2008-07-21 20352, 2008

      • aCiD2
        okie dokie
      • 2008-07-21 20325, 2008

      • murdos
        so ruaok, what the roadmap in the near future for the server?
      • 2008-07-21 20349, 2008

      • ruaok
        near future...
      • 2008-07-21 20356, 2008

      • murdos
        do you still plan to do an non-db-schema release?
      • 2008-07-21 20303, 2008

      • ruaok
        no.
      • 2008-07-21 20310, 2008

      • ruaok
        the next release will be schema change.
      • 2008-07-21 20333, 2008

      • MBChatLogger
        drop table trm;
      • 2008-07-21 20333, 2008

      • ruaok
        part of that will be trm removal, various bugs, tag improvements, probably cd lookup improvements.
      • 2008-07-21 20344, 2008

      • ruaok
        and whatever you and luks would like to squeeze in.
      • 2008-07-21 20353, 2008

      • murdos
        oki
      • 2008-07-21 20358, 2008

      • ruaok
        then we'll proably have a release with niklas' discography support.
      • 2008-07-21 20310, 2008

      • ruaok
        then a release with aCiD2's TT work much later this year.
      • 2008-07-21 20319, 2008

      • murdos
        what is the purpose of cd lookup improvements?
      • 2008-07-21 20320, 2008

      • ruaok
        then all work going forward should be based on TT.
      • 2008-07-21 20333, 2008

      • murdos
        sure, go for TT !!
      • 2008-07-21 20342, 2008

      • ruaok
        to make the cd lookup features a little easier to use.
      • 2008-07-21 20345, 2008

      • aCiD2
        ruaok: sounds like a good time as well, I really want to get this polished before we push it out
      • 2008-07-21 20353, 2008

      • aCiD2
        make sure everything is done as cleanly as it can :)
      • 2008-07-21 20300, 2008

      • ruaok
        mainly to make it so that we can use it to make money to hire more devs.
      • 2008-07-21 20308, 2008

      • ruaok
        aCiD2: yep. :)
      • 2008-07-21 20321, 2008

      • murdos
        and what about timestamped entites which will allow google search, RSS, ... ?
      • 2008-07-21 20321, 2008

      • ruaok
        not sure if we can make the google search happen just yet, but that is scheduled for the next release
      • 2008-07-21 20322, 2008

      • murdos
        and then we'll be flooded by new users :|
      • 2008-07-21 20335, 2008

      • aCiD2
        you say it like it's a bad thing :P
      • 2008-07-21 20338, 2008

      • murdos
        with its good and its bad
      • 2008-07-21 20342, 2008

      • ruaok
        that part of the issue I'm worried about.
      • 2008-07-21 20353, 2008

      • ruaok
        indeed. too much traffic == bad.
      • 2008-07-21 20304, 2008

      • ruaok
        huge influx of users is also bad for the community.
      • 2008-07-21 20320, 2008

      • murdos
        I'm not sure the moderation system is ready for that
      • 2008-07-21 20336, 2008

      • aCiD2
        hmmm
      • 2008-07-21 20347, 2008

      • ruaok
        we proabably need to move the WS to EC2 before we can have enough capacituy on the main servers for that
      • 2008-07-21 20310, 2008

      • Muzzz_
        Heheh
      • 2008-07-21 20321, 2008

      • Muzzz_
        Hadoop cluster!
      • 2008-07-21 20344, 2008

      • ruaok
        I failz to see how hadoop will help here.
      • 2008-07-21 20301, 2008

      • Muzzz_
        Oh storage, not computation
      • 2008-07-21 20314, 2008

      • Muzzz_ was half paying attention and half playing keyboard heh
      • 2008-07-21 20342, 2008

      • murdos
        ruaok: got a minute? I've a question about db schema for ratings
      • 2008-07-21 20348, 2008

      • ruaok
        shoot
      • 2008-07-21 20359, 2008

      • murdos
      • 2008-07-21 20318, 2008

      • murdos
        I'm not sure it'a good idea to have separate tables for aggregate ratings
      • 2008-07-21 20342, 2008

      • Muzzz_
        aCiD2: was it you harping on about trying to get data out of rolldabeats a while ago?
      • 2008-07-21 20300, 2008

      • murdos
        there's 1 rating for 1 entity, so we could have the rating in the artist table e.g.
      • 2008-07-21 20315, 2008

      • ruaok
        IN the artist table?
      • 2008-07-21 20321, 2008

      • ruaok
        or artist_rating?
      • 2008-07-21 20321, 2008

      • murdos
        will allow to use less dabase requests
      • 2008-07-21 20331, 2008

      • murdos
        yes, in the artist table
      • 2008-07-21 20341, 2008

      • ruaok
        certainly no in the artist table.
      • 2008-07-21 20345, 2008

      • ruaok
        that conflates too much data.
      • 2008-07-21 20353, 2008

      • murdos
        you think?
      • 2008-07-21 20306, 2008

      • murdos
        the problem will be on the artist page or a release page
      • 2008-07-21 20307, 2008

      • ruaok
        and we want to keep the raw ratings separate from the main metadata.
      • 2008-07-21 20334, 2008

      • murdos
        we will load the release ratings + n*ratings for the tracks
      • 2008-07-21 20343, 2008

      • ruaok
        for instance, in tags we have raw tags in the rawdata server and the aggregate tags in the main server.
      • 2008-07-21 20310, 2008

      • murdos
        Sure, for the raw tables I will keep separate tables : http://bugs.musicbrainz.org/browser/mb_server/bra…
      • 2008-07-21 20315, 2008

      • ruaok
        this way we can have the raw data grow big -- without needing a STUPIDLY large database server.
      • 2008-07-21 20341, 2008

      • ruaok
        ok.
      • 2008-07-21 20351, 2008

      • murdos
        but in the end, once you've calculated the averate rating, you only have 1 rating for 1 artist
      • 2008-07-21 20358, 2008

      • ruaok
        the tags are very similar to the ratings.
      • 2008-07-21 20312, 2008

      • ruaok
        we keep the aggregate tags up to date automatically.
      • 2008-07-21 20319, 2008

      • ruaok
        and the user may not always want to know the tags.
      • 2008-07-21 20334, 2008

      • ruaok
        user in this case could be a WS caller or a mason/tt page asking for data.
      • 2008-07-21 20343, 2008

      • murdos
        exepted that you've many tags for 1 artist, but only one rating (says 3/5)
      • 2008-07-21 20357, 2008

      • ruaok
        by creating better granularity we can better tailor our database requests.
      • 2008-07-21 20319, 2008

      • ruaok
        it should still be in a separate table.
      • 2008-07-21 20323, 2008

      • murdos
        ok
      • 2008-07-21 20337, 2008

      • ruaok
        I used to think much like you, but pretty much all those conflating decisions I've come to regret.
      • 2008-07-21 20345, 2008

      • ruaok
        for instance the page column in the entities.
      • 2008-07-21 20352, 2008

      • ruaok
        that is used for paging the browse pages.
      • 2008-07-21 20302, 2008

      • ruaok
        works, but it doesn't belong in those tables.
      • 2008-07-21 20330, 2008

      • ruaok
        now, luks and I were just talking about creating artist_meta and track_meta tables.
      • 2008-07-21 20337, 2008

      • ruaok tries to remember for what
      • 2008-07-21 20342, 2008

      • ruaok
        oh yeah, timestamps.
      • 2008-07-21 20357, 2008

      • ruaok
        see, luks feels that even timestamps should not be inthe main tables.
      • 2008-07-21 20307, 2008

      • ruaok
        but in a separate _meta table.
      • 2008-07-21 20321, 2008

      • ruaok
        let's create the _meta tables and put the aggregate rating and timestamps in there.
      • 2008-07-21 20329, 2008

      • ruaok
        how does that sound?
      • 2008-07-21 20343, 2008

      • murdos
        ok for me, you're the db architect :)
      • 2008-07-21 20349, 2008

      • ruaok
        me?
      • 2008-07-21 20355, 2008

      • ruaok
        oh boy, we're in trouble.
      • 2008-07-21 20311, 2008

      • ruaok
        whenever I do something I ask luks to tell me how i screwed it up and how to fix it. :)
      • 2008-07-21 20325, 2008

      • murdos
        yes lol, you've much more experience than me of real application
      • 2008-07-21 20331, 2008

      • murdos
        ok :)
      • 2008-07-21 20335, 2008

      • ruaok
        :-)
      • 2008-07-21 20354, 2008

      • ruaok
        hmmm. how do we do this?
      • 2008-07-21 20308, 2008

      • ruaok
        given that the timestamps are in trunk and your stuff is in a branch...
      • 2008-07-21 20331, 2008

      • murdos
        I've branched rating recently
      • 2008-07-21 20342, 2008

      • murdos
        so maybe I've it