#musicbrainz-devel

/

      • ruaok_ joined the channel
      • 2010-01-25 02558, 2010

      • ruaok joined the channel
      • 2010-01-25 02515, 2010

      • pronik`` joined the channel
      • 2010-01-25 02559, 2010

      • pronik``` joined the channel
      • 2010-01-25 02502, 2010

      • ruaok joined the channel
      • 2010-01-25 02556, 2010

      • ijabz joined the channel
      • 2010-01-25 02550, 2010

      • ijabz joined the channel
      • 2010-01-25 02533, 2010

      • djce joined the channel
      • 2010-01-25 02539, 2010

      • evansd17 joined the channel
      • 2010-01-25 02502, 2010

      • djce joined the channel
      • 2010-01-25 02537, 2010

      • ijabz
        And database people about ?
      • 2010-01-25 02543, 2010

      • nikki wonders what you have to know to be a database person
      • 2010-01-25 02508, 2010

      • ijabz
        ok here goes
      • 2010-01-25 02542, 2010

      • ijabz
        CREATE INDEX artist_name_idx_page ON artist_name (page_index(name));
      • 2010-01-25 02556, 2010

      • ijabz
        why is the second one needed ?
      • 2010-01-25 02520, 2010

      • warp was just disqualified as a database person.
      • 2010-01-25 02525, 2010

      • djce
        ijabz: I haven't looked at the db schema for a few years,
      • 2010-01-25 02531, 2010

      • djce
        but if it hasn't changed since then,
      • 2010-01-25 02555, 2010

      • djce
        then the answer is that the "page" column is used for browsing by name.
      • 2010-01-25 02508, 2010

      • djce
        but I have to say, that SQL looks wrong. Or, it has changed in the last few years.
      • 2010-01-25 02530, 2010

      • djce doesn't remember an artist_name table. So you might want to ignore everything I just said :-)
      • 2010-01-25 02548, 2010

      • nikki
        heh, you haven't seen the ngs schema then? :P
      • 2010-01-25 02555, 2010

      • djce
        correct.
      • 2010-01-25 02512, 2010

      • nikki knows very little about indexes :/
      • 2010-01-25 02552, 2010

      • ijabz
        ok, so ist just for browsing artist by names, it wont speed up any other sql queries
      • 2010-01-25 02523, 2010

      • djce
        I would assume so, if "page" has the same meaning it used to pre-NGS
      • 2010-01-25 02541, 2010

      • nikki
      • 2010-01-25 02543, 2010

      • djce
        ah, so the page logic is moved into the db now. IIRC it used to be in *.pm somewhere.
      • 2010-01-25 02554, 2010

      • djce feels old ;-)
      • 2010-01-25 02532, 2010

      • nikki
        it's probably just another of the things which has changed for ngs
      • 2010-01-25 02506, 2010

      • ijabz
        thx, I didnt undertsand the syntax, thx djce and nikki looks like you are a database person ;0
      • 2010-01-25 02515, 2010

      • ijabz_ joined the channel
      • 2010-01-25 02516, 2010

      • alastair1 joined the channel
      • 2010-01-25 02552, 2010

      • Muz joined the channel
      • 2010-01-25 02513, 2010

      • brianfreud joined the channel
      • 2010-01-25 02524, 2010

      • ruaok joined the channel
      • 2010-01-25 02558, 2010

      • djce joined the channel
      • 2010-01-25 02501, 2010

      • ijabz joined the channel
      • 2010-01-25 02522, 2010

      • errorlevel_ joined the channel
      • 2010-01-25 02522, 2010

      • Jozo joined the channel
      • 2010-01-25 02523, 2010

      • ruaok joined the channel
      • 2010-01-25 02546, 2010

      • pronik``` joined the channel
      • 2010-01-25 02529, 2010

      • djce
        ruaok: Quick 1-minute update on web stats?
      • 2010-01-25 02512, 2010

      • luciddrmr joined the channel
      • 2010-01-25 02503, 2010

      • ruaok
        shoot
      • 2010-01-25 02500, 2010

      • ruaok waves at luciddrmr
      • 2010-01-25 02515, 2010

      • luciddrmr waves back
      • 2010-01-25 02518, 2010

      • luciddrmr
        hullo!
      • 2010-01-25 02522, 2010

      • djce
        I'm half way through writing an email now. I'll send it in a mo.
      • 2010-01-25 02530, 2010

      • djce
        But in short:
      • 2010-01-25 02531, 2010

      • ruaok
        ok.
      • 2010-01-25 02533, 2010

      • djce
      • 2010-01-25 02536, 2010

      • ruaok
        I should really get to the office anyway.
      • 2010-01-25 02537, 2010

      • djce
      • 2010-01-25 02555, 2010

      • ruaok
        woah. 7.3M daily avg.
      • 2010-01-25 02502, 2010

      • djce
        That'll be /ws/ then :-)
      • 2010-01-25 02508, 2010

      • ruaok
        yeah. :-)
      • 2010-01-25 02541, 2010

      • pronik``` joined the channel
      • 2010-01-25 02539, 2010

      • nikolai joined the channel
      • 2010-01-25 02514, 2010

      • pronik joined the channel
      • 2010-01-25 02519, 2010

      • aCiD2
        mornin folks
      • 2010-01-25 02540, 2010

      • nikki wonders what aCiD2 is doing in australia :P
      • 2010-01-25 02554, 2010

      • nikki
        or new zealand or wherever it's morning
      • 2010-01-25 02559, 2010

      • aCiD2
        i wish :P
      • 2010-01-25 02539, 2010

      • warp
        his connection seems to be in france.
      • 2010-01-25 02504, 2010

      • ruaok joined the channel
      • 2010-01-25 02516, 2010

      • ruaok reads djce's email
      • 2010-01-25 02526, 2010

      • ruaok
        wow. the web service accounts for 89.3% of our overall traffic.
      • 2010-01-25 02511, 2010

      • ruaok
        and the old web service *still* gets 3.3M hits per month.
      • 2010-01-25 02521, 2010

      • ruaok will never understand that.
      • 2010-01-25 02502, 2010

      • ruaok
        <BANG>
      • 2010-01-25 02502, 2010

      • MBChatLogger
        MBChatLogger has changed the topic to: http://musicbrainz.org/#devel
      • 2010-01-25 02513, 2010

      • warp
        hello!
      • 2010-01-25 02518, 2010

      • ruaok
        welcome everyone!
      • 2010-01-25 02529, 2010

      • ruaok
        ruaok has changed the topic to: agenda: review, b1 review, warp planning
      • 2010-01-25 02540, 2010

      • ruaok
        moin warp.
      • 2010-01-25 02542, 2010

      • aCiD2
        warp planning \o/
      • 2010-01-25 02543, 2010

      • ruaok
        aCiD2: you here?
      • 2010-01-25 02559, 2010

      • aCiD2
        oui
      • 2010-01-25 02510, 2010

      • ruaok
        :-)
      • 2010-01-25 02517, 2010

      • ruaok
        kick off the review form last week, aCiD2 !
      • 2010-01-25 02519, 2010

      • pronik
        greetings everyone
      • 2010-01-25 02541, 2010

      • aCiD2
        ok :) As somewhat anticipated work slowed down this week
      • 2010-01-25 02544, 2010

      • ruaok waves at pronik
      • 2010-01-25 02553, 2010

      • aCiD2
        But I still managed to get a good 10 hours fixing some bugs that are hitting test.mb
      • 2010-01-25 02504, 2010

      • aCiD2
        Sadly, the most noticable problems (/edit/open) is still yet to be fixed
      • 2010-01-25 02515, 2010

      • ruaok
        :-(
      • 2010-01-25 02532, 2010

      • aCiD2
        The biggest work I did was refactoring our database handling, -- mostly a development issue, but this runs our test suite about 300% faster (and I think it will actually make the web site faster too)
      • 2010-01-25 02532, 2010

      • ruaok
        yeah, next time it works, ping me. I've never seen it work. :)
      • 2010-01-25 02552, 2010

      • aCiD2
        essentially, we now connect to both databases once, per process, and share that handle over the life of the process
      • 2010-01-25 02500, 2010

      • aCiD2
        (before we were reconnecting and disconnecting per request)
      • 2010-01-25 02505, 2010

      • ruaok
        good. that wasn't the case before?
      • 2010-01-25 02511, 2010

      • aCiD2
        Newp
      • 2010-01-25 02520, 2010

      • ruaok
        what was it before?
      • 2010-01-25 02534, 2010

      • aCiD2
        Connect on a request (lazily), and then disconnect on completion
      • 2010-01-25 02553, 2010

      • aCiD2
        I think under apache that might have used a pool, but it was still a needlessly complicated way of doing things
      • 2010-01-25 02554, 2010

      • ruaok
        ah, on a per request basis.
      • 2010-01-25 02509, 2010

      • ruaok
        yes, apache::DBI provided that.
      • 2010-01-25 02542, 2010

      • ruaok
        ok. how is your week looking? when can we expect to have /edit/open working?
      • 2010-01-25 02554, 2010

      • aCiD2
        This week it will be working, that has to be fixed now
      • 2010-01-25 02506, 2010

      • aCiD2
        this week is so-so, I should be able to hammer out another 15 hours work I think at least
      • 2010-01-25 02508, 2010

      • ruaok nods
      • 2010-01-25 02513, 2010

      • ruaok
        good.
      • 2010-01-25 02526, 2010

      • ruaok
        did you look at my discid dilemma at all?
      • 2010-01-25 02536, 2010

      • ruaok
        I'm stuck on that for finishing the WS.
      • 2010-01-25 02551, 2010

      • aCiD2
        Yea, sorry I haven't got round to replying yet, I was hoping to talk to you about that
      • 2010-01-25 02501, 2010

      • ruaok
        lets do that after the meeting then.
      • 2010-01-25 02511, 2010

      • warp is curious what the dilemma is.
      • 2010-01-25 02544, 2010

      • ruaok
        warp: when querying for the data, too much data is returned and its not easy to pick out which ids belong to which release.
      • 2010-01-25 02500, 2010

      • ruaok
        join us in the post meeting discussion. :)
      • 2010-01-25 02500, 2010

      • warp
        ah
      • 2010-01-25 02508, 2010

      • warp will stick around.
      • 2010-01-25 02511, 2010

      • ruaok
        warp: how was your week? busy getting out of your old job?
      • 2010-01-25 02532, 2010

      • warp
        yes, didn't do anything mb related really.
      • 2010-01-25 02509, 2010

      • ruaok
        ok. I noticed this weekend was very quiet. I needed a break too, so it was hard to stay focused.
      • 2010-01-25 02519, 2010

      • ruaok segways into his week
      • 2010-01-25 02547, 2010

      • ruaok
        I kept working on the web service. today I won't be able to work on it -- today is set aside to close out 2009 for the foundation. loads of BS paperwork and crap like that.
      • 2010-01-25 02548, 2010

      • warp
        :)
      • 2010-01-25 02556, 2010

      • aCiD2
        fun
      • 2010-01-25 02558, 2010

      • ruaok
        maybe i can get to the annual report.
      • 2010-01-25 02504, 2010

      • warp
        ah
      • 2010-01-25 02511, 2010

      • ruaok
        dave just finished his work on the web stats, so I can write the report.
      • 2010-01-25 02518, 2010

      • warp
        :)
      • 2010-01-25 02534, 2010

      • ruaok
        one of my main tasks for this week is to get the WS working (finish all core elements)
      • 2010-01-25 02550, 2010

      • ruaok
        and to think about how to integrate warp into the team. but more on that on our next topic.
      • 2010-01-25 02559, 2010

      • ruaok
        djce: please give us an update on the web stats.
      • 2010-01-25 02511, 2010

      • ruaok
        erp. looks like he's run off. :(
      • 2010-01-25 02522, 2010

      • ruaok
        stats.musicbrainz.org has been updated....
      • 2010-01-25 02536, 2010

      • ruaok
      • 2010-01-25 02553, 2010

      • ruaok
        this is our front end that collects stats about all of our services.
      • 2010-01-25 02505, 2010

      • MBChatLogger
        ruaok probably meant ' musicbrainz-full takes into account all of the traffic to musicbrainz.org '
      • 2010-01-25 02505, 2010

      • ruaok
        musicbrainz-full takes into account all of the traffic to mb.org
      • 2010-01-25 02530, 2010

      • ruaok
        somewhat interesting. 90% of our traffic is web service traffic, which isnt very surprising.
      • 2010-01-25 02543, 2010

      • ruaok
        but its a clear case for making sure the next WS is *tight*.
      • 2010-01-25 02554, 2010

      • ruaok
        and on a business note...
      • 2010-01-25 02507, 2010

      • ijabz
        SO which value do we look at to work out the 90%
      • 2010-01-25 02517, 2010

      • ruaok
        there are more people wishing to have unfettered access to the WS. (read: no rate limiting)
      • 2010-01-25 02529, 2010

      • murdos joined the channel
      • 2010-01-25 02544, 2010

      • ruaok
        I think making a amazon EC2 hosted WS that has not rate limiting, but is $$$ for access may bring in more money. certainly to pay for warp. :)
      • 2010-01-25 02547, 2010

      • ruaok
        but that is a lot of work.
      • 2010-01-25 02556, 2010

      • aCiD2
        oo, interesting idea
      • 2010-01-25 02506, 2010

      • ruaok
      • 2010-01-25 02514, 2010

      • ruaok
        look for : Top 30 of 2511791 Total URLs
      • 2010-01-25 02514, 2010

      • aCiD2
        evening murdos
      • 2010-01-25 02525, 2010

      • murdos
        hi
      • 2010-01-25 02538, 2010

      • ruaok
        aCiD2: yes, but there are plenty of engineering issues to make that work.
      • 2010-01-25 02539, 2010

      • ijabz is reminded of the idea of taggers that pay getting a faster rate
      • 2010-01-25 02540, 2010

      • warp
        77% web service in that list.
      • 2010-01-25 02558, 2010

      • ruaok
        ijabz: yes, this would be part of that.
      • 2010-01-25 02505, 2010

      • aCiD2
        oh yea, sure