#musicbrainz-devel

/

      • ianmcorvidae
        you usually do updates via hobbes anyway, so do it in screen and let's do it as quick as we can :)
      • 2013-05-15 13554, 2013

      • warp
        ok
      • 2013-05-15 13503, 2013

      • ianmcorvidae
        asterix out
      • 2013-05-15 13530, 2013

      • warp
        eep, that's quick.
      • 2013-05-15 13552, 2013

      • warp pulls master
      • 2013-05-15 13553, 2013

      • ianmcorvidae
        heh, oops
      • 2013-05-15 13500, 2013

      • ianmcorvidae
        well, it's out once you're ready :)
      • 2013-05-15 13526, 2013

      • warp fab productions asterix.
      • 2013-05-15 13536, 2013

      • andreypopp joined the channel
      • 2013-05-15 13527, 2013

      • warp
        ianmcorvidae: done.
      • 2013-05-15 13540, 2013

      • ianmcorvidae
        pingu out, asterix in
      • 2013-05-15 13543, 2013

      • warp
        I see some warnings but I presume those are expected.
      • 2013-05-15 13549, 2013

      • ianmcorvidae
        which ones?
      • 2013-05-15 13501, 2013

      • ocharles
        ruaok: did you see one of our hypothesis on high load on totoro btw?
      • 2013-05-15 13519, 2013

      • warp
        ianmcorvidae: [asterix] out: [warn]: duplicate MIME type "text/html" in /etc/nginx/sites-enabled/001-musicbrainz:16
      • 2013-05-15 13524, 2013

      • warp
        ianmcorvidae: and the msgfmt one.
      • 2013-05-15 13527, 2013

      • ianmcorvidae
        oh, yeah, whatever
      • 2013-05-15 13532, 2013

      • nikki
        luks: upgrade done and replication up to date with no problems, thanks! :D
      • 2013-05-15 13533, 2013

      • ocharles
        luks: ianmcorvidae caused that regression because I caused a different regression
      • 2013-05-15 13536, 2013

      • ocharles
        :)
      • 2013-05-15 13547, 2013

      • ocharles
        well, i guess it's not a regression
      • 2013-05-15 13558, 2013

      • ocharles
        bug*
      • 2013-05-15 13504, 2013

      • warp
        fatal
      • 2013-05-15 13517, 2013

      • ianmcorvidae
        bugs, bugs everywhere
      • 2013-05-15 13521, 2013

      • ianmcorvidae
        warp: hm?
      • 2013-05-15 13555, 2013

      • warp
        ianmcorvidae: pingu failed presumably because it still though it was busy. seems to succeed now.
      • 2013-05-15 13501, 2013

      • warp
        yes, done.
      • 2013-05-15 13528, 2013

      • ianmcorvidae
        okay
      • 2013-05-15 13534, 2013

      • ianmcorvidae
        ready to put pingu back in?
      • 2013-05-15 13536, 2013

      • warp
        yes
      • 2013-05-15 13552, 2013

      • ianmcorvidae
        pingu in, astro out
      • 2013-05-15 13522, 2013

      • warp
        [astro] The server does NOT appear to be quiet!
      • 2013-05-15 13538, 2013

      • ocharles
        documentation isn't load balanced yet is it?
      • 2013-05-15 13541, 2013

      • warp
        now it is.
      • 2013-05-15 13542, 2013

      • ianmcorvidae
        wikidocs will continue to happen on astro
      • 2013-05-15 13555, 2013

      • ianmcorvidae
        until that PR gets done
      • 2013-05-15 13557, 2013

      • ianmcorvidae
        (and reports)
      • 2013-05-15 13503, 2013

      • ianmcorvidae
        but yeah, carry on :)
      • 2013-05-15 13515, 2013

      • warp
        ianmcorvidae: astro done.
      • 2013-05-15 13529, 2013

      • ianmcorvidae
        okay, everything back
      • 2013-05-15 13547, 2013

      • warp
        yay, thanks
      • 2013-05-15 13533, 2013

      • MBJenkins
        Project schema-migration-2013-05-15-slave-upgrade build #15: SUCCESS in 33 min: http://ci.musicbrainz.org/job/schema-migration-20…
      • 2013-05-15 13534, 2013

      • MBJenkins
        * warp: Merge branch 'mbs-6295'
      • 2013-05-15 13552, 2013

      • ocharles
        heh, we can probably lose these jobs now
      • 2013-05-15 13557, 2013

      • ocharles deactivates them
      • 2013-05-15 13557, 2013

      • warp
        :)
      • 2013-05-15 13506, 2013

      • MBJenkins
        Project schema-migration-2013-05-15-upgrade-sh build #59: ABORTED in 2 min 33 sec: http://ci.musicbrainz.org/job/schema-migration-20…
      • 2013-05-15 13507, 2013

      • MBJenkins
        * warp: Merge branch 'mbs-6295'
      • 2013-05-15 13511, 2013

      • warp
        ABORT ABORT
      • 2013-05-15 13519, 2013

      • ocharles
        EPANIC
      • 2013-05-15 13541, 2013

      • warp
        is the rest of the week a non-freeze week? :)
      • 2013-05-15 13553, 2013

      • warp
        (what about next week?)
      • 2013-05-15 13554, 2013

      • ianmcorvidae
        I think that's the notion
      • 2013-05-15 13522, 2013

      • ianmcorvidae
        I think next week is not, though we may have to give way if something especially important is up
      • 2013-05-15 13536, 2013

      • ianmcorvidae
        and we definitely need to ensure the GPG replication gets in, since we promised that :)
      • 2013-05-15 13553, 2013

      • warp
        warp has changed the topic to: luke-warm week | DfOTS: 0 / Agenda: reviews
      • 2013-05-15 13503, 2013

      • ruaok returns
      • 2013-05-15 13514, 2013

      • ruaok
        I did not catch the hypothesis on totoro...
      • 2013-05-15 13554, 2013

      • ianmcorvidae
        short version is that ocharles and I both have pg9.2, which has some query planner improvements over 9.0 and 9.1
      • 2013-05-15 13520, 2013

      • ianmcorvidae
        in the scrollback ollie found a couple that look like they may be especially relevant to release-event and area-related changes to some of our queries
      • 2013-05-15 13538, 2013

      • ocharles
        ya
      • 2013-05-15 13504, 2013

      • ruaok
        so, can we make a policy of only developing on pg version that we're actually supporting.
      • 2013-05-15 13510, 2013

      • ruaok
        this isn't a new problem. yet it keeps happening.
      • 2013-05-15 13517, 2013

      • ruaok
        +?
      • 2013-05-15 13548, 2013

      • nikki points to http://tickets.musicbrainz.org/browse/MBS-6161 which is still open :P
      • 2013-05-15 13532, 2013

      • ocharles
        i do agree with that, but it's only a hypothesis that this is the problem
      • 2013-05-15 13538, 2013

      • ocharles
        maybe 9.0 or 9.1 can do this rewriting
      • 2013-05-15 13545, 2013

      • ianmcorvidae
        we require 9.0 at this point, or 9.1?
      • 2013-05-15 13555, 2013

      • ruaok
        9.1
      • 2013-05-15 13500, 2013

      • ianmcorvidae is just going to commit the INSTALL changes for MBS-6161, that's stupid that we haven't changed it :P
      • 2013-05-15 13501, 2013

      • mb-chat-logger
      • 2013-05-15 13509, 2013

      • ruaok
        maybe we can upgrade to 9.1 soon and mitigate this.
      • 2013-05-15 13550, 2013

      • Rockj
        Q: what is cube.control extention for postgres?
      • 2013-05-15 13553, 2013

      • Rockj
        extension
      • 2013-05-15 13530, 2013

      • ocharles
        ruaok: do you have a migrated 9.1?
      • 2013-05-15 13535, 2013

      • ruaok
        yes.
      • 2013-05-15 13539, 2013

      • ruaok
        on sakura.
      • 2013-05-15 13542, 2013

      • ocharles
        ok, then it would be good to test the query there
      • 2013-05-15 13548, 2013

      • ruaok
        installed from packages, even.
      • 2013-05-15 13552, 2013

      • ianmcorvidae
        which query were you using, ocharles?
      • 2013-05-15 13555, 2013

      • ruaok
        feel free.
      • 2013-05-15 13555, 2013

      • ocharles
      • 2013-05-15 13501, 2013

      • ocharles
        explain analyze that and let me know the plan
      • 2013-05-15 13539, 2013

      • ianmcorvidae
        0.855ms for that
      • 2013-05-15 13541, 2013

      • ianmcorvidae
        that bodes well
      • 2013-05-15 13549, 2013

      • ocharles
        does anyone have 9.0
      • 2013-05-15 13551, 2013

      • ocharles
        that's not totoro :p
      • 2013-05-15 13554, 2013

      • ianmcorvidae
        rika does
      • 2013-05-15 13535, 2013

      • ocharles
        sakura presumably just has a bunch of index lookups in a nested loop?
      • 2013-05-15 13540, 2013

      • ianmcorvidae
      • 2013-05-15 13551, 2013

      • ianmcorvidae
        lemme go run it on rika
      • 2013-05-15 13500, 2013

      • ianmcorvidae
        (that one's sakura, on 9.1)
      • 2013-05-15 13542, 2013

      • ocharles
        yep, sakura matches my machine
      • 2013-05-15 13545, 2013

      • ruaok
        ocharles: there is a from source install of 9.0 complete with db on sakura.
      • 2013-05-15 13554, 2013

      • ruaok
        sakura has complete 9.0 and 9.1 installs.
      • 2013-05-15 13556, 2013

      • ianmcorvidae
        rika, 9.0
      • 2013-05-15 13558, 2013

      • ianmcorvidae
      • 2013-05-15 13513, 2013

      • ruaok
        one from package and one from source in /usr/local/postgres-9.0.13
      • 2013-05-15 13514, 2013

      • ocharles
        yea, rika matches totoro
      • 2013-05-15 13527, 2013

      • ianmcorvidae
        this suggests that an upgrade to 9.1 will solve a lot of these problems?
      • 2013-05-15 13500, 2013

      • Rockj
        regarding my question: sicbrainz-server/admin/sql/Extensions.sql:4: ERROR: could not open extension control file "/usr/share/postgresql/9.1/extension/cube.control": No such file or directory
      • 2013-05-15 13502, 2013

      • ocharles
        we have several 9.1 machines with the right plan and no 9.0 machines with it
      • 2013-05-15 13516, 2013

      • ocharles
        so yes, 9.1 does agree with the hypothesis
      • 2013-05-15 13522, 2013

      • ocharles
        Rockj: did you install postgresql-contrib?
      • 2013-05-15 13544, 2013

      • Rockj
        oh of course
      • 2013-05-15 13546, 2013

      • Rockj
        doh
      • 2013-05-15 13522, 2013

      • Rockj
        there we go, importing :-)
      • 2013-05-15 13527, 2013

      • Rockj
        on new server
      • 2013-05-15 13556, 2013

      • MBJenkins
        Project musicbrainz-server_master build #427: SUCCESS in 8 min 53 sec: http://ci.musicbrainz.org/job/musicbrainz-server_…
      • 2013-05-15 13557, 2013

      • MBJenkins
        Ian McEwen: We require postgresl 9.1.
      • 2013-05-15 13523, 2013

      • ianmcorvidae
        heh, I spellz gud
      • 2013-05-15 13524, 2013

      • reosarevok
        woot, that didn't break :p
      • 2013-05-15 13525, 2013

      • ianmcorvidae
        anyway
      • 2013-05-15 13513, 2013

      • warp
        so we sudo apt dist-upgrade totoro until we're at 12:04 LTS and then sudo apt-get install postgres? :)
      • 2013-05-15 13516, 2013

      • ocharles
        master built in 8 minutes?
      • 2013-05-15 13520, 2013

      • ocharles
        that doesn't seem right
      • 2013-05-15 13501, 2013

      • ianmcorvidae
        er
      • 2013-05-15 13502, 2013

      • ianmcorvidae
        that's true
      • 2013-05-15 13516, 2013

      • ianmcorvidae
        it's almost certainly not related to that patch, since that was a change to INSTALL.md, but
      • 2013-05-15 13528, 2013

      • ocharles
        yet the log does look like it ran everything...
      • 2013-05-15 13530, 2013

      • ocharles
        i am tres confused
      • 2013-05-15 13539, 2013

      • ianmcorvidae
        is the html5 validator hooked up?
      • 2013-05-15 13548, 2013

      • ianmcorvidae
        ok 4 # skip No HTML_VALIDATOR configured, skip html validation
      • 2013-05-15 13552, 2013

      • Jozo
        (I tried read source) but is it important split every entitity to own file on geordi? (used discogs example... )
      • 2013-05-15 13500, 2013

      • warp
        ianmcorvidae: master doesn't do html5 validation.
      • 2013-05-15 13509, 2013

      • warp
        ianmcorvidae: only the beta build on jenkins is configured to validate HTML
      • 2013-05-15 13516, 2013

      • ianmcorvidae
        Jozo: separate folders, they should be named by entity
      • 2013-05-15 13520, 2013

      • ianmcorvidae
        er, named by ID
      • 2013-05-15 13541, 2013

      • ianmcorvidae
        at present it supports only having one base type of entity, and everything else is done as a 'subitem'
      • 2013-05-15 13509, 2013

      • Jozo
        ianmcorvidae: Oh, thanks
      • 2013-05-15 13512, 2013

      • ianmcorvidae
        (generally, that's a release)
      • 2013-05-15 13535, 2013

      • warp
        ocharles: yep, I also don't see anything obviously wrong in the logs.
      • 2013-05-15 13520, 2013

      • ocharles
        http://ci.musicbrainz.org/job/musicbrainz-server_… the last few have been that quick actually
      • 2013-05-15 13540, 2013

      • Jozo
        ianmcorvidae: When works is covered on geordi?
      • 2013-05-15 13502, 2013

      • warp
        ocharles: yes, so we broke it after build #423.
      • 2013-05-15 13512, 2013

      • warp
        (or fixed it, depending on wtf is going on)
      • 2013-05-15 13523, 2013

      • ianmcorvidae
      • 2013-05-15 13539, 2013

      • ocharles
        Oh
      • 2013-05-15 13540, 2013

      • ianmcorvidae
        Jozo: it can be works now, but we haven't really tried yet
      • 2013-05-15 13545, 2013

      • ianmcorvidae
        Jozo: what're you trying to do?
      • 2013-05-15 13547, 2013

      • ocharles
        I did change the web service tests to not do TRUNCATE
      • 2013-05-15 13559, 2013

      • warp
      • 2013-05-15 13516, 2013

      • ocharles
        that's mad.
      • 2013-05-15 13519, 2013

      • ocharles gives himself a raise
      • 2013-05-15 13538, 2013

      • warp
        lol
      • 2013-05-15 13510, 2013

      • warp
        I'm still waiting for that postgresql upgrade which will make TRUNCATEs fast.
      • 2013-05-15 13528, 2013

      • ocharles
        that'd be nice
      • 2013-05-15 13531, 2013

      • ianmcorvidae
        "TRUNCATE quickly removes all rows from a set of tables. It has the same effect as an unqualified DELETE on each table, but since it does not actually scan the tables it is faster." apparently completely incorrect
      • 2013-05-15 13540, 2013

      • ianmcorvidae
        (quoted from current postgres docs)
      • 2013-05-15 13546, 2013

      • ianmcorvidae
        why is it that truncate is slower?