#musicbrainz-devel

/

      • DWSR2
        ianmcorvidae: Ok, but I go back to it still not working.
      • 2013-11-19 32345, 2013

      • ianmcorvidae
        how delightfully vague
      • 2013-11-19 32345, 2013

      • DWSR2
        Even just running psql gives the same error about the db not existing.
      • 2013-11-19 32317, 2013

      • ianmcorvidae
        the default config makes a database called musicbrainz_db, as I recall, so that would be why there's no database called 'musicbrainz'
      • 2013-11-19 32304, 2013

      • ianmcorvidae
        you also don't need to drop from the psql shell, you can use dropdb -U <whatever> <database name> from a system shell
      • 2013-11-19 32309, 2013

      • DWSR2
        right, but you instructed me to just DROP the database, which I did, then reimport.
      • 2013-11-19 32312, 2013

      • ianmcorvidae
        assuming that's what you're trying to do
      • 2013-11-19 32300, 2013

      • ianmcorvidae
        I don't know what you're trying to do with a plain psql shell
      • 2013-11-19 32313, 2013

      • ianmcorvidae
        there is no step of the drop and reimport process that uses one
      • 2013-11-19 32352, 2013

      • DWSR2
        nothing, just pointing out that the script seems to be just using the same sql user as the system user, which yields the same error message.
      • 2013-11-19 32312, 2013

      • ianmcorvidae
        I have literally no idea what point any of this conversation has at this point
      • 2013-11-19 32328, 2013

      • ianmcorvidae
        run dropdb and rerun InitDb, and it seems like while you're waiting you could stand to read the psql man page :P
      • 2013-11-19 32336, 2013

      • DWSR2
        I did.
      • 2013-11-19 32338, 2013

      • DWSR2
        I get that error message.
      • 2013-11-19 32308, 2013

      • DWSR2
      • 2013-11-19 32309, 2013

      • ianmcorvidae
        then it seems likely you've not included --createdb
      • 2013-11-19 32320, 2013

      • ianmcorvidae
        hm
      • 2013-11-19 32325, 2013

      • DWSR2
        Hence the conversation.
      • 2013-11-19 32338, 2013

      • ianmcorvidae
        yeah, if you'd actually provided that context at any point I'd be a lot less annoyed at you right now
      • 2013-11-19 32356, 2013

      • DWSR2
        Sorry, I thought it was implied.
      • 2013-11-19 32338, 2013

      • DWSR2
        When I ran into this error previously, I just created the db musicbrainz and the import process seemed to go as expected, other than the bad import.
      • 2013-11-19 32331, 2013

      • ianmcorvidae
        could you pastebin your lib/DBDefs.pm as well (sanitizing anything private, if relevant)
      • 2013-11-19 32326, 2013

      • DWSR2
      • 2013-11-19 32326, 2013

      • DWSR2
        untouched, btw.
      • 2013-11-19 32335, 2013

      • ianmcorvidae
        ah, hm
      • 2013-11-19 32355, 2013

      • ianmcorvidae
        try doing ./admin/InitDb.pl --createdb --import <etc...>
      • 2013-11-19 32310, 2013

      • ianmcorvidae
        I'm not sure if that extra -- is a documentation mistake from when we used to use carton
      • 2013-11-19 32354, 2013

      • ianmcorvidae
        potentially that's making it ignore the rest of the arguments, which would explain it trying to connect to a database without trying to create it first, and also the empty database at the end
      • 2013-11-19 32318, 2013

      • DWSR2
        seems to work better.
      • 2013-11-19 32346, 2013

      • ianmcorvidae
        okay
      • 2013-11-19 32357, 2013

      • ianmcorvidae
        I'll fix that documentation then, surprised it hasn't bitten anyone else yet :/
      • 2013-11-19 32311, 2013

      • DWSR2
        I'm slightly more newb, I guess?
      • 2013-11-19 32319, 2013

      • ianmcorvidae
        heh
      • 2013-11-19 32324, 2013

      • ianmcorvidae
        you haven't seen some of the people coming in here for help :P
      • 2013-11-19 32325, 2013

      • ianmcorvidae
        but I guess we've mostly just been telling people to use the VM lately anyway
      • 2013-11-19 32335, 2013

      • DWSR2
        replication takes forever and the server was over a month behind.
      • 2013-11-19 32344, 2013

      • DWSR2
        So I decided fresh import was much easier.
      • 2013-11-19 32302, 2013

      • DWSR2
        btw, the ftp server that the fullexport data is hosted on is having a problem. Browsing it via http works, via FTP the directory listings time out.
      • 2013-11-19 32312, 2013

      • ianmcorvidae
        strange
      • 2013-11-19 32321, 2013

      • ianmcorvidae
        that's not hosted by us, anyway, unless you're using data.musicbrainz.org for some reason
      • 2013-11-19 32338, 2013

      • DWSR2
        No, and yeah, I saw it. Just thought you might have a contact email for the sysadmin
      • 2013-11-19 32334, 2013

      • DWSR2
        Do you guys need a US mirror for full export data?
      • 2013-11-19 32301, 2013

      • kepstin_
        ftp.musicbrainz.org is hosted by osuosl (oregon state u)
      • 2013-11-19 32305, 2013

      • ianmcorvidae
        yeah, that one's already in the US
      • 2013-11-19 32320, 2013

      • ianmcorvidae
        all of MB except for our torrent-hosting VM and ftp.eu.musicbrainz.org are in the US
      • 2013-11-19 32354, 2013

      • DWSR2
        ?
      • 2013-11-19 32302, 2013

      • DWSR2
        Import's running, but will take a bit
      • 2013-11-19 32312, 2013

      • ianmcorvidae
        relatively; I lurk in IRC all the time anyway
      • 2013-11-19 32300, 2013

      • DWSR2
        Oh, you're a daywalker as well, then?
      • 2013-11-19 32350, 2013

      • ianmcorvidae
        every definition of that I can find seems to refer to redheaded people who don't sunburn easily, so I'll have to go with no :P
      • 2013-11-19 32317, 2013

      • kepstin_
        could be a subtype of vampire that doesn't have issues with sunlight, too
      • 2013-11-19 32340, 2013

      • DWSR2
        Also that.
      • 2013-11-19 32305, 2013

      • DWSR2
        Also sometimes used to refer to that special type of nerd that can also socialize with people.
      • 2013-11-19 32347, 2013

      • nikki__ joined the channel
      • 2013-11-19 32336, 2013

      • kepstin-laptop joined the channel
      • 2013-11-19 32356, 2013

      • bitmap
        heh, InitDb.pl hasn't worked for me either the last several times I tried it, which I guess makes sense now given that I just copy the line from INSTALL
      • 2013-11-19 32317, 2013

      • bitmap
        I never brought it up because I've been importing things on OS X, so I didn't even think the command might be wrong, I just assumed it was some weird OS X incompatibility
      • 2013-11-19 32356, 2013

      • DWSR2
        Welp, now you have confirmation that it wasn't JUST you. :P
      • 2013-11-19 32316, 2013

      • DWSR2
        huh
      • 2013-11-19 32329, 2013

      • DWSR2
        The import is failing due to no disk space being left on a disk that has 20GB free.
      • 2013-11-19 32321, 2013

      • DWSR2
        To be fair, I noticed I didn't end up resizing the partition as I had originally intended, but 20G should be plenty of free space.
      • 2013-11-19 32325, 2013

      • DWSR2
        ianmcorvidae: 20G should be plenty of free space, right? The DB is already on disk.
      • 2013-11-19 32335, 2013

      • DWSR2
        And, it's only like 5G
      • 2013-11-19 32324, 2013

      • kepstin-laptop
        nah, 20gb isn't nearly enough free space.
      • 2013-11-19 32338, 2013

      • kepstin-laptop
        well, it's probably close to enough free space, actually.
      • 2013-11-19 32354, 2013

      • kepstin-laptop usually recommends about 30gb, but the last time he did the import was a while ago :)
      • 2013-11-19 32335, 2013

      • DWSR2
        welp, gonna resize the partition out to the full 300GB of disk and try again.
      • 2013-11-19 32341, 2013

      • DWSR2
        I assume THAT will be enough space, right? :P
      • 2013-11-19 32316, 2013

      • ianmcorvidae
        20GB is... possibly enough for the finished DB, but not for 2x that as you need during import
      • 2013-11-19 32334, 2013

      • ianmcorvidae
        also, hopefully you're not importing the edit dump
      • 2013-11-19 32337, 2013

      • ianmcorvidae
        if you are, don't :P
      • 2013-11-19 32348, 2013

      • DWSR2
        lulz, too late.
      • 2013-11-19 32334, 2013

      • DWSR2
        nah, just kidding. Just rebooting out of LiveCD. Gonna do the import again right after. What's in the edit dump, anyway?
      • 2013-11-19 32359, 2013

      • ianmcorvidae
        edits
      • 2013-11-19 32303, 2013

      • ianmcorvidae
        as you might imagine
      • 2013-11-19 32308, 2013

      • ianmcorvidae
        it's all the history, anyway
      • 2013-11-19 32320, 2013

      • DWSR2
        Oh, just history?
      • 2013-11-19 32322, 2013

      • ianmcorvidae
        everything you see on the 'open edits' and 'all edits' pages for an entity
      • 2013-11-19 32325, 2013

      • ianmcorvidae
        yeah
      • 2013-11-19 32335, 2013

      • ianmcorvidae
        so, nothing you need for a mirror
      • 2013-11-19 32342, 2013

      • ianmcorvidae
        and it takes up about as much space, alone, as the entire rest of the DB
      • 2013-11-19 32345, 2013

      • ianmcorvidae
        so yeah :)
      • 2013-11-19 32347, 2013

      • DWSR2
        yeah, I noticed.
      • 2013-11-19 32312, 2013

      • ianmcorvidae notes, for those who were following along earlier re: editor stats, my "has done anything ever" stat for editors found 243,219 (versus 1,059,526 non-deleted editors total)
      • 2013-11-19 32341, 2013

      • ianmcorvidae
        biggest class of editors is "not deleted, but hasn't validated an email or done anything" with 475,097 people
      • 2013-11-19 32344, 2013

      • ianmcorvidae
        heh
      • 2013-11-19 32347, 2013

      • ianmcorvidae
        next biggest is "validated email but nothing else" with 341,696
      • 2013-11-19 32317, 2013

      • ianmcorvidae
        then people who have validated and edited but used nothing else on the site, 85,015, and people who have no valid email but have edited (I guess used to have a validated email?) with 53,302
      • 2013-11-19 32322, 2013

      • CallerNo6 joined the channel
      • 2013-11-19 32320, 2013

      • snartal
        hmmm, having a framed screenshot of your MB hanging on the wall must be popular, or something.
      • 2013-11-19 32335, 2013

      • ianmcorvidae
        heh, or half our users are spammers :P
      • 2013-11-19 32306, 2013

      • JesseW_not_logge
        I'm not seeing the v-2013-11-11 tag in git?
      • 2013-11-19 32310, 2013

      • DWSR2
        It's there.
      • 2013-11-19 32318, 2013

      • DWSR2
        Try doing a git pull first.
      • 2013-11-19 32336, 2013

      • JesseW_not_logge
        hm. I ran git fetch git [at bitbucket.org]:metabrainz/musicbrainz-server.git and it found v-2013-10-28 but not v-2013-11-11
      • 2013-11-19 32347, 2013

      • JesseW_not_logge
        hm, maybe it hasn't gotten copied from the github repo?
      • 2013-11-19 32316, 2013

      • JesseW_not_logge
        yep, it doesn't seem to have been copied over yet. who should I ping to get that done?
      • 2013-11-19 32329, 2013

      • JesseW_not_logge
      • 2013-11-19 32356, 2013

      • JesseW_not_logge
      • 2013-11-19 32316, 2013

      • JesseW_not_logge
        ianmcorvidae: ping?
      • 2013-11-19 32334, 2013

      • ianmcorvidae joined the channel
      • 2013-11-19 32341, 2013

      • JesseW_not_logge
        ianmcorvidae: any idea why the bitbucket repo doesn't have the most recent tag?
      • 2013-11-19 32323, 2013

      • ianmcorvidae
        JesseW_not_logge: probably I forgot to push it there :)
      • 2013-11-19 32326, 2013

      • ianmcorvidae
        JesseW_not_logge: I'll do that now
      • 2013-11-19 32327, 2013

      • JesseW_not_logge
        ianmcorvidae: thanks!
      • 2013-11-19 32348, 2013

      • SultS joined the channel
      • 2013-11-19 32311, 2013

      • rvedotrc joined the channel
      • 2013-11-19 32355, 2013

      • rvedotrc1 joined the channel
      • 2013-11-19 32327, 2013

      • JesseW_not_logge
        In current beta, ./admin/InitDb.pl -- --createdb --clean doesn't work -- MBImport.pl says it doesn't recognize --createdb or --clean.
      • 2013-11-19 32331, 2013

      • JesseW_not_logge
        Help?
      • 2013-11-19 32338, 2013

      • ianmcorvidae
        remove the extra --
      • 2013-11-19 32351, 2013

      • ianmcorvidae
        at the very least
      • 2013-11-19 32300, 2013

      • JesseW_not_logge
        tried that. Still fails.
      • 2013-11-19 32330, 2013

      • JesseW_not_logge
        hm, maybe not.
      • 2013-11-19 32308, 2013

      • JesseW_not_logge
        In any case, the line in INSTALL has the extra -- . I'll make a pull request.
      • 2013-11-19 32329, 2013

      • ianmcorvidae
        already fixed in master
      • 2013-11-19 32336, 2013

      • JesseW_not_logge
        not in beta...
      • 2013-11-19 32337, 2013

      • ianmcorvidae
        because DWSR was having the problem with the extra -- earlier
      • 2013-11-19 32335, 2013

      • JesseW_not_logge
        ah, I see it: git diff upstream/master -- INSTALL.*
      • 2013-11-19 32354, 2013

      • JesseW_not_logge
        good
      • 2013-11-19 32354, 2013

      • ianmcorvidae
        yes, it'll make it into beta at some point
      • 2013-11-19 32313, 2013

      • ianmcorvidae
        since master is the normal place people are recommended to install things from I didn't bother propagating it all around
      • 2013-11-19 32346, 2013

      • JesseW_not_logge
        sigh, I forgot, and was working off beta.
      • 2013-11-19 32338, 2013

      • Freso
        Is it possible to do something like (in a JS regex): /foo(?:\/(bar/xyz))/ and catch the bar/xyz (e.g., using $1)?
      • 2013-11-19 32353, 2013

      • Freso
        *bar|xyz
      • 2013-11-19 32330, 2013

      • ianmcorvidae
        I mean, you could just do that without ?: and use $2
      • 2013-11-19 32348, 2013

      • ianmcorvidae
        I forget if javascript regex supports (?:) or not but it's just a nicety
      • 2013-11-19 32306, 2013

      • Freso
        ianmcorvidae: But I don't want to catch the \/
      • 2013-11-19 32317, 2013

      • Freso
        Oh, right.
      • 2013-11-19 32327, 2013

      • ianmcorvidae
        sure, so (\/(bar/xyz)) and use the $2 :)
      • 2013-11-19 32327, 2013

      • Freso daft
      • 2013-11-19 32336, 2013

      • reosarevok joined the channel
      • 2013-11-19 32355, 2013

      • andreypopp joined the channel
      • 2013-11-19 32359, 2013

      • rvedotrc joined the channel
      • 2013-11-19 32312, 2013

      • ruaok joined the channel
      • 2013-11-19 32354, 2013

      • mb-chat-logger
        New post: blog: Venue and Studio Support: Introducing Places <http://blog.musicbrainz.org/2013/11/19/introducing-places/>
      • 2013-11-19 32359, 2013

      • ruaok
        no mention of the ISS? :-(
      • 2013-11-19 32315, 2013

      • ruaok
        great blog post, nikki !
      • 2013-11-19 32325, 2013

      • ianmcorvidae
        haha
      • 2013-11-19 32302, 2013

      • nikki
        hehe
      • 2013-11-19 32309, 2013

      • ruaok
        ianmcorvidae: I forgot to make a ticket for the nofollow stuff. should I still make one?
      • 2013-11-19 32333, 2013

      • ianmcorvidae
        sure, may as well
      • 2013-11-19 32338, 2013

      • ruaok
        k
      • 2013-11-19 32337, 2013

      • ianmcorvidae has also written some undoubtedly terrifying-to-the-uninitiated SQL for the more detailed editor stats re: activity :P
      • 2013-11-19 32338, 2013

      • ruaok is curious of the results
      • 2013-11-19 32333, 2013

      • ianmcorvidae
      • 2013-11-19 32342, 2013

      • ruaok
        thx
      • 2013-11-19 32310, 2013

      • ianmcorvidae
        though I think the basic summary is 75% of our editors don't do anything :P
      • 2013-11-19 32338, 2013

      • ruaok
        50% spammers, 25% lurkers?
      • 2013-11-19 32352, 2013

      • ianmcorvidae
        yeah, probably something like that