#metabrainz

/

      • darwin
        the cassandra python driver?
      • 2015-09-30 27351, 2015

      • darwin
        (are you using cqlengine?)
      • 2015-09-30 27303, 2015

      • darwin
        (gee, it's nice to finally have relevant knowledge to contribute to new initiatives.. :D)
      • 2015-09-30 27306, 2015

      • alastairp
        python driver I think
      • 2015-09-30 27342, 2015

      • alastairp
        darwin: it's kind of incredible to go and build some new project and find that the person who wrote all the advice blog posts we followed was already in our main development channel!
      • 2015-09-30 27313, 2015

      • darwin
        alastairp: lol.. honestly I should have much more blog posts up.. my company has drug its feet on posting them, I'm going to go it alone and get a wordpress blog
      • 2015-09-30 27346, 2015

      • darwin
        but yeah, I like to help cassandra operators.. and it seems based on this year's summit that cassandra is getting huge adoption in the enterprise now...
      • 2015-09-30 27351, 2015

      • Freso
        zas: Can you make a "BrainzBot" (or "BotBot") GitHub team with LordSputnik and LeoVerto in it?
      • 2015-09-30 27357, 2015

      • Freso
      • 2015-09-30 27359, 2015

      • darwin
        nice when being helpful seems to be its own reward :D
      • 2015-09-30 27350, 2015

      • jesus2099 has quit
      • 2015-09-30 27335, 2015

      • Freso
        Leo_Verto: ^
      • 2015-09-30 27347, 2015

      • Freso
        Leo_Verto: Seems I can't do it right now, and I have to run.
      • 2015-09-30 27351, 2015

      • Leo_Verto
        Thanks :D
      • 2015-09-30 27309, 2015

      • zas
        Freso: do you need to be in the team too ?
      • 2015-09-30 27310, 2015

      • Freso
        zas: If you can do it and you do it, can you add that team to https://github.com/metabrainz/botbot-web/settings… ?
      • 2015-09-30 27319, 2015

      • Freso
        zas: Meh. Just do it for good measure.
      • 2015-09-30 27358, 2015

      • samphippen joined the channel
      • 2015-09-30 27310, 2015

      • zas
        Ok should be done
      • 2015-09-30 27347, 2015

      • Leo_Verto
        Thanks zas :D
      • 2015-09-30 27302, 2015

      • Freso
        zas: Add LordSputnik too?
      • 2015-09-30 27308, 2015

      • Freso
        ("LordSputnik")
      • 2015-09-30 27313, 2015

      • Leo_Verto
        Hmm, any chance I could get repo admin access so I can set up travis and change the description?
      • 2015-09-30 27323, 2015

      • Gentlecat
        alastairp: can we just add messybrainz repo url to requirements.txt?
      • 2015-09-30 27341, 2015

      • alastairp
        yes, possibly
      • 2015-09-30 27350, 2015

      • alastairp
        I'm not sure if I like it 100% though
      • 2015-09-30 27328, 2015

      • Gentlecat
        it will probably need to be automated eventually
      • 2015-09-30 27336, 2015

      • zas
        Freso: LordSputnik was notified, but he has to accept invite
      • 2015-09-30 27338, 2015

      • Gentlecat
        for testing or something else
      • 2015-09-30 27311, 2015

      • Freso
        Ah.
      • 2015-09-30 27348, 2015

      • zas
        Leo_Verto: i created a BrainzBotAdmins team and you should be in, check if it is ok
      • 2015-09-30 27301, 2015

      • Leo_Verto
        Hmm, looks like that team doesn't have any repos
      • 2015-09-30 27341, 2015

      • zas
        Now it should be ok
      • 2015-09-30 27301, 2015

      • samphippen has quit
      • 2015-09-30 27305, 2015

      • samphipp_ joined the channel
      • 2015-09-30 27339, 2015

      • Leo_Verto
        Yep, thanks again!
      • 2015-09-30 27313, 2015

      • alastairp
        Gentlecat: yes, automated yes
      • 2015-09-30 27338, 2015

      • alastairp
        listenstore is in a similar situation (though it's in the same repository). it's a standalone package that has to be installed
      • 2015-09-30 27343, 2015

      • Gentlecat
        right
      • 2015-09-30 27356, 2015

      • alastairp
        the irccloud way (tm) of doing this is to generate an egg, and install it to system/virtualenv
      • 2015-09-30 27309, 2015

      • alastairp
        we are currently using develop mode to symlink from the venv to it
      • 2015-09-30 27332, 2015

      • alastairp
        I quite like the egg/deploy system, but it should be automated as part of fab deploy
      • 2015-09-30 27351, 2015

      • Gentlecat
        `submit_listens_and_sing_me_a_sweet_song` lol
      • 2015-09-30 27356, 2015

      • alastairp
        I asked rob what the submission method should be, and he told me
      • 2015-09-30 27357, 2015

      • Gentlecat
        ok, ignoring most of initialization worked
      • 2015-09-30 27323, 2015

      • alastairp
        yeah. not surprised
      • 2015-09-30 27343, 2015

      • Gentlecat
        it's kind of ugly, but
      • 2015-09-30 27301, 2015

      • Gentlecat
        I've seen worse things
      • 2015-09-30 27333, 2015

      • github joined the channel
      • 2015-09-30 27333, 2015

      • github
        [listenbrainz-server] gentlecat created api-docs-extra (+1 new commit): https://github.com/metabrainz/listenbrainz-server…
      • 2015-09-30 27333, 2015

      • github
        listenbrainz-server/api-docs-extra ea937db Roman Tsukanov: Ignore most of initialization when building docs on rtfd.org
      • 2015-09-30 27333, 2015

      • github has left the channel
      • 2015-09-30 27338, 2015

      • github joined the channel
      • 2015-09-30 27338, 2015

      • github
        [listenbrainz-server] gentlecat opened pull request #47: Ignore most of initialization when building docs on rtfd.org (api-docs...api-docs-extra) https://github.com/metabrainz/listenbrainz-server…
      • 2015-09-30 27338, 2015

      • github has left the channel
      • 2015-09-30 27346, 2015

      • alastairp
        ah. hmm
      • 2015-09-30 27350, 2015

      • alastairp
        I really don't like this
      • 2015-09-30 27305, 2015

      • alastairp
        I'd prefer it to be conditional on the configuration options being set
      • 2015-09-30 27322, 2015

      • Gentlecat
        we don't have config on their server
      • 2015-09-30 27329, 2015

      • Gentlecat
        can create a default config though
      • 2015-09-30 27336, 2015

      • alastairp
        right
      • 2015-09-30 27317, 2015

      • Gentlecat
      • 2015-09-30 27344, 2015

      • Gentlecat
        shouldn't use it directly like that
      • 2015-09-30 27337, 2015

      • alastairp
        fine. tell rob :)
      • 2015-09-30 27358, 2015

      • ruaok joined the channel
      • 2015-09-30 27359, 2015

      • Gentlecat
        right :0
      • 2015-09-30 27301, 2015

      • Gentlecat
        :)
      • 2015-09-30 27318, 2015

      • Gentlecat
        ruaok: decided to help you out a bit https://github.com/metabrainz/listenbrainz-server… :)
      • 2015-09-30 27353, 2015

      • rahul_ joined the channel
      • 2015-09-30 27353, 2015

      • Guest23351 has quit
      • 2015-09-30 27316, 2015

      • samphipp_ has quit
      • 2015-09-30 27333, 2015

      • rahul_ has quit
      • 2015-09-30 27322, 2015

      • regagain joined the channel
      • 2015-09-30 27338, 2015

      • ruaok
        Gentlecat: thanks!
      • 2015-09-30 27346, 2015

      • ruaok
        zas: I just now saw the message you left in trello.
      • 2015-09-30 27353, 2015

      • ruaok
        please ping me here with questions.
      • 2015-09-30 27312, 2015

      • ruaok
        > i didnt find any cron for those
      • 2015-09-30 27313, 2015

      • zas
        well, i'm currently looking about the size, clearly an issue
      • 2015-09-30 27327, 2015

      • ruaok nods
      • 2015-09-30 27337, 2015

      • zas
        how much would be reasonable ?
      • 2015-09-30 27338, 2015

      • ruaok starts at the top
      • 2015-09-30 27314, 2015

      • zas
        well, i didnt understand the rsync thing, because it seems to me it was a 2-steps rsync, according to what i found
      • 2015-09-30 27323, 2015

      • ruaok
        we should sum up our space usage on ftp.mb.org and add 15+GB
      • 2015-09-30 27324, 2015

      • zas
        but some bits are lacking
      • 2015-09-30 27348, 2015

      • ruaok
        the musicbrainz-server daily runs the rsync commands.
      • 2015-09-30 27358, 2015

      • ruaok
        so, no cron mods needed.
      • 2015-09-30 27306, 2015

      • zas
        hmmm
      • 2015-09-30 27324, 2015

      • zas
        this is on astro ?
      • 2015-09-30 27325, 2015

      • ruaok
        for the sync, the key lies in the authorized keys portions on scooby. which may have been lost.
      • 2015-09-30 27351, 2015

      • ruaok
        but in the dest ssh setup you can specify which commands are allowable to execute.
      • 2015-09-30 27300, 2015

      • zas
        yes, i found that
      • 2015-09-30 27309, 2015

      • zas
        not an issue, i found the keys too
      • 2015-09-30 27314, 2015

      • ruaok
        ok, good.
      • 2015-09-30 27328, 2015

      • zas
        so where is this "dummy" ?
      • 2015-09-30 27330, 2015

      • Lotheric has quit
      • 2015-09-30 27344, 2015

      • zas
        this is the bit i lack to understand how it was set up
      • 2015-09-30 27348, 2015

      • alastairp
        ruaok <— dummy
      • 2015-09-30 27349, 2015

      • alastairp
        ?
      • 2015-09-30 27350, 2015

      • ruaok
        dummy is just that -- it isn't used, the SSH bits define where it goes.
      • 2015-09-30 27355, 2015

      • ruaok
        alastairp:duh
      • 2015-09-30 27305, 2015

      • ruaok
        rvedotrc: do you remember how that setup worked?
      • 2015-09-30 27307, 2015

      • zas
        hmmm rsync --server ??
      • 2015-09-30 27345, 2015

      • ruaok
        maybe. I don't really recall
      • 2015-09-30 27354, 2015

      • ruaok
        (and I'm feeling like crap, half asleep again)
      • 2015-09-30 27356, 2015

      • zas
        this is the hacky part ;)
      • 2015-09-30 27314, 2015

      • zas
        --server is not really documented, check man page ;)
      • 2015-09-30 27330, 2015

      • zas
        i search about it, and yes, it may serve this purpose
      • 2015-09-30 27355, 2015

      • ruaok
        it may just be overkill, tbh.
      • 2015-09-30 27300, 2015

      • zas
        i'll have a second look into that, but anyway we need more storage space on this serve
      • 2015-09-30 27305, 2015

      • ruaok
        but, disk space is the key problem I suspect.
      • 2015-09-30 27307, 2015

      • zas
        s/$/r/
      • 2015-09-30 27327, 2015

      • ruaok
        so, the replication packets take up a large amount of space.
      • 2015-09-30 27329, 2015

      • zas
        well, i tried a simple rsync for fullexport and hit the max space ... so ;)
      • 2015-09-30 27341, 2015

      • ruaok
        those are now so old (May) and we may not need to offer them anymore.
      • 2015-09-30 27306, 2015

      • ruaok
        not sure anyone would be insane enough to try and catch up replication from May.
      • 2015-09-30 27316, 2015

      • ruaok
        but it would be nice to archive them.
      • 2015-09-30 27322, 2015

      • ruaok
        send them up a glacier?
      • 2015-09-30 27326, 2015

      • ruaok
        then rest might then fit.
      • 2015-09-30 27335, 2015

      • zas
        why not
      • 2015-09-30 27338, 2015

      • ruaok
        also, the user directories? just nuke them we no longer need that stuff.
      • 2015-09-30 27346, 2015

      • zas
        yes
      • 2015-09-30 27349, 2015

      • JesseW joined the channel
      • 2015-09-30 27327, 2015

      • zas
        i think i can nuke old files that were on taz ftp space since they were prolly there after tests
      • 2015-09-30 27340, 2015

      • zas
        and i'm preparing a 150G disk
      • 2015-09-30 27347, 2015

      • zas
        with quotas
      • 2015-09-30 27312, 2015

      • ruaok
        do we need to use quotas?
      • 2015-09-30 27301, 2015

      • zas
        well, they were set up for ftp-misc on taz, not a bad idea actually, but prolly useless atm
      • 2015-09-30 27339, 2015

      • zas
        especially if we have no nagios alerts for those quotas
      • 2015-09-30 27307, 2015

      • zas
        and since disk space is controlled by the disk image file ... which is dedicated to the ftp server i don't see where quotas help
      • 2015-09-30 27327, 2015

      • ruaok
        exactly.
      • 2015-09-30 27339, 2015

      • zas
        ok let's simplify and drop that
      • 2015-09-30 27317, 2015

      • zas
        also, the ftp disk image was ext2, does it make sense to use ext3/4 for it ?
      • 2015-09-30 27319, 2015

      • ruaok
        yes, please
      • 2015-09-30 27333, 2015

      • zas
        ok
      • 2015-09-30 27320, 2015

      • Lotheric joined the channel
      • 2015-09-30 27331, 2015

      • zas
        so this dummy must be the command= thing with rsync --server, i'll confirm that soon
      • 2015-09-30 27350, 2015

      • ruaok
        yeah, I think so.
      • 2015-09-30 27316, 2015

      • zas
        it deserves to be documented a bit if it is, even --server is a mysterious rsync option ;)
      • 2015-09-30 27343, 2015

      • zas
        it is used in the rrsync exemple provided with rsync source (and only there it seems=
      • 2015-09-30 27323, 2015

      • zas
        well, anyway i need a break
      • 2015-09-30 27336, 2015

      • JesseW has quit
      • 2015-09-30 27354, 2015

      • JesseW joined the channel
      • 2015-09-30 27339, 2015

      • Lotheric has quit
      • 2015-09-30 27354, 2015

      • chirlu`
        Gentlecat: I think it hasn’t been answered yet; forms are in lib/MusicBrainz/Server/Form
      • 2015-09-30 27320, 2015

      • Mineo
        is the json in https://lb-test.readthedocs.org/dev/json.html#sub… the final version? because the various mbid keys differ from what the api uses at the moment
      • 2015-09-30 27324, 2015

      • JesseW has quit
      • 2015-09-30 27353, 2015

      • darwin
      • 2015-09-30 27301, 2015

      • darwin
        is the slide deck from cassandra summit about cassandra counters
      • 2015-09-30 27302, 2015

      • alastairp
        thanks!
      • 2015-09-30 27324, 2015

      • Lotheric joined the channel