#metabrainz

/

      • Gentlecat
        ruaok: decided to help you out a bit https://github.com/metabrainz/listenbrainz-server… :)

        • 2015-09-30 27353, 2015

      • rahul_ joined the channel

        • 2015-09-30 27353, 2015

      • Guest23351 has quit

        • 2015-09-30 27316, 2015

      • samphipp_ has quit

        • 2015-09-30 27333, 2015

      • rahul_ has quit

        • 2015-09-30 27322, 2015

      • regagain joined the channel

        • 2015-09-30 27338, 2015

      • ruaok
        Gentlecat: thanks!

        • 2015-09-30 27346, 2015

      • ruaok
        zas: I just now saw the message you left in trello.

        • 2015-09-30 27353, 2015

      • ruaok
        please ping me here with questions.

        • 2015-09-30 27312, 2015

      • ruaok
        > i didnt find any cron for those

        • 2015-09-30 27313, 2015

      • zas
        well, i'm currently looking about the size, clearly an issue

        • 2015-09-30 27327, 2015

      • ruaok nods

        • 2015-09-30 27337, 2015

      • zas
        how much would be reasonable ?

        • 2015-09-30 27338, 2015

      • ruaok starts at the top

        • 2015-09-30 27314, 2015

      • zas
        well, i didnt understand the rsync thing, because it seems to me it was a 2-steps rsync, according to what i found

        • 2015-09-30 27323, 2015

      • ruaok
        we should sum up our space usage on ftp.mb.org and add 15+GB

        • 2015-09-30 27324, 2015

      • zas
        but some bits are lacking

        • 2015-09-30 27348, 2015

      • ruaok
        the musicbrainz-server daily runs the rsync commands.

        • 2015-09-30 27358, 2015

      • ruaok
        so, no cron mods needed.

        • 2015-09-30 27306, 2015

      • zas
        hmmm

        • 2015-09-30 27324, 2015

      • zas
        this is on astro ?

        • 2015-09-30 27325, 2015

      • ruaok
        for the sync, the key lies in the authorized keys portions on scooby. which may have been lost.

        • 2015-09-30 27351, 2015

      • ruaok
        but in the dest ssh setup you can specify which commands are allowable to execute.

        • 2015-09-30 27300, 2015

      • zas
        yes, i found that

        • 2015-09-30 27309, 2015

      • zas
        not an issue, i found the keys too

        • 2015-09-30 27314, 2015

      • ruaok
        ok, good.

        • 2015-09-30 27328, 2015

      • zas
        so where is this "dummy" ?

        • 2015-09-30 27330, 2015

      • Lotheric has quit

        • 2015-09-30 27344, 2015

      • zas
        this is the bit i lack to understand how it was set up

        • 2015-09-30 27348, 2015

      • alastairp
        ruaok <— dummy

        • 2015-09-30 27349, 2015

      • alastairp
        ?

        • 2015-09-30 27350, 2015

      • ruaok
        dummy is just that -- it isn't used, the SSH bits define where it goes.

        • 2015-09-30 27355, 2015

      • ruaok
        alastairp:duh

        • 2015-09-30 27305, 2015

      • ruaok
        rvedotrc: do you remember how that setup worked?

        • 2015-09-30 27307, 2015

      • zas
        hmmm rsync --server ??

        • 2015-09-30 27345, 2015

      • ruaok
        maybe. I don't really recall

        • 2015-09-30 27354, 2015

      • ruaok
        (and I'm feeling like crap, half asleep again)

        • 2015-09-30 27356, 2015

      • zas
        this is the hacky part ;)

        • 2015-09-30 27314, 2015

      • zas
        --server is not really documented, check man page ;)

        • 2015-09-30 27330, 2015

      • zas
        i search about it, and yes, it may serve this purpose

        • 2015-09-30 27355, 2015

      • ruaok
        it may just be overkill, tbh.

        • 2015-09-30 27300, 2015

      • zas
        i'll have a second look into that, but anyway we need more storage space on this serve

        • 2015-09-30 27305, 2015

      • ruaok
        but, disk space is the key problem I suspect.

        • 2015-09-30 27307, 2015

      • zas
        s/$/r/

        • 2015-09-30 27327, 2015

      • ruaok
        so, the replication packets take up a large amount of space.

        • 2015-09-30 27329, 2015

      • zas
        well, i tried a simple rsync for fullexport and hit the max space ... so ;)

        • 2015-09-30 27341, 2015

      • ruaok
        those are now so old (May) and we may not need to offer them anymore.

        • 2015-09-30 27306, 2015

      • ruaok
        not sure anyone would be insane enough to try and catch up replication from May.

        • 2015-09-30 27316, 2015

      • ruaok
        but it would be nice to archive them.

        • 2015-09-30 27322, 2015

      • ruaok
        send them up a glacier?

        • 2015-09-30 27326, 2015

      • ruaok
        then rest might then fit.

        • 2015-09-30 27335, 2015

      • zas
        why not

        • 2015-09-30 27338, 2015

      • ruaok
        also, the user directories? just nuke them we no longer need that stuff.

        • 2015-09-30 27346, 2015

      • zas
        yes

        • 2015-09-30 27349, 2015

      • JesseW joined the channel

        • 2015-09-30 27327, 2015

      • zas
        i think i can nuke old files that were on taz ftp space since they were prolly there after tests

        • 2015-09-30 27340, 2015

      • zas
        and i'm preparing a 150G disk

        • 2015-09-30 27347, 2015

      • zas
        with quotas

        • 2015-09-30 27312, 2015

      • ruaok
        do we need to use quotas?

        • 2015-09-30 27301, 2015

      • zas
        well, they were set up for ftp-misc on taz, not a bad idea actually, but prolly useless atm

        • 2015-09-30 27339, 2015

      • zas
        especially if we have no nagios alerts for those quotas

        • 2015-09-30 27307, 2015

      • zas
        and since disk space is controlled by the disk image file ... which is dedicated to the ftp server i don't see where quotas help

        • 2015-09-30 27327, 2015

      • ruaok
        exactly.

        • 2015-09-30 27339, 2015

      • zas
        ok let's simplify and drop that

        • 2015-09-30 27317, 2015

      • zas
        also, the ftp disk image was ext2, does it make sense to use ext3/4 for it ?

        • 2015-09-30 27319, 2015

      • ruaok
        yes, please

        • 2015-09-30 27333, 2015

      • zas
        ok

        • 2015-09-30 27320, 2015

      • Lotheric joined the channel

        • 2015-09-30 27331, 2015

      • zas
        so this dummy must be the command= thing with rsync --server, i'll confirm that soon

        • 2015-09-30 27350, 2015

      • ruaok
        yeah, I think so.

        • 2015-09-30 27316, 2015

      • zas
        it deserves to be documented a bit if it is, even --server is a mysterious rsync option ;)

        • 2015-09-30 27343, 2015

      • zas
        it is used in the rrsync exemple provided with rsync source (and only there it seems=

        • 2015-09-30 27323, 2015

      • zas
        well, anyway i need a break

        • 2015-09-30 27336, 2015

      • JesseW has quit

        • 2015-09-30 27354, 2015

      • JesseW joined the channel

        • 2015-09-30 27339, 2015

      • Lotheric has quit

        • 2015-09-30 27354, 2015

      • chirlu`
        Gentlecat: I think it hasn’t been answered yet; forms are in lib/MusicBrainz/Server/Form

        • 2015-09-30 27320, 2015

      • Mineo
        is the json in https://lb-test.readthedocs.org/dev/json.html#sub… the final version? because the various mbid keys differ from what the api uses at the moment

        • 2015-09-30 27324, 2015

      • JesseW has quit

        • 2015-09-30 27353, 2015

      • darwin
        http://www.slideshare.net/elubow/counters-at-scal…

        • 2015-09-30 27301, 2015

      • darwin
        is the slide deck from cassandra summit about cassandra counters

        • 2015-09-30 27302, 2015

      • alastairp
        thanks!

        • 2015-09-30 27324, 2015

      • Lotheric joined the channel

        • 2015-09-30 27301, 2015

      • alastairp
        Mineo: what’s missing? I see artistid should be plural

        • 2015-09-30 27302, 2015

      • Mineo
        well, that documentation uses musicbrainz_$entitytypeid, the api expects $entitytype_mbid

        • 2015-09-30 27302, 2015

      • ruaok
        Mineo: those docs are far from done.

        • 2015-09-30 27337, 2015

      • alastairp
        ah, right. I think we removed musicbrainz because mbid means the same thing

        • 2015-09-30 27340, 2015

      • ruaok
        and I copied that json from your example. ;)

        • 2015-09-30 27317, 2015

      • Mineo
        my example was https://gist.github.com/mineo/d3657cd61c0b821579de

        • 2015-09-30 27306, 2015

      • ruaok
        i copied someone's gist to test formatting.

        • 2015-09-30 27330, 2015

      • Mineo
        probably one from the guy who's doing the foobar2k integration

        • 2015-09-30 27348, 2015

      • ruaok
        regardless, the docs are not done, thus pointless to critique :)

        • 2015-09-30 27351, 2015

      • alastairp
        "i copied someone's gist to test formatting."

        • 2015-09-30 27330, 2015

      • alastairp
        oh, I just looked around and found that someone else had already started writing some docs for our 2 week old project

        • 2015-09-30 27334, 2015

      • alastairp
        yus

        • 2015-09-30 27353, 2015

      • Mineo
        anyway, carry on if it's not final

        • 2015-09-30 27324, 2015

      • Mineo
        and if you want me to nitpick the final version, feel free to cc me on a pull request or something :)

        • 2015-09-30 27323, 2015

      • Lotheric has quit

        • 2015-09-30 27358, 2015

      • Lotheric joined the channel

        • 2015-09-30 27330, 2015

      • regagain has quit

        • 2015-09-30 27319, 2015

      • ruaok
        Gentlecat: that is a really nice pi case design you found. not like the one I printed for alastairp. this one is quite clever. I'll print this up next.

        • 2015-09-30 27350, 2015

      • alastairp
        I feel like I've been short changed with my crappy pi case now

        • 2015-09-30 27358, 2015

      • ruaok
        awwww.

        • 2015-09-30 27310, 2015

      • ruaok
        when you break yours, I'll print you a new one.

        • 2015-09-30 27317, 2015

      • alastairp
        cool

        • 2015-09-30 27319, 2015

      • ruaok can hear the crunching noises all this way over here

        • 2015-09-30 27320, 2015

      • alastairp
        got a link?

        • 2015-09-30 27338, 2015

      • ruaok
        https://www.thingiverse.com/thing:1015706/#files

        • 2015-09-30 27320, 2015

      • LordSputnik joined the channel

        • 2015-09-30 27315, 2015

      • regagain joined the channel

        • 2015-09-30 27345, 2015

      • Gentlecat
        ruaok: does it just slide in?

        • 2015-09-30 27302, 2015

      • ruaok
        it probably needs lube.

        • 2015-09-30 27306, 2015

      • ruaok
        wait, what???

        • 2015-09-30 27308, 2015

      • Gentlecat
        or on, depending on your perspective

        • 2015-09-30 27352, 2015

      • ruaok
        woah.

        • 2015-09-30 27303, 2015

      • ruaok
        dear printer: please stop smoking crack. wtf are you doing?

        • 2015-09-30 27316, 2015

      • darwin
        just the tip

        • 2015-09-30 27336, 2015

      • zas
        ruaok: i tested this rsync --server thing, this is where is the magic, and it works

        • 2015-09-30 27353, 2015

      • ruaok
        \ø/

        • 2015-09-30 27313, 2015

      • zas
        i will document it, because it is far from obvious

        • 2015-09-30 27320, 2015

      • ruaok
        thanks!

        • 2015-09-30 27331, 2015

      • zas
        bitmap: around ?

        • 2015-09-30 27347, 2015

      • bitmap
        zas: yes, hi

        • 2015-09-30 27329, 2015

      • zas
        we'll need to change https://github.com/metabrainz/musicbrainz-server/…

        • 2015-09-30 27332, 2015

      • alastairp
        Oh yeah, that looks cool ruaok

        • 2015-09-30 27332, 2015

      • alastairp
        Mine broke. Can you make me another?

        • 2015-09-30 27340, 2015

      • Gentlecat
        kek

        • 2015-09-30 27350, 2015

      • UmkaDK has quit

        • 2015-09-30 27354, 2015

      • ruaok thought he heard a crunching noise.

        • 2015-09-30 27306, 2015

      • ruaok
        thought I have no idea what my printer is currently doing.

        • 2015-09-30 27316, 2015

      • ruaok
        the part being printed is... a little derp?

        • 2015-09-30 27336, 2015

      • zas
        bitmap: to 'ftp-data@taz.localdomain', but i still need to fix the ftp 'disk', too small atm ;)

        • 2015-09-30 27353, 2015

      • bitmap
        zas: ok, lemme know when I should deploy the changes

        • 2015-09-30 27328, 2015

      • UmkaDK joined the channel

        • 2015-09-30 27355, 2015

      • Gentlecat
        chirlu`: ah, thank you! :)

        • 2015-09-30 27355, 2015

      • zas
        From rsync man page: 'The options --server and --sender are used internally by rsync, and should never be typed by a user under normal circumstances. ... ' . I guess we aren't under normal circumstances anymore.

        • 2015-09-30 27313, 2015

      • Leo_Verto
        :D

        • 2015-09-30 27344, 2015

      • UmkaDK has quit

        • 2015-09-30 27349, 2015

      • ruaok
        well, rvedotrc was never normal. :)

        • 2015-09-30 27312, 2015

      • ruaok is still trying to dechiper the piece of plastic in his hand

        • 2015-09-30 27323, 2015

      • UmkaDK joined the channel

        • 2015-09-30 27326, 2015

      • Gentlecat
        alastairp, ruaok: XMLHttpRequest cannot load http://listenbrainz.org/user/Gentlecat/scraper.js….... No 'Access-Control-Allow-Origin' header is present on the requested resource. Origin 'http://www.last.fm' is therefore not allowed access.

        • 2015-09-30 27334, 2015

      • darwin
        (why do you guys need to use --server and --sender?)

        • 2015-09-30 27337, 2015

      • Gentlecat
        also http://sentry.roman.zone/sentry/listenbrainz/grou…

        • 2015-09-30 27340, 2015

      • Gentlecat
        missing import

        • 2015-09-30 27349, 2015

      • darwin
        (are you sure you don't actually, for example, need a reverse-ssh tunnel?)

        • 2015-09-30 27317, 2015

      • UmkaDK has quit

        • 2015-09-30 27338, 2015

      • alastairp
        Gentlecat: is it because you need to refresh your bookmarklet to HTTPS?

        • 2015-09-30 27339, 2015

      • UmkaDK joined the channel

        • 2015-09-30 27347, 2015

      • ruaok doesn't think that a reverse tunnel would help this piece of plastic