#metabrainz

/

      • H-Lo[m] joined the channel
      • 2019-04-05 09543, 2019

      • thefar8[m] joined the channel
      • 2019-04-05 09551, 2019

      • Kode_ has quit
      • 2019-04-05 09532, 2019

      • Mr_Monkey
        iliekcomputers: I can indeed ssh into herb. I saw `param/new/bookbrainz-site/`, I suppose that's where you're testing stuff.
      • 2019-04-05 09557, 2019

      • iliekcomputers
        So the basic idea is
      • 2019-04-05 09510, 2019

      • iliekcomputers
        That you make your changes
      • 2019-04-05 09524, 2019

      • iliekcomputers
        And push a new docker image to docker hub using push.sh
      • 2019-04-05 09554, 2019

      • iliekcomputers
        Then you become root and go to /root/docker-server-configs
      • 2019-04-05 09531, 2019

      • iliekcomputers
        Stop the bookbrainz-web-prod container and restart using scripts/start_services.sh
      • 2019-04-05 09550, 2019

      • Mr_Monkey
        I'll try that.
      • 2019-04-05 09534, 2019

      • Mr_Monkey
        iliekcomputers: I stop the bb container using docker command and then just run `scripts/start_services.sh` as is with no additional args or anything ?
      • 2019-04-05 09544, 2019

      • Mr_Monkey doesn't want to break everything
      • 2019-04-05 09558, 2019

      • iliekcomputers
        Yup
      • 2019-04-05 09537, 2019

      • iliekcomputers
        Docker stop bookbrainz-web-prod && docker rm bookbrainz-web-prod && scripts/start_services.sh
      • 2019-04-05 09545, 2019

      • Kode_ joined the channel
      • 2019-04-05 09501, 2019

      • zas
        yvanzo: i updated nagios & syswiki with new tickets IP
      • 2019-04-05 09558, 2019

      • yvanzo
        tickets ssh server key fingerprint changed, I cannot log into it anymore
      • 2019-04-05 09507, 2019

      • BestSteve has quit
      • 2019-04-05 09522, 2019

      • yvanzo
        oh ok
      • 2019-04-05 09552, 2019

      • BestSteve joined the channel
      • 2019-04-05 09505, 2019

      • yvanzo
        zas: is the old VM still reachable?
      • 2019-04-05 09518, 2019

      • Mr_Monkey
        iliekcomputers: Do I need to change this too? https://github.com/metabrainz/docker-server-confi…
      • 2019-04-05 09501, 2019

      • iliekcomputers
        Mr_Monkey: if you push an image with a new tag then yes
      • 2019-04-05 09533, 2019

      • Mr_Monkey
        Gotcha. Standard workflow in this situation is to overwrite images, then?
      • 2019-04-05 09550, 2019

      • iliekcomputers
        For example if you pushed with ./push.sh prod v-2019-04-05.1, then you'd change it
      • 2019-04-05 09500, 2019

      • iliekcomputers
        We use version dates generally
      • 2019-04-05 09510, 2019

      • zas
        yvanzo: yes, why not ? just use the IP, or if you prefer i add a name
      • 2019-04-05 09529, 2019

      • iliekcomputers
        Start with current-date.0 and increase the number at the end
      • 2019-04-05 09528, 2019

      • yvanzo
        zas: ok thanks, just have to update my scripts :)
      • 2019-04-05 09533, 2019

      • zas
        yvanzo: we will not delete the VM too soon, at least not before we are sure the migration is perfectly ok
      • 2019-04-05 09533, 2019

      • Mr_Monkey
        OK, Thanks for the crash course iliekcomputers.
      • 2019-04-05 09554, 2019

      • iliekcomputers
        No worries
      • 2019-04-05 09529, 2019

      • reosarevok
        yvanzo, bitmap: when you have some time, see the last commit on https://github.com/metabrainz/musicbrainz-server/…
      • 2019-04-05 09508, 2019

      • reosarevok
        If you prefer, we could separate that commit onto a separate PR and merge the rest of this separately - after all, it's already broken - and then look into improving unknown country later
      • 2019-04-05 09509, 2019

      • alastairp
      • 2019-04-05 09531, 2019

      • alastairp
        not sure if this affects anything on our jira installation
      • 2019-04-05 09506, 2019

      • yvanzo
        alastairp: it doesn’t, we don't use Jira Issue Updater
      • 2019-04-05 09527, 2019

      • D4RK-PH0ENiX has quit
      • 2019-04-05 09509, 2019

      • alastairp
        Ah, I meant to say Jenkins installation ,😅
      • 2019-04-05 09530, 2019

      • alastairp
        but again I think you're right, we only have GitHub integration
      • 2019-04-05 09519, 2019

      • alastairp
        maybe IRC? But we should use irccat anyway I guess
      • 2019-04-05 09536, 2019

      • yvanzo
        We should but we don’t and irccat doesn’t have a jenkins endpoint yet
      • 2019-04-05 09540, 2019

      • letaiv_ joined the channel
      • 2019-04-05 09507, 2019

      • letaiv has quit
      • 2019-04-05 09551, 2019

      • reosarevok
      • 2019-04-05 09500, 2019

      • reosarevok
        ... those don't even look similar?
      • 2019-04-05 09541, 2019

      • spookyninja has quit
      • 2019-04-05 09559, 2019

      • D4RK-PH0ENiX joined the channel
      • 2019-04-05 09518, 2019

      • kurisu has quit
      • 2019-04-05 09559, 2019

      • aidanlw17 joined the channel
      • 2019-04-05 09538, 2019

      • aidanlw17_ joined the channel
      • 2019-04-05 09525, 2019

      • aidanlw17 has quit
      • 2019-04-05 09539, 2019

      • aliamo joined the channel
      • 2019-04-05 09553, 2019

      • aliamo has quit
      • 2019-04-05 09521, 2019

      • Mr_Monkey
        reosarevok: Yeah, the elasticsearch setup could be improved, but I've been reluctant to put any time into it if we're ditching it soon™. But maybe open a ticket, see if someone fancies giving it a go?
      • 2019-04-05 09503, 2019

      • aidanlw17_ has quit
      • 2019-04-05 09524, 2019

      • ZaphodBeeblebrox
        no tickets, 🚲 free parking
      • 2019-04-05 09514, 2019

      • ZaphodBeeblebrox
        !time
      • 2019-04-05 09557, 2019

      • aliamo joined the channel
      • 2019-04-05 09502, 2019

      • aduuna joined the channel
      • 2019-04-05 09522, 2019

      • aliamo has quit
      • 2019-04-05 09557, 2019

      • Cyna has quit
      • 2019-04-05 09514, 2019

      • yvanzo
        JIRA upgrade is postponed to 4pm (UTC), tickets are available (read/write) meanwhile.
      • 2019-04-05 09504, 2019

      • aidanlw17 joined the channel
      • 2019-04-05 09535, 2019

      • iliekcomputers
        Mr_Monkey: i fixed the less build in prod and removed the `npm start-prod` command.
      • 2019-04-05 09553, 2019

      • Mr_Monkey
        Awesome :)
      • 2019-04-05 09519, 2019

      • Mr_Monkey
        I'm having a look at making a docker-compose.dev file targetting the bookbrainz-dev stage
      • 2019-04-05 09543, 2019

      • BrainzGit
        [musicbrainz-server] reosarevok opened pull request #998 (master…MBS-8360): MBS-8360: Add BookBrainz to the sidebar https://github.com/metabrainz/musicbrainz-server/…
      • 2019-04-05 09544, 2019

      • BrainzBot
        MBS-8360: Show BookBrainz relationships in the sidebar https://tickets.metabrainz.org/browse/MBS-8360
      • 2019-04-05 09504, 2019

      • iliekcomputers
      • 2019-04-05 09511, 2019

      • iliekcomputers
        should be very similar to this.
      • 2019-04-05 09516, 2019

      • Mr_Monkey
        Yep, that's my reference :)
      • 2019-04-05 09530, 2019

      • iliekcomputers
        cool cool cool :)
      • 2019-04-05 09514, 2019

      • alastairp
        hi aidanlw17, if you didn't already know we prefer that potential SoC applicants post their proposal on our forums before submitting it so that we can give feedback. Your chances of a favourible review are much better if you do this
      • 2019-04-05 09554, 2019

      • aliamo joined the channel
      • 2019-04-05 09522, 2019

      • letaiv_
        Hi, I've recently posted my draft on forum. I would appreciate your feedback. Also, I have to delete reference section thus new users are not allowed to used more than 5 links.
      • 2019-04-05 09521, 2019

      • iliekcomputers
      • 2019-04-05 09536, 2019

      • alastairp
        oh, sad :(
      • 2019-04-05 09550, 2019

      • alastairp
        in fact, that limit shoulkdn't even be there
      • 2019-04-05 09500, 2019

      • iliekcomputers
        should I remove it?
      • 2019-04-05 09517, 2019

      • aliamo has quit
      • 2019-04-05 09527, 2019

      • alastairp
        yes, sure
      • 2019-04-05 09541, 2019

      • alastairp
        oh, I see what I did. I had the query and then I wrapped the 'create temp view' arround it
      • 2019-04-05 09549, 2019

      • iliekcomputers
        how big do you expect the csv to be?
      • 2019-04-05 09529, 2019

      • Darkloke has quit
      • 2019-04-05 09501, 2019

      • code_master5 joined the channel
      • 2019-04-05 09538, 2019

      • iliekcomputers
        connection broke in the middle, i'll start again with screen :(
      • 2019-04-05 09551, 2019

      • iliekcomputers
      • 2019-04-05 09554, 2019

      • alastairp
        yes, and yes
      • 2019-04-05 09502, 2019

      • alastairp
        you'll need screen, and the csv will be huge
      • 2019-04-05 09506, 2019

      • alastairp
        10s of gb at least
      • 2019-04-05 09544, 2019

      • alastairp
        are you just starting now? (ll done, or are you starting with hl?)
      • 2019-04-05 09550, 2019

      • alastairp
        (just asking, I'm in no rush for the data)
      • 2019-04-05 09553, 2019

      • iliekcomputers
        just started now
      • 2019-04-05 09505, 2019

      • alastairp
        this is why we need summary data (pulkit's gsoc proposal!)
      • 2019-04-05 09506, 2019

      • alastairp
        ok, cool
      • 2019-04-05 09519, 2019

      • alastairp
        yeah, load will be high unfortunately. Hopefully it won't impact the site too much
      • 2019-04-05 09553, 2019

      • iliekcomputers
        highlevel file written to 3G
      • 2019-04-05 09556, 2019

      • iliekcomputers
        3gb
      • 2019-04-05 09514, 2019

      • alastairp
        oh? cool. how many lines?
      • 2019-04-05 09539, 2019

      • iliekcomputers
      • 2019-04-05 09542, 2019

      • alastairp
        it should be 10m * 9 models
      • 2019-04-05 09501, 2019

      • alastairp
        (pst, wc -l <filename> works too)
      • 2019-04-05 09511, 2019

      • alastairp
      • 2019-04-05 09516, 2019

      • iliekcomputers
        whoops :)
      • 2019-04-05 09545, 2019

      • alastairp
        OK, that seems approximately within the expected order for results
      • 2019-04-05 09505, 2019

      • alastairp
        not sure why I expected 90m and you have only 48m
      • 2019-04-05 09549, 2019

      • iliekcomputers
        it isn't done yet
      • 2019-04-05 09512, 2019

      • iliekcomputers
      • 2019-04-05 09528, 2019

      • alastairp
        ah, great!
      • 2019-04-05 09500, 2019

      • iliekcomputers
        93M done
      • 2019-04-05 09537, 2019

      • outsidecontext joined the channel
      • 2019-04-05 09538, 2019

      • sampsyo has quit
      • 2019-04-05 09521, 2019

      • sampsyo joined the channel
      • 2019-04-05 09513, 2019

      • aliamo joined the channel
      • 2019-04-05 09533, 2019

      • aidanlw17
        alastairp: hey! I wasn't aware but knowing that I will post it shortly. Thank you for the heads up.
      • 2019-04-05 09533, 2019

      • alastairp
        OK, cool
      • 2019-04-05 09554, 2019

      • ZaphodBeeblebrox
        +1 to making things easier for newbies!
      • 2019-04-05 09546, 2019

      • aliamo has quit
      • 2019-04-05 09559, 2019

      • Lotheric has quit
      • 2019-04-05 09526, 2019

      • Lotheric joined the channel
      • 2019-04-05 09535, 2019

      • AfroThundr|main joined the channel
      • 2019-04-05 09526, 2019

      • iliekcomputers
        100M done
      • 2019-04-05 09521, 2019

      • iliekcomputers
        Mr_Monkey: I can't merge the PR, feel free to merge.
      • 2019-04-05 09532, 2019

      • iliekcomputers
        I'll start work on data dumps cron
      • 2019-04-05 09542, 2019

      • iliekcomputers
        is there a script that creates data dumps rn?
      • 2019-04-05 09547, 2019

      • Mr_Monkey
        OK, cool, I think it's ready to merge too.
      • 2019-04-05 09502, 2019

      • Mr_Monkey
      • 2019-04-05 09521, 2019

      • aliamo joined the channel
      • 2019-04-05 09546, 2019

      • BrainzGit
        [bookbrainz-site] paramsingh closed pull request #272 (master…metabrainz-node): Use metabrainz node image which has runit and consul https://github.com/bookbrainz/bookbrainz-site/pul…
      • 2019-04-05 09520, 2019

      • BrainzGit
        [bookbrainz-site] MonkeyDo merged pull request #273 (master…production-setup): Production and development Docker setup for Hetzner https://github.com/bookbrainz/bookbrainz-site/pul…
      • 2019-04-05 09530, 2019

      • iliekcomputers
        is the production crontab in the repo somewhere as well?
      • 2019-04-05 09511, 2019

      • Mr_Monkey
        Negative
      • 2019-04-05 09552, 2019

      • iliekcomputers
        ok, how frequently are dumps created? where is the crontab in the bookbrainz vm?
      • 2019-04-05 09502, 2019

      • aliamo has quit
      • 2019-04-05 09514, 2019

      • Mr_Monkey
        iliekcomputers: Weekly dumps, not sure where the crontab lives
      • 2019-04-05 09535, 2019

      • Mr_Monkey
        Having a sniff on the VM now
      • 2019-04-05 09504, 2019

      • travis-ci joined the channel
      • 2019-04-05 09504, 2019

      • travis-ci
        Project bookbrainz-site build #2106: passed in 3 min 55 sec: https://travis-ci.org/bookbrainz/bookbrainz-site/…
      • 2019-04-05 09504, 2019

      • travis-ci has left the channel
      • 2019-04-05 09538, 2019

      • Mr_Monkey
        iliekcomputers: /var/spool/cron/crontabs/root
      • 2019-04-05 09549, 2019

      • Mr_Monkey
        Somehow not /var/spool/cron/crontabs/bookbrainz, don't ask me why.
      • 2019-04-05 09555, 2019

      • alastairp
        (you're not supposed to edit that file by hand)
      • 2019-04-05 09552, 2019

      • Mr_Monkey
        So it says, but how do you know you can trust the word of a crontab, huh?
      • 2019-04-05 09500, 2019

      • Mr_Monkey
        Looking for the master now
      • 2019-04-05 09552, 2019

      • Mr_Monkey
        iliekcomputers: Need more info?
      • 2019-04-05 09519, 2019

      • iliekcomputers
        no, sounds okay to me.
      • 2019-04-05 09525, 2019

      • iliekcomputers
        thx!
      • 2019-04-05 09526, 2019

      • alastairp
        letaiv_: thanks for the proposal. I'd hope to see a bit more detail in this, giving more information about implementation details of each step
      • 2019-04-05 09535, 2019

      • Mr_Monkey
        If only life had `man` pages.