- 
    
        
    
        
        
ephemer0l has quit
     
      2019-05-01 12119, 2019
    - 
    
        
    
        
        
ephemer0l joined the channel
     
      2019-05-01 12104, 2019
    - 
    
        
    
        
        
D4RK-PH0ENiX has quit
     
      2019-05-01 12131, 2019
    - 
    
        
    
        
        
D4RK-PH0ENiX joined the channel
     
      2019-05-01 12152, 2019
    - 
    
        
    
        
        
Hobbyboy has quit
     
      2019-05-01 12106, 2019
    - 
    
        
    
        
        
pingupingu joined the channel
     
      2019-05-01 12147, 2019
    - 
    
        
    
        
        
michelv__ joined the channel
     
      2019-05-01 12150, 2019
    - 
    
        
    
        
        
pingupingu has quit
     
      2019-05-01 12156, 2019
    - 
    
        
    
        
        
travis-ci joined the channel
     
      2019-05-01 12156, 2019
    - 
    
        
    
                    
travis-ci
                
     
      2019-05-01 12156, 2019
    - 
    
        
    
        
        
travis-ci has left the channel
     
      2019-05-01 12125, 2019
    - 
    
        
    
                    
Freso
                milkii: I was just about to open a ticket on your behalf, but I see you did so yourself already (PICARD-1508). :)
     
      2019-05-01 12127, 2019
    - 
    
        
    
                    
BrainzBot
                
     
      2019-05-01 12102, 2019
    - 
    
        
    
                    
milkii
                Freso: hehe, though i should log it properly
     
      2019-05-01 12113, 2019
    - 
    
        
    
                    
Freso
                milkii: Good job. :)
     
      2019-05-01 12117, 2019
    - 
    
        
    
                    
Freso
                (And thank you!)
     
      2019-05-01 12113, 2019
    - 
    
        
    
                    
iliekcomputers
                Mr_Monkey: moin!
     
      2019-05-01 12123, 2019
    - 
    
        
    
        
        
chirlu has quit
     
      2019-05-01 12116, 2019
    - 
    
        
    
        
        
chirlu joined the channel
     
      2019-05-01 12138, 2019
    - 
    
        
    
                    
Mr_Monkey
                Hi iliekcomputers ! Sorry, had an alarm clock failure…
     
      2019-05-01 12118, 2019
    - 
    
        
    
                    
Mr_Monkey
                Hi zas ! Are you around today for a dns change?
     
      2019-05-01 12110, 2019
    - 
    
        
    
                    
iliekcomputers
                No worries. I have a college thing in like 40 min. Do you wanna start once i get back?
     
      2019-05-01 12136, 2019
    - 
    
        
    
                    
Mr_Monkey
                Sure
     
      2019-05-01 12140, 2019
    - 
    
        
    
                    
Mr_Monkey
                iliekcomputers: roughly how long do you think?
     
      2019-05-01 12107, 2019
    - 
    
        
    
                    
iliekcomputers
                10-15 min at most
     
      2019-05-01 12132, 2019
    - 
    
        
    
                    
Mr_Monkey
                Oh, OK :p
     
      2019-05-01 12142, 2019
    - 
    
        
    
                    
iliekcomputers
                I'm gonna be here fully from 5 PM IST.
     
      2019-05-01 12149, 2019
    - 
    
        
    
                    
Mr_Monkey
                I was thinking 2-3 hours, thinking about lunch plans and all that :p
     
      2019-05-01 12115, 2019
    - 
    
        
    
                    
iliekcomputers
                Ahh
     
      2019-05-01 12122, 2019
    - 
    
        
    
                    
iliekcomputers
                When do you lunch?
     
      2019-05-01 12157, 2019
    - 
    
        
    
                    
Mr_Monkey
                I'll do that now-ish and be free at 5PM IST
     
      2019-05-01 12122, 2019
    - 
    
        
    
                    
iliekcomputers
                Ah, cool!
     
      2019-05-01 12134, 2019
    - 
    
        
    
                    
iliekcomputers
                Hopefully we're done in minutes :) :)
     
      2019-05-01 12158, 2019
    - 
    
        
    
                    
iliekcomputers
                Mr_Monkey: how many tables does the db have?
     
      2019-05-01 12159, 2019
    - 
    
        
    
        
        
michelv__ has quit
     
      2019-05-01 12130, 2019
    - 
    
        
    
                    
iliekcomputers
                Might be good to write a script to count number of rows in each table for a consistency check.
     
      2019-05-01 12138, 2019
    - 
    
        
    
                    
iliekcomputers
                I can do that today.
     
      2019-05-01 12109, 2019
    - 
    
        
    
                    
Mr_Monkey
                That would be great :)
     
      2019-05-01 12147, 2019
    - 
    
        
    
                    
Mr_Monkey
                iliekcomputers: 240 tables
     
      2019-05-01 12114, 2019
    - 
    
        
    
                    
iliekcomputers
                Yikes lol
     
      2019-05-01 12127, 2019
    - 
    
        
    
                    
Mr_Monkey
                61 of which are on the bookbrainz schema
     
      2019-05-01 12121, 2019
    - 
    
        
    
        
        
michelv__ joined the channel
     
      2019-05-01 12119, 2019
    - 
    
        
    
                    
zas
                Mr_Monkey: yup, just ping me when you need
     
      2019-05-01 12137, 2019
    - 
    
        
    
                    
Mr_Monkey
                Hello zas! Could you please change the DNS TTL to 5 minutes for BookBrainz.org?
     
      2019-05-01 12104, 2019
    - 
    
        
    
        
        
letaiv joined the channel
     
      2019-05-01 12119, 2019
    - 
    
        
    
                    
iliekcomputers
                Be around in just 10-15 min, if that's okay.
     
      2019-05-01 12137, 2019
    - 
    
        
    
                    
zas
                K
     
      2019-05-01 12154, 2019
    - 
    
        
    
                    
iliekcomputers
                * I'll be around.
     
      2019-05-01 12103, 2019
    - 
    
        
    
                    
zas
                Mr_Monkey: ttl is on 300 seconds already
     
      2019-05-01 12124, 2019
    - 
    
        
    
                    
Mr_Monkey
                Ah, I hadn't realised, thanks zas
     
      2019-05-01 12129, 2019
    - 
    
        
    
                    
Mr_Monkey
                No rush iliekcomputers
     
      2019-05-01 12147, 2019
    - 
    
        
    
        
        
michelv__ has quit
     
      2019-05-01 12121, 2019
    - 
    
        
    
                    
iliekcomputers
                Mr_Monkey: i'm here, sorry!
     
      2019-05-01 12128, 2019
    - 
    
        
    
                    
Mr_Monkey
                No worries !
     
      2019-05-01 12152, 2019
    - 
    
        
    
                    
Mr_Monkey
                Do you need more time?
     
      2019-05-01 12111, 2019
    - 
    
        
    
                    
iliekcomputers
                nope, here totally now
     
      2019-05-01 12131, 2019
    - 
    
        
    
        
        
Mr_Monkey takes deep breath
     
      2019-05-01 12135, 2019
    - 
    
        
    
                    
iliekcomputers
                yo!
     
      2019-05-01 12137, 2019
    - 
    
        
    
                    
Mr_Monkey
                All right, let's do this then :)
     
      2019-05-01 12109, 2019
    - 
    
        
    
                    
iliekcomputers
                let's migrate the db once before bringing the site down.
     
      2019-05-01 12139, 2019
    - 
    
        
    
                    
Mr_Monkey
                I'm down with that. do you want to do the honnors?
     
      2019-05-01 12123, 2019
    - 
    
        
    
                    
iliekcomputers
                yea, sure.
     
      2019-05-01 12102, 2019
    - 
    
        
    
                    
iliekcomputers
                in the meanwhile, can you come up with a list of tables that we should check for consistency in rows?
     
      2019-05-01 12118, 2019
    - 
    
        
    
                    
Mr_Monkey
                Yep
     
      2019-05-01 12105, 2019
    - 
    
        
    
                    
iliekcomputers
                new db created.
     
      2019-05-01 12145, 2019
    - 
    
        
    
                    
Mr_Monkey
                OK, time to take a dump.
     
      2019-05-01 12145, 2019
    - 
    
        
    
                    
Mr_Monkey
                I'm set up to compare rows
     
      2019-05-01 12100, 2019
    - 
    
        
    
                    
iliekcomputers
                wokay, creating dump on the vm.
     
      2019-05-01 12156, 2019
    - 
    
        
    
                    
Mr_Monkey
                The dumps are so fast on BB
     
      2019-05-01 12109, 2019
    - 
    
        
    
                    
Mr_Monkey
                For now
     
      2019-05-01 12149, 2019
    - 
    
        
    
                    
ruaok
                
     
      2019-05-01 12104, 2019
    - 
    
        
    
                    
ruaok
                not a bad place to pay people from, no?
     
      2019-05-01 12122, 2019
    - 
    
        
    
                    
ruaok
                if you sent  your invoice in already, its paid. the rest of you: Slackers!
     
      2019-05-01 12125, 2019
    - 
    
        
    
        
        
ruaok runs off again
     
      2019-05-01 12135, 2019
    - 
    
        
    
                    
Mr_Monkey
                Damn, I always forget the month ends.
     
      2019-05-01 12141, 2019
    - 
    
        
    
                    
Mr_Monkey
                Enjoy, ruaok !
     
      2019-05-01 12120, 2019
    - 
    
        
    
                    
iliekcomputers
                ok dump copied over
     
      2019-05-01 12129, 2019
    - 
    
        
    
                    
iliekcomputers
                and imported into postgres master
     
      2019-05-01 12146, 2019
    - 
    
        
    
                    
iliekcomputers
                sorry for the lateness, some network problems
     
      2019-05-01 12113, 2019
    - 
    
        
    
                    
Mr_Monkey
                OK, let me compare rows
     
      2019-05-01 12147, 2019
    - 
    
        
    
                    
iliekcomputers
                
     
      2019-05-01 12133, 2019
    - 
    
        
    
                    
zas
                
     
      2019-05-01 12156, 2019
    - 
    
        
    
                    
Mr_Monkey
                Did you stop the service iliekcomputers ?
     
      2019-05-01 12105, 2019
    - 
    
        
    
                    
iliekcomputers
                yes.
     
      2019-05-01 12133, 2019
    - 
    
        
    
                    
iliekcomputers
                do the rows look ok?
     
      2019-05-01 12142, 2019
    - 
    
        
    
                    
Mr_Monkey
                Ah, I thought we were doing a dry run. Well, zas it'll be down fora short period of time
     
      2019-05-01 12149, 2019
    - 
    
        
    
                    
Mr_Monkey
                iliekcomputers:  Checking now
     
      2019-05-01 12129, 2019
    - 
    
        
    
                    
iliekcomputers
                Mr_Monkey: do you have a script to test?
     
      2019-05-01 12140, 2019
    - 
    
        
    
                    
Mr_Monkey
                iliekcomputers: I'm checking manually
     
      2019-05-01 12146, 2019
    - 
    
        
    
                    
iliekcomputers
                ah.
     
      2019-05-01 12106, 2019
    - 
    
        
    
                    
iliekcomputers
                what tables, maybe I can do the counts on vm and you on bowie
     
      2019-05-01 12121, 2019
    - 
    
        
    
                    
Mr_Monkey
                iliekcomputers: Just saw this, sorry. It all looks good!
     
      2019-05-01 12128, 2019
    - 
    
        
    
                    
iliekcomputers
                ahh
     
      2019-05-01 12131, 2019
    - 
    
        
    
                    
iliekcomputers
                woohoo nice!
     
      2019-05-01 12147, 2019
    - 
    
        
    
                    
iliekcomputers
                i checked new.bookbrainz and it looks sane to me.
     
      2019-05-01 12154, 2019
    - 
    
        
    
                    
iliekcomputers
                search works.
     
      2019-05-01 12107, 2019
    - 
    
        
    
                    
Mr_Monkey
                Let me add an item to make sure
     
      2019-05-01 12120, 2019
    - 
    
        
    
                    
Mr_Monkey
                iliekcomputers: A-OK
     
      2019-05-01 12129, 2019
    - 
    
        
    
                    
iliekcomputers
                cool, cool, cool.
     
      2019-05-01 12102, 2019
    - 
    
        
    
                    
iliekcomputers
                i triggered the reindex.
     
      2019-05-01 12103, 2019
    - 
    
        
    
                    
Mr_Monkey
                Are you reindexing?
     
      2019-05-01 12107, 2019
    - 
    
        
    
                    
Mr_Monkey
                OK
     
      2019-05-01 12114, 2019
    - 
    
        
    
                    
iliekcomputers
                {"success":true}
     
      2019-05-01 12120, 2019
    - 
    
        
    
                    
Mr_Monkey
                Great
     
      2019-05-01 12145, 2019
    - 
    
        
    
                    
iliekcomputers
                
     
      2019-05-01 12149, 2019
    - 
    
        
    
                    
iliekcomputers
                to gateways
     
      2019-05-01 12155, 2019
    - 
    
        
    
                    
iliekcomputers
                zas: ping?
     
      2019-05-01 12101, 2019
    - 
    
        
    
                    
zas
                pooong
     
      2019-05-01 12103, 2019
    - 
    
        
    
                    
iliekcomputers
                
     
      2019-05-01 12104, 2019
    - 
    
        
    
                    
Mr_Monkey
                On it for the PR
     
      2019-05-01 12108, 2019
    - 
    
        
    
                    
zas
                ok
     
      2019-05-01 12117, 2019
    - 
    
        
    
                    
iliekcomputers
                Mr_Monkey: cool cool cool.
     
      2019-05-01 12147, 2019
    - 
    
        
    
                    
iliekcomputers
                
     
      2019-05-01 12111, 2019
    - 
    
        
    
                    
zas
                done, ttl is 5 mins
     
      2019-05-01 12109, 2019
    - 
    
        
    
                    
zas
                hmmm weird, i got an ssl error
     
      2019-05-01 12117, 2019
    - 
    
        
    
                    
zas
                
     
      2019-05-01 12130, 2019
    - 
    
        
    
                    
Mr_Monkey
                zas: I just opened a PR for that
     
      2019-05-01 12135, 2019
    - 
    
        
    
                    
iliekcomputers
                zas: yep, Mr_Monkey was doing that afaik.
     
      2019-05-01 12115, 2019
    - 
    
        
    
                    
zas
                lgtm
     
      2019-05-01 12141, 2019
    - 
    
        
    
                    
zas
                btw, when the switch will be fully completed, we'll make a snapshot of the gcloud VM and stop it
     
      2019-05-01 12154, 2019
    - 
    
        
    
                    
Mr_Monkey
                OK, liekcomputers, I'm pulling the merged PR and restarting containers
     
      2019-05-01 12131, 2019
    - 
    
        
    
                    
Mr_Monkey
                Ah, no need.
     
      2019-05-01 12138, 2019
    - 
    
        
    
                    
iliekcomputers
                Mr_Monkey:yo!
     
      2019-05-01 12144, 2019
    - 
    
        
    
                    
iliekcomputers
                it works for me.
     
      2019-05-01 12147, 2019
    - 
    
        
    
                    
iliekcomputers
                login does too.
     
      2019-05-01 12147, 2019
    - 
    
        
    
                    
Mr_Monkey
                Well, it looks to me like we've just migrated.
     
      2019-05-01 12156, 2019
    - 
    
        
    
                    
iliekcomputers
                wow, a release i didn't fuck up
     
      2019-05-01 12100, 2019
    - 
    
        
    
                    
iliekcomputers
                nice!
     
      2019-05-01 12106, 2019
    - 
    
        
    
                    
Mr_Monkey
                You and me both !
     
      2019-05-01 12109, 2019
    - 
    
        
    
                    
iliekcomputers
                last migration took me 15 hrs :D
     
      2019-05-01 12111, 2019
    - 
    
        
    
                    
Mr_Monkey
                High five !
     
      2019-05-01 12115, 2019
    - 
    
        
    
                    
iliekcomputers
                <3 <3
     
      2019-05-01 12129, 2019
    - 
    
        
    
                    
Mr_Monkey
                Let me tweet tweet tweet
     
      2019-05-01 12135, 2019
    - 
    
        
    
                    
iliekcomputers
                let's keep a look out on cron dumps
     
      2019-05-01 12136, 2019
    - 
    
        
    
                    
zas
                good job guys ! Next level: do it without any downtime ;)
     
      2019-05-01 12138, 2019
    - 
    
        
    
                    
iliekcomputers
                right, i triggered a dump and it worked.
     
      2019-05-01 12120, 2019
    - 
    
        
    
                    
zas
                i'll update nagios checks for it
     
      2019-05-01 12131, 2019
    - 
    
        
    
                    
iliekcomputers
                thanks zas !
     
      2019-05-01 12138, 2019
    - 
    
        
    
                    
Mr_Monkey
                Thanks zas! And yes as you pointed out that leaves cleaning up the VM
     
      2019-05-01 12157, 2019
    - 
    
        
    
                    
Mr_Monkey
                Oh, and putting the DNS TTL back to a sane value?
     
      2019-05-01 12153, 2019
    - 
    
        
    
                    
Mr_Monkey
                zas: mind if we keep the VM up for another few days, just in case?
     
      2019-05-01 12122, 2019
    - 
    
        
    
                    
iliekcomputers
                yea, we probably should.
     
      2019-05-01 12130, 2019
    - 
    
        
    
                    
zas
                yes, few days, but when sure, ping me so i archive/stop it
     
      2019-05-01 12143, 2019
    - 
    
        
    
                    
Mr_Monkey
                Cool, thanks
     
      2019-05-01 12146, 2019
    - 
    
        
    
                    
zas
                i'll increase ttl again
     
      2019-05-01 12134, 2019
    - 
    
        
    
                    
zas
                done
     
      2019-05-01 12139, 2019
    - 
    
        
    
                    
zas
                now updating nagios stuff
     
      2019-05-01 12141, 2019
    - 
    
        
    
                    
Mr_Monkey
                Yay, we didn't faceplant! Thanks iliekcomputers
     
      2019-05-01 12135, 2019
    - 
    
        
    
                    
iliekcomputers
                ❤️❤️
     
      2019-05-01 12118, 2019
    - 
    
        
    
                    
zas
                nagios done