#metabrainz

/

      • zas
        it could be worse ;)
      • 2016-11-08 31351, 2016

      • JesseW has left the channel
      • 2016-11-08 31348, 2016

      • bitmap
        they're not going to be cremated and scattered in the ocean?
      • 2016-11-08 31325, 2016

      • dseomn has quit
      • 2016-11-08 31348, 2016

      • zas
        ok switched to herb then back to kiki, nothing unexpected happened
      • 2016-11-08 31302, 2016

      • zas
        ruaok, bitmap : https://github.com/metabrainz/hetzner-failover (bus factor reduction...)
      • 2016-11-08 31333, 2016

      • dseomn joined the channel
      • 2016-11-08 31329, 2016

      • zas
        i'm doing a coffee, going to smoke, do the same (not the second one if you want long and boring life), and then we start if everyone is ok
      • 2016-11-08 31351, 2016

      • ruaok
        Not sure about the cremation. I was more thinking of a Viking funeral. Loads of fire...
      • 2016-11-08 31329, 2016

      • zas
        cheerleader pom-poms out for real ?
      • 2016-11-08 31315, 2016

      • Freso votes for the option of sending any hardware that isn't being saved to the recycling station, rather than burning or doing other things to it that will release toxic materials...
      • 2016-11-08 31335, 2016

      • chirlu
        Wha? Toxic materials from computers? Never!
      • 2016-11-08 31319, 2016

      • ruaok
        Freso: that *is* the recycling station.
      • 2016-11-08 31353, 2016

      • ruaok
        5 or so servers are going to Portland state university. The rest go to recycling.
      • 2016-11-08 31305, 2016

      • ruaok
        Hmm. This early in the morning I am confused about which part of the California tequila/coffee cycle I'm supposed to be in.
      • 2016-11-08 31334, 2016

      • ruaok
        Too early for coffee. Too late for tequila.
      • 2016-11-08 31342, 2016

      • zas
        half of each
      • 2016-11-08 31301, 2016

      • zas
        Freso: you are responsible of tweeting, step 1 of https://docs.google.com/document/d/1MgqZ4hiKC0MZJ…
      • 2016-11-08 31304, 2016

      • ruaok
        K. On it.
      • 2016-11-08 31331, 2016

      • ruaok
        (the tequila coffee, not the tweeting)
      • 2016-11-08 31352, 2016

      • zas
        bitmap: after Freso tweeted, we start
      • 2016-11-08 31302, 2016

      • bitmap
        D:
      • 2016-11-08 31307, 2016

      • zas
        Gentlecat: ok ?
      • 2016-11-08 31312, 2016

      • zas
        ruaok: ok ?
      • 2016-11-08 31314, 2016

      • ruaok
        Is freso paying attention?
      • 2016-11-08 31317, 2016

      • alastairp
        hello metabrainz
      • 2016-11-08 31320, 2016

      • Freso is
      • 2016-11-08 31321, 2016

      • alastairp
        good luck!
      • 2016-11-08 31322, 2016

      • zas
        Hey alastairp
      • 2016-11-08 31324, 2016

      • ruaok
        OK.
      • 2016-11-08 31336, 2016

      • ruaok
        Thanks alastairp
      • 2016-11-08 31357, 2016

      • Gentlecat
        zas: yes, I'm still alive
      • 2016-11-08 31302, 2016

      • zas
        i hope we don't rely too much on luck ;)
      • 2016-11-08 31321, 2016

      • dboys_ has quit
      • 2016-11-08 31324, 2016

      • zas
        luck is a bitch, never here when you need it
      • 2016-11-08 31339, 2016

      • Gentlecat
        zas: this is fine
      • 2016-11-08 31324, 2016

      • Freso
        Note that I'll go unresponsive in ~2 hours for about an hour.
      • 2016-11-08 31326, 2016

      • Freso tweeted
      • 2016-11-08 31343, 2016

      • Freso
      • 2016-11-08 31303, 2016

      • Gentlecat
        #MigrationDay
      • 2016-11-08 31309, 2016

      • zas
        bitmap: please cron off on astro
      • 2016-11-08 31348, 2016

      • bitmap
        I need to close some ssh tabs because I'm already lost
      • 2016-11-08 31340, 2016

      • bitmap
        done
      • 2016-11-08 31319, 2016

      • zas
        yes, same here (and browser tabs.... 130+)
      • 2016-11-08 31302, 2016

      • Gentlecat
        alastairp: fyi, sentry for AB probably stopped working and client needs an update https://github.com/metabrainz/brainzutils-python/…
      • 2016-11-08 31316, 2016

      • Gentlecat
        or you could just switch to brainzutils
      • 2016-11-08 31320, 2016

      • alastairp
        Gentlecat: OK, cool
      • 2016-11-08 31337, 2016

      • alastairp
        I've put it on my list
      • 2016-11-08 31338, 2016

      • Gentlecat
        has to do with SNI again
      • 2016-11-08 31340, 2016

      • zas
        bitmap: strike through entries on doc when done
      • 2016-11-08 31352, 2016

      • bitmap
        k
      • 2016-11-08 31308, 2016

      • bitmap
        putting site in read only
      • 2016-11-08 31356, 2016

      • chirlu
        Don’t forget to add “import Redis” for NewHost, too. :)
      • 2016-11-08 31319, 2016

      • zas
        ruaok: can you prepare dns zones files with new IPs @ gandi ?
      • 2016-11-08 31355, 2016

      • chirlu
        zas: Wrong part, that belongs into the NewHost section. :)
      • 2016-11-08 31302, 2016

      • zas
        oh yes...
      • 2016-11-08 31329, 2016

      • zas
        fiixed
      • 2016-11-08 31346, 2016

      • ruaok
        Zas: OK. I'll have questions on that.
      • 2016-11-08 31324, 2016

      • zas
        once we activate them, it takes a bit of time to Gandi to propagate changes (added to ttl time)
      • 2016-11-08 31330, 2016

      • ruaok
        Are we using lb1 at all?
      • 2016-11-08 31338, 2016

      • zas
        i don't think, but we'll cleanup later, i think we just have to replace all dwni addresses by hetzner failover one for now
      • 2016-11-08 31323, 2016

      • zas
        they are plenty of entries which are useless already, most are still there because no one is very sure about them, it will be simpler at NewHost
      • 2016-11-08 31341, 2016

      • bitmap
        site in RO mode
      • 2016-11-08 31356, 2016

      • bitmap
        can someone do the banner?
      • 2016-11-08 31309, 2016

      • bitmap is bad with words
      • 2016-11-08 31331, 2016

      • ruaok
        I can do the banner
      • 2016-11-08 31323, 2016

      • ruaok
        main banner in place
      • 2016-11-08 31315, 2016

      • ruaok
        beta is slooow.
      • 2016-11-08 31326, 2016

      • ruaok
        I'd say proceed with the dump.
      • 2016-11-08 31333, 2016

      • ruaok
        if you haven't already.
      • 2016-11-08 31337, 2016

      • jesus2099 joined the channel
      • 2016-11-08 31307, 2016

      • ruaok
        beta banner up.
      • 2016-11-08 31307, 2016

      • chirlu suggests turning the Twitter mention into a link.
      • 2016-11-08 31326, 2016

      • ruaok
        does that work?
      • 2016-11-08 31344, 2016

      • chirlu
        Yes, just use HTML: <a href="...">...</a>
      • 2016-11-08 31317, 2016

      • zas
        bitmap: step 5 now
      • 2016-11-08 31320, 2016

      • ruaok
        not very secure then. :)
      • 2016-11-08 31322, 2016

      • bitmap
        on it
      • 2016-11-08 31357, 2016

      • ruaok
        both updated.
      • 2016-11-08 31300, 2016

      • colbydray joined the channel
      • 2016-11-08 31320, 2016

      • chirlu
        ruaok: The security is in it being limited to trusted people.
      • 2016-11-08 31323, 2016

      • bitmap
        onto step 6
      • 2016-11-08 31356, 2016

      • ruaok
        chirlu: yeah, that is probably a bad idea, knowing this lot. :)
      • 2016-11-08 31309, 2016

      • zas
        ahah^^
      • 2016-11-08 31320, 2016

      • ruaok
        root access is fine. banner edit access? no wai.
      • 2016-11-08 31329, 2016

      • Freso inserts some XSS in the banner
      • 2016-11-08 31320, 2016

      • bitmap
        prod redis rdb at /home/bitmap/dump.201611081554.rdb on jiji
      • 2016-11-08 31329, 2016

      • bitmap
        saving beta redis now
      • 2016-11-08 31352, 2016

      • ruaok
        zas: *all* DWNI IPs get moved to 138.201.227.205?
      • 2016-11-08 31306, 2016

      • ruaok
        there are lots of mx'es as well, which are no longer in use?
      • 2016-11-08 31315, 2016

      • ruaok
        change all, let god sort them out later?
      • 2016-11-08 31330, 2016

      • ruaok
        where god == zas
      • 2016-11-08 31305, 2016

      • bitmap
        beta redis rdb at /home/bitmap/dump.201611081556.rdb on pino
      • 2016-11-08 31306, 2016

      • zas
        lol, if i was such god, we'll not need all this mess ;)
      • 2016-11-08 31343, 2016

      • bitmap
        we'll need to disable AOF when restoring these
      • 2016-11-08 31303, 2016

      • bitmap
        step 7
      • 2016-11-08 31334, 2016

      • zas
        ruaok: be sure to set ttl to the lowest on every changed entry, so we can fix them fast if needed
      • 2016-11-08 31302, 2016

      • zas
        i think we'll have issues with mail anyway, as always
      • 2016-11-08 31313, 2016

      • ruaok
      • 2016-11-08 31326, 2016

      • ruaok
        not saved yet
      • 2016-11-08 31332, 2016

      • pprkut has quit
      • 2016-11-08 31345, 2016

      • bitmap
        stopped services on lolo, step 8
      • 2016-11-08 31350, 2016

      • zas
        chatlogs was pointing where ?
      • 2016-11-08 31326, 2016

      • ruaok
        72* address
      • 2016-11-08 31336, 2016

      • ruaok
        which is a redirect to chatlogs.meb
      • 2016-11-08 31346, 2016

      • ruaok
        which is elsewhere.
      • 2016-11-08 31342, 2016

      • zas
      • 2016-11-08 31351, 2016

      • zas
        this conf is missing
      • 2016-11-08 31314, 2016

      • mihaitish has quit
      • 2016-11-08 31300, 2016

      • ruaok
        *something* at DWNI handles the redirect currently.
      • 2016-11-08 31306, 2016

      • ruaok
        it goes to the wayback machine.
      • 2016-11-08 31344, 2016

      • ruaok ensures all the ttls on the hetzner ips is 300
      • 2016-11-08 31345, 2016

      • pprkut joined the channel
      • 2016-11-08 31300, 2016

      • mihaitish joined the channel
      • 2016-11-08 31304, 2016

      • ruaok
        gist updated, zas
      • 2016-11-08 31324, 2016

      • chirlu
        Speaking of the chatlogs.mb.o redirect, it generates broken redirect URLs. But it’s probably not the right time to work on that now.
      • 2016-11-08 31336, 2016

      • ruaok
        ding
      • 2016-11-08 31359, 2016

      • zas
        i copied the current setup to newhost for chatlogs, we'll fix if needed
      • 2016-11-08 31324, 2016

      • bitmap
        pg_dump --format=custom --host=127.0.0.1 --port=5432 --username=sitemaps sitemaps_db > sitemaps_db.dump
      • 2016-11-08 31327, 2016

      • bitmap
        running on lolo
      • 2016-11-08 31352, 2016

      • bitmap
        I'll move to step 9
      • 2016-11-08 31359, 2016

      • ruaok
        k, zas.
      • 2016-11-08 31301, 2016

      • zas
        ruaok: don't forget other zones, like meb.o
      • 2016-11-08 31312, 2016

      • ruaok
        waiting for an ok from you before moving on.
      • 2016-11-08 31318, 2016

      • ruaok
        or chirlu.
      • 2016-11-08 31328, 2016

      • zas
        if things are missing we'll add them from old config anyway
      • 2016-11-08 31329, 2016

      • ruaok is still quasi-pre-coffee
      • 2016-11-08 31352, 2016

      • zas
        i don't want to blindly copy useless stuff to new setup, so let it break
      • 2016-11-08 31333, 2016

      • zas
        ruaok: ok for mb.o, but don't activate yet ;)
      • 2016-11-08 31346, 2016

      • ruaok nods to both
      • 2016-11-08 31307, 2016

      • ruaok
        saved. moving on.
      • 2016-11-08 31341, 2016

      • bitmap
      • 2016-11-08 31350, 2016

      • bitmap
        ^ last replication packet produced
      • 2016-11-08 31351, 2016

      • bitmap
        step 10
      • 2016-11-08 31310, 2016

      • github joined the channel
      • 2016-11-08 31310, 2016

      • github
        [musicbrainz-server] jesus2099 opened pull request #391: Fix banner overlap with right floating top menu. (master...fix-banner-overlap) https://git.io/vXuGV
      • 2016-11-08 31310, 2016

      • github has left the channel
      • 2016-11-08 31323, 2016

      • ruaok
        how much data is left to sync?
      • 2016-11-08 31335, 2016

      • ruaok
        we could drop the traffic shaping if it would speed things up.
      • 2016-11-08 31345, 2016

      • bitmap
        everything :)
      • 2016-11-08 31300, 2016

      • ruaok
        ok, I'll drop it then.
      • 2016-11-08 31309, 2016

      • chirlu tries importing the replication packet.
      • 2016-11-08 31351, 2016

      • ruaok
        removed.
      • 2016-11-08 31330, 2016

      • chirlu
        Packet 99848 applied successfully to the FreeDB gateway.
      • 2016-11-08 31336, 2016

      • ruaok
        woo!
      • 2016-11-08 31356, 2016

      • bitmap
        hmm, I have to go through zaphod to rsync from sakura right?
      • 2016-11-08 31329, 2016

      • Gentlecat
        bitmap: I use this `rsync -chavzP --stats -e "ssh -p 10031" gentlecat@zaphod.musicbrainz.org:/home/... ...`
      • 2016-11-08 31334, 2016

      • Gentlecat
        which is kind of slow
      • 2016-11-08 31349, 2016

      • bitmap
        or I guess I can do it from the other direction
      • 2016-11-08 31315, 2016

      • Gentlecat
        should I start moving MeB?