8:43 AM
ruaok
very odd.
8:43 AM
ocharles
Cannot upgrade #236638: This data is corrupt and cannot be upgraded at /home/acid2/musicbrainz-server/admin/sql/updates/../../../lib/MusicBrainz/Server/Edit/Historic/EditTrackNum.pm line 48.
8:43 AM
that's the last line for me
8:44 AM
ruaok: well if it crashes I didn't have anything to display the error
8:44 AM
but I've got a commit for that too
8:44 AM
shall I push and resume migration from this script?
8:44 AM
ruaok
I didin't see any error either.
8:44 AM
ocharles
yea, it dies silently
8:44 AM
ruaok
but since you had it in a transaction, you can re-run it, right?
8:44 AM
ocharles
yep
8:44 AM
ruaok
right-o.
8:44 AM
I'm coming up on 2am here.
8:45 AM
djce: you here right now?
8:45 AM
djce
ping
8:45 AM
ruaok
ok, I'd like to hand over the reigns to both of you and get some sleep.
8:45 AM
first: reboot astro.
8:45 AM
can we do that now?
8:45 AM
djce
go for it...
8:46 AM
ocharles: you've got root, close off your sessions and last man out gets to reboot it ...
8:46 AM
ocharles
i'm out!
8:46 AM
ocharles puts some bacon on
8:46 AM
ruaok
dont go anywhere!@
8:47 AM
astro is rebooting.
8:48 AM
ocharles
i'm here
8:48 AM
ruaok
ok.
8:48 AM
ocharles will need to make sure all is well.
8:48 AM
and that the right branch is loaded and read to go.
8:49 AM
once ocharles is happy with the branch, we need to start executing the migration plan.
8:49 AM
murdos_ joined the channel
8:49 AM
djce: can you please be the master of ceremonies?
8:49 AM
djce
I'll try :-)
8:49 AM
ocharles
:)
8:49 AM
have we stolen djce for the day?
8:49 AM
ruaok
2 days!
8:49 AM
djce occasionally prods ocharles until he says "no it's your turn"
8:49 AM
lets go through what we needs to happen in the next 8 hours.
8:49 AM
ocharles
cool :)
8:49 AM
ruaok
8:50 AM
Disallow any changes to MB.
8:50 AM
for that, svn up the codebase on tails, stimpy, dexter.
8:50 AM
djce
does that stop modbot?
8:50 AM
ruaok
no.
8:50 AM
> Change the data download URL in admin/replication/LoadReplicationChanges
8:50 AM
we can skip that til later.
8:50 AM
I'll move it.
8:50 AM
> stop all cron jobs on classic
8:51 AM
you illustrated that to me earlier djce. should be no issue.
8:51 AM
djce
I can do that.
8:51 AM
ruaok
> Close all open edits
8:51 AM
set the expire and close time of all edits in moderation_open to now().
8:51 AM
the run CheckVotes.pl
8:51 AM
the end results should be an emty moderation_open table
8:52 AM
(oh and ofter the web servers need to be restarted once svn up is done above)
8:52 AM
djce
sure
8:52 AM
ruaok
and get nikki or reoscarksiorsky to check to make sure that no one can edit anything.
8:52 AM
> Dump the MB Classic data for the last time.
8:52 AM
nikki
poor reosarevok :P
8:52 AM
ruaok
easy, you know what needs to happen.
8:52 AM
djce nods
8:53 AM
> Move the last classic data dump to permanently saved location on the FTP server.
8:53 AM
move it out of the data dir.
8:53 AM
maybe into the classic dir.
8:53 AM
djce
ok
8:53 AM
ruaok
or a dir called classic
8:53 AM
> Copy the data to astro and start import into clean DB.
8:53 AM
don't forget the private data file in /usr/local/mb_server/backup.
8:53 AM
on scooby that is.
8:54 AM
> Start migration immediately. igrate to musicbrainz_db and musicbrainz_db_raw, and set type to RT_MASTER in the migration codebase
8:55 AM
8:55 AM
ocharles
are we going to have ngs.mb up while migration is running?
8:55 AM
ruaok
djce: you'll recognize what is going on here. this step requires that the export be called with --without-replication
8:55 AM
ocharles: should be possible. your call.
8:56 AM
ocharles
yep, it will be possible, just a tiny bit more load
8:56 AM
shouldn't be a problem
8:56 AM
ruaok
djce: still with me?
8:56 AM
ocharles
shall I commit --without-replication to upgrade.sh?
8:56 AM
djce
so the final export from classic needs to be --without-replication ?
8:56 AM
ruaok
no.
8:57 AM
actually that step can probably wait.
8:57 AM
ignore that for now.
8:57 AM
MBChatLogger
8:57 AM
ruaok
once the replication finishes, bring it up on
ngs.mb.org and poke at it.
8:57 AM
get everyone and their mom to poke at it. see if it has problems.
8:57 AM
djce
Sorry, I'm lost. What step can wait?
8:57 AM
ruaok
8:57 AM
djce
ok
8:57 AM
ocharles
djce: ./upgrade.sh will fail, right at the end
8:57 AM
but you don't need to worry about that, iirc
8:58 AM
ruaok
oh, its part of migration.
8:58 AM
hum, one sec.
8:58 AM
ocharles
ruaok: that's why I said shall I add the flag to upgrade.sh
8:58 AM
hrm, it has --without-replication in the export in upgrade.sh
8:58 AM
ruaok
yeah.
8:58 AM
not sure wtf.
8:59 AM
it dies because the dbmirror* tables are not present.
8:59 AM
ocharles: add this line before the vacuum:
8:59 AM
djce
Not entirely sure I understand what's going on. The import of the final classic export, on astro, into totoro, uses what codebase?
8:59 AM
ruaok
./admin/psql READWRITE <./admin/sql/CreateReplicationSetup.sql
9:00 AM
ocharles
djce: the 'production' branch
9:00 AM
can I use astro yet btw?
9:00 AM
djce
So that knows how to import a classic db?
9:00 AM
ruaok
and ocharles will be in charge of making sure that branch is ready to go.
9:00 AM
ocharles
djce: indeed
9:00 AM
ruaok
it doesn't.
9:00 AM
djce detects conflicting answers
9:00 AM
ocharles
yea...
9:01 AM
ruaok
ok, hold on a sec ocharles
9:01 AM
ocharles shuts up
9:01 AM
1. copy all the dump files to astro.
9:01 AM
2. double check the private data file is there too
9:01 AM
pecastro joined the channel
9:02 AM
3. import the classic data with the mb_server codebase in ~musicbrainz on astro.
9:02 AM
djce
ah
9:02 AM
ruaok
4. Once the classic data is imported, start migration.
9:02 AM
djce
using the musicbrainz-server production branch?
9:02 AM
ruaok
yes.
9:02 AM
djce
ocharles: you know how to do that step presumably.
9:03 AM
ruaok
ocharles: did you note to add the ReplicationSetup.sql step?
9:03 AM
ocharles
yes, that's commited to edit-fixes
9:03 AM
ruaok
get.
9:03 AM
ocharles
which assuming this all works on astro/my machine will be commited straight to master shortly
9:03 AM
ruaok
echo "PLEASE BACKUP these exported dumps from /tmp/mbexport-XXXX!!!!!!"
9:03 AM
those are the tmp tables we need to save so save them in some place on put them on the ftp site.
9:04 AM
djce
so catalyst needs to be stopped presumably while the migration occurs?
9:04 AM
ocharles
djce: nope, just using a different database
9:04 AM
hm
9:04 AM
djce
so, a different codebase copy too then?
9:04 AM
ruaok
yep
9:04 AM
ocharles
probably best to just stop it
9:04 AM
rather than making more work for ourselves
9:05 AM
djce
And the migration is what, "./upgrade.sh" ?
9:05 AM
ocharles
yep
9:05 AM
once you've set DBDefs.pm up, of course
9:05 AM
djce
and it takes roughly how long?
9:05 AM
ocharles
~6 hours?
9:05 AM
ruaok
thereabouts.
9:05 AM
should be faster now with a reboot.
9:06 AM
ocharles
can I kick the script off again now, btw?
9:06 AM
ruaok
9:06 AM
please review.
9:06 AM
the artist fix? yes.
9:07 AM
djce
"RT_MASTER in the migration codebase " happens /before/ running upgrade.sh ?
9:07 AM
ruaok
I don't think it mattes.
9:07 AM
djce
k
9:07 AM
ruaok
I've always done it as RT-STANDALONE come to think of it.
9:07 AM
and then promote it to master by hand by doing the replication stuff.
9:08 AM
djce
tbh by the time we get to this point, I think you'll be back with us again.
9:08 AM
ocharles
yea, that's about 8 hours away
9:09 AM
ruaok
yep.
9:09 AM
I just updated the times in the wiki page.