8:43 AM
ruaok
very odd.
2011-05-16 13652, 2011
8:43 AM
ocharles
Cannot upgrade #236638: This data is corrupt and cannot be upgraded at /home/acid2/musicbrainz-server/admin/sql/updates/../../../lib/MusicBrainz/Server/Edit/Historic/EditTrackNum.pm line 48.
2011-05-16 13654, 2011
8:43 AM
ocharles
that's the last line for me
2011-05-16 13602, 2011
8:44 AM
ocharles
ruaok: well if it crashes I didn't have anything to display the error
2011-05-16 13606, 2011
8:44 AM
ocharles
but I've got a commit for that too
2011-05-16 13612, 2011
8:44 AM
ocharles
shall I push and resume migration from this script?
2011-05-16 13618, 2011
8:44 AM
ruaok
I didin't see any error either.
2011-05-16 13628, 2011
8:44 AM
ocharles
yea, it dies silently
2011-05-16 13630, 2011
8:44 AM
ruaok
but since you had it in a transaction, you can re-run it, right?
2011-05-16 13641, 2011
8:44 AM
ocharles
yep
2011-05-16 13655, 2011
8:44 AM
ruaok
right-o.
2011-05-16 13659, 2011
8:44 AM
ruaok
I'm coming up on 2am here.
2011-05-16 13603, 2011
8:45 AM
ruaok
djce: you here right now?
2011-05-16 13607, 2011
8:45 AM
djce
ping
2011-05-16 13621, 2011
8:45 AM
ruaok
ok, I'd like to hand over the reigns to both of you and get some sleep.
2011-05-16 13625, 2011
8:45 AM
ruaok
first: reboot astro.
2011-05-16 13628, 2011
8:45 AM
ruaok
can we do that now?
2011-05-16 13633, 2011
8:45 AM
djce
go for it...
2011-05-16 13605, 2011
8:46 AM
djce
ocharles: you've got root, close off your sessions and last man out gets to reboot it ...
2011-05-16 13637, 2011
8:46 AM
ocharles
i'm out!
2011-05-16 13645, 2011
8:46 AM
ocharles puts some bacon on
2011-05-16 13656, 2011
8:46 AM
ruaok
dont go anywhere!@
2011-05-16 13612, 2011
8:47 AM
ruaok
astro is rebooting.
2011-05-16 13610, 2011
8:48 AM
ocharles
i'm here
2011-05-16 13615, 2011
8:48 AM
ruaok
ok.
2011-05-16 13636, 2011
8:48 AM
ruaok
ocharles will need to make sure all is well.
2011-05-16 13649, 2011
8:48 AM
ruaok
and that the right branch is loaded and read to go.
2011-05-16 13604, 2011
8:49 AM
ruaok
once ocharles is happy with the branch, we need to start executing the migration plan.
2011-05-16 13607, 2011
8:49 AM
murdos_ joined the channel
2011-05-16 13613, 2011
8:49 AM
ruaok
djce: can you please be the master of ceremonies?
2011-05-16 13621, 2011
8:49 AM
djce
I'll try :-)
2011-05-16 13626, 2011
8:49 AM
ocharles
:)
2011-05-16 13633, 2011
8:49 AM
ocharles
have we stolen djce for the day?
2011-05-16 13639, 2011
8:49 AM
ruaok
2 days!
2011-05-16 13641, 2011
8:49 AM
djce occasionally prods ocharles until he says "no it's your turn"
2011-05-16 13650, 2011
8:49 AM
ruaok
lets go through what we needs to happen in the next 8 hours.
2011-05-16 13654, 2011
8:49 AM
ocharles
cool :)
2011-05-16 13656, 2011
8:49 AM
ruaok
2011-05-16 13606, 2011
8:50 AM
ruaok
Disallow any changes to MB.
2011-05-16 13618, 2011
8:50 AM
ruaok
for that, svn up the codebase on tails, stimpy, dexter.
2011-05-16 13631, 2011
8:50 AM
djce
does that stop modbot?
2011-05-16 13635, 2011
8:50 AM
ruaok
no.
2011-05-16 13638, 2011
8:50 AM
ruaok
> Change the data download URL in admin/replication/LoadReplicationChanges
2011-05-16 13642, 2011
8:50 AM
ruaok
we can skip that til later.
2011-05-16 13644, 2011
8:50 AM
ruaok
I'll move it.
2011-05-16 13650, 2011
8:50 AM
ruaok
> stop all cron jobs on classic
2011-05-16 13604, 2011
8:51 AM
ruaok
you illustrated that to me earlier djce. should be no issue.
2011-05-16 13609, 2011
8:51 AM
djce
I can do that.
2011-05-16 13612, 2011
8:51 AM
ruaok
> Close all open edits
2011-05-16 13629, 2011
8:51 AM
ruaok
set the expire and close time of all edits in moderation_open to now().
2011-05-16 13635, 2011
8:51 AM
ruaok
the run CheckVotes.pl
2011-05-16 13650, 2011
8:51 AM
ruaok
the end results should be an emty moderation_open table
2011-05-16 13607, 2011
8:52 AM
ruaok
(oh and ofter the web servers need to be restarted once svn up is done above)
2011-05-16 13614, 2011
8:52 AM
djce
sure
2011-05-16 13630, 2011
8:52 AM
ruaok
and get nikki or reoscarksiorsky to check to make sure that no one can edit anything.
2011-05-16 13638, 2011
8:52 AM
ruaok
> Dump the MB Classic data for the last time.
2011-05-16 13639, 2011
8:52 AM
nikki
poor reosarevok :P
2011-05-16 13648, 2011
8:52 AM
ruaok
easy, you know what needs to happen.
2011-05-16 13653, 2011
8:52 AM
djce nods
2011-05-16 13600, 2011
8:53 AM
ruaok
> Move the last classic data dump to permanently saved location on the FTP server.
2011-05-16 13606, 2011
8:53 AM
ruaok
move it out of the data dir.
2011-05-16 13614, 2011
8:53 AM
ruaok
maybe into the classic dir.
2011-05-16 13621, 2011
8:53 AM
djce
ok
2011-05-16 13624, 2011
8:53 AM
ruaok
or a dir called classic
2011-05-16 13635, 2011
8:53 AM
ruaok
> Copy the data to astro and start import into clean DB.
2011-05-16 13652, 2011
8:53 AM
ruaok
don't forget the private data file in /usr/local/mb_server/backup.
2011-05-16 13657, 2011
8:53 AM
ruaok
on scooby that is.
2011-05-16 13622, 2011
8:54 AM
ruaok
> Start migration immediately. igrate to musicbrainz_db and musicbrainz_db_raw, and set type to RT_MASTER in the migration codebase
2011-05-16 13613, 2011
8:55 AM
ruaok
2011-05-16 13617, 2011
8:55 AM
ocharles
are we going to have ngs.mb up while migration is running?
2011-05-16 13645, 2011
8:55 AM
ruaok
djce: you'll recognize what is going on here. this step requires that the export be called with --without-replication
2011-05-16 13652, 2011
8:55 AM
ruaok
ocharles: should be possible. your call.
2011-05-16 13611, 2011
8:56 AM
ocharles
yep, it will be possible, just a tiny bit more load
2011-05-16 13613, 2011
8:56 AM
ocharles
shouldn't be a problem
2011-05-16 13618, 2011
8:56 AM
ruaok
djce: still with me?
2011-05-16 13619, 2011
8:56 AM
ocharles
shall I commit --without-replication to upgrade.sh?
2011-05-16 13632, 2011
8:56 AM
djce
so the final export from classic needs to be --without-replication ?
2011-05-16 13642, 2011
8:56 AM
ruaok
no.
2011-05-16 13601, 2011
8:57 AM
ruaok
actually that step can probably wait.
2011-05-16 13605, 2011
8:57 AM
ruaok
ignore that for now.
2011-05-16 13617, 2011
8:57 AM
MBChatLogger
2011-05-16 13617, 2011
8:57 AM
ruaok
once the replication finishes, bring it up on
ngs.mb.org and poke at it.
2011-05-16 13627, 2011
8:57 AM
ruaok
get everyone and their mom to poke at it. see if it has problems.
2011-05-16 13632, 2011
8:57 AM
djce
Sorry, I'm lost. What step can wait?
2011-05-16 13643, 2011
8:57 AM
ruaok
2011-05-16 13646, 2011
8:57 AM
djce
ok
2011-05-16 13647, 2011
8:57 AM
ocharles
djce: ./upgrade.sh will fail, right at the end
2011-05-16 13652, 2011
8:57 AM
ocharles
but you don't need to worry about that, iirc
2011-05-16 13605, 2011
8:58 AM
ruaok
oh, its part of migration.
2011-05-16 13608, 2011
8:58 AM
ruaok
hum, one sec.
2011-05-16 13617, 2011
8:58 AM
ocharles
ruaok: that's why I said shall I add the flag to upgrade.sh
2011-05-16 13635, 2011
8:58 AM
ocharles
hrm, it has --without-replication in the export in upgrade.sh
2011-05-16 13645, 2011
8:58 AM
ruaok
yeah.
2011-05-16 13647, 2011
8:58 AM
ruaok
not sure wtf.
2011-05-16 13620, 2011
8:59 AM
ruaok
it dies because the dbmirror* tables are not present.
2011-05-16 13636, 2011
8:59 AM
ruaok
ocharles: add this line before the vacuum:
2011-05-16 13642, 2011
8:59 AM
djce
Not entirely sure I understand what's going on. The import of the final classic export, on astro, into totoro, uses what codebase?
2011-05-16 13659, 2011
8:59 AM
ruaok
./admin/psql READWRITE <./admin/sql/CreateReplicationSetup.sql
2011-05-16 13607, 2011
9:00 AM
ocharles
djce: the 'production' branch
2011-05-16 13623, 2011
9:00 AM
ocharles
can I use astro yet btw?
2011-05-16 13623, 2011
9:00 AM
djce
So that knows how to import a classic db?
2011-05-16 13628, 2011
9:00 AM
ruaok
and ocharles will be in charge of making sure that branch is ready to go.
2011-05-16 13632, 2011
9:00 AM
ocharles
djce: indeed
2011-05-16 13636, 2011
9:00 AM
ruaok
it doesn't.
2011-05-16 13651, 2011
9:00 AM
djce detects conflicting answers
2011-05-16 13654, 2011
9:00 AM
ocharles
yea...
2011-05-16 13605, 2011
9:01 AM
ruaok
ok, hold on a sec ocharles
2011-05-16 13610, 2011
9:01 AM
ocharles shuts up
2011-05-16 13622, 2011
9:01 AM
ruaok
1. copy all the dump files to astro.
2011-05-16 13631, 2011
9:01 AM
ruaok
2. double check the private data file is there too
2011-05-16 13642, 2011
9:01 AM
pecastro joined the channel
2011-05-16 13609, 2011
9:02 AM
ruaok
3. import the classic data with the mb_server codebase in ~musicbrainz on astro.
2011-05-16 13614, 2011
9:02 AM
djce
ah
2011-05-16 13621, 2011
9:02 AM
ruaok
4. Once the classic data is imported, start migration.
2011-05-16 13632, 2011
9:02 AM
djce
using the musicbrainz-server production branch?
2011-05-16 13638, 2011
9:02 AM
ruaok
yes.
2011-05-16 13645, 2011
9:02 AM
djce
ocharles: you know how to do that step presumably.
2011-05-16 13600, 2011
9:03 AM
ruaok
ocharles: did you note to add the ReplicationSetup.sql step?
2011-05-16 13612, 2011
9:03 AM
ocharles
yes, that's commited to edit-fixes
2011-05-16 13617, 2011
9:03 AM
ruaok
get.
2011-05-16 13623, 2011
9:03 AM
ocharles
which assuming this all works on astro/my machine will be commited straight to master shortly
2011-05-16 13635, 2011
9:03 AM
ruaok
echo "PLEASE BACKUP these exported dumps from /tmp/mbexport-XXXX!!!!!!"
2011-05-16 13652, 2011
9:03 AM
ruaok
those are the tmp tables we need to save so save them in some place on put them on the ftp site.
2011-05-16 13617, 2011
9:04 AM
djce
so catalyst needs to be stopped presumably while the migration occurs?
2011-05-16 13629, 2011
9:04 AM
ocharles
djce: nope, just using a different database
2011-05-16 13637, 2011
9:04 AM
ocharles
hm
2011-05-16 13638, 2011
9:04 AM
djce
so, a different codebase copy too then?
2011-05-16 13643, 2011
9:04 AM
ruaok
yep
2011-05-16 13648, 2011
9:04 AM
ocharles
probably best to just stop it
2011-05-16 13656, 2011
9:04 AM
ocharles
rather than making more work for ourselves
2011-05-16 13611, 2011
9:05 AM
djce
And the migration is what, "./upgrade.sh" ?
2011-05-16 13616, 2011
9:05 AM
ocharles
yep
2011-05-16 13623, 2011
9:05 AM
ocharles
once you've set DBDefs.pm up, of course
2011-05-16 13623, 2011
9:05 AM
djce
and it takes roughly how long?
2011-05-16 13637, 2011
9:05 AM
ocharles
~6 hours?
2011-05-16 13647, 2011
9:05 AM
ruaok
thereabouts.
2011-05-16 13651, 2011
9:05 AM
ruaok
should be faster now with a reboot.
2011-05-16 13603, 2011
9:06 AM
ocharles
can I kick the script off again now, btw?
2011-05-16 13604, 2011
9:06 AM
ruaok
2011-05-16 13606, 2011
9:06 AM
ruaok
please review.
2011-05-16 13615, 2011
9:06 AM
ruaok
the artist fix? yes.
2011-05-16 13610, 2011
9:07 AM
djce
"RT_MASTER in the migration codebase " happens /before/ running upgrade.sh ?
2011-05-16 13634, 2011
9:07 AM
ruaok
I don't think it mattes.
2011-05-16 13638, 2011
9:07 AM
djce
k
2011-05-16 13646, 2011
9:07 AM
ruaok
I've always done it as RT-STANDALONE come to think of it.
2011-05-16 13658, 2011
9:07 AM
ruaok
and then promote it to master by hand by doing the replication stuff.
2011-05-16 13628, 2011
9:08 AM
djce
tbh by the time we get to this point, I think you'll be back with us again.
2011-05-16 13635, 2011
9:08 AM
ocharles
yea, that's about 8 hours away
2011-05-16 13611, 2011
9:09 AM
ruaok
yep.
2011-05-16 13615, 2011
9:09 AM
ruaok
I just updated the times in the wiki page.
