hi ocharles: appreciate you're right in the middle of a major db upgrade so thank you for your time today. Solved the "role does not exist" error after some googling and for the benefit of others: su postgres (create a UNIX passwd for that account if required) then "createuser -d -a -P musicbrainz" without the quotes to create the psql role. Now have an error importing the database "key name is duplicated"
How closed is the Agenda for IA Meeting page? I'd like to propose "Support for other image types than JPEG", but not sure if that's good or bad karma. :)
2012-10-15 28924, 2012
ianmcorvidae
that's not something that needs discussing with the IA :)
2012-10-15 28933, 2012
warp
why not?
2012-10-15 28935, 2012
ianmcorvidae
unless I'm misunderstanding
2012-10-15 28952, 2012
ianmcorvidae
they already create thumbnails for a variety of formats, *we* don't allow them
2012-10-15 28959, 2012
ianmcorvidae
there's some that don't work, but
2012-10-15 28915, 2012
nikki
we're waiting for the cors thing for pngs
2012-10-15 28932, 2012
nikki
we already told them about gif thumbnails, but haven't heard anything back yet
2012-10-15 28933, 2012
ianmcorvidae
oh? why did we need cors for that?
2012-10-15 28946, 2012
warp
Freso: anyway, add whatever you can think of. We'll sort things into some kind of prioritized list before going to the archive.
2012-10-15 28900, 2012
nikki
because it's easier to do with warp's multi-upload thingy
2012-10-15 28914, 2012
nikki
I think we set the format in the upload page, so the current one makes it tricky to switch, or something like that
2012-10-15 28917, 2012
nikki
I dunno, ask warp :P
2012-10-15 28921, 2012
Freso
warp: Alright. I just noticed Nikki's CORS thing being about PNG, so I guess I don't really have anything to add anyway. :D
2012-10-15 28921, 2012
ianmcorvidae
ah
2012-10-15 28926, 2012
warp
but, sleep now. woosh.
2012-10-15 28914, 2012
ianmcorvidae
ah! my thing is done
2012-10-15 28917, 2012
ianmcorvidae starts upgrade
2012-10-15 28924, 2012
jdamcd joined the channel
2012-10-15 28941, 2012
ianmcorvidae
people doing slave migrations: the URL you'll need to put into upgrade.sh is:
rest of migration/export/etc. still in progress for master, but that makes more of step #3 possible :)
2012-10-15 28947, 2012
ianmcorvidae waits for merge-duplicate-credits, that one always takes a long time
2012-10-15 28940, 2012
ocharles
should only be about 5 minutes?
2012-10-15 28954, 2012
ocharles
ianmcorvidae: thanks, i'm doing a slave migration
2012-10-15 28906, 2012
ianmcorvidae
longer than any of the other scripts :)
2012-10-15 28925, 2012
ocharles
yea
2012-10-15 28932, 2012
ocharles
just making sure it didn't suddenly take half an hour for you
2012-10-15 28939, 2012
ianmcorvidae
the whole migration tends to take about 30 minutes, so no
2012-10-15 28920, 2012
ianmcorvidae
ocharles: __PACKAGE__->meta->make_immutable; doesn't seem to work on Controller::Role::WikipediaExtract, complains about being unable to find make_immutable
2012-10-15 28947, 2012
ianmcorvidae
ocharles: none of our other controller roles have that, seems like maybe it shouldn't be there?
nikki: for some reason the IA never got back to me on the other image types.
2012-10-15 28947, 2012
ruaok
I plan to pester the IA people in person next week
2012-10-15 28957, 2012
ocharles
HEAD is now at 18e31b9... Ensure that the CreateTable scripts use the same column order as what the main database uses, otherwise imports will fail.
2012-10-15 28958, 2012
ocharles
heh.
2012-10-15 28959, 2012
ocharles
great.
2012-10-15 28935, 2012
ianmcorvidae
I imagine that was the reaction when it happened too :P
2012-10-15 28934, 2012
ianmcorvidae noted this complication in the schema change doc, not that it'll necessarily be needed
2012-10-15 28946, 2012
ianmcorvidae
RootWyrm_: if you do a slave import/migration, take note :)
2012-10-15 28948, 2012
ruaok
ok, one import is done.
2012-10-15 28958, 2012
ruaok
what branch should I migrate on?
2012-10-15 28907, 2012
ianmcorvidae
beta.
2012-10-15 28918, 2012
RootWyrm_
ianmcorvidae: of which?
2012-10-15 28924, 2012
ianmcorvidae
master has the same stuff
2012-10-15 28952, 2012
ianmcorvidae
RootWyrm_: if you import the 20121013 dump, make sure to use v-2012-05-15-import-fix, not v-2012-15-15-schema-change
2012-10-15 28900, 2012
ianmcorvidae
otherwise the import will fail
2012-10-15 28908, 2012
ianmcorvidae
as ocharles just discovered
2012-10-15 28922, 2012
RootWyrm_
ianmcorvidae: ah, okay. Huge wall of text plus bad glasses = confusion.
2012-10-15 28944, 2012
ianmcorvidae
whoo, master migration done
2012-10-15 28948, 2012
ocharles
isn't converting a standalone excatly the same as converting a master?
2012-10-15 28958, 2012
ocharles
like master is just a standalone conversion + triggers?
2012-10-15 28902, 2012
ianmcorvidae
no, because of replication stuff
2012-10-15 28915, 2012
ocharles
what 'stuff' is that
2012-10-15 28920, 2012
ianmcorvidae
triggers :)
2012-10-15 28937, 2012
ianmcorvidae
note: artist_idx_uniq_name_comment doesn't work with the 1013 dump.
2012-10-15 28936, 2012
ianmcorvidae will drop that and label_idx_uniq_name_comment and rerun not-null-comments-master; when we test imports of this data we'll need to comment out the index.
2012-10-15 28920, 2012
ruaok
ianmcorvidae: the 1013 dump also cleanly imports on master. was that wrong?
2012-10-15 28932, 2012
ianmcorvidae
no, it imports fine
2012-10-15 28935, 2012
ianmcorvidae
it's the migration that screws it up
2012-10-15 28944, 2012
ianmcorvidae
when null becomes '', then there are duplicate '' comments
2012-10-15 28950, 2012
ruaok
k
2012-10-15 28911, 2012
ianmcorvidae running not-null-comments-master again, then I'll do a data export
2012-10-15 28914, 2012
ruaok
I'm making a copy of my cleanly imported DB. then I will do the standalone with raw and edit migration
2012-10-15 28945, 2012
ianmcorvidae
then I'll turn on ianmcorvidae.mbsandbox.org, collect stats, screw with some cover art, maybe add a release or two, and produce some replication packets :)
2012-10-15 28950, 2012
ianmcorvidae
okay, master fully migrated, doing a full dump
2012-10-15 28957, 2012
ruaok
sounds dirty.
2012-10-15 28907, 2012
ruaok
make sure you light a match when you're done.
2012-10-15 28911, 2012
ianmcorvidae
haha
2012-10-15 28959, 2012
ianmcorvidae
heh, this testing is the hardest work rika has ever had to do
2012-10-15 28906, 2012
ianmcorvidae
the graphs have a nice cliff starting on friday :P
2012-10-15 28914, 2012
reosarevok
Clearly we need to strain it more
2012-10-15 28918, 2012
reosarevok
(normally)
2012-10-15 28929, 2012
ianmcorvidae
yes!
2012-10-15 28958, 2012
ianmcorvidae
ruaok: by the by, the archive.org search for empty buckets is 'collection:coverartarchive AND NOT format:JPEG'
2012-10-15 28911, 2012
ruaok
k
2012-10-15 28915, 2012
ianmcorvidae
currently 45064 entries; some of those have faulty index.json and such
2012-10-15 28941, 2012
ianmcorvidae
er, 45063, forgot the CSV header :P
2012-10-15 28956, 2012
ianmcorvidae
there are other buckets that are functionally worthless that are a lot harder to find (after release merges, no-longer-valid gids retain their cover art; our delete doesn't appear to work)
2012-10-15 28917, 2012
ianmcorvidae
but there are probably at least 2 orders of magnitude fewer of those :P
2012-10-15 28945, 2012
ruaok starts a migration on beta
2012-10-15 28949, 2012
ruaok
(branch beta)
2012-10-15 28921, 2012
ianmcorvidae
yes, that should be correct
2012-10-15 28930, 2012
ianmcorvidae
do you still have {artist,label}_idx_uniq_name_comment?
2012-10-15 28946, 2012
ruaok
I have made no modifications of the code.
2012-10-15 28900, 2012
ruaok
not on import, nor on upgrade.
2012-10-15 28914, 2012
ianmcorvidae
k
2012-10-15 28931, 2012
ianmcorvidae
then one of the scripts will fail, but it won't stop the whole migration
2012-10-15 28954, 2012
ruaok
why is that still there?
2012-10-15 28905, 2012
ruaok
why aren't we just dumping it at this stage?
2012-10-15 28931, 2012
ianmcorvidae
this is the problem which is why I added dropping those indexes and re-adding them afterwards to the migration doc :)
2012-10-15 28954, 2012
ruaok
ianmcorvidae: you're listed as flying to Seattle after BCN. You sure you got the right airport code?
2012-10-15 28913, 2012
ruaok
SEN
2012-10-15 28918, 2012
ianmcorvidae
oh, whoops, no
2012-10-15 28925, 2012
ehrgeiz has left the channel
2012-10-15 28941, 2012
ijabz joined the channel
2012-10-15 28943, 2012
ianmcorvidae
the reservation itself is fine, easyjet doesn't fly to seattle, just screwed up the wiki page
2012-10-15 28953, 2012
ruaok
I figured as much.
2012-10-15 28944, 2012
reosarevok
:D
2012-10-15 28953, 2012
reosarevok
That'd have been fun
2012-10-15 28925, 2012
ianmcorvidae
I think if I'd ended up in seattle I'd have just given up, bought some books at the japanese bookstore, and flown home :P
2012-10-15 28943, 2012
nikki
it would however have been a really cheap flight if you could get from barcelona to seattle :P
2012-10-15 28921, 2012
ianmcorvidae
true
2012-10-15 28944, 2012
ruaok
ianmcorvidae: migration ran/died as expected.
2012-10-15 28955, 2012
reosarevok
kepstin: have you booked'
2012-10-15 28956, 2012
ruaok
just re-run that script now?
2012-10-15 28956, 2012
reosarevok
?
2012-10-15 28921, 2012
ianmcorvidae
ruaok: DROP INDEX artist_idx_uniq_name_comment; DROP INDEX label_idx_uniq_name_comment;
