but they accepted it. then realized they accepted something that was incomplete.
2012-09-06 25023, 2012
ruaok
then they GUESSED and sent it out.
2012-09-06 25029, 2012
ruaok
they should've rejected it.
2012-09-06 25033, 2012
nikki
tsk
2012-09-06 25042, 2012
ianmcorvidae
both, then :P
2012-09-06 25051, 2012
ruaok
and really, if you guess are you going to send GBP to UK or the EU?
2012-09-06 25010, 2012
nikki
what's the difference? it's all weird foreign shit :P
2012-09-06 25011, 2012
ocharles
haha
2012-09-06 25022, 2012
ocharles
everyone knows the UK loves the EU
2012-09-06 25023, 2012
nikki
probably canadian! :P
2012-09-06 25025, 2012
ruaok
seems freaking obvious to me, but then again I can tell the difference between two countries.
2012-09-06 25031, 2012
ocharles
so obviously you'd send the UK euros
2012-09-06 25034, 2012
ruaok
LOL. yes, canadian!
2012-09-06 25045, 2012
ruaok
ianmcorvidae: wrt to the replication roll up stuff.
2012-09-06 25005, 2012
ianmcorvidae
canadian euros!
2012-09-06 25009, 2012
ianmcorvidae
and, yes? XD
2012-09-06 25019, 2012
warp
ruaok: haha, brilliant.
2012-09-06 25046, 2012
ruaok
it should not just be a tarball of the other replication packets.
2012-09-06 25052, 2012
ianmcorvidae
okay
2012-09-06 25014, 2012
ianmcorvidae
that's what I figured, but the concern is then we're generating really huge replication packets, and hit our existing performance problems with replication
2012-09-06 25022, 2012
ruaok
every 24 hours we should take all the replication packets from the last 24 hours, concatenate the files in them and make a new -daily packet.
2012-09-06 25023, 2012
ianmcorvidae
so I guess I should also be looking into being smarter about that?
2012-09-06 25038, 2012
ruaok
and once again on every 24 * 7 to make a -weekly packet.
2012-09-06 25025, 2012
ruaok
actually, the really huge replication packets for the time delayed feeds are fine.
2012-09-06 25044, 2012
ruaok
its a sliding scale of timeliness and convenience.
2012-09-06 25057, 2012
ruaok
the cheaper options are harder on the consumer.
2012-09-06 25004, 2012
ruaok
the more expensive ones are easier.
2012-09-06 25029, 2012
ianmcorvidae
fair enough
2012-09-06 25007, 2012
ruaok
so on the LoadReplicationPackets scheme we should have a -hourly -daily and -weekly flags.
2012-09-06 25018, 2012
ruaok
-a
2012-09-06 25032, 2012
ianmcorvidae
so I guess the code I'd need to write is the code to roll together packets, to calculate which ones to roll together, and updates to the replication scripts to deal with one packet jumping several numbers in the sequence
2012-09-06 25005, 2012
ruaok
sounds about right.
2012-09-06 25005, 2012
ianmcorvidae
possibly also migration measures like "give me hourly packets until I'm at a day boundary so I can switch to daily packets"?
2012-09-06 25022, 2012
ruaok
yes, good thought!
2012-09-06 25031, 2012
ianmcorvidae
LoadReplicationChanges already has a --limit option, but making people figure out how many they need seems like unnecessary work to impose :)
2012-09-06 25046, 2012
nikki
presumably it should default to hourly to not break existing stuff :P
2012-09-06 25051, 2012
ruaok
nikki: yes.
2012-09-06 25057, 2012
ianmcorvidae
yeah, for sure
2012-09-06 25011, 2012
ruaok
but we need the ability for users to specify which feed to use.
2012-09-06 25020, 2012
ruaok
somehow.
2012-09-06 25055, 2012
nikki
yeah, I was just saying/confirming 'cause you listed all three as flags
2012-09-06 25015, 2012
ruaok
warp: is the json ws live yet?
2012-09-06 25006, 2012
warp
ruaok: no, only for labels I think.
2012-09-06 25015, 2012
ijabz
ruaok:reminds me we need to do a simple release for search server, to provide the search server json part
2012-09-06 25031, 2012
ruaok
warp: ok.
2012-09-06 25037, 2012
ijabz
however there is one piece of work on relations that I need to do first
2012-09-06 25040, 2012
ruaok
ijabz: ok.
2012-09-06 25047, 2012
ruaok
early next week acceptable for that ijabz ?
2012-09-06 25053, 2012
warp
ruaok: I have shippits from ian, but I'd like to get approval from oliver as well.
2012-09-06 25059, 2012
ruaok
ok.
2012-09-06 25008, 2012
warp
ocharles: poke. can you look at the json webservice reviews? :)
2012-09-06 25008, 2012
ruaok
once that is done I can finish the "rss" stuff.
2012-09-06 25023, 2012
ijabz
I'll try and get it done for then yes
2012-09-06 25024, 2012
ruaok
dont rush on my account.
2012-09-06 25026, 2012
ijabz
warp as I understand it , this json release is going to be 'this is the json, but it may change a bit if users find problems with it, right ?'
2012-09-06 25039, 2012
ruaok
everything in my life is a mess right now and will take me some time to straighten out.
2012-09-06 25058, 2012
ijabz
right :(
2012-09-06 25037, 2012
warp
ijabz: yes, I think we should allow some time for people using it in production to give feedback. I expect we'll find a few bugs and things which can be improved.
2012-09-06 25051, 2012
ijabz
yeah, agreed
2012-09-06 25035, 2012
warp
ijabz: and then in a few weeks or months, depending on feedback, we'll mark and announce it as stable.
2012-09-06 25010, 2012
ocharles
warp: not until monday, but I can then
2012-09-06 25056, 2012
ocharles
warp: might be worth renaming the ticket you're fixing to 'preliminary JSON support' or something, to clarify the release notes
2012-09-06 25051, 2012
Leftmost joined the channel
2012-09-06 25052, 2012
Leftmost joined the channel
2012-09-06 25041, 2012
ianmcorvidae
ruaok: btw, two other things we should do at some point: a.) schedule the wiki switchover, probably a blog post telling people it'll be read-only for a bit would be good
2012-09-06 25022, 2012
ianmcorvidae
ruaok: and b.) I'd like to catch up with you re: the sysadmin stuff for the paid WS, but that's on no real schedule since I still need to come more fully to grips with the varnish setup/the VCL/etc. before it's actionable
2012-09-06 25033, 2012
dsteiner
does anyone here have a valid iswc so i can test my lookup
ianmcorvidae: re: wiki switchover. yep, a blog post would be good.
2012-09-06 25035, 2012
ruaok
when do you want to do that?
2012-09-06 25010, 2012
ianmcorvidae
I'm up for whenever, really, as early as tomorrow :)
2012-09-06 25020, 2012
ianmcorvidae
I don't know how much advance warning we want to give
2012-09-06 25035, 2012
CallerNo6 's ears prik up
2012-09-06 25039, 2012
ruaok
tomorrow is a bit scattered for me.
2012-09-06 25047, 2012
ruaok
how much time do you think this project will take?
2012-09-06 25007, 2012
ianmcorvidae
most of the time is running the database upgrade script, which takes a couple hours
2012-09-06 25020, 2012
ianmcorvidae
(since we're upgrading something like 11 major versions at once)
2012-09-06 25026, 2012
ruaok
how much of my attention do you need?
2012-09-06 25000, 2012
ianmcorvidae
probably almost none -- I'll need you at the end for doing the nginx switchover and some sanity-checking
2012-09-06 25033, 2012
ruaok looks at his schedule.
2012-09-06 25050, 2012
ianmcorvidae
mostly just want you around in case something goes sour, but the past two imports on perry have gone without a hitch
2012-09-06 25006, 2012
ianmcorvidae
doesn't *need* to be tomorrow, either, that's just the earliest it can happen :)
2012-09-06 25032, 2012
ianmcorvidae
CallerNo6: http://wikiport.musicbrainz.org <-- that's what the new wiki will look like, after we do the switchover; will take a couple hours of read-only wiki but that's no huge deal :)
2012-09-06 25011, 2012
ruaok
I'm free from 5pm to 6:30pm pacific tomorrow.
2012-09-06 25021, 2012
ruaok
is AZ the same as PDT right now?
2012-09-06 25026, 2012
ianmcorvidae
yeah, it is
2012-09-06 25029, 2012
ruaok
k
2012-09-06 25003, 2012
ianmcorvidae
so maybe I'll start the process tomorrow around 3:30 or 4 so the end is within your availability?
2012-09-06 25006, 2012
ruaok
so, what if we start the data conversion at 3:30pm tomorrow.
2012-09-06 25009, 2012
ianmcorvidae
hah
2012-09-06 25011, 2012
ruaok
ha. :)
2012-09-06 25013, 2012
ianmcorvidae
same wavelength
2012-09-06 25014, 2012
ianmcorvidae
sounds good.
2012-09-06 25023, 2012
ruaok
k, want me to post a blog entry?
2012-09-06 25030, 2012
ianmcorvidae
I can do that, should be quick
2012-09-06 25034, 2012
ruaok
ok. sounds good.
2012-09-06 25053, 2012
ruaok
I will appear starting at 5pm. I'll be around in the morning too, but lunch -> 5pm will be dicey.
2012-09-06 25009, 2012
ianmcorvidae
okay
2012-09-06 25027, 2012
ruaok
ok, in the calendar.
2012-09-06 25027, 2012
ianmcorvidae
worst that happens is the wiki's read-only a bit longer or we say fuck it and use wiley for a bit longer
2012-09-06 25033, 2012
ruaok
k
2012-09-06 25049, 2012
ruaok
ok, on to point b.
2012-09-06 25055, 2012
ruaok
catching up on the paid WS.
2012-09-06 25006, 2012
ruaok
what loose ends do you have for that?
2012-09-06 25024, 2012
ianmcorvidae
mainly what I want to know is what sysadmin-y things need doing other than setting up the VCL and varnish itself
2012-09-06 25025, 2012
ruaok hands over a pile of threads, some chewed and barfed on by cats
2012-09-06 25041, 2012
ianmcorvidae
I know there was some stuff in the ratelimiter, obviously
2012-09-06 25054, 2012
ianmcorvidae
I don't know everything we were hoping to launch off with -- I guess just the no-waiting one to start, though
2012-09-06 25003, 2012
ruaok
yes, the ratelimiter is the tricky portion.
2012-09-06 25021, 2012
ianmcorvidae
basically I just want a picture of what needs doing between where we are and when we can start getting people paying us :)
2012-09-06 25028, 2012
ruaok
:-)
2012-09-06 25044, 2012
ruaok
you've gotten all the info from ocharles on this, right?
2012-09-06 25054, 2012
ruaok
I think the next thing to do is to have a discussion with djce.
2012-09-06 25009, 2012
ruaok
he's had some thoughts and was going to run off an do some ratelimiter things.
2012-09-06 25010, 2012
ianmcorvidae
yeah; I have the VCL and such which I need to play with (and my own 3scale account to do that with)
2012-09-06 25025, 2012
ruaok
we need to see where he is at and if he has anything to pass off to you.
2012-09-06 25026, 2012
ianmcorvidae
that sounds like it could be right
2012-09-06 25040, 2012
ruaok
ok, so the next time the three of us are here, lets chat.
2012-09-06 25047, 2012
ianmcorvidae
sounds good
2012-09-06 25008, 2012
ruaok
I'm really glad you're going to own this an drag it across the finish line.
2012-09-06 25013, 2012
ruaok
so. long. overdue.
2012-09-06 25011, 2012
ianmcorvidae
heh
2012-09-06 25040, 2012
ruaok
the next project I need to kick off is the MB showcase.
2012-09-06 25042, 2012
ianmcorvidae
helps that more money means more chance I get to keep my job ;)
2012-09-06 25055, 2012
ruaok
we need to find everyone who is using MB and make a list of how and what they do.
2012-09-06 25000, 2012
ruaok
ianmcorvidae: :)
2012-09-06 25010, 2012
ruaok
and then start shaking them down for money.
2012-09-06 25030, 2012
ruaok
afterall we seem to have 2M inbound links. that is "monetizable", right?
