but they accepted it. then realized they accepted something that was incomplete.
then they GUESSED and sent it out.
they should've rejected it.
nikki
tsk
ianmcorvidae
both, then :P
ruaok
and really, if you guess are you going to send GBP to UK or the EU?
nikki
what's the difference? it's all weird foreign shit :P
ocharles
haha
everyone knows the UK loves the EU
nikki
probably canadian! :P
ruaok
seems freaking obvious to me, but then again I can tell the difference between two countries.
ocharles
so obviously you'd send the UK euros
ruaok
LOL. yes, canadian!
ianmcorvidae: wrt to the replication roll up stuff.
ianmcorvidae
canadian euros!
and, yes? XD
warp
ruaok: haha, brilliant.
ruaok
it should not just be a tarball of the other replication packets.
ianmcorvidae
okay
that's what I figured, but the concern is then we're generating really huge replication packets, and hit our existing performance problems with replication
ruaok
every 24 hours we should take all the replication packets from the last 24 hours, concatenate the files in them and make a new -daily packet.
ianmcorvidae
so I guess I should also be looking into being smarter about that?
ruaok
and once again on every 24 * 7 to make a -weekly packet.
actually, the really huge replication packets for the time delayed feeds are fine.
its a sliding scale of timeliness and convenience.
the cheaper options are harder on the consumer.
the more expensive ones are easier.
ianmcorvidae
fair enough
ruaok
so on the LoadReplicationPackets scheme we should have a -hourly -daily and -weekly flags.
-a
ianmcorvidae
so I guess the code I'd need to write is the code to roll together packets, to calculate which ones to roll together, and updates to the replication scripts to deal with one packet jumping several numbers in the sequence
ruaok
sounds about right.
ianmcorvidae
possibly also migration measures like "give me hourly packets until I'm at a day boundary so I can switch to daily packets"?
ruaok
yes, good thought!
ianmcorvidae
LoadReplicationChanges already has a --limit option, but making people figure out how many they need seems like unnecessary work to impose :)
nikki
presumably it should default to hourly to not break existing stuff :P
ruaok
nikki: yes.
ianmcorvidae
yeah, for sure
ruaok
but we need the ability for users to specify which feed to use.
somehow.
nikki
yeah, I was just saying/confirming 'cause you listed all three as flags
ruaok
warp: is the json ws live yet?
warp
ruaok: no, only for labels I think.
ijabz
ruaok:reminds me we need to do a simple release for search server, to provide the search server json part
ruaok
warp: ok.
ijabz
however there is one piece of work on relations that I need to do first
ruaok
ijabz: ok.
early next week acceptable for that ijabz ?
warp
ruaok: I have shippits from ian, but I'd like to get approval from oliver as well.
ruaok
ok.
warp
ocharles: poke. can you look at the json webservice reviews? :)
ruaok
once that is done I can finish the "rss" stuff.
ijabz
I'll try and get it done for then yes
ruaok
dont rush on my account.
ijabz
warp as I understand it , this json release is going to be 'this is the json, but it may change a bit if users find problems with it, right ?'
ruaok
everything in my life is a mess right now and will take me some time to straighten out.
ijabz
right :(
warp
ijabz: yes, I think we should allow some time for people using it in production to give feedback. I expect we'll find a few bugs and things which can be improved.
ijabz
yeah, agreed
warp
ijabz: and then in a few weeks or months, depending on feedback, we'll mark and announce it as stable.
ocharles
warp: not until monday, but I can then
warp: might be worth renaming the ticket you're fixing to 'preliminary JSON support' or something, to clarify the release notes
Leftmost joined the channel
Leftmost joined the channel
ianmcorvidae
ruaok: btw, two other things we should do at some point: a.) schedule the wiki switchover, probably a blog post telling people it'll be read-only for a bit would be good
ruaok: and b.) I'd like to catch up with you re: the sysadmin stuff for the paid WS, but that's on no real schedule since I still need to come more fully to grips with the varnish setup/the VCL/etc. before it's actionable
dsteiner
does anyone here have a valid iswc so i can test my lookup
ianmcorvidae: re: wiki switchover. yep, a blog post would be good.
when do you want to do that?
ianmcorvidae
I'm up for whenever, really, as early as tomorrow :)
I don't know how much advance warning we want to give
CallerNo6 's ears prik up
ruaok
tomorrow is a bit scattered for me.
how much time do you think this project will take?
ianmcorvidae
most of the time is running the database upgrade script, which takes a couple hours
(since we're upgrading something like 11 major versions at once)
ruaok
how much of my attention do you need?
ianmcorvidae
probably almost none -- I'll need you at the end for doing the nginx switchover and some sanity-checking
ruaok looks at his schedule.
mostly just want you around in case something goes sour, but the past two imports on perry have gone without a hitch
doesn't *need* to be tomorrow, either, that's just the earliest it can happen :)
CallerNo6: http://wikiport.musicbrainz.org <-- that's what the new wiki will look like, after we do the switchover; will take a couple hours of read-only wiki but that's no huge deal :)
ruaok
I'm free from 5pm to 6:30pm pacific tomorrow.
is AZ the same as PDT right now?
ianmcorvidae
yeah, it is
ruaok
k
ianmcorvidae
so maybe I'll start the process tomorrow around 3:30 or 4 so the end is within your availability?
ruaok
so, what if we start the data conversion at 3:30pm tomorrow.
ianmcorvidae
hah
ruaok
ha. :)
ianmcorvidae
same wavelength
sounds good.
ruaok
k, want me to post a blog entry?
ianmcorvidae
I can do that, should be quick
ruaok
ok. sounds good.
I will appear starting at 5pm. I'll be around in the morning too, but lunch -> 5pm will be dicey.
ianmcorvidae
okay
ruaok
ok, in the calendar.
ianmcorvidae
worst that happens is the wiki's read-only a bit longer or we say fuck it and use wiley for a bit longer
ruaok
k
ok, on to point b.
catching up on the paid WS.
what loose ends do you have for that?
ianmcorvidae
mainly what I want to know is what sysadmin-y things need doing other than setting up the VCL and varnish itself
ruaok hands over a pile of threads, some chewed and barfed on by cats
I know there was some stuff in the ratelimiter, obviously
I don't know everything we were hoping to launch off with -- I guess just the no-waiting one to start, though
ruaok
yes, the ratelimiter is the tricky portion.
ianmcorvidae
basically I just want a picture of what needs doing between where we are and when we can start getting people paying us :)
ruaok
:-)
you've gotten all the info from ocharles on this, right?
I think the next thing to do is to have a discussion with djce.
he's had some thoughts and was going to run off an do some ratelimiter things.
ianmcorvidae
yeah; I have the VCL and such which I need to play with (and my own 3scale account to do that with)
ruaok
we need to see where he is at and if he has anything to pass off to you.
ianmcorvidae
that sounds like it could be right
ruaok
ok, so the next time the three of us are here, lets chat.
ianmcorvidae
sounds good
ruaok
I'm really glad you're going to own this an drag it across the finish line.
so. long. overdue.
ianmcorvidae
heh
ruaok
the next project I need to kick off is the MB showcase.
ianmcorvidae
helps that more money means more chance I get to keep my job ;)
ruaok
we need to find everyone who is using MB and make a list of how and what they do.
ianmcorvidae: :)
and then start shaking them down for money.
afterall we seem to have 2M inbound links. that is "monetizable", right?