-
rsh7 has quit
2018-09-21 26419, 2018
-
Zorroness16 joined the channel
2018-09-21 26419, 2018
-
Zorroness16 has quit
2018-09-21 26411, 2018
-
borsin5 joined the channel
2018-09-21 26415, 2018
-
borsin5 has quit
2018-09-21 26453, 2018
-
r2d317 joined the channel
2018-09-21 26453, 2018
-
r2d317 has quit
2018-09-21 26413, 2018
-
stubbers6 joined the channel
2018-09-21 26417, 2018
-
stubbers6 has quit
2018-09-21 26406, 2018
-
Hobbyboy has quit
2018-09-21 26451, 2018
-
Hobbyboy joined the channel
2018-09-21 26418, 2018
-
Leo_Verto_ joined the channel
2018-09-21 26433, 2018
-
Leo_Verto has quit
2018-09-21 26433, 2018
-
Leo_Verto_ is now known as Leo_Verto
2018-09-21 26414, 2018
-
Praematura8 joined the channel
2018-09-21 26418, 2018
-
Praematura8 has quit
2018-09-21 26457, 2018
-
Gore|woerk joined the channel
2018-09-21 26408, 2018
-
G0re has quit
2018-09-21 26432, 2018
-
bass_head joined the channel
2018-09-21 26459, 2018
-
bass_head
i can do such that :)
2018-09-21 26401, 2018
-
bass_head has left the channel
2018-09-21 26434, 2018
-
Gazooo has quit
2018-09-21 26458, 2018
-
Gazooo joined the channel
2018-09-21 26412, 2018
-
demonimin has quit
2018-09-21 26424, 2018
-
Gazooo has quit
2018-09-21 26427, 2018
-
outsidecontext joined the channel
2018-09-21 26416, 2018
-
demonimin joined the channel
2018-09-21 26416, 2018
-
demonimin has quit
2018-09-21 26416, 2018
-
demonimin joined the channel
2018-09-21 26433, 2018
-
github joined the channel
2018-09-21 26433, 2018
-
github
[picard] phw opened pull request #977: i18n: Enable languages with more than 40% translation (master...enable-more-languages)
https://git.io/fA7XF
2018-09-21 26433, 2018
-
github has left the channel
2018-09-21 26402, 2018
-
travis-ci joined the channel
2018-09-21 26403, 2018
-
travis-ci
metabrainz/picard#3777 (master - f108cc7 : Philipp Wolfer): The build passed.
2018-09-21 26403, 2018
-
travis-ci
2018-09-21 26403, 2018
-
travis-ci
2018-09-21 26403, 2018
-
travis-ci has left the channel
2018-09-21 26452, 2018
-
travis-ci joined the channel
2018-09-21 26453, 2018
-
travis-ci
metabrainz/picard#3777 (master - f108cc7 : Philipp Wolfer): The build passed.
2018-09-21 26453, 2018
-
travis-ci
2018-09-21 26453, 2018
-
travis-ci
2018-09-21 26453, 2018
-
travis-ci has left the channel
2018-09-21 26439, 2018
-
Rubennn7 joined the channel
2018-09-21 26440, 2018
-
Rubennn7 has quit
2018-09-21 26413, 2018
-
zas
bitmap, yvanzo: high number of 500s on wetton, ludwig, hip, started on 2018-09-21, 00:30 UTC, i restarted mb ws containers on those
2018-09-21 26430, 2018
-
zas
2018-09-21 26406, 2018
-
zas
ok, now coffee ;)
2018-09-21 26423, 2018
-
rsh7 joined the channel
2018-09-21 26420, 2018
-
flynux29 joined the channel
2018-09-21 26420, 2018
-
flynux29 has quit
2018-09-21 26434, 2018
-
outsidecontext_ joined the channel
2018-09-21 26409, 2018
-
outsidecontext has quit
2018-09-21 26410, 2018
-
outsidecontext_ is now known as outsidecontext
2018-09-21 26424, 2018
-
jesseclay18 joined the channel
2018-09-21 26428, 2018
-
jesseclay18 has quit
2018-09-21 26418, 2018
-
UmkaDK joined the channel
2018-09-21 26420, 2018
-
Jormangeud has quit
2018-09-21 26404, 2018
-
discopatrick joined the channel
2018-09-21 26401, 2018
-
iliekcomputers
2018-09-21 26438, 2018
-
donics24 joined the channel
2018-09-21 26442, 2018
-
donics24 has quit
2018-09-21 26449, 2018
-
ruaok
nom. :)
2018-09-21 26459, 2018
-
JelmerD15 joined the channel
2018-09-21 26400, 2018
-
JelmerD15 has quit
2018-09-21 26407, 2018
-
Nyanko-sensei has quit
2018-09-21 26434, 2018
-
CatQuest
iliekcomputers: what is the blue jelly? (i assume red and yellow strawberry/raspberry and is pineapple/lemon) but what is the blue?
2018-09-21 26443, 2018
-
CatQuest
orwait it's probably blue raspberry :C
2018-09-21 26442, 2018
-
iliekcomputers
ruaok: hey, let's catch up on LB when you want
2018-09-21 26426, 2018
-
ruaok
k, let's do it.
2018-09-21 26419, 2018
-
ruaok
ok, high level view.
2018-09-21 26437, 2018
-
ruaok
stats are broken, we have a messy spotify patch looming and we need to replay some data.
2018-09-21 26450, 2018
-
ruaok
what other short term projects are there?
2018-09-21 26420, 2018
-
zas
can someone bring a video projector for the summit ? It'd be convenient for small presentations
2018-09-21 26424, 2018
-
reosarevok
We had that last year, right? Where did we get it from?
2018-09-21 26438, 2018
-
ruaok does not remember.
2018-09-21 26412, 2018
-
reosarevok
I mean, we definitely had stuff on a screen because I remember Leo_Verto presenting some results
2018-09-21 26416, 2018
-
reosarevok
Unless I'm going mad, that is
2018-09-21 26439, 2018
-
ruaok
I don't dispute that.
2018-09-21 26444, 2018
-
ruaok
I just can't remember.
2018-09-21 26421, 2018
-
reosarevok
But the office itself doesn't have a projector? :)
2018-09-21 26422, 2018
-
Mr_Monkey
I've got one I can bring
2018-09-21 26429, 2018
-
reosarevok
Oh, that makes it easy :)
2018-09-21 26456, 2018
-
chhavi_
Yes and I hope we can live stream too like last year
2018-09-21 26430, 2018
-
zas
Mr_Monkey: perfect
2018-09-21 26415, 2018
-
schlafwandler21 joined the channel
2018-09-21 26415, 2018
-
schlafwandler21 has quit
2018-09-21 26458, 2018
-
iliekcomputers
ruaok: Spotify thing should be deployed first
2018-09-21 26420, 2018
-
kartikeyaSh joined the channel
2018-09-21 26409, 2018
-
iliekcomputers
It's done, we decided on waiting for better logging but i fixed that after the BQ bill...
2018-09-21 26404, 2018
-
iliekcomputers
Other than that, Spark setup is something we should discuss
2018-09-21 26425, 2018
-
ruaok
agreed, I want to get spotify out of the way -- so, do that first.
2018-09-21 26441, 2018
-
ruaok
and yes on spark. I've been trying to wrap my head around what we need to do.
2018-09-21 26401, 2018
-
iliekcomputers
Okay, Spotify on beta for testing
2018-09-21 26439, 2018
-
ruaok
ok, good first step. there were tons of open tickets related to that -- have you churned through all those already?
2018-09-21 26436, 2018
-
iliekcomputers
ruaok: yeah
2018-09-21 26445, 2018
-
ruaok
huh. there is a docker event happening on dec 3 here in BCN.
2018-09-21 26448, 2018
-
iliekcomputers
Most of them were fixed in the main PR
2018-09-21 26455, 2018
-
iliekcomputers
I'll check again once
2018-09-21 26402, 2018
-
ruaok
and apparently my old college roommate is organizing it and just invited me. so odd.
2018-09-21 26428, 2018
-
ruaok
beta testing is going to be.. tricky. I think.
2018-09-21 26454, 2018
-
ruaok
we dont have 'throwaway spotify accounts' and it is a service that needs to keep running.
2018-09-21 26410, 2018
-
pyratebeard24 joined the channel
2018-09-21 26410, 2018
-
ruaok
let me think about a good way to do that, but for now let's move on to spark.
2018-09-21 26426, 2018
-
pyratebeard24 has quit
2018-09-21 26437, 2018
-
iliekcomputers
Okay
2018-09-21 26451, 2018
-
ruaok
so, you reworked the images to include... HDFS support, right?
2018-09-21 26427, 2018
-
iliekcomputers
Was working on that, I'll be done with it soon.
2018-09-21 26431, 2018
-
ruaok
ok.
2018-09-21 26401, 2018
-
ruaok
so, from what I see we need to create a namenode and one or more datanotes to create an HPFS networked file system.
2018-09-21 26417, 2018
-
ruaok
does that live on the same node at spark workers/master?
2018-09-21 26428, 2018
-
ruaok
or do they need separate instances?
2018-09-21 26443, 2018
-
iliekcomputers
I was thinking they'd be on the same nodes
2018-09-21 26444, 2018
-
iliekcomputers
lb is pretty small rn, I'm not sure if keeping seperate nodes for storage is needed.
2018-09-21 26410, 2018
-
ruaok
certainly sounds not too difficult to change.
2018-09-21 26425, 2018
-
ruaok
let's plan on having a master node that has spark master and namenode.
2018-09-21 26432, 2018
-
ruaok
and spark workers that have datanodes.
2018-09-21 26442, 2018
-
ruaok
1-to-1 mapping.
2018-09-21 26447, 2018
-
ruaok
I think that should be a safe starting point.
2018-09-21 26458, 2018
-
iliekcomputers
Okay, sounds good to me.
2018-09-21 26419, 2018
-
ruaok
I've been looking at various project that seem to do this on github. there are about 3 of them, most of them have had zero commits in the last year.
2018-09-21 26435, 2018
-
ruaok
where this is... HDFS in docker.
2018-09-21 26404, 2018
-
ruaok
none seem to be a an out of the box fit -- I think we should take one that looks reasonable fork it and tweak it to our needs.
2018-09-21 26425, 2018
-
ruaok
SSH passwordless access and installing packages and running the nodes seem to be the biggest tasks.
2018-09-21 26459, 2018
-
ruaok
then we need to load and update the LB data into the cluster -- I think those might be two distinct tasks.
2018-09-21 26412, 2018
-
ruaok
finally, then we need to bolt the stats back on top.
2018-09-21 26420, 2018
-
ruaok
once that is working we can get back to the recommendation engine.
2018-09-21 26435, 2018
-
ruaok
that feels like the right path for me, what do you think?
2018-09-21 26415, 2018
-
iliekcomputers
Okay, these steps sound good.
2018-09-21 26454, 2018
-
iliekcomputers
I'd say one to 1.5 weeks for each task should be possible.
2018-09-21 26402, 2018
-
ruaok
I'm looking at my calendar and really... ugh. I doubt I'll have a lot of time to work on this stuff until mid-oct.
2018-09-21 26421, 2018
-
ruaok
summit, beginning of quarter, travel.
2018-09-21 26452, 2018
-
iliekcomputers
Right. Forgot about the travel
2018-09-21 26453, 2018
-
ruaok
maybe on friday we could spend some time working on this stuff together.
2018-09-21 26411, 2018
-
iliekcomputers
Okay
2018-09-21 26413, 2018
-
ruaok
like getting a HDFS cluster up and running.
2018-09-21 26446, 2018
-
iliekcomputers
Sounds really good
2018-09-21 26419, 2018
-
iliekcomputers
I'll hack on the Dockerfile in the meanwhile
2018-09-21 26427, 2018
-
iliekcomputers
And see what needs to be done with spotify
2018-09-21 26410, 2018
-
ruaok
ok, sounds good.
2018-09-21 26403, 2018
-
ruaok
2018-09-21 26421, 2018
-
ruaok
2018-09-21 26437, 2018
-
ruaok
there was another, but I think the latter one looks like a decent starting point.
2018-09-21 26430, 2018
-
iliekcomputers
Okay, I've seen the first one. I'll look into the second one.
2018-09-21 26438, 2018
-
bukwurm joined the channel
2018-09-21 26416, 2018
-
UmkaDK has quit
2018-09-21 26458, 2018
-
UmkaDK joined the channel
2018-09-21 26411, 2018
-
alastairp
ruaok: hi, does spike have a domain name?
2018-09-21 26433, 2018
-
PuercoPop joined the channel
2018-09-21 26434, 2018
-
PuercoPop has quit
2018-09-21 26410, 2018
-
ruaok
