13:24 PM
pbnoxious has quit
2017-06-20 17118, 2017
13:25 PM
ruaok
k
2017-06-20 17130, 2017
13:25 PM
ruaok
same outright replamcement.
2017-06-20 17105, 2017
13:29 PM
modwizcode has quit
2017-06-20 17122, 2017
13:29 PM
ruaok
sent
2017-06-20 17159, 2017
13:29 PM
modwizcode joined the channel
2017-06-20 17152, 2017
13:34 PM
D4RK-PH0ENiX joined the channel
2017-06-20 17113, 2017
14:21 PM
suhas2go joined the channel
2017-06-20 17139, 2017
14:32 PM
support joined the channel
2017-06-20 17147, 2017
14:32 PM
support has quit
2017-06-20 17108, 2017
14:48 PM
Slurpee joined the channel
2017-06-20 17108, 2017
14:48 PM
Slurpee has quit
2017-06-20 17108, 2017
14:48 PM
Slurpee joined the channel
2017-06-20 17147, 2017
14:49 PM
ruaok
cage replaced, zas.
2017-06-20 17102, 2017
14:51 PM
ruaok
root passwd in hetzner group
2017-06-20 17124, 2017
15:14 PM
alastairp
2017-06-20 17116, 2017
15:15 PM
alastairp
oh wait, this is the deezer guy :)
2017-06-20 17115, 2017
15:16 PM
ruaok
2017-06-20 17121, 2017
15:16 PM
ruaok
I know you have some thoughts on this one.
2017-06-20 17125, 2017
15:16 PM
Quesito
hmm. well his projects are for the moment his own --from my understnding --however yes. what ruaok said...
2017-06-20 17137, 2017
15:17 PM
alastairp
ruaok: interesting
2017-06-20 17150, 2017
15:17 PM
alastairp
isn't there a minimum song length in last.fm?
2017-06-20 17156, 2017
15:17 PM
alastairp
might help us define the threshold
2017-06-20 17120, 2017
15:18 PM
ruaok
I don't know.
2017-06-20 17121, 2017
15:18 PM
Clint
audioscrobbler protocol forbids submitting a track <30s
2017-06-20 17142, 2017
15:18 PM
ruaok
Clint: ah, that is very helpful.
2017-06-20 17112, 2017
15:19 PM
alastairp
yeah, that's what I was thinking of
2017-06-20 17123, 2017
15:19 PM
Clint
actually <=30s
2017-06-20 17137, 2017
15:19 PM
Clint
2017-06-20 17151, 2017
15:19 PM
alastairp
ruaok: what about approaching this from a different direction
2017-06-20 17109, 2017
15:20 PM
alastairp
because there's a huge amount of effort going into supporting these people on alpha
2017-06-20 17131, 2017
15:20 PM
alastairp
- if you import from last.fm, you're not allowed to import from alpha. ever
2017-06-20 17154, 2017
15:20 PM
ruaok
what is your motivation/reservation for suggesting this?
2017-06-20 17112, 2017
15:21 PM
alastairp
I guess trying to make things easier for us :)
2017-06-20 17115, 2017
15:21 PM
ruaok
I thought was to put this in place long enoughfor people to import from alpha, then get rid of it.
2017-06-20 17128, 2017
15:21 PM
ruaok
well, yes.
2017-06-20 17138, 2017
15:21 PM
ruaok
great idea, but now we have working code, thanks to iliekcomputers
2017-06-20 17100, 2017
15:22 PM
ruaok
if this code works for the time being, in 3 months we can nuke alpha and then this code.
2017-06-20 17102, 2017
15:22 PM
alastairp
do we have code in the lastfm importer to only import stuff scrobbled since the last time data was added to our account?
2017-06-20 17110, 2017
15:22 PM
ruaok
not yet, no.
2017-06-20 17122, 2017
15:22 PM
ruaok
ideally, I would like to hold off on that since that is a new feature.
2017-06-20 17127, 2017
15:22 PM
alastairp
(that's another solution to work around the bad data in alpha. OK, let's go with the patch since we have code)
2017-06-20 17139, 2017
15:22 PM
ruaok
we're still trying to get to a stable/scalable feature parity with alpha.
2017-06-20 17101, 2017
15:23 PM
ruaok
got a moment to review the PR?
2017-06-20 17108, 2017
15:23 PM
ruaok
easier than my counting one.
2017-06-20 17109, 2017
15:23 PM
alastairp
yes, looking at it now
2017-06-20 17116, 2017
15:23 PM
ruaok
woo
2017-06-20 17127, 2017
15:23 PM
alastairp
min_time = users[user_name]['min_time']
2017-06-20 17134, 2017
15:23 PM
alastairp
what is min_time ?
2017-06-20 17159, 2017
15:23 PM
ruaok
unfold the code immediately above that segment.
2017-06-20 17100, 2017
15:24 PM
alastairp
OK. users is a dict, because a bulk add can be many users?
2017-06-20 17107, 2017
15:24 PM
ruaok
yes.
2017-06-20 17122, 2017
15:24 PM
alastairp
and each username is a list of listens, plus the boundary timestamps of the oldest and newest listen
2017-06-20 17127, 2017
15:24 PM
ruaok
we never make a guarantee about what is in a batch from rabbitmq.
2017-06-20 17133, 2017
15:24 PM
ruaok
ding
2017-06-20 17101, 2017
15:26 PM
alastairp
then for each user, you get all listens that fall within that range, and... only import the ones which didn't get returned?
2017-06-20 17109, 2017
15:26 PM
alastairp
after doing some filtering for fuzzy timestamps
2017-06-20 17126, 2017
15:26 PM
alastairp
does this importer know if these items are from alpha or from last.fm?
2017-06-20 17138, 2017
15:26 PM
alastairp
because it'd be nice to replace bad->good timestamps
2017-06-20 17141, 2017
15:26 PM
ruaok
it does not attempt to know.
2017-06-20 17142, 2017
15:26 PM
alastairp
(yes yes, new feature)
2017-06-20 17155, 2017
15:26 PM
ruaok
oh, that is a great observation.
2017-06-20 17100, 2017
15:27 PM
ruaok
but....
2017-06-20 17102, 2017
15:27 PM
ruaok
:(
2017-06-20 17107, 2017
15:27 PM
ruaok
updates to influx/bigquery
2017-06-20 17115, 2017
15:27 PM
alastairp
feh
2017-06-20 17118, 2017
15:27 PM
ruaok
yeah.
2017-06-20 17139, 2017
15:27 PM
alastairp
I still vote we get a really long stick and smack around the people who put real data in alpha
2017-06-20 17101, 2017
15:28 PM
ruaok
one of the things I want to do is to make it clear that people should only use the alpha importer if they submitted new listens not already in last.fm
2017-06-20 17109, 2017
15:28 PM
alastairp
yeah
2017-06-20 17120, 2017
15:28 PM
ruaok
ocharles is in the UK. I got sticks long enough for htat.
2017-06-20 17148, 2017
15:28 PM
ruaok
but I think iliekcomputers' PR is "good enough"
2017-06-20 17157, 2017
15:28 PM
ruaok
to cover for the numpties in the world.
2017-06-20 17106, 2017
15:30 PM
alastairp
the comments on the code seem reasonable, but it's too late in the day to verify the logic of the actual timestamp diff sweeper
2017-06-20 17137, 2017
15:30 PM
ruaok
I'm happy enough with it to deploy to beta and then to engage ocharles for a real world test.
2017-06-20 17130, 2017
15:31 PM
alastairp
2017-06-20 17135, 2017
15:31 PM
alastairp
what are all those 0000s in the timestamp?
2017-06-20 17142, 2017
15:31 PM
ruaok
influx nonsense.
2017-06-20 17148, 2017
15:31 PM
alastairp
😞(
2017-06-20 17154, 2017
15:31 PM
ruaok
influx timestamps have to be in NANOseconds.
2017-06-20 17121, 2017
15:32 PM
ruaok
unless you can specify the time precision, but that isn't possible in a lot of places.
2017-06-20 17136, 2017
15:32 PM
ruaok
and this appending 8 "0" is found in a lot of example code.
2017-06-20 17101, 2017
15:33 PM
ruaok
> do we do stuff with dates in this format from influx often? If so, it'd be nice to have this abstracted away somewhere
2017-06-20 17112, 2017
15:33 PM
ruaok
that is a fair comment, but I'll make a bug for it for later.
2017-06-20 17118, 2017
15:33 PM
alastairp
yeah, of course
2017-06-20 17124, 2017
15:33 PM
alastairp
I just added another "later" comment
2017-06-20 17129, 2017
15:33 PM
ruaok
saw it.
2017-06-20 17146, 2017
15:33 PM
ruaok
I'm just aggressively trying to get to beta now.
2017-06-20 17141, 2017
15:36 PM
ruaok
LB-178
2017-06-20 17141, 2017
15:36 PM
BrainzBot
2017-06-20 17138, 2017
15:37 PM
ruaok
!m Quesito
2017-06-20 17138, 2017
15:37 PM
BrainzBot
You're doing good work, Quesito!
2017-06-20 17123, 2017
15:38 PM
ruaok
> creating deltas is left as an exercise to the reader
2017-06-20 17135, 2017
15:38 PM
ruaok
alastairp: do we need to do an "academic intervention"?
2017-06-20 17129, 2017
15:39 PM
alastairp
send me a proposal document, and I'll tell you if I agree with it
2017-06-20 17148, 2017
15:39 PM
ruaok
with a guaranteed turn around of time 6 weeks.
2017-06-20 17105, 2017
15:40 PM
alastairp
optimistic!
2017-06-20 17123, 2017
15:40 PM
alastairp
yeah, the code looks good in general, except artist_msid is optional
2017-06-20 17126, 2017
15:40 PM
alastairp
hmm
2017-06-20 17135, 2017
15:40 PM
alastairp
*mbids* are optional
2017-06-20 17139, 2017
15:40 PM
alastairp
will we always have an msid?
2017-06-20 17150, 2017
15:40 PM
ruaok
I don't recall.
2017-06-20 17102, 2017
15:41 PM
alastairp
artist_name is required
2017-06-20 17105, 2017
15:41 PM
ruaok
quite frankly we've done a poor job documenting what is required and what is not.
2017-06-20 17112, 2017
15:41 PM
alastairp
so we'll have an msid
2017-06-20 17129, 2017
15:41 PM
mat_ has quit
2017-06-20 17139, 2017
15:41 PM
ruaok
hmm, ok, now I'm going to dig to see where my confusion comes from
2017-06-20 17113, 2017
15:42 PM
alastairp
so, the contents of an object in influx is different to the stuff that is sent by a client
2017-06-20 17123, 2017
15:42 PM
alastairp
because it contains msids
2017-06-20 17151, 2017
15:42 PM
mat_ joined the channel
2017-06-20 17151, 2017
15:42 PM
mat_ has quit
2017-06-20 17151, 2017
15:42 PM
mat_ joined the channel
2017-06-20 17123, 2017
15:43 PM
ruaok
yes and it is flattened as well.
2017-06-20 17138, 2017
15:43 PM
ruaok
2017-06-20 17147, 2017
15:43 PM
ruaok
artist_msid is required.
2017-06-20 17105, 2017
15:44 PM
hernantz has quit
2017-06-20 17118, 2017
15:45 PM
ruaok
thanks alastairp
2017-06-20 17123, 2017
15:45 PM
alastairp
👍
2017-06-20 17103, 2017
15:47 PM
Quesito
ruaok: technically I lied. I have a heart of cheese.
2017-06-20 17108, 2017
15:47 PM
Quesito
:D
2017-06-20 17119, 2017
15:47 PM
ruaok
far better.
2017-06-20 17123, 2017
15:47 PM
ruaok
can't eat gold.
2017-06-20 17113, 2017
15:49 PM
hernantz joined the channel
2017-06-20 17120, 2017
15:49 PM
Quesito
ruaok: is last bizdev email legit?
2017-06-20 17112, 2017
15:51 PM
Sophist_UK has quit
2017-06-20 17102, 2017
15:57 PM
Sophist-UK joined the channel
2017-06-20 17126, 2017
15:57 PM
Quesito
si
2017-06-20 17147, 2017
15:58 PM
Sophist-UK has quit
2017-06-20 17100, 2017
15:59 PM
ruaok
yeah, seems quite on the up and up.
2017-06-20 17112, 2017
15:59 PM
Sophist-UK joined the channel
2017-06-20 17116, 2017
15:59 PM
ruaok
being open source and for/non-profit are two different things.
2017-06-20 17124, 2017
15:59 PM
ruaok
you can be open source and for profit.
2017-06-20 17140, 2017
15:59 PM
ruaok
and that is what they are trying to do, which is fine.
2017-06-20 17106, 2017
16:01 PM
Quesito
right on
2017-06-20 17153, 2017
16:05 PM
saifulbkhan joined the channel
2017-06-20 17148, 2017
16:14 PM
Sophist-UK has quit
2017-06-20 17115, 2017
16:15 PM
Sophist-UK joined the channel
2017-06-20 17134, 2017
16:15 PM
Protab joined the channel
2017-06-20 17135, 2017
16:15 PM
Rotab has quit
2017-06-20 17158, 2017
16:27 PM
saifulbkhan has quit
2017-06-20 17148, 2017
16:30 PM
Mycah has quit
2017-06-20 17112, 2017
16:34 PM
saifulbkhan joined the channel
2017-06-20 17134, 2017
16:41 PM
lazka joined the channel
2017-06-20 17126, 2017
16:45 PM
dpmittal joined the channel
2017-06-20 17134, 2017
16:47 PM
lazka has quit
2017-06-20 17104, 2017
16:48 PM
Guest61528
Gentlecat: ping
2017-06-20 17146, 2017
17:07 PM
ladyfrid1y is now known as ladyfriday
2017-06-20 17154, 2017
17:07 PM
ladyfriday has quit
2017-06-20 17100, 2017
17:08 PM
ladyfriday joined the channel
2017-06-20 17143, 2017
17:08 PM
saifulbkhan has quit
