15:27 PM
MajorLurker has quit
2020-07-23 20533, 2020
15:27 PM
alastairp
oh, sure!
2020-07-23 20550, 2020
15:27 PM
alastairp
of course, if you're evaluating on everything that you trained on I would hope that you get 100% ;)
2020-07-23 20506, 2020
15:28 PM
jmp_music_
2020-07-23 20550, 2020
15:28 PM
jmp_music_
this is the evaluation of fitting and predicting to the whole amount of thedanceability's data collection
2020-07-23 20504, 2020
15:29 PM
jmp_music_
data collection --> dataset
2020-07-23 20521, 2020
15:29 PM
alastairp
yeah, understood
2020-07-23 20526, 2020
15:29 PM
jmp_music_
I'm trying now to see what I can do with gaia
2020-07-23 20547, 2020
15:29 PM
sumedh has quit
2020-07-23 20502, 2020
15:30 PM
jmp_music_
you said before: `replace this with just a single item pointing to the history file`
2020-07-23 20521, 2020
15:30 PM
jmp_music_
you mean something like that, right?
2020-07-23 20530, 2020
15:30 PM
jmp_music_
2020-07-23 20504, 2020
15:31 PM
jmp_music_
i made a code directory inside the data dir of AB, and I put the file there
2020-07-23 20512, 2020
15:31 PM
alastairp
right
2020-07-23 20538, 2020
15:31 PM
sumedh joined the channel
2020-07-23 20545, 2020
15:31 PM
jmp_music_
and by saying `add anything you want to the 2 items under mergeValues`
2020-07-23 20545, 2020
15:31 PM
alastairp
so, `svm_models: [ /data/svm_models/voice_instrumental.history, /code/data/jmp_results_danceability ]`
2020-07-23 20556, 2020
15:31 PM
jmp_music_
yes
2020-07-23 20558, 2020
15:31 PM
alastairp
in fact, you can delete the whole mergeValues section
2020-07-23 20508, 2020
15:32 PM
alastairp
make sure you get the path correct for your second item
2020-07-23 20522, 2020
15:32 PM
alastairp
the `acousticbrainz-server` folder on your computer is mapped to /code inside the container
2020-07-23 20543, 2020
15:32 PM
jmp_music_
oh, ok!
2020-07-23 20508, 2020
15:33 PM
alastairp
but sure, you could also make a new folder in /data, but keep in mind that when you close the session (and shut down the container) that data will disappear
2020-07-23 20515, 2020
15:33 PM
jmp_music_
and the json value I want to predict, how AB-server can read it?
2020-07-23 20542, 2020
15:34 PM
alastairp
the low-level file?
2020-07-23 20520, 2020
15:35 PM
jmp_music_
yes
2020-07-23 20522, 2020
15:35 PM
alastairp
just download it and put it in your `acousticbrainz-server` folder somewhere, and then when you are inside the container you can access it as `/code/wherever/you/put/it`
2020-07-23 20550, 2020
15:36 PM
sumedh has quit
2020-07-23 20556, 2020
15:47 PM
jmp_music_
Thanks! And finally, which is the `[profilefile]`
2020-07-23 20557, 2020
15:47 PM
jmp_music_
?
2020-07-23 20538, 2020
15:54 PM
alastairp
jmp_music_: profilefile is that file that you just made
2020-07-23 20540, 2020
15:54 PM
alastairp
the configuration file
2020-07-23 20507, 2020
16:00 PM
iliekcomputers
ishaanshah: hey
2020-07-23 20520, 2020
16:00 PM
ishaanshah
Hi
2020-07-23 20525, 2020
16:00 PM
ishaanshah
How are you
2020-07-23 20527, 2020
16:00 PM
ishaanshah
?
2020-07-23 20548, 2020
16:00 PM
iliekcomputers
good, good. I'm gonna deploy the daily activity backend today.
2020-07-23 20558, 2020
16:00 PM
iliekcomputers
i just want to pull in the landing page changes as well.
2020-07-23 20505, 2020
16:01 PM
ishaanshah
Cool, I worked on the frontend today
2020-07-23 20514, 2020
16:01 PM
ishaanshah
The line graph is done
2020-07-23 20521, 2020
16:01 PM
ishaanshah
But very messy right now
2020-07-23 20540, 2020
16:01 PM
iliekcomputers
messy as in it doesn't look good, or as in the code is messy?
2020-07-23 20552, 2020
16:01 PM
ishaanshah
doesn't look good
2020-07-23 20559, 2020
16:01 PM
BrainzGit
2020-07-23 20500, 2020
16:02 PM
BrainzBot
2020-07-23 20503, 2020
16:02 PM
ishaanshah
but thats because of less data
2020-07-23 20503, 2020
16:02 PM
iliekcomputers
hmm.
2020-07-23 20518, 2020
16:02 PM
iliekcomputers
I'll trigger a calculation today, let's see how it looks then
2020-07-23 20523, 2020
16:02 PM
ishaanshah
Lets check again after calculation
2020-07-23 20539, 2020
16:02 PM
ishaanshah
I have a feelling it would be better for others
2020-07-23 20539, 2020
16:02 PM
iliekcomputers
yep
2020-07-23 20553, 2020
16:02 PM
ishaanshah
I didn't work on fine tuning the graph much
2020-07-23 20503, 2020
16:03 PM
ishaanshah
Like toggleable legend and stuff
2020-07-23 20521, 2020
16:03 PM
iliekcomputers
yeah, makes sense. let's see how it looks first
2020-07-23 20524, 2020
16:03 PM
ishaanshah
if we have to switch to bar then it would have gone waste thats why
2020-07-23 20540, 2020
16:03 PM
ishaanshah
yeah exactly
2020-07-23 20555, 2020
16:03 PM
ishaanshah
I came across this site today
2020-07-23 20510, 2020
16:04 PM
ishaanshah
2020-07-23 20539, 2020
16:04 PM
ishaanshah
I like the first graph they have used
2020-07-23 20502, 2020
16:05 PM
ishaanshah
I think we should replace the stream graph in sitewide entities with this one
2020-07-23 20524, 2020
16:05 PM
iliekcomputers
sure, it looks cleaner1
2020-07-23 20525, 2020
16:05 PM
ishaanshah
Btw the whole site is built using nivo
2020-07-23 20527, 2020
16:05 PM
iliekcomputers
!
2020-07-23 20550, 2020
16:05 PM
iliekcomputers
that's pretty cool
2020-07-23 20545, 2020
16:06 PM
ishaanshah
cool, just wanted to ask your opinion on it
2020-07-23 20510, 2020
16:07 PM
ishaanshah
Let me know when you calculation is complete
2020-07-23 20533, 2020
16:07 PM
ishaanshah
I will be around for some more time, I will post some screenshots
2020-07-23 20542, 2020
16:07 PM
ishaanshah
you -> the
2020-07-23 20504, 2020
16:08 PM
iliekcomputers
sure, ok. i want to merge a couple of pull requests that are building. i'll keep you updated.
2020-07-23 20514, 2020
16:08 PM
ishaanshah
Cool
2020-07-23 20526, 2020
16:08 PM
BrainzGit
2020-07-23 20524, 2020
16:09 PM
iliekcomputers
i don't have much else, do you?
2020-07-23 20534, 2020
16:09 PM
ishaanshah
Nah nothing else
2020-07-23 20540, 2020
16:09 PM
iliekcomputers
cool!
2020-07-23 20528, 2020
16:16 PM
BrainzGit
2020-07-23 20533, 2020
16:18 PM
jmp_music_
@alastairp: just ran the extractor for the same track
2020-07-23 20553, 2020
16:18 PM
jmp_music_
2020-07-23 20549, 2020
16:19 PM
alastairp
cool. 99.9% looks very close to the 100% of acousticbrainz
2020-07-23 20503, 2020
16:20 PM
jmp_music_
that's right!
2020-07-23 20528, 2020
16:20 PM
jmp_music_
I have to check my code again. maybe i 've done something wrong when i call the model
2020-07-23 20542, 2020
16:20 PM
jmp_music_
i.e. in the predictions
2020-07-23 20549, 2020
16:20 PM
alastairp
sure thing
2020-07-23 20527, 2020
16:21 PM
alastairp
have you tried to make a model specifically with the C/gamma values from gaia?
2020-07-23 20504, 2020
16:22 PM
jmp_music_
I 'll proceed with this ones
2020-07-23 20508, 2020
16:22 PM
jmp_music_
one*
2020-07-23 20537, 2020
16:22 PM
jmp_music_
I'll work on it tomorrow
2020-07-23 20518, 2020
16:23 PM
alastairp
no problem
2020-07-23 20519, 2020
16:23 PM
alastairp
thanks
2020-07-23 20522, 2020
16:23 PM
jmp_music_
I have already made a script that loads gaia's params
2020-07-23 20531, 2020
16:23 PM
jmp_music_
so it will not take long to me to test it
2020-07-23 20540, 2020
16:23 PM
jmp_music_
will you be available tomorrow?
2020-07-23 20554, 2020
16:23 PM
jmp_music_
to discuss any results?
2020-07-23 20508, 2020
16:27 PM
shivam-kapila
ishaanshah: you up?
2020-07-23 20518, 2020
16:27 PM
ishaanshah
yep
2020-07-23 20541, 2020
16:27 PM
shivam-kapila
So I wanted to dicuss about the graph on the my listens page
2020-07-23 20554, 2020
16:27 PM
shivam-kapila
What do you think we can show there
2020-07-23 20533, 2020
16:28 PM
shivam-kapila
Listening activity over past 30 days?
2020-07-23 20546, 2020
16:28 PM
ishaanshah
Thats what I was gonna say
2020-07-23 20510, 2020
16:29 PM
shivam-kapila
I dont want to make a bar graph
2020-07-23 20516, 2020
16:29 PM
ishaanshah
We can have a line graph without the points
2020-07-23 20517, 2020
16:29 PM
shivam-kapila
You know for the sake of variety
2020-07-23 20527, 2020
16:29 PM
ishaanshah
Yep I think the same
2020-07-23 20543, 2020
16:29 PM
shivam-kapila
Yeah we are in the same boat
2020-07-23 20523, 2020
16:30 PM
shivam-kapila
Do we have something like past 30 days listen activity in backend right now. I mean a spark job for that
2020-07-23 20536, 2020
16:30 PM
ishaanshah
the graph you have shown in the mockup seems good already
2020-07-23 20537, 2020
16:30 PM
alastairp
jmp_music_: I'm not sure if I'll be around tomorrow, I have some things to do. however, send me some messages and I'll respond if I have time
2020-07-23 20505, 2020
16:31 PM
ishaanshah
2020-07-23 20521, 2020
16:31 PM
jmp_music_
@alastairp: Ok! Thanks again!
2020-07-23 20523, 2020
16:31 PM
ishaanshah
2020-07-23 20528, 2020
16:31 PM
shivam-kapila
Yeah. Since the whole dashboard focuses on smoothness I would like this one to be smooth
2020-07-23 20559, 2020
16:31 PM
BrainzGit
2020-07-23 20505, 2020
16:32 PM
ishaanshah
Yep, we can do that
2020-07-23 20521, 2020
16:32 PM
shivam-kapila
So its basically the last month plus the month till now
2020-07-23 20528, 2020
16:32 PM
ishaanshah
Yeah
2020-07-23 20534, 2020
16:32 PM
shivam-kapila
Cool we have the data
2020-07-23 20536, 2020
16:32 PM
ishaanshah
But we should skip the last month
2020-07-23 20527, 2020
16:33 PM
shivam-kapila
From what I was thinking is: say today is 23 july so we show from june 24 to july 23
2020-07-23 20537, 2020
16:33 PM
shivam-kapila
What do you think
2020-07-23 20503, 2020
16:34 PM
ishaanshah
Yep, that makes sense
2020-07-23 20506, 2020
16:34 PM
iliekcomputers
shivam-kapila: what would happen if stats were not calculated for a month, due to some downtime?
2020-07-23 20528, 2020
16:34 PM
ishaanshah
we can have the same message that we have on stats page?
2020-07-23 20549, 2020
16:34 PM
shivam-kapila
For a month? Arent the stats jobs triggered regularly
2020-07-23 20507, 2020
16:35 PM
ishaanshah
Yeah but there are bugs some times
2020-07-23 20508, 2020
16:35 PM
iliekcomputers
they are, but part of engineering is trying to handle failure cases gracefully
2020-07-23 20521, 2020
16:35 PM
ishaanshah
The pipeline is not very stable right now
2020-07-23 20541, 2020
16:35 PM
shivam-kapila
TBH I was gonna just tag you because of your wider sense of figuring things out
2020-07-23 20548, 2020
16:35 PM
shivam-kapila
Yeah I understand
2020-07-23 20522, 2020
16:36 PM
iliekcomputers
we solved the issue for stats by using the latest listen timestamp in spark for all calculations.
2020-07-23 20545, 2020
16:36 PM
shivam-kapila
Yeah I remember seeing that in the PR
2020-07-23 20507, 2020
16:37 PM
iliekcomputers
on the frontend we show data based on that, but we also explicitly state the time range (Jan 23 - Jan 30, for example)
2020-07-23 20525, 2020
16:37 PM
ishaanshah
iliekcomputers: What I had in mind is, we show slice the array to show past 30 days
2020-07-23 20537, 2020
16:37 PM
ishaanshah
Yeah show the date expicitely
2020-07-23 20549, 2020
16:37 PM
iliekcomputers
right, that makes sense.
2020-07-23 20551, 2020
16:37 PM
ishaanshah
expicitly
2020-07-23 20556, 2020
16:37 PM
shivam-kapila
Actually the graph comes just after user's current listen count etc
2020-07-23 20558, 2020
16:37 PM
iliekcomputers
2020-07-23 20522, 2020
16:38 PM
iliekcomputers
oh dammit
2020-07-23 20526, 2020
16:38 PM
ishaanshah
error on sentry
2020-07-23 20528, 2020
16:38 PM
iliekcomputers
i didn't do the schema change lol
2020-07-23 20528, 2020
16:38 PM
shivam-kapila
So thats I was considering the last 30 days
2020-07-23 20540, 2020
16:38 PM
ishaanshah
Whoops :D
2020-07-23 20541, 2020
16:39 PM
ishaanshah
shivam-kapila: Instead of past 30 days, lets just show the time range that we are calulating it for below
2020-07-23 20548, 2020
16:40 PM
shivam-kapila
Thag makes it somewhat like a line copy of a bar graph already in charts section if I am not wrong
2020-07-23 20552, 2020
16:40 PM
shivam-kapila
That*
2020-07-23 20538, 2020
16:41 PM
shivam-kapila
iliekcomputers: iiuc the edge case you mentioned is somwhat like a user has no listens in the past 30 days. Am I right?
2020-07-23 20539, 2020
16:41 PM
ishaanshah
I mean, show 24 june to 23 july
2020-07-23 20557, 2020
16:41 PM
shivam-kapila
I understand that
2020-07-23 20512, 2020
16:42 PM
iliekcomputers
not really, the edge case here is that you might not have the stats for the past 30 days
2020-07-23 20554, 2020
16:42 PM
ishaanshah
2020-07-23 20556, 2020
16:42 PM
iliekcomputers
the user could be submitting data and stats not getting calculaed
