15:27 PM
MajorLurker has quit
15:27 PM
alastairp
oh, sure!
15:27 PM
of course, if you're evaluating on everything that you trained on I would hope that you get 100% ;)
15:28 PM
jmp_music_
15:28 PM
this is the evaluation of fitting and predicting to the whole amount of thedanceability's data collection
15:29 PM
data collection --> dataset
15:29 PM
alastairp
yeah, understood
15:29 PM
jmp_music_
I'm trying now to see what I can do with gaia
15:29 PM
sumedh has quit
15:30 PM
you said before: `replace this with just a single item pointing to the history file`
15:30 PM
you mean something like that, right?
15:30 PM
15:31 PM
i made a code directory inside the data dir of AB, and I put the file there
15:31 PM
alastairp
right
15:31 PM
sumedh joined the channel
15:31 PM
jmp_music_
and by saying `add anything you want to the 2 items under mergeValues`
15:31 PM
alastairp
so, `svm_models: [ /data/svm_models/voice_instrumental.history, /code/data/jmp_results_danceability ]`
15:31 PM
jmp_music_
yes
15:31 PM
alastairp
in fact, you can delete the whole mergeValues section
15:32 PM
make sure you get the path correct for your second item
15:32 PM
the `acousticbrainz-server` folder on your computer is mapped to /code inside the container
15:32 PM
jmp_music_
oh, ok!
15:33 PM
alastairp
but sure, you could also make a new folder in /data, but keep in mind that when you close the session (and shut down the container) that data will disappear
15:33 PM
jmp_music_
and the json value I want to predict, how AB-server can read it?
15:34 PM
alastairp
the low-level file?
15:35 PM
jmp_music_
yes
15:35 PM
alastairp
just download it and put it in your `acousticbrainz-server` folder somewhere, and then when you are inside the container you can access it as `/code/wherever/you/put/it`
15:36 PM
sumedh has quit
15:47 PM
jmp_music_
Thanks! And finally, which is the `[profilefile]`
15:47 PM
?
15:54 PM
alastairp
jmp_music_: profilefile is that file that you just made
15:54 PM
the configuration file
16:00 PM
iliekcomputers
ishaanshah: hey
16:00 PM
ishaanshah
Hi
16:00 PM
How are you
16:00 PM
?
16:00 PM
iliekcomputers
good, good. I'm gonna deploy the daily activity backend today.
16:00 PM
i just want to pull in the landing page changes as well.
16:01 PM
ishaanshah
Cool, I worked on the frontend today
16:01 PM
The line graph is done
16:01 PM
But very messy right now
16:01 PM
iliekcomputers
messy as in it doesn't look good, or as in the code is messy?
16:01 PM
ishaanshah
doesn't look good
16:01 PM
BrainzGit
16:02 PM
BrainzBot
16:02 PM
ishaanshah
but thats because of less data
16:02 PM
iliekcomputers
hmm.
16:02 PM
I'll trigger a calculation today, let's see how it looks then
16:02 PM
ishaanshah
Lets check again after calculation
16:02 PM
I have a feelling it would be better for others
16:02 PM
iliekcomputers
yep
16:02 PM
ishaanshah
I didn't work on fine tuning the graph much
16:03 PM
Like toggleable legend and stuff
16:03 PM
iliekcomputers
yeah, makes sense. let's see how it looks first
16:03 PM
ishaanshah
if we have to switch to bar then it would have gone waste thats why
16:03 PM
yeah exactly
16:03 PM
I came across this site today
16:04 PM
16:04 PM
I like the first graph they have used
16:05 PM
I think we should replace the stream graph in sitewide entities with this one
16:05 PM
iliekcomputers
sure, it looks cleaner1
16:05 PM
ishaanshah
Btw the whole site is built using nivo
16:05 PM
iliekcomputers
!
16:05 PM
that's pretty cool
16:06 PM
ishaanshah
cool, just wanted to ask your opinion on it
16:07 PM
Let me know when you calculation is complete
16:07 PM
I will be around for some more time, I will post some screenshots
16:07 PM
you -> the
16:08 PM
iliekcomputers
sure, ok. i want to merge a couple of pull requests that are building. i'll keep you updated.
16:08 PM
ishaanshah
Cool
16:08 PM
BrainzGit
16:09 PM
iliekcomputers
i don't have much else, do you?
16:09 PM
ishaanshah
Nah nothing else
16:09 PM
iliekcomputers
cool!
16:16 PM
BrainzGit
16:18 PM
jmp_music_
@alastairp: just ran the extractor for the same track
16:18 PM
16:19 PM
alastairp
cool. 99.9% looks very close to the 100% of acousticbrainz
16:20 PM
jmp_music_
that's right!
16:20 PM
I have to check my code again. maybe i 've done something wrong when i call the model
16:20 PM
i.e. in the predictions
16:20 PM
alastairp
sure thing
16:21 PM
have you tried to make a model specifically with the C/gamma values from gaia?
16:22 PM
jmp_music_
I 'll proceed with this ones
16:22 PM
one*
16:22 PM
I'll work on it tomorrow
16:23 PM
alastairp
no problem
16:23 PM
thanks
16:23 PM
jmp_music_
I have already made a script that loads gaia's params
16:23 PM
so it will not take long to me to test it
16:23 PM
will you be available tomorrow?
16:23 PM
to discuss any results?
16:27 PM
shivam-kapila
ishaanshah: you up?
16:27 PM
ishaanshah
yep
16:27 PM
shivam-kapila
So I wanted to dicuss about the graph on the my listens page
16:27 PM
What do you think we can show there
16:28 PM
Listening activity over past 30 days?
16:28 PM
ishaanshah
Thats what I was gonna say
16:29 PM
shivam-kapila
I dont want to make a bar graph
16:29 PM
ishaanshah
We can have a line graph without the points
16:29 PM
shivam-kapila
You know for the sake of variety
16:29 PM
ishaanshah
Yep I think the same
16:29 PM
shivam-kapila
Yeah we are in the same boat
16:30 PM
Do we have something like past 30 days listen activity in backend right now. I mean a spark job for that
16:30 PM
ishaanshah
the graph you have shown in the mockup seems good already
16:30 PM
alastairp
jmp_music_: I'm not sure if I'll be around tomorrow, I have some things to do. however, send me some messages and I'll respond if I have time
16:31 PM
ishaanshah
16:31 PM
jmp_music_
@alastairp: Ok! Thanks again!
16:31 PM
ishaanshah
16:31 PM
shivam-kapila
Yeah. Since the whole dashboard focuses on smoothness I would like this one to be smooth
16:31 PM
BrainzGit
16:32 PM
ishaanshah
Yep, we can do that
16:32 PM
shivam-kapila
So its basically the last month plus the month till now
16:32 PM
ishaanshah
Yeah
16:32 PM
shivam-kapila
Cool we have the data
16:32 PM
ishaanshah
But we should skip the last month
16:33 PM
shivam-kapila
From what I was thinking is: say today is 23 july so we show from june 24 to july 23
16:33 PM
What do you think
16:34 PM
ishaanshah
Yep, that makes sense
16:34 PM
iliekcomputers
shivam-kapila: what would happen if stats were not calculated for a month, due to some downtime?
16:34 PM
ishaanshah
we can have the same message that we have on stats page?
16:34 PM
shivam-kapila
For a month? Arent the stats jobs triggered regularly
16:35 PM
ishaanshah
Yeah but there are bugs some times
16:35 PM
iliekcomputers
they are, but part of engineering is trying to handle failure cases gracefully
16:35 PM
ishaanshah
The pipeline is not very stable right now
16:35 PM
shivam-kapila
TBH I was gonna just tag you because of your wider sense of figuring things out
16:35 PM
Yeah I understand
16:36 PM
iliekcomputers
we solved the issue for stats by using the latest listen timestamp in spark for all calculations.
16:36 PM
shivam-kapila
Yeah I remember seeing that in the PR
16:37 PM
iliekcomputers
on the frontend we show data based on that, but we also explicitly state the time range (Jan 23 - Jan 30, for example)
16:37 PM
ishaanshah
iliekcomputers: What I had in mind is, we show slice the array to show past 30 days
16:37 PM
Yeah show the date expicitely
16:37 PM
iliekcomputers
right, that makes sense.
16:37 PM
ishaanshah
expicitly
16:37 PM
shivam-kapila
Actually the graph comes just after user's current listen count etc
16:37 PM
iliekcomputers
16:38 PM
oh dammit
16:38 PM
ishaanshah
error on sentry
16:38 PM
iliekcomputers
i didn't do the schema change lol
16:38 PM
shivam-kapila
So thats I was considering the last 30 days
16:38 PM
ishaanshah
Whoops :D
16:39 PM
shivam-kapila: Instead of past 30 days, lets just show the time range that we are calulating it for below
16:40 PM
shivam-kapila
Thag makes it somewhat like a line copy of a bar graph already in charts section if I am not wrong
16:40 PM
That*
16:41 PM
iliekcomputers: iiuc the edge case you mentioned is somwhat like a user has no listens in the past 30 days. Am I right?
16:41 PM
ishaanshah
I mean, show 24 june to 23 july
16:41 PM
shivam-kapila
I understand that
16:42 PM
iliekcomputers
not really, the edge case here is that you might not have the stats for the past 30 days
16:42 PM
ishaanshah
16:42 PM
iliekcomputers
the user could be submitting data and stats not getting calculaed