#metabrainz

/

      • iliekcomputers
        for now, let's fix the links on the user page
      • 2020-03-28 08804, 2020

      • ishaanshah[m]
        As for the track_mbid I will try and see if I can speed up the process by caching
      • 2020-03-28 08812, 2020

      • ishaanshah[m]
        as most of the listens will be duplicates
      • 2020-03-28 08819, 2020

      • iliekcomputers
        yeah, just use a map in the importer
      • 2020-03-28 08837, 2020

      • iliekcomputers
        and add some logic to handle MB rate limits maybe
      • 2020-03-28 08856, 2020

      • iliekcomputers
        i'm okay with slowing down the import a bit if it means we get the correct data
      • 2020-03-28 08805, 2020

      • ishaanshah[m]
        yep will do
      • 2020-03-28 08846, 2020

      • ishaanshah[m]
        Also can I look into seting up prettier along with ts
      • 2020-03-28 08856, 2020

      • iliekcomputers
        yes!
      • 2020-03-28 08857, 2020

      • ishaanshah[m]
        I think it will be useful to have consistent code
      • 2020-03-28 08800, 2020

      • iliekcomputers
        that would be amazing!
      • 2020-03-28 08808, 2020

      • ishaanshah[m]
        I will try to get it done next week
      • 2020-03-28 08847, 2020

      • iliekcomputers
      • 2020-03-28 08833, 2020

      • shivam-kapila
        iliekcomputers: Are you free for some minutes?
      • 2020-03-28 08855, 2020

      • iliekcomputers
        yes, sup
      • 2020-03-28 08857, 2020

      • shivam-kapila
        So currently we have 25 listens per page.
      • 2020-03-28 08835, 2020

      • shivam-kapila
        So there are two ways we can feed that value according to users preferences
      • 2020-03-28 08847, 2020

      • _lucifer
        gr0uch0mars: done. submitted the final proposal
      • 2020-03-28 08850, 2020

      • jwf
        iliekcomputers / ruaok: I just tried to delete a lot of my listens all at once, but looks like LB timed out. Not sure if it's something you want to look into from logs
      • 2020-03-28 08802, 2020

      • jwf
        Not sure if I should try again or if there is a bigger bug to report
      • 2020-03-28 08810, 2020

      • iliekcomputers
        jwf: ouch
      • 2020-03-28 08817, 2020

      • iliekcomputers
        can you open a ticket?
      • 2020-03-28 08823, 2020

      • iliekcomputers
        shivam-kapila: ^
      • 2020-03-28 08823, 2020

      • jwf
        504 Gateway Timeout
      • 2020-03-28 08825, 2020

      • jwf
        Yep, sure
      • 2020-03-28 08835, 2020

      • iliekcomputers
        thanks jwf !
      • 2020-03-28 08801, 2020

      • iliekcomputers
        shivam-kapila: can you take a look at jwf's problem first?
      • 2020-03-28 08812, 2020

      • shivam-kapila
        Sure
      • 2020-03-28 08814, 2020

      • iliekcomputers
        the pagination thing can be done later anyways
      • 2020-03-28 08843, 2020

      • iliekcomputers
        shivam-kapila: i think the delete-listens function might be timing out for big measurements
      • 2020-03-28 08800, 2020

      • iliekcomputers
        can you reproduce with CatQuest's listens
      • 2020-03-28 08802, 2020

      • iliekcomputers
        ?
      • 2020-03-28 08816, 2020

      • shivam-kapila
        I will check
      • 2020-03-28 08811, 2020

      • c1e0 has quit
      • 2020-03-28 08815, 2020

      • jwf
      • 2020-03-28 08816, 2020

      • BrainzBot
        LB-506: Deleting my listens results in 504 Gateway Timeout
      • 2020-03-28 08821, 2020

      • jwf
        iliekcomputers / shivam-kapila: ^
      • 2020-03-28 08850, 2020

      • shivam-kapila
        jwf: Thanks. I will look into it
      • 2020-03-28 08806, 2020

      • jwf
        Thanks! Now I definitely want to completely purge my profile :D
      • 2020-03-28 08813, 2020

      • jwf
        I appreciate ya looking into it
      • 2020-03-28 08830, 2020

      • iliekcomputers
        jwf: you can just delete your account and create it again :D
      • 2020-03-28 08843, 2020

      • jwf
        Oh that's true
      • 2020-03-28 08804, 2020

      • jwf
        I guess I can wait for that since I am still a valid account for this bug :)
      • 2020-03-28 08823, 2020

      • jwf
        But good to know account deletion will do the trick
      • 2020-03-28 08844, 2020

      • shivam-kapila
        jwf: So your listens got deleted. But the request got timed out. Also I see we have to remove the stats for deleted listens.
      • 2020-03-28 08841, 2020

      • iliekcomputers
        ha, good point
      • 2020-03-28 08851, 2020

      • iliekcomputers
        let's do that soon too
      • 2020-03-28 08809, 2020

      • shivam-kapila
        iliekcomputers: I dont know how can I add CatQuests listens into my local machine. Can you please guide me a little
      • 2020-03-28 08855, 2020

      • iliekcomputers
        import from their last.fm
      • 2020-03-28 08804, 2020

      • madmouser1 has quit
      • 2020-03-28 08805, 2020

      • shivam-kapila
        Well it isnt even importing from my profile. It says imported 1 listen but there is nothing on listens page
      • 2020-03-28 08801, 2020

      • madmouser1 joined the channel
      • 2020-03-28 08847, 2020

      • madmouser1 has quit
      • 2020-03-28 08850, 2020

      • ishaanshah[m]
        shivam-kapila: you might need to reset your latest import timetamp
      • 2020-03-28 08824, 2020

      • shivam-kapila
        ishaanshah[m]: It was my stupidity. I pulled latest master then copied config.py forgot to modify API_URL. Thanks for help :)
      • 2020-03-28 08835, 2020

      • ishaanshah[m]
        Oh, No problem
      • 2020-03-28 08839, 2020

      • shivam-kapila
        iliekcomputers: I think the possible solution can be a modal just like import listens one.
      • 2020-03-28 08848, 2020

      • shivam-kapila
        Whats your opinion?
      • 2020-03-28 08827, 2020

      • iliekcomputers
        Shivam-kapila: would you delete batches of listens?
      • 2020-03-28 08836, 2020

      • shivam-kapila
        Not really
      • 2020-03-28 08857, 2020

      • iliekcomputers
        The modal would still have to make a request which would time out.
      • 2020-03-28 08826, 2020

      • iliekcomputers
        The solution here probably involves deleting batches of listens
      • 2020-03-28 08846, 2020

      • iliekcomputers
        Not sure how feasible this is in influx though
      • 2020-03-28 08824, 2020

      • shivam-kapila
      • 2020-03-28 08837, 2020

      • shivam-kapila
        Please have a look at it
      • 2020-03-28 08803, 2020

      • shivam-kapila
        iliekcomputers: I will look into deleting in batches option. Seems better
      • 2020-03-28 08803, 2020

      • iliekcomputers
        We can make it a task in rabbitmq.
      • 2020-03-28 08810, 2020

      • shivam-kapila
        In 99% cases the drop measurement wont fail. Adding in the queue can be good option
      • 2020-03-28 08826, 2020

      • shivam-kapila
        We can extend it to drop stats afterwards too
      • 2020-03-28 08803, 2020

      • iliekcomputers
        If we can do it in batches, that would be simpler though
      • 2020-03-28 08805, 2020

      • shivam-kapila
        I will have a look at how listens are fed into influx. It should be similar.
      • 2020-03-28 08819, 2020

      • iliekcomputers
        Huh?
      • 2020-03-28 08845, 2020

      • madmouser1 joined the channel
      • 2020-03-28 08806, 2020

      • iliekcomputers
        Just drop the first x listens, then the next x and so on
      • 2020-03-28 08812, 2020

      • iliekcomputers
        Would that be possible?
      • 2020-03-28 08855, 2020

      • iliekcomputers
      • 2020-03-28 08829, 2020

      • iliekcomputers
        Do it year by year and it should be okay
      • 2020-03-28 08847, 2020

      • shivam-kapila
        Thanks iliekcomputers. On it
      • 2020-03-28 08825, 2020

      • iliekcomputers
        Delete listens for the year 2020, 2019...2000 in a request each and the in a final request drop the measurement, stats etc in a final request
      • 2020-03-28 08844, 2020

      • iliekcomputers
        *and then
      • 2020-03-28 08825, 2020

      • shivam-kapila
        iliekcomputers: I dont think it will work year by year
      • 2020-03-28 08829, 2020

      • shivam-kapila
      • 2020-03-28 08837, 2020

      • shivam-kapila
        He has 40k scrobbles in an year
      • 2020-03-28 08817, 2020

      • iliekcomputers
        Why do you think it won't work?
      • 2020-03-28 08834, 2020

      • iliekcomputers
        Let's make the time interval configurable
      • 2020-03-28 08847, 2020

      • shivam-kapila
        I mean it can still timeout for such large number
      • 2020-03-28 08822, 2020

      • iliekcomputers
        That way we can change it as we come across problems. Keep it an year in the beginning and we'll see if it doesn't work, change the time interval to something shorter
      • 2020-03-28 08836, 2020

      • shivam-kapila
        Okay
      • 2020-03-28 08857, 2020

      • iliekcomputers
        Thx!
      • 2020-03-28 08811, 2020

      • iliekcomputers
        I'm off for the day. See ya tomorrow, everyone! 👋🏼
      • 2020-03-28 08811, 2020

      • travis-ci joined the channel
      • 2020-03-28 08811, 2020

      • travis-ci
        Project bookbrainz-data-js build #1411: passed in 1 min 46 sec: https://travis-ci.org/bookbrainz/bookbrainz-data-…
      • 2020-03-28 08811, 2020

      • travis-ci has left the channel
      • 2020-03-28 08832, 2020

      • prabal has quit
      • 2020-03-28 08828, 2020

      • shivam-kapila
        jwf: Can I use your data for testing?
      • 2020-03-28 08853, 2020

      • ayerhart has quit
      • 2020-03-28 08819, 2020

      • ayerhart joined the channel
      • 2020-03-28 08808, 2020

      • ayerhart has quit
      • 2020-03-28 08832, 2020

      • ayerhart joined the channel
      • 2020-03-28 08823, 2020

      • apetresc has quit
      • 2020-03-28 08807, 2020

      • shivam-kapila
        iliekcomputers: When you are back please look at this. I guess we shouldn't iterate upto 50 years. How about deleting say 10000 listens ib batches. l will look if its possible in influx. Its possible in SQL though.
      • 2020-03-28 08816, 2020

      • shivam-kapila
      • 2020-03-28 08818, 2020

      • iliekcomputers
        shivam-kapila: just do it until 2002 (the year when last.fm started and our oldest source of listens) and then drop the measurement
      • 2020-03-28 08838, 2020

      • shivam-kapila
        Ok ok. Thanks for replying even after day off :)
      • 2020-03-28 08804, 2020

      • scientist1642 joined the channel
      • 2020-03-28 08810, 2020

      • scientist1642
        Hey Hey, is there a separate channel for discussing GSOC ideas?
      • 2020-03-28 08842, 2020

      • yvanzo
        hi scientist1642, not really, this is the channel.
      • 2020-03-28 08817, 2020

      • apetresc joined the channel
      • 2020-03-28 08853, 2020

      • thomasross joined the channel
      • 2020-03-28 08841, 2020

      • scientist1642
        yvanzo Good! I am a bit of late to the party and sprinting through organizations. :] I saw this talk a few weeks ago, and it was really fascinating https://www.youtube.com/watch?v=FD5ZKi-moMU
      • 2020-03-28 08832, 2020

      • scientist1642
        Don't know how much work is done in ML community for tagging emotions on music tracks, but I see Moods field in acusticbrainz with probabilities. Could anyone point out how acousticbrainz currently does this?
      • 2020-03-28 08810, 2020

      • heyarne[m] joined the channel
      • 2020-03-28 08822, 2020

      • heyarne[m]
        hi! i have a collection of a bit more than 10000 songs. i'd like to set up acousticbrainz so i can query information on all of them. how do i actually generate the dataset? the acousticbrainz site only has info on how to import one and use the api to query it, as far as i can see
      • 2020-03-28 08859, 2020

      • alastairp
        scientist1642: hi, the moods in AcousticBrainz use SVM models, trained on a handful of audio examples
      • 2020-03-28 08811, 2020

      • alastairp
        see https://acousticbrainz.org/datasets/accuracy for more information about the specific models
      • 2020-03-28 08854, 2020

      • alastairp
        here's an overview of our training process, including a list of the features that we use: https://github.com/MTG/essentia/blob/master/FAQ.m…
      • 2020-03-28 08838, 2020

      • alastairp
        If you're interested in emotion and music in general, you could also take a look at our classification challenge that we ran last year (and will run again this year): http://www.multimediaeval.org/mediaeval2019/music/
      • 2020-03-28 08817, 2020

      • alastairp
        heyarne[m]: you can use the submission tool and tell it to submit to your local server instead of acousticbrainz.org
      • 2020-03-28 08858, 2020

      • alastairp
      • 2020-03-28 08848, 2020

      • alastairp
        what's your final goal? if you just want to process the audio and do something with it, it _may_ be faster to just use the underlying tools instead of setting up acousticbrainz
      • 2020-03-28 08851, 2020

      • heyarne[m]
        yes, i want to process the audio and do something with it. that something involves querying the info via api, at least i thought it would, because it's going to be a web app since that's where i feel at home
      • 2020-03-28 08847, 2020

      • heyarne[m]
        but i'm not even sure what "the underlying tools" are exactly. the page mentions the essentia toolkit, but that seems vast
      • 2020-03-28 08842, 2020

      • alastairp
        the specific part of essentia that AB uses is https://essentia.upf.edu/streaming_extractor_musi…
      • 2020-03-28 08822, 2020

      • alastairp
        if you compile it yourself with --with-example=streaming_extractor_music then it'll spit out a binary which takes audio in and writes json out
      • 2020-03-28 08840, 2020

      • alastairp
        This is the same file as the static binary listed under "Do it yourself install" at https://acousticbrainz.org/download
      • 2020-03-28 08800, 2020

      • heyarne[m]
        Cool! Thanks for your help
      • 2020-03-28 08816, 2020

      • alastairp
        np
      • 2020-03-28 08800, 2020

      • alastairp
        if you're just doing your own personal project, I recommend compiling the extractor tool yourself, because it's got lots of improvements since the AB one was released. If you want compatibility with AB, use the one from the download page
      • 2020-03-28 08805, 2020

      • scientist1642
        alastairp woah thanks.
      • 2020-03-28 08807, 2020

      • scientist1642
        In general, is it too late to work on a gsoc proposal now? I have background in machine learning and react/react-native. Seems like there are some suitable projects.
      • 2020-03-28 08820, 2020

      • alastairp
        scientist1642: you're welcome to submit a proposal if you want, but we typically prefer that potential students spend some time with us in the weeks before proposals are due, and iterate over a few drafts of the proposal first
      • 2020-03-28 08809, 2020

      • alastairp
        it's unlikely that anyone will be able to give you feedback on a proposal until Monday evening which means that you'll probably be cutting it quite fine, but it's up to you
      • 2020-03-28 08807, 2020

      • scientist1642
        alastairp ah I see. Makes sense.
      • 2020-03-28 08823, 2020

      • alastairp
        scientist1642: what's your ML experience in?
      • 2020-03-28 08803, 2020

      • scientist1642
        I did an MSc in data mining and went through regular ML courses and assignments but I was mostly interested in deep reinforcement learning.
      • 2020-03-28 08800, 2020

      • heyarne[m]
        I didn't know it's so easy to actually submit data; I'm currently subbmiting info for the first release. No use in keeping the analyses private :)
      • 2020-03-28 08816, 2020

      • alastairp
        scientist1642: ah neat, we do a bit of that at https://www.upf.edu/web/mtg/, though I'm not involved with the deep learning groups
      • 2020-03-28 08825, 2020

      • alastairp
        heyarne[m]: perfect! thanks for the contribution
      • 2020-03-28 08806, 2020

      • scientist1642
        Cool group! I think there is so much to discover in neuroscience regarding how we perceive music. tbh right now I am more inclined to study some basic neurobiology and explore unconventional approaches in AI like http://numenta.com/ is pushing through.
      • 2020-03-28 08831, 2020

      • alastairp
        there's some interesting neuroscience / music stuff going on at University of Montreal, some of my old colleagues are doing this: https://twitter.com/finneco, https://twitter.com/tsonj
      • 2020-03-28 08813, 2020

      • shivam-kapila
        iliekcomputers: Seems like deleting from influx isn't easy. :-/. Please have a look tomorrow. Till then I will see what can be done.
      • 2020-03-28 08822, 2020

      • shivam-kapila
      • 2020-03-28 08814, 2020

      • CatQuest has quit
      • 2020-03-28 08809, 2020

      • CatQuest joined the channel
      • 2020-03-28 08833, 2020

      • scientist1642
        alastairp I'll definitely check out! What's your main involvement with metabrainz?
      • 2020-03-28 08838, 2020

      • rohitdandamudi
        Congo everyone! on new release of ListenBrainz :)
      • 2020-03-28 08835, 2020

      • shivam-kapila has quit
      • 2020-03-28 08813, 2020

      • supersandro2000 has quit
      • 2020-03-28 08825, 2020

      • supersandro2000 joined the channel
      • 2020-03-28 08832, 2020

      • rohitdandamudi has quit