#metabrainz

/

      • bukwurm_
        LordSputnik: Ok, cool
      • 2018-04-01 09149, 2018

      • UmkaDK has quit
      • 2018-04-01 09115, 2018

      • akhilesh_
        LordSputnik: Did you see a new table of count entity in the stats page?
      • 2018-04-01 09139, 2018

      • LordSputnik
        akhilesh_: no, not yet, maybe later today
      • 2018-04-01 09146, 2018

      • LordSputnik
        I've been a bit busy the last couple of days
      • 2018-04-01 09129, 2018

      • bukwurm
      • 2018-04-01 09155, 2018

      • bukwurm
        LordSputnik: The local build is also showing the same. 🤔
      • 2018-04-01 09134, 2018

      • akhilesh_
        LordSputnik: ok, after seeing you may suggest that , what other table can be added in the statas page.
      • 2018-04-01 09142, 2018

      • bukwurm
        I assume the production and dev environment run different builds.
      • 2018-04-01 09110, 2018

      • LordSputnik
        bukwurm: maybe. I'd have to check that
      • 2018-04-01 09128, 2018

      • LordSputnik
        akhilesh_: ok, I'll have a think and let you know
      • 2018-04-01 09107, 2018

      • bukwurm
        Meanwhile, I'll check the build process. Never used gulp/grunt, so lots to learn! :)
      • 2018-04-01 09149, 2018

      • LordSputnik
        bukwurm: neither do we, so that's good :D
      • 2018-04-01 09100, 2018

      • LordSputnik
        We use command line scripts called from npm directly
      • 2018-04-01 09109, 2018

      • LordSputnik
        There's no real need for gulp/grunt
      • 2018-04-01 09140, 2018

      • bukwurm_
        Oh
      • 2018-04-01 09157, 2018

      • LordSputnik
        We did used to use gulp, but then simplified things
      • 2018-04-01 09159, 2018

      • bukwurm_
        I saw somewhere grunt file
      • 2018-04-01 09112, 2018

      • bukwurm_
        Lol it was in the .gitignore
      • 2018-04-01 09115, 2018

      • LordSputnik
        Although if we move to webpack in the near future, I suspect that some of the build process will need to change
      • 2018-04-01 09118, 2018

      • LordSputnik
        Haha!
      • 2018-04-01 09117, 2018

      • bukwurm_
        LordSputnik: Webpack is hot cake right now :P
      • 2018-04-01 09147, 2018

      • UmkaDK joined the channel
      • 2018-04-01 09159, 2018

      • bukwurm_
        I'll open up JIRA for it! :)
      • 2018-04-01 09135, 2018

      • bukwurm
        I think webpack is a GSoC org this year
      • 2018-04-01 09146, 2018

      • iliekcomputers
        ruaok: we modified load_data to use the latest dump structure
      • 2018-04-01 09100, 2018

      • iliekcomputers
        pushed to master
      • 2018-04-01 09107, 2018

      • ruaok
        awesome. I'll run it as soon as I get the dumps.
      • 2018-04-01 09132, 2018

      • ruaok
        making good progress -- now to make a script to train from the loaded RDDs?
      • 2018-04-01 09146, 2018

      • iliekcomputers
        yeah, starting on that now
      • 2018-04-01 09149, 2018

      • ruaok
        I'm going to look at dockeriizing a spark setup -- that stuff I was using yesterday was bunk.
      • 2018-04-01 09103, 2018

      • ruaok
        but I think I found a clever way to make it for one a single cluster.
      • 2018-04-01 09117, 2018

      • LordSputnik
        bukwurm_: knex updated and immutable installed for data-js
      • 2018-04-01 09118, 2018

      • ruaok plans to use a floating ip from hetzer rather than docker swarm.
      • 2018-04-01 09127, 2018

      • travis-ci joined the channel
      • 2018-04-01 09128, 2018

      • travis-ci
        Project bookbrainz-data-js build #755: passed in 3 min 8 sec: https://travis-ci.org/bookbrainz/bookbrainz-data-…
      • 2018-04-01 09129, 2018

      • travis-ci has left the channel
      • 2018-04-01 09103, 2018

      • iliekcomputers
        ruaok: what exactly is the use of the last digit of the recording id we keep in playcount_rdd here https://github.com/metabrainz/listenbrainz-recomm…
      • 2018-04-01 09107, 2018

      • iliekcomputers
        ?
      • 2018-04-01 09139, 2018

      • ruaok
        that is how the example code partitions the data set into training, testing, validation.
      • 2018-04-01 09111, 2018

      • ruaok
        but later that code got improved to use a randomsample of sorts, so I don't think we need the last digit hack anymore
      • 2018-04-01 09134, 2018

      • iliekcomputers
        ah
      • 2018-04-01 09136, 2018

      • iliekcomputers
        okay cool
      • 2018-04-01 09137, 2018

      • iliekcomputers
        thanks
      • 2018-04-01 09132, 2018

      • drsaunde joined the channel
      • 2018-04-01 09105, 2018

      • dpmittal[m] has quit
      • 2018-04-01 09132, 2018

      • dpmittal[m] joined the channel
      • 2018-04-01 09104, 2018

      • iliekcomputers
        ruaok: pushing some code that trains models
      • 2018-04-01 09118, 2018

      • ruaok
        wooo!
      • 2018-04-01 09125, 2018

      • iliekcomputers
        we're gonna take a break now, get something to eat, be back in a bit
      • 2018-04-01 09129, 2018

      • ruaok
        you guys are so far ahead of me. data dumps move slowly.
      • 2018-04-01 09145, 2018

      • ruaok
        good plan, you guys more than deserve. I'll keep at it.
      • 2018-04-01 09130, 2018

      • dpmittal_ joined the channel
      • 2018-04-01 09129, 2018

      • dpmittal[m] has quit
      • 2018-04-01 09101, 2018

      • akhilesh_ has quit
      • 2018-04-01 09120, 2018

      • D4RK-PH0ENiX has quit
      • 2018-04-01 09103, 2018

      • D4RK-PH0ENiX joined the channel
      • 2018-04-01 09155, 2018

      • ruaok finally fires off a data load
      • 2018-04-01 09157, 2018

      • dpmittal_ has quit
      • 2018-04-01 09138, 2018

      • ruaok
        first run died persisting data since an old copy existed. but that was only 20 minutes.
      • 2018-04-01 09146, 2018

      • ruaok starts again
      • 2018-04-01 09102, 2018

      • yokel has quit
      • 2018-04-01 09153, 2018

      • iliekcomputers
        20 minutes is lower than i expected lol
      • 2018-04-01 09157, 2018

      • yokel joined the channel
      • 2018-04-01 09119, 2018

      • CatQuest
        bah i missed my b anniversary again. it's 14 years now in february :D
      • 2018-04-01 09126, 2018

      • CatQuest
        mb*
      • 2018-04-01 09129, 2018

      • ruaok
      • 2018-04-01 09101, 2018

      • ruaok
        dest dir df was empty when I started.
      • 2018-04-01 09157, 2018

      • dpmittal joined the channel
      • 2018-04-01 09128, 2018

      • iliekcomputers
      • 2018-04-01 09148, 2018

      • iliekcomputers
      • 2018-04-01 09156, 2018

      • iliekcomputers
        maybe related
      • 2018-04-01 09130, 2018

      • dpmittal
        iliekcomputers, ferbncode: When I am trying to test my patch locally using the command given in docs, I am getting this error https://pastebin.com/YmLWE07y
      • 2018-04-01 09121, 2018

      • ferbncode
        dpmittal: Stop and Remove the db_test container and try again (`docker stop docker_db_test_1` and `docker rm docker_db_test_1`)
      • 2018-04-01 09141, 2018

      • ferbncode
        or bring down all test containers and retry `docker-compose -f docker/docker-compose.test.yml down`
      • 2018-04-01 09120, 2018

      • dpmittal
        ferbncode: Removing the db_test container worked. Thanks!
      • 2018-04-01 09100, 2018

      • Rotab has quit
      • 2018-04-01 09133, 2018

      • Rotab joined the channel
      • 2018-04-01 09113, 2018

      • ruaok
        iliekcomputers: did you incur any costs associated with the first attempt to go to Delhi? if so, include those in the invoice.
      • 2018-04-01 09122, 2018

      • ruaok starts again with sudo
      • 2018-04-01 09146, 2018

      • iliekcomputers
        ruaok: sorry about that, sent with the bus cancellation acknowledgement email
      • 2018-04-01 09108, 2018

      • ruaok
        all good
      • 2018-04-01 09155, 2018

      • iliekcomputers
        Any updates on the data loading?
      • 2018-04-01 09152, 2018

      • ruaok
        persisting listens right now
      • 2018-04-01 09123, 2018

      • ruaok
        Persist playcounts...
      • 2018-04-01 09142, 2018

      • ruaok
        running 40 minutes now. not too bad.
      • 2018-04-01 09104, 2018

      • Major_Lurker has quit
      • 2018-04-01 09154, 2018

      • iliekcomputers
        ruaok: exited?
      • 2018-04-01 09113, 2018

      • ruaok
        without error. :)
      • 2018-04-01 09123, 2018

      • iliekcomputers
        Wow
      • 2018-04-01 09137, 2018

      • ferbncode
        \o/
      • 2018-04-01 09148, 2018

      • iliekcomputers
        45 minutes...
      • 2018-04-01 09149, 2018

      • ruaok
        [table_dir] [data_dir]
      • 2018-04-01 09150, 2018

      • ruaok
        ?
      • 2018-04-01 09103, 2018

      • ruaok
        the df dir is the data dir and table dir is a new empty dir?
      • 2018-04-01 09117, 2018

      • ruaok
        (for train)
      • 2018-04-01 09144, 2018

      • iliekcomputers
        Noooo
      • 2018-04-01 09148, 2018

      • iliekcomputers
        I need to fix that
      • 2018-04-01 09152, 2018

      • ruaok
        other way round.
      • 2018-04-01 09157, 2018

      • iliekcomputers
        Yea
      • 2018-04-01 09111, 2018

      • iliekcomputers
        Table dir is where the dataframes are saved
      • 2018-04-01 09126, 2018

      • iliekcomputers
        And data_dir is where it should output the model
      • 2018-04-01 09136, 2018

      • ruaok
        let's call it model dir, please
      • 2018-04-01 09140, 2018

      • iliekcomputers
        Yeah
      • 2018-04-01 09144, 2018

      • iliekcomputers
        I'll fix it.
      • 2018-04-01 09112, 2018

      • jwf
        Super excited about ListenBrainz statistics!!!
      • 2018-04-01 09118, 2018

      • jwf
        I'm going to check it out now
      • 2018-04-01 09129, 2018

      • ruaok
        jwf: have you seen the recommendations?
      • 2018-04-01 09145, 2018

      • ruaok
      • 2018-04-01 09148, 2018

      • jwf
        ruaok: Oops, that is what I meant :-)
      • 2018-04-01 09159, 2018

      • jwf
        I was curious how it work with my account, since so many of my listens aren't linked to MB entities
      • 2018-04-01 09108, 2018

      • Leo_Verto
        it works very well
      • 2018-04-01 09127, 2018

      • jwf
        Nooooooooooo!
      • 2018-04-01 09139, 2018

      • ruaok
        lolololol, sorry dude.
      • 2018-04-01 09147, 2018

      • ruaok
        iliekcomputers: ferbncode: output so far https://gist.github.com/mayhem/fa6e58305d66fcb8d7…
      • 2018-04-01 09109, 2018

      • jwf
        I have to give y'all serious credit on that one, this is the first one today that has genuinely fooled me
      • 2018-04-01 09121, 2018

      • iliekcomputers
        Means the dataframes got loaded
      • 2018-04-01 09151, 2018

      • iliekcomputers
        jwf: lol 😋
      • 2018-04-01 09104, 2018

      • Leo_Verto
        it even works on mobile, but on firefox on android you can't minimize the video :P
      • 2018-04-01 09137, 2018

      • ruaok
        evil
      • 2018-04-01 09125, 2018

      • Leo_Verto
        jwf: don't forget to leave some feedback on the discourse thread! https://community.metabrainz.org/t/help-us-test-l…
      • 2018-04-01 09134, 2018

      • jwf
        Hahahah, yes, I must now :P
      • 2018-04-01 09145, 2018

      • iliekcomputers
        ruaok: where do you see the output?
      • 2018-04-01 09100, 2018

      • ruaok
        my console, sorry, I should've redirected.
      • 2018-04-01 09102, 2018

      • ruaok
        not much to see.
      • 2018-04-01 09103, 2018

      • jwf
        Leo_Verto: For me, I was hit with a licensing restriction, so I saw the title of the video but had to click a link to open in YouTube :P
      • 2018-04-01 09110, 2018

      • ruaok
        Training model with rank = 8.00, lambda = 0.10, iterations = 10...
      • 2018-04-01 09125, 2018

      • iliekcomputers
        Okay, no worries
      • 2018-04-01 09159, 2018

      • Major_Lurker joined the channel
      • 2018-04-01 09118, 2018

      • iliekcomputers
        I'm curious what the error will be this time
      • 2018-04-01 09128, 2018

      • Leo_Verto
        ruaok: can you try different alphas? maybe something like .1 or .3
      • 2018-04-01 09109, 2018

      • ruaok
        will do, once we have a successful run.
      • 2018-04-01 09114, 2018

      • Leo_Verto
        jwf: damn, at first I wanted to use the original video but that was blocked in Germany so I went with this one instead, shame to hear it's blocked in some places :(
      • 2018-04-01 09120, 2018

      • jwf
        Leo_Verto: International music licensing restrictions, one of the banes of my existence :P
      • 2018-04-01 09105, 2018

      • jwf
        Unrelated, but is it possible to "reset" a ListenBrainz profile? Over time, I've accumulated duplicate listens from songs I submit from my Android and when I use the Last.fm importer – but I think I would just like to use the Last.fm importer from now on
      • 2018-04-01 09151, 2018

      • iliekcomputers
        jwf: that has been a hard problem to solve
      • 2018-04-01 09106, 2018

      • iliekcomputers
        It isn't possible to delete listens yet
      • 2018-04-01 09117, 2018

      • ruaok
        training will take a good while.
      • 2018-04-01 09121, 2018

      • ruaok
        its done three passes now
      • 2018-04-01 09153, 2018

      • iliekcomputers
        Total of 8 models to train
      • 2018-04-01 09108, 2018

      • jwf
        iliekcomputers: I see. It's something I know I will be interested in doing, once the functionality is there :-)
      • 2018-04-01 09117, 2018

      • samj1912
        zas: you there? wanted to talk to you about beta3
      • 2018-04-01 09142, 2018

      • iliekcomputers
        ruaok: any progress? 😅
      • 2018-04-01 09152, 2018

      • ruaok
        still training
      • 2018-04-01 09152, 2018

      • iliekcomputers wonders whether to go to sleep
      • 2018-04-01 09100, 2018

      • ruaok
        go to sleep.
      • 2018-04-01 09118, 2018

      • ruaok
        I'll carry on. but I also have guests, so sporadically.
      • 2018-04-01 09141, 2018

      • iliekcomputers is awake but afk for now
      • 2018-04-01 09105, 2018

      • kartikeyaSh_ircc joined the channel
      • 2018-04-01 09150, 2018

      • ruaok
        best model is 10.56% so far.