#metabrainz

/

      • goldenshimmer joined the channel
      • 2020-05-07 12834, 2020

      • adi5026[m] joined the channel
      • 2020-05-07 12834, 2020

      • kepstin joined the channel
      • 2020-05-07 12834, 2020

      • heyarne[m] joined the channel
      • 2020-05-07 12834, 2020

      • reg[m] joined the channel
      • 2020-05-07 12841, 2020

      • elomatreb[m] joined the channel
      • 2020-05-07 12823, 2020

      • ishaanshah[m]
        iliekcomputers: Another thing, have the stats on production been recently calculated?
      • 2020-05-07 12829, 2020

      • Lotheric has quit
      • 2020-05-07 12851, 2020

      • Lotheric joined the channel
      • 2020-05-07 12832, 2020

      • SomalRudra
        gr0uch0mars : file listing done.. i can now start figuring out to send it as input to extract metadata
      • 2020-05-07 12828, 2020

      • sumedh has quit
      • 2020-05-07 12806, 2020

      • sumedh joined the channel
      • 2020-05-07 12811, 2020

      • ishaanshah[m]
        iliekcomputers: I have added the range parameter, please have a look when free
      • 2020-05-07 12824, 2020

      • ishaanshah[m]
        wbu?
      • 2020-05-07 12821, 2020

      • _lucifer
        SomalRudra: Plz open a PR on the main repo so that your changes are visible and we can better coordinate the work.
      • 2020-05-07 12818, 2020

      • _lucifer
        zas: outsidecontext: is there some test for the similarity checking code of Picard?
      • 2020-05-07 12823, 2020

      • Chinmay3199 joined the channel
      • 2020-05-07 12846, 2020

      • sumedh has quit
      • 2020-05-07 12836, 2020

      • sumedh joined the channel
      • 2020-05-07 12838, 2020

      • sumedh has quit
      • 2020-05-07 12824, 2020

      • sumedh joined the channel
      • 2020-05-07 12814, 2020

      • Filion_Teras joined the channel
      • 2020-05-07 12814, 2020

      • sumedh has quit
      • 2020-05-07 12845, 2020

      • sumedh joined the channel
      • 2020-05-07 12855, 2020

      • ruaok
        zas: see support@
      • 2020-05-07 12814, 2020

      • ruaok
        alastairp (for tomorrow), iliekcomputers, Mr_Monkey : I've taken alastairp's feedback to my gist and incorporated that into v2 of the recommendation document.
      • 2020-05-07 12847, 2020

      • ruaok
        I've also attempted to incorporate all feedback so far. please have another read and leave more comments.
      • 2020-05-07 12822, 2020

      • ruaok
        shivam-kapila, ishaanshah[m] and everyone else: clearly I am looking for feedback from as many people as possible, so please read if you care.
      • 2020-05-07 12811, 2020

      • ruaok
        shivam-kapila: the latest import to the test server is on 2016 right now.
      • 2020-05-07 12830, 2020

      • shivam-kapila
        ruaok: Sure. I will give a read
      • 2020-05-07 12814, 2020

      • ruaok
        thx
      • 2020-05-07 12801, 2020

      • shivam-kapila
        > shivam-kapila: the latest import to the test server is on 2016 right now.
      • 2020-05-07 12801, 2020

      • shivam-kapila
        Nice.
      • 2020-05-07 12832, 2020

      • Lotheric has quit
      • 2020-05-07 12803, 2020

      • BrainzGit
        [listenbrainz-server] ishaanshah opened pull request #838 (master…artist_graph_port): [WIP] LB-557: Port User Artist graph to ReactJS https://github.com/metabrainz/listenbrainz-server…
      • 2020-05-07 12804, 2020

      • BrainzBot
        LB-557: Move current artist graph to React https://tickets.metabrainz.org/browse/LB-557
      • 2020-05-07 12848, 2020

      • shivam-kapila
        ruaok: Are the duplicates removed while this Import in Timescale?
      • 2020-05-07 12800, 2020

      • sumedh has quit
      • 2020-05-07 12820, 2020

      • Darkloke has quit
      • 2020-05-07 12853, 2020

      • ruaok
        Yes
      • 2020-05-07 12843, 2020

      • shivam-kapila
        Awesome
      • 2020-05-07 12852, 2020

      • Filion_Teras has quit
      • 2020-05-07 12804, 2020

      • KindTwo joined the channel
      • 2020-05-07 12858, 2020

      • KindOne has quit
      • 2020-05-07 12825, 2020

      • jmp_music has quit
      • 2020-05-07 12856, 2020

      • outsidecontext
        zas: I think there are some tests for the metadata comparison functions
      • 2020-05-07 12817, 2020

      • zas
        _lucifer: ^^
      • 2020-05-07 12859, 2020

      • zas
        _lucifer: if you mean testing matching algorithms, not enough for sure, if you mean test for similarity function, yes
      • 2020-05-07 12846, 2020

      • diru1100
        yvanzo: Hey, can I work on MacOS for MB part? The ML part is running smoothly in my MBP , having a little trouble replicating it in ubuntu.
      • 2020-05-07 12831, 2020

      • Lotheric joined the channel
      • 2020-05-07 12809, 2020

      • diru1100
        also i installed the short version of MB in ubuntu, my MBP has only 128 GB internal storage 😭
      • 2020-05-07 12857, 2020

      • jmp_music joined the channel
      • 2020-05-07 12834, 2020

      • ruaok
        shivam-kapila: https://test.listenbrainz.org is updated, but there is a problem with some of the listens. :(
      • 2020-05-07 12859, 2020

      • _lucifer
        _lucifer: similarity would work
      • 2020-05-07 12843, 2020

      • BestSteve has quit
      • 2020-05-07 12840, 2020

      • BestSteve joined the channel
      • 2020-05-07 12811, 2020

      • ruaok
        iliekcomputers: is the LB dump still going?
      • 2020-05-07 12802, 2020

      • thomasross joined the channel
      • 2020-05-07 12835, 2020

      • Lotheric has quit
      • 2020-05-07 12843, 2020

      • thomasross has quit
      • 2020-05-07 12811, 2020

      • thomasross joined the channel
      • 2020-05-07 12819, 2020

      • adi5026[m] has quit
      • 2020-05-07 12834, 2020

      • djwhitey has quit
      • 2020-05-07 12852, 2020

      • CatQuest
      • 2020-05-07 12843, 2020

      • CatQuest
        Mr_Monkey: might intrest you ˆˆ
      • 2020-05-07 12831, 2020

      • _lucifer
        gr0uch0mars: you can check the circleci dashboard. I have added an artist lookup test. it passes with the ci. I am not sure the test I have written is the best possible way to do it. Can you review the test and provide feedback to use for other tests?
      • 2020-05-07 12810, 2020

      • v6lur has quit
      • 2020-05-07 12854, 2020

      • ishaanshah[m]
        iliekcomputers: Hi!
      • 2020-05-07 12807, 2020

      • gr0uch0mars
        _lucifer: ok, I'll check it!
      • 2020-05-07 12816, 2020

      • iliekcomputers
        👋🏼
      • 2020-05-07 12825, 2020

      • iliekcomputers
        How goes it?
      • 2020-05-07 12831, 2020

      • ishaanshah[m]
        I have added the range parameter to the api endpoint
      • 2020-05-07 12804, 2020

      • shivam-kapila
        ruaok: Oh no. What is the problem you noticed?
      • 2020-05-07 12815, 2020

      • ishaanshah[m]
        Other than that I got the artist graph to render correctly
      • 2020-05-07 12837, 2020

      • ruaok
        a problem with my cleanup route that clears out empty strings, lists and such.
      • 2020-05-07 12846, 2020

      • ruaok
        easy to fix. once fixed I will rerun thedata.
      • 2020-05-07 12800, 2020

      • iliekcomputers
        Oooh awesome
      • 2020-05-07 12800, 2020

      • ishaanshah[m]
        I will look into getting the data and processing it tomorrow
      • 2020-05-07 12829, 2020

      • iliekcomputers
        A screenshot in the PR would be nice. :)
      • 2020-05-07 12830, 2020

      • ishaanshah[m]
        We can use the API endpoint directly right?
      • 2020-05-07 12846, 2020

      • ishaanshah[m]
        Just a sec
      • 2020-05-07 12820, 2020

      • shivam-kapila
        ruaok: Oh. Liked the "easy to fix" part. Anything I should specifically test??
      • 2020-05-07 12837, 2020

      • iliekcomputers
        We could use the endpoint sure, but you should implement some logic for a loading screen while it loads the data from the endpoint
      • 2020-05-07 12846, 2020

      • ruaok
        no, its part of the migration code.
      • 2020-05-07 12846, 2020

      • shivam-kapila
        ishaanshah[m]: Tried ngrok service?
      • 2020-05-07 12851, 2020

      • iliekcomputers
        Or just pass in the data into the html like we were doing right now
      • 2020-05-07 12813, 2020

      • shivam-kapila
        ruaok: Ok ok.
      • 2020-05-07 12853, 2020

      • ishaanshah[m]
        I was thinking we should display a paginated view for top artist
      • 2020-05-07 12823, 2020

      • ishaanshah[m]
        Like 25 artists on a page
      • 2020-05-07 12808, 2020

      • iliekcomputers
        Sounds reasonable to me.
      • 2020-05-07 12816, 2020

      • ruaok
        shivam-kapila: new import started.
      • 2020-05-07 12817, 2020

      • yvanzo
        diru1100: yes, MacOs should do, what is the "short version of MB"?
      • 2020-05-07 12824, 2020

      • ruaok
        iliekcomputers: is the new LB dump still running?
      • 2020-05-07 12807, 2020

      • iliekcomputers
        ruaok: it isn't, it errored out for some reason. I haven't had the time to retrigger or look at the error, sorry.
      • 2020-05-07 12815, 2020

      • ishaanshah[m] uploaded an image: 2020-05-07-213431_1381x744_scrot.png (96KB) < https://matrix.org/_matrix/media/r0/download/matrix.org/cNBSoXUCpTVNKrYdqOIDyZdJ >
      • 2020-05-07 12845, 2020

      • diru1100
        yvanzo: The dev version didnt require all the data to install so it is lot less in memory
      • 2020-05-07 12851, 2020

      • ishaanshah[m]
        So 25 listens won't take much time to fetch right?
      • 2020-05-07 12812, 2020

      • ruaok
        iliekcomputers: ok, I'm now fully blocked on the timescale migration -- I need to test that the deduping works for the new dups recently inserted.
      • 2020-05-07 12822, 2020

      • diru1100
        yvanzo: i have around 30-35GB left, is it enough to work on MB. I will see if I get more space...
      • 2020-05-07 12836, 2020

      • ishaanshah[m]
        I have inputed the data by hand
      • 2020-05-07 12838, 2020

      • yvanzo
        diru1100: it is enough to work with sample data.
      • 2020-05-07 12845, 2020

      • ishaanshah[m]
        So only 5 entries
      • 2020-05-07 12800, 2020

      • shivam-kapila
        ruaok: I think you can ask out someone having dupes to export their listens and share with you. So you can atleast give it a try.
      • 2020-05-07 12857, 2020

      • Mr_Monkey
        CatQuest: Nice !
      • 2020-05-07 12856, 2020

      • iliekcomputers
        ruaok: I'll trigger another one today.
      • 2020-05-07 12800, 2020

      • iliekcomputers
      • 2020-05-07 12826, 2020

      • ruaok
        thx!
      • 2020-05-07 12802, 2020

      • iliekcomputers
        ishaanshah[m]: OK, let's use the endpoint and see how long it takes to load.
      • 2020-05-07 12824, 2020

      • ishaanshah[m]
        Ok
      • 2020-05-07 12840, 2020

      • iliekcomputers
        I figure adding some logic for a loading circle when we don't have the data wouldn't take much work anyways.
      • 2020-05-07 12822, 2020

      • ishaanshah[m]
        Yep, we will add it if we need it
      • 2020-05-07 12853, 2020

      • iliekcomputers
        Cool, is there anything else you wanted to talk about?
      • 2020-05-07 12811, 2020

      • ishaanshah[m]
        Another thing, were the stats on production recently updated
      • 2020-05-07 12828, 2020

      • iliekcomputers
        How recently do you mean?
      • 2020-05-07 12852, 2020

      • ishaanshah[m]
        After the graph started showing up again
      • 2020-05-07 12804, 2020

      • iliekcomputers
        Yeah, at least once, the latest stats are from the dump 136. There's a bug with the cron jobs that I'm hoping to look at.
      • 2020-05-07 12827, 2020

      • ishaanshah[m]
        I think the stats are getting incorrectly calculated
      • 2020-05-07 12838, 2020

      • ishaanshah[m]
      • 2020-05-07 12839, 2020

      • iliekcomputers
        How do you mean?
      • 2020-05-07 12841, 2020

      • Leo_Verto joined the channel
      • 2020-05-07 12834, 2020

      • ishaanshah[m]
        I am sure that I did not listen to womb sounds heartbeat 668 times :D
      • 2020-05-07 12801, 2020

      • ruaok
        suuuuuure.
      • 2020-05-07 12812, 2020

      • ishaanshah[m]
        Also total number of artists shown is 1434 which definately wrong
      • 2020-05-07 12841, 2020

      • shivam-kapila
        Well I thing the listens in graph will exceed your total listens
      • 2020-05-07 12849, 2020

      • ishaanshah[m]
        I think my stays have been calculated along with 2 or 3 other users
      • 2020-05-07 12803, 2020

      • iliekcomputers
        It shows 1434 artists on your graph btw
      • 2020-05-07 12809, 2020

      • Leo_Verto
        So you did end up making a Matrix room :D
      • 2020-05-07 12823, 2020

      • iliekcomputers
        Can you export your listens and see whats happening once
      • 2020-05-07 12824, 2020

      • ishaanshah[m]
        shivam-kapila: yep
      • 2020-05-07 12836, 2020

      • iliekcomputers
        Like what the actual stats should be
      • 2020-05-07 12839, 2020

      • ruaok
        Leo_Verto: long time no see!
      • 2020-05-07 12855, 2020

      • iliekcomputers
        It's easier to debug this stuff when we know what the inconsistencies are
      • 2020-05-07 12812, 2020

      • Leo_Verto
        Hey, sorry I've been gone for so long, happy to be back though!
      • 2020-05-07 12821, 2020

      • ishaanshah[m]
        Yep I wil check once
      • 2020-05-07 12809, 2020

      • diru1100
        Leo_Verto: Hey, I will be completing your SpamBrainz legacy. Welcome back!!!! 😁
      • 2020-05-07 12852, 2020

      • shivam-kapila
        ishaanshah[m]: Oh yes. Did you try ngrok. It will be helpful for front end a lot
      • 2020-05-07 12803, 2020

      • shivam-kapila
        Live demo.
      • 2020-05-07 12819, 2020

      • ishaanshah[m]
        I cant find womb sounds heartbeat in my export
      • 2020-05-07 12847, 2020

      • ishaanshah[m]
        shivam-kapila: no I havent, what does it do?
      • 2020-05-07 12857, 2020

      • Leo_Verto
        diru1100: so I heard! how have you been getting along with the code?
      • 2020-05-07 12858, 2020

      • shivam-kapila
        Wait. Let me show you.
      • 2020-05-07 12810, 2020

      • iliekcomputers
        ishaanshah[m]: can you upload your export here
      • 2020-05-07 12804, 2020

      • ishaanshah[m] posted a file: ishaanshah_lb-2020-05-07.json (2053KB) < https://matrix.org/_matrix/media/r0/download/matrix.org/iolRmXWjFvmyFDxTUEnItHVn >
      • 2020-05-07 12815, 2020

      • diru1100
        yvanzo: Fine, should I wait till the SpamNinja part is integrated? Till then I will work on Ledbrok and api part :)
      • 2020-05-07 12828, 2020

      • diru1100
        Leo_Verto: Well, there was no documentation at all 😅 I had to figure out how lodbrok works by various posts and your blog. Having no data also was a challenge
      • 2020-05-07 12824, 2020

      • iliekcomputers
        ishaanshah[m]: huh
      • 2020-05-07 12828, 2020

      • iliekcomputers
        that is very weird
      • 2020-05-07 12833, 2020

      • iliekcomputers
        can you open a ticket
      • 2020-05-07 12845, 2020

      • ishaanshah[m]
        Ya sure
      • 2020-05-07 12859, 2020

      • diru1100
        I documented what I understood here: https://github.com/diru1100/spambrainz_ml/blob/ma…