#metabrainz

/

      • Gentlecat
        hellska: you planned to look into client, right? can do that
      • 2016-06-01 15338, 2016

      • Gentlecat
        I'll take a look at the code when I can
      • 2016-06-01 15323, 2016

      • hellska
        Ok I start with the client!
      • 2016-06-01 15350, 2016

      • hellska
        I have finished a review of the document now and added some comments
      • 2016-06-01 15330, 2016

      • black-perl joined the channel
      • 2016-06-01 15346, 2016

      • Zastai joined the channel
      • 2016-06-01 15359, 2016

      • diana_olhovyk joined the channel
      • 2016-06-01 15329, 2016

      • opatel99 joined the channel
      • 2016-06-01 15352, 2016

      • Gentlecat
        don't focus too much on the document at this point, just write code :)
      • 2016-06-01 15320, 2016

      • Zastai
        I AM writing code. Bloody BSDs are pissing me off with their "Inappropriate ioctl for device" when using PInvoke.
      • 2016-06-01 15339, 2016

      • regagain joined the channel
      • 2016-06-01 15305, 2016

      • armalcolite
        alastairp: i have added the support for ZIP
      • 2016-06-01 15333, 2016

      • armalcolite
        alastairp: though, i am not sure if this is good. It takes some time to upload as well.
      • 2016-06-01 15335, 2016

      • armalcolite
        alastairp: i also tested using a ZIP-bomb and a self-extracting-zip. It works fine!
      • 2016-06-01 15333, 2016

      • diana_olhovyk has quit
      • 2016-06-01 15309, 2016

      • armalcolite
        alastairp: i also tested on some random zip's and non-zip's as well. It works fine.
      • 2016-06-01 15305, 2016

      • armalcolite
        it would be good if someone can give a very big lastfm-backup-file, so that we can test.
      • 2016-06-01 15317, 2016

      • hellska
        gentlecat: jajajaj got it!
      • 2016-06-01 15348, 2016

      • diana_olhovyk_ joined the channel
      • 2016-06-01 15354, 2016

      • adamcik has quit
      • 2016-06-01 15347, 2016

      • regagain has quit
      • 2016-06-01 15305, 2016

      • Zastai
        when you say lastfm-backup-file, what do you mean? is that something I should be able to download from my last.fm account?
      • 2016-06-01 15355, 2016

      • diana_olhovyk_ has quit
      • 2016-06-01 15355, 2016

      • armalcolite
        Zastai: the current version of lastfm does not allow you to download.
      • 2016-06-01 15302, 2016

      • Zastai
        armalcolite: and what counts as "big"; i assume my paltry 181k does not count
      • 2016-06-01 15302, 2016

      • kartikgupta0909 has quit
      • 2016-06-01 15312, 2016

      • armalcolite
        from the earlier version. you could save your uploaded listens to file.
      • 2016-06-01 15325, 2016

      • Zastai
        am currently exporting to xml via http://mainstream.ghan.nl/scrobbles.html
      • 2016-06-01 15333, 2016

      • Zastai
        is that a supported format too?
      • 2016-06-01 15345, 2016

      • hellska has left the channel
      • 2016-06-01 15348, 2016

      • armalcolite
        nope.
      • 2016-06-01 15310, 2016

      • armalcolite
        Big, around 10-20 MB may be more :)
      • 2016-06-01 15327, 2016

      • armalcolite
        the only archive i have is from alastairp and is < 1MB
      • 2016-06-01 15341, 2016

      • Zastai
        how many scrobbles is that?
      • 2016-06-01 15303, 2016

      • Zastai
        the xml export for mine is 119MB, if that's an indication
      • 2016-06-01 15309, 2016

      • armalcolite
        ~6K
      • 2016-06-01 15328, 2016

      • regagain joined the channel
      • 2016-06-01 15349, 2016

      • armalcolite
        woah, you have quite a big collection
      • 2016-06-01 15353, 2016

      • armalcolite
      • 2016-06-01 15358, 2016

      • armalcolite
        ^ example backup file
      • 2016-06-01 15346, 2016

      • Zastai
        ok mine should be about 30 times larger then :) 181K scrobbles over 10 years
      • 2016-06-01 15348, 2016

      • armalcolite
        i guess it wont be that hard to convert it into the required format. ;)
      • 2016-06-01 15326, 2016

      • armalcolite
        wait, we can directly upload it onto lastfm using the API scrapper...
      • 2016-06-01 15346, 2016

      • armalcolite
        s/lastfm/listenbrainz
      • 2016-06-01 15308, 2016

      • Zastai
        (alastraip.zip? looks like a typo :))
      • 2016-06-01 15350, 2016

      • Zastai
        looking at the xml, it just has the track info (no separate uncorrectedTrack like the json), and does not seem to include which application did the scrobbling
      • 2016-06-01 15334, 2016

      • Zastai
        http://pastebin.com/11bY87e7 is the first two entries
      • 2016-06-01 15301, 2016

      • armalcolite
        that zip was given by lastfm older version
      • 2016-06-01 15306, 2016

      • jcazevedo has quit
      • 2016-06-01 15336, 2016

      • armalcolite
        (i just renamed it to keep it indexed.)
      • 2016-06-01 15338, 2016

      • Zastai
        i meant I/someone could convert the xml to that json format, but not including that application name
      • 2016-06-01 15337, 2016

      • armalcolite
        wait, i shared partial zip.
      • 2016-06-01 15341, 2016

      • armalcolite
        1 sec.
      • 2016-06-01 15325, 2016

      • armalcolite
      • 2016-06-01 15330, 2016

      • armalcolite
        Zastai: also you dont need to convert it, listenbrainz already supports scrobbling from existing lastfm channels.
      • 2016-06-01 15353, 2016

      • Zastai
        ah ok
      • 2016-06-01 15304, 2016

      • Zastai
        was just offering my data for testing purposes :)
      • 2016-06-01 15312, 2016

      • armalcolite
        the backup thing is just for those listens which are not there on lastfm, you know the 'old collection'
      • 2016-06-01 15333, 2016

      • armalcolite
        Zastai: i really appreciate it.
      • 2016-06-01 15304, 2016

      • armalcolite
        Zastai: your lastfm username can help too. :D
      • 2016-06-01 15315, 2016

      • Zastai
        Zastai, unsurprisingly
      • 2016-06-01 15339, 2016

      • armalcolite
        Zastai: awesome!
      • 2016-06-01 15359, 2016

      • Zastai
        logged in on LB and running the import now
      • 2016-06-01 15317, 2016

      • Zastai
        page 120/3628
      • 2016-06-01 15335, 2016

      • armalcolite
        Zastai: its better you wait for some more time. the API scrapper is not yet live.
      • 2016-06-01 15308, 2016

      • armalcolite
        the current scraper has some timestamp issues.
      • 2016-06-01 15320, 2016

      • Zastai
        is it easy to discard imported data?
      • 2016-06-01 15335, 2016

      • armalcolite
        as of now, no
      • 2016-06-01 15343, 2016

      • armalcolite
        dont worry
      • 2016-06-01 15358, 2016

      • diana_olhovyk_ joined the channel
      • 2016-06-01 15358, 2016

      • armalcolite
        we'll clean the database once API scrapper is live to prevent duplicates
      • 2016-06-01 15309, 2016

      • gcilou
      • 2016-06-01 15301, 2016

      • Zastai
        ah so basically the same as we have now with the middle ribbon dropped and the family ribbon added at the bottom
      • 2016-06-01 15324, 2016

      • gcilou
        yeah, for now :)
      • 2016-06-01 15319, 2016

      • black-perl has quit
      • 2016-06-01 15311, 2016

      • aron_kexp has quit
      • 2016-06-01 15326, 2016

      • aron_kexp joined the channel
      • 2016-06-01 15353, 2016

      • CatQuest
        was there a blup for about changeing the colour of the new icons? (for userstyles etc) imagine a monochrome one!
      • 2016-06-01 15342, 2016

      • CatQuest
        [20:38] <Zastai> ok mine should be about 30 times larger then :) 181K scrobbles over 10 years
      • 2016-06-01 15342, 2016

      • CatQuest
        :D
      • 2016-06-01 15320, 2016

      • CatQuest
        oh hai, I've been on since 05 on last
      • 2016-06-01 15358, 2016

      • CatQuest
        it was when it switched from this "audioscrobbler" thing to the last.fm thing.. ahh times
      • 2016-06-01 15304, 2016

      • CatQuest
        huh
      • 2016-06-01 15313, 2016

      • CatQuest
        ZaphodBeeblebrox • scrobbling since 24 May 2005
      • 2016-06-01 15353, 2016

      • CatQuest
        but Zastai if you wanna try a *really* big sample. you can try with mine :P
      • 2016-06-01 15302, 2016

      • CatQuest
        1mill scrobbles :o
      • 2016-06-01 15306, 2016

      • Zastai
        nice
      • 2016-06-01 15317, 2016

      • CatQuest
      • 2016-06-01 15321, 2016

      • fc7 joined the channel
      • 2016-06-01 15351, 2016

      • Zastai
        ooh, DSOTM
      • 2016-06-01 15318, 2016

      • CatQuest
        I just keep them usic runnig always. i figure it compensates for all those years before scrobbling..and also i listne to music while outside too
      • 2016-06-01 15318, 2016

      • CatQuest
        ;)
      • 2016-06-01 15315, 2016

      • Zastai
        i stopped scrobbling for a long time (i think foo_audioscrobbler stopped working at some point, and then I mainly streamed radio at work for a year or two)
      • 2016-06-01 15336, 2016

      • Zastai
        but now that I'm mostly using spotify at work, it's ticking up again
      • 2016-06-01 15359, 2016

      • fc7
        hi there
      • 2016-06-01 15302, 2016

      • fc7
        :)
      • 2016-06-01 15311, 2016

      • armalcolite
        ruaok: do i need to add "submitQueue.unshift()" in these lines as well.
      • 2016-06-01 15314, 2016

      • armalcolite
      • 2016-06-01 15330, 2016

      • opatel99 has quit
      • 2016-06-01 15301, 2016

      • bitmap
        foo.unshift() is a no-op...
      • 2016-06-01 15340, 2016

      • aron_kexp_ joined the channel
      • 2016-06-01 15352, 2016

      • aron_kexp has quit
      • 2016-06-01 15352, 2016

      • aron_kexp_ is now known as aron_kexp
      • 2016-06-01 15300, 2016

      • fc7 has quit
      • 2016-06-01 15351, 2016

      • jcazevedo joined the channel
      • 2016-06-01 15341, 2016

      • aron_kexp has quit
      • 2016-06-01 15300, 2016

      • kepstin
        heh, I'm only up to 100k scrobbles now :)
      • 2016-06-01 15325, 2016

      • kepstin
        (I actually discovered musicbrainz originally via a last.fm community)
      • 2016-06-01 15309, 2016

      • fc7 joined the channel
      • 2016-06-01 15348, 2016

      • fc7
        hey guys
      • 2016-06-01 15303, 2016

      • fc7
        after building the search-server and the indexes
      • 2016-06-01 15319, 2016

      • fc7
        when I start tomcat I get this error for every index: WARNING: Could not load artist index: null
      • 2016-06-01 15325, 2016

      • fc7
        and a java exception
      • 2016-06-01 15337, 2016

      • fc7
        any ideas?
      • 2016-06-01 15300, 2016

      • fc7
        the first line of the exception is: java.lang.reflect.InvocationTargetException
      • 2016-06-01 15319, 2016

      • fc7
        I checked file permission on the index directory and tomcat is able to access it, so it seems to be a problem with the indexes themselves
      • 2016-06-01 15333, 2016

      • fc7
        indexing took 19 hours btw
      • 2016-06-01 15344, 2016

      • fc7
        not sure if it's normal either
      • 2016-06-01 15355, 2016

      • aron_kexp joined the channel
      • 2016-06-01 15357, 2016

      • ariscop has quit
      • 2016-06-01 15317, 2016

      • aron_kexp has quit
      • 2016-06-01 15348, 2016

      • aron_kexp joined the channel
      • 2016-06-01 15320, 2016

      • andreivolgin has quit
      • 2016-06-01 15357, 2016

      • yeeeargh has quit
      • 2016-06-01 15304, 2016

      • Zastai has quit
      • 2016-06-01 15331, 2016

      • fc7
        @ruaok: any ideas?
      • 2016-06-01 15309, 2016

      • ruaok
        Where are the indexes?
      • 2016-06-01 15339, 2016

      • aron_kexp has quit
      • 2016-06-01 15313, 2016

      • fc7
        home/search/indexdata
      • 2016-06-01 15300, 2016

      • ruaok
        Hmmm, no ideas of yet.
      • 2016-06-01 15318, 2016

      • fc7
        maybe something went wrong while building the indexes?
      • 2016-06-01 15339, 2016

      • fc7
        because also when running the update script
      • 2016-06-01 15334, 2016

      • fc7
        i get this for all the indexes: Current index properties: schema_sequence=23, replication_sequence=95849, change_sequence=
      • 2016-06-01 15345, 2016

      • fc7
        and "No changes found" but the DB on the other hand was downloading updates and current replication sequence 95898
      • 2016-06-01 15335, 2016

      • Freso
        alastairp: What paper is that (if you can divulge)?
      • 2016-06-01 15354, 2016

      • Freso
        armalcolite: Did alastairp point you to CatQuest's Last.FM user?
      • 2016-06-01 15356, 2016

      • Freso
        +yet
      • 2016-06-01 15309, 2016

      • diana_olhovyk_ has quit
      • 2016-06-01 15356, 2016

      • Freso
        I see CatQuest himself pointed you to it.
      • 2016-06-01 15324, 2016

      • Freso
        You should be sure that that can get imported, whichever method you're using.
      • 2016-06-01 15339, 2016

      • kartikgupta0909 joined the channel
      • 2016-06-01 15321, 2016

      • kartikgupta0909
        alastairp: Finally the library got uploaded to the PPA. could you have a look at it.
      • 2016-06-01 15301, 2016

      • ariscop joined the channel
      • 2016-06-01 15347, 2016

      • aron_kexp joined the channel
      • 2016-06-01 15320, 2016

      • fc7 has quit
      • 2016-06-01 15320, 2016

      • Zialus_PT joined the channel
      • 2016-06-01 15327, 2016

      • Zialus has quit
      • 2016-06-01 15330, 2016

      • Freso
        chrisskye: http://madsonic.org seems to (potentially) use MB data. (It's an open source project, so not likely a $$$ candidate, but it might still be good to reach out to them. I'm not familiar with the project at all.)
      • 2016-06-01 15332, 2016

      • fc7 joined the channel
      • 2016-06-01 15342, 2016

      • fc7
        hi again