#metabrainz

/

      • github joined the channel
      • 2015-09-16 25900, 2015

      • github
        [listenbrainz-server] gentlecat created import-btn (+1 new commit): https://github.com/metabrainz/listenbrainz-server…
      • 2015-09-16 25900, 2015

      • github
        listenbrainz-server/import-btn 8da1cf4 Roman Tsukanov: Use `current_user` in import_data view.
      • 2015-09-16 25900, 2015

      • github has left the channel
      • 2015-09-16 25920, 2015

      • github joined the channel
      • 2015-09-16 25920, 2015

      • github
        [listenbrainz-server] gentlecat opened pull request #24: Use `current_user` in import_data view (master...import-btn) https://github.com/metabrainz/listenbrainz-server…
      • 2015-09-16 25920, 2015

      • github has left the channel
      • 2015-09-16 25917, 2015

      • github joined the channel
      • 2015-09-16 25917, 2015

      • github
        [listenbrainz-server] gentlecat force-pushed import-btn from 8da1cf4 to c163b2c: https://github.com/metabrainz/listenbrainz-server…
      • 2015-09-16 25917, 2015

      • github
        listenbrainz-server/import-btn c163b2c Roman Tsukanov: Use `current_user` in import_data view.
      • 2015-09-16 25917, 2015

      • github has left the channel
      • 2015-09-16 25918, 2015

      • github joined the channel
      • 2015-09-16 25918, 2015

      • github
        [listenbrainz-server] alastair closed pull request #24: Use `current_user` in import_data view (master...import-btn) https://github.com/metabrainz/listenbrainz-server…
      • 2015-09-16 25918, 2015

      • github has left the channel
      • 2015-09-16 25937, 2015

      • github joined the channel
      • 2015-09-16 25937, 2015

      • github
        [listenbrainz-server] alastair closed pull request #23: Remove database installation section from instructions in README.md (master...readme) https://github.com/metabrainz/listenbrainz-server…
      • 2015-09-16 25937, 2015

      • github has left the channel
      • 2015-09-16 25937, 2015

      • Gentlecat
        ok, should be better now
      • 2015-09-16 25917, 2015

      • github joined the channel
      • 2015-09-16 25917, 2015

      • github
        [listenbrainz-server] gentlecat deleted import-btn at c163b2c: https://github.com/metabrainz/listenbrainz-server…
      • 2015-09-16 25917, 2015

      • github has left the channel
      • 2015-09-16 25946, 2015

      • Gentlecat
        I don't think you even need to check there https://github.com/metabrainz/listenbrainz-server…
      • 2015-09-16 25957, 2015

      • Gentlecat
        just put login_required on it too
      • 2015-09-16 25915, 2015

      • alastairp
        oh, wait
      • 2015-09-16 25916, 2015

      • alastairp
        hmm
      • 2015-09-16 25927, 2015

      • alastairp
        I thought you had it in /import, but it’s in /user/import
      • 2015-09-16 25931, 2015

      • alastairp
        hmm
      • 2015-09-16 25902, 2015

      • alastairp
        http://musicbrainz.org/user/import well. not a problem yet
      • 2015-09-16 25935, 2015

      • alastairp
        it’s a good idea to keep everything in /user namespaced with a username
      • 2015-09-16 25958, 2015

      • Gentlecat
        or just remove prefix where we attach blueprint
      • 2015-09-16 25908, 2015

      • Gentlecat
        and set it in views which need it
      • 2015-09-16 25920, 2015

      • Gentlecat
        so it will be lb.org/import or something
      • 2015-09-16 25954, 2015

      • alastairp
        right. I like the url prefix. it makes things cleaner
      • 2015-09-16 25910, 2015

      • alastairp
        I’m not completely against lb.org/import
      • 2015-09-16 25913, 2015

      • Gentlecat
        it does, but that seems like the easiest way
      • 2015-09-16 25936, 2015

      • Gentlecat
        another alternative is just to move all importing/exporting endpoints to a separate blueprint
      • 2015-09-16 25900, 2015

      • alastairp
        right
      • 2015-09-16 25906, 2015

      • alastairp
        it’s user-y though
      • 2015-09-16 25904, 2015

      • github joined the channel
      • 2015-09-16 25904, 2015

      • github
        [messybrainz-server] alastair pushed 1 new commit to master: https://github.com/metabrainz/messybrainz-server/…
      • 2015-09-16 25904, 2015

      • github
        messybrainz-server/master bb7ebb8 Alastair Porter: Merge pull request #9 from metabrainz/musicbrainzngs...
      • 2015-09-16 25904, 2015

      • github has left the channel
      • 2015-09-16 25934, 2015

      • github joined the channel
      • 2015-09-16 25934, 2015

      • github
        [messybrainz-server] gentlecat deleted musicbrainzngs at 6cd5890: https://github.com/metabrainz/messybrainz-server/…
      • 2015-09-16 25934, 2015

      • github has left the channel
      • 2015-09-16 25951, 2015

      • ariscop joined the channel
      • 2015-09-16 25910, 2015

      • alastairp
        Gentlecat: re: bad timestamps
      • 2015-09-16 25917, 2015

      • alastairp
        where are you at with that?
      • 2015-09-16 25908, 2015

      • Gentlecat
        I didn't look into thhat
      • 2015-09-16 25920, 2015

      • Gentlecat
        so nowhere I guess
      • 2015-09-16 25940, 2015

      • Gentlecat
        thought that ruaok fixed that after asking me
      • 2015-09-16 25904, 2015

      • alastairp
        I’m still not 100% sure what your problem is, other than “it doesn’t work"
      • 2015-09-16 25914, 2015

      • alastairp
        I see in the api endpoint that there are timestamps
      • 2015-09-16 25902, 2015

      • Gentlecat
        oh wait
      • 2015-09-16 25917, 2015

      • Gentlecat
        maybe that was on another branch
      • 2015-09-16 25933, 2015

      • Gentlecat
        now I see "listened_at": "Wed, 16 Sep 2015 17:27:00 GMT"
      • 2015-09-16 25947, 2015

      • Gentlecat
        it was in another format before, right?
      • 2015-09-16 25911, 2015

      • alastairp
        I don’t know
      • 2015-09-16 25927, 2015

      • alastairp
      • 2015-09-16 25920, 2015

      • Gentlecat
        is it on the latest commit in master?
      • 2015-09-16 25927, 2015

      • Gentlecat
        on lb.org it's "listened_at": 1442394540
      • 2015-09-16 25937, 2015

      • Gentlecat
      • 2015-09-16 25948, 2015

      • Gentlecat
        weird
      • 2015-09-16 25949, 2015

      • github joined the channel
      • 2015-09-16 25949, 2015

      • github
        [listenbrainz-server] alastair pushed 1 new commit to master: https://github.com/metabrainz/listenbrainz-server…
      • 2015-09-16 25949, 2015

      • github
        listenbrainz-server/master cc0acb2 Alastair Porter: Don't use innerHTML to get text content....
      • 2015-09-16 25949, 2015

      • github has left the channel
      • 2015-09-16 25918, 2015

      • alastairp
        I don’t know what format you want
      • 2015-09-16 25942, 2015

      • Gentlecat
        1442394540
      • 2015-09-16 25932, 2015

      • alastairp
        right
      • 2015-09-16 25942, 2015

      • alastairp
        and that’s what is in the api at the moment?
      • 2015-09-16 25912, 2015

      • github joined the channel
      • 2015-09-16 25912, 2015

      • github
        [listenbrainz-server] alastair created counter (+1 new commit): https://github.com/metabrainz/listenbrainz-server…
      • 2015-09-16 25912, 2015

      • github
        listenbrainz-server/counter 7319725 Alastair Porter: Wait until we've sent data to LB before reporting it as a submitted page...
      • 2015-09-16 25912, 2015

      • github has left the channel
      • 2015-09-16 25923, 2015

      • github joined the channel
      • 2015-09-16 25923, 2015

      • github
        [listenbrainz-server] alastair opened pull request #25: Wait until we've sent data to LB before reporting it as a submitted page (master...counter) https://github.com/metabrainz/listenbrainz-server…
      • 2015-09-16 25923, 2015

      • github has left the channel
      • 2015-09-16 25919, 2015

      • yeeeargh has quit
      • 2015-09-16 25910, 2015

      • Gentlecat
        maybe it's not converted to json properly
      • 2015-09-16 25958, 2015

      • Gentlecat
      • 2015-09-16 25937, 2015

      • reosarevok has quit
      • 2015-09-16 25916, 2015

      • alastairp
        well
      • 2015-09-16 25926, 2015

      • alastairp
        that looks… reliable
      • 2015-09-16 25940, 2015

      • Gentlecat
        can you check locally?
      • 2015-09-16 25952, 2015

      • alastairp
        I don’t have any local data
      • 2015-09-16 25912, 2015

      • Gentlecat
        ok
      • 2015-09-16 25920, 2015

      • Mineo
        alastairp: I'm around now, I'll try the import again
      • 2015-09-16 25927, 2015

      • alastairp
        thanks
      • 2015-09-16 25931, 2015

      • alastairp
        grrr leadernotavailable
      • 2015-09-16 25938, 2015

      • zas has quit
      • 2015-09-16 25913, 2015

      • alastairp
        Gentlecat: how do you make a topic?
      • 2015-09-16 25938, 2015

      • Gentlecat
        I added info into readme.md
      • 2015-09-16 25958, 2015

      • Gentlecat
        about that
      • 2015-09-16 25941, 2015

      • alastairp
        I see it
      • 2015-09-16 25942, 2015

      • alastairp
        thanks
      • 2015-09-16 25953, 2015

      • Gentlecat
        :)
      • 2015-09-16 25904, 2015

      • Mineo
        alastairp: works great now :)
      • 2015-09-16 25908, 2015

      • alastairp
        cool
      • 2015-09-16 25916, 2015

      • alastairp
        I have an unreleased fix for you &, too
      • 2015-09-16 25946, 2015

      • alastairp
        that thing where kafka 0.8.1.1 doesn’t let you delete topics but 0.8.2 does
      • 2015-09-16 25947, 2015

      • alastairp
        sigh
      • 2015-09-16 25937, 2015

      • alastairp
        yep, working fine now after deleting it
      • 2015-09-16 25938, 2015

      • Mineo
        is there some part of the scraper that needs to do an options request to the submission url before *every* submission?
      • 2015-09-16 25924, 2015

      • alastairp
        I guess it’s just built into the request?
      • 2015-09-16 25931, 2015

      • alastairp
        is there a way to make it do it only once?
      • 2015-09-16 25937, 2015

      • alastairp
        (I don’t know)
      • 2015-09-16 25944, 2015

      • Gentlecat
        how long does it take for listens to show up on the website after import?
      • 2015-09-16 25919, 2015

      • alastairp
        it should be pretty immediate (there is a script which runs in the background)
      • 2015-09-16 25929, 2015

      • Gentlecat
        I imported 100 pages already and there's still nothing
      • 2015-09-16 25945, 2015

      • Gentlecat
      • 2015-09-16 25950, 2015

      • alastairp
        right. maybe the importer failed
      • 2015-09-16 25908, 2015

      • alastairp
        it’s running in rob’s screen session, so hard for me to get to
      • 2015-09-16 25926, 2015

      • Gentlecat
        says "successfully reported page"
      • 2015-09-16 25936, 2015

      • Gentlecat
        or on the server?
      • 2015-09-16 25912, 2015

      • alastairp
        right. do you remember (/know?) the architecture?
      • 2015-09-16 25920, 2015

      • alastairp
        the server only inserts it into kafka
      • 2015-09-16 25923, 2015

      • Gentlecat
        roughly
      • 2015-09-16 25930, 2015

      • Gentlecat
        yeah
      • 2015-09-16 25932, 2015

      • alastairp
        then another process copies it into cassandra
      • 2015-09-16 25937, 2015

      • alastairp
        and the api gets it from cassandra
      • 2015-09-16 25947, 2015

      • alastairp
        anyway, your data is… importing
      • 2015-09-16 25912, 2015

      • ruaok
        ya know... for a while I saw no PRs flying by. I felt... disconnected. and then BAM! :-)
      • 2015-09-16 25918, 2015

      • alastairp
        2015-09-16 21:50:08,947 ERROR Cannot insert listen: 'ascii' codec can't encode characters in position 14-25: ordinal not in range(128)
      • 2015-09-16 25926, 2015

      • Gentlecat
        aha!
      • 2015-09-16 25935, 2015

      • ruaok
        do you guys need anything from me?
      • 2015-09-16 25947, 2015

      • alastairp
        Gentlecat: damn you and your weird characters
      • 2015-09-16 25952, 2015

      • alastairp
        ruaok: I don’t think so
      • 2015-09-16 25912, 2015

      • Gentlecat
        I knew that my Пользователь would be useful
      • 2015-09-16 25912, 2015

      • alastairp
        I opened a PR, are you in a position to give competent feedback on it? :)
      • 2015-09-16 25915, 2015

      • Gentlecat
        :P
      • 2015-09-16 25929, 2015

      • alastairp
        yeah, so the thing is, I have no idea what’s causing the problem
      • 2015-09-16 25940, 2015

      • alastairp
        maybe russss or RJ2 do
      • 2015-09-16 25944, 2015

      • ruaok
        ok, I'll focus on putting together some slides then
      • 2015-09-16 25901, 2015

      • alastairp
        ok, that’d be handy
      • 2015-09-16 25908, 2015

      • Gentlecat
        that looks like an error that would come from python
      • 2015-09-16 25914, 2015

      • alastairp
        yeah
      • 2015-09-16 25921, 2015

      • Gentlecat
        so there's probably some conversion missing
      • 2015-09-16 25925, 2015

      • alastairp
        it’s in the importer script
      • 2015-09-16 25926, 2015

      • Gentlecat
        just python 2 things
      • 2015-09-16 25943, 2015

      • alastairp
        Gentlecat: is that mb account your one, or a test one?
      • 2015-09-16 25946, 2015

      • Gentlecat
        should've started with 3 :P
      • 2015-09-16 25905, 2015

      • Gentlecat
        it's one of my test accounts
      • 2015-09-16 25913, 2015

      • Gentlecat
        sure
      • 2015-09-16 25930, 2015

      • Gentlecat
        sent
      • 2015-09-16 25916, 2015

      • alastairp
        while I play with this, can you look at LB-15? it’s the last thing on my list of things I want to fix tonight
      • 2015-09-16 25941, 2015

      • Gentlecat
        oh, that thing
      • 2015-09-16 25950, 2015

      • Gentlecat
        sorry, I forgot about that
      • 2015-09-16 25952, 2015

      • alastairp
        :D
      • 2015-09-16 25953, 2015

      • alastairp
        no problem