#metabrainz

/

      • ruaok
        LordSputnik: I don't think so. :(
      • 2016-01-04 00415, 2016

      • LordSputnik
        ruaok: how fast is the current Last.fm importer?
      • 2016-01-04 00435, 2016

      • ruaok
        fast now, but it will be rate limited soon and thus be slower.
      • 2016-01-04 00435, 2016

      • drsaunde has quit
      • 2016-01-04 00407, 2016

      • drsaunde joined the channel
      • 2016-01-04 00451, 2016

      • reosarevok
        ruaok: no, I missed it. Will answer
      • 2016-01-04 00408, 2016

      • ruaok
        how about Peter Peskens? how is your dutch?
      • 2016-01-04 00454, 2016

      • kepstin still needs to make an abz last.fm importer that uses the api so it can get mbids :/
      • 2016-01-04 00448, 2016

      • reosarevok
        ruaok: awful, but from g translate I think I can deal with the request
      • 2016-01-04 00454, 2016

      • kuno
        reosarevok: ping me if you need any help
      • 2016-01-04 00442, 2016

      • reosarevok
        kuno: "Hi! I think this should be ok now" in Dutch is the most I should need :p
      • 2016-01-04 00403, 2016

      • kuno
        reosarevok: that's difficult to translate without the question it is responding too
      • 2016-01-04 00401, 2016

      • Mineo
        zas, weeksio: sorry, I have a lot of real life stuff to do at the moment, but for the replication you have to set up the rabbitmq as in sirs documentation, install the functions and triggers in the sql directory and then use the amqp_watch command for it to listen on the queues and reindex entities as necessary
      • 2016-01-04 00409, 2016

      • Mineo
        I'll also push a patch for solr-1 in a minute
      • 2016-01-04 00440, 2016

      • Mineo
        I'm not sure what's the cause of solr-2 because I have no idea which version of the code is running on the vm, so line 328 is not helpful
      • 2016-01-04 00459, 2016

      • ruaok
        weeksio: what is running on the VM? got link?
      • 2016-01-04 00430, 2016

      • CatCat has quit
      • 2016-01-04 00412, 2016

      • weeksio
      • 2016-01-04 00433, 2016

      • LordSputnik
        kepstin: You can have my code if you like, it's Python
      • 2016-01-04 00458, 2016

      • kepstin
        LordSputnik: was planning to adapt the abz js code, probably
      • 2016-01-04 00424, 2016

      • LordSputnik
        kepstin: ok :)
      • 2016-01-04 00432, 2016

      • LordSputnik
        sampsyo: yup, beets lastimport fixed
      • 2016-01-04 00413, 2016

      • CatCat joined the channel
      • 2016-01-04 00413, 2016

      • CatCat has quit
      • 2016-01-04 00413, 2016

      • CatCat joined the channel
      • 2016-01-04 00433, 2016

      • LordSputnik
        Now to fix the LastFM sync plugin for Quod Libet...
      • 2016-01-04 00401, 2016

      • yeeeargh joined the channel
      • 2016-01-04 00433, 2016

      • weeksio
        sorry Mineo it's this code that's running on the VM: https://github.com/jeffweeksio/mb-solrquerywriter
      • 2016-01-04 00458, 2016

      • JesseW joined the channel
      • 2016-01-04 00422, 2016

      • weeksio
        what is the easiest way to pull Mineo 's patch into my repo? (inexperienced git user) https://github.com/metabrainz/sir/commit/f006ee36…
      • 2016-01-04 00443, 2016

      • alastairp
        you have a sir repository too?
      • 2016-01-04 00444, 2016

      • weeksio
        yes
      • 2016-01-04 00449, 2016

      • alastairp
        I would git remote add metabrainz https://github.com/metabrainz/sir.git; git fetch metabrainz; git cherry-pick f006ee36bec
      • 2016-01-04 00457, 2016

      • weeksio
      • 2016-01-04 00400, 2016

      • sampsyo
        LordSputnik: Whoa; awesome!
      • 2016-01-04 00404, 2016

      • alastairp
        though, for just 2 lines?? :)
      • 2016-01-04 00430, 2016

      • weeksio
        I know...it's really just 2 characters
      • 2016-01-04 00443, 2016

      • alastairp
        cherry pick is pretty neat
      • 2016-01-04 00452, 2016

      • weeksio
        but It seems like bad practice to make manual changes
      • 2016-01-04 00452, 2016

      • alastairp
        it’ll apply the patch of just that commit
      • 2016-01-04 00402, 2016

      • weeksio
        kewl
      • 2016-01-04 00407, 2016

      • alastairp
        though that means it’ll have a different commit hash
      • 2016-01-04 00418, 2016

      • alastairp
      • 2016-01-04 00432, 2016

      • alastairp
        and use git apply
      • 2016-01-04 00437, 2016

      • weeksio
        what would alastairp do?
      • 2016-01-04 00408, 2016

      • alastairp
        actually, I like the second one
      • 2016-01-04 00412, 2016

      • alastairp
        since it’s just 1 patch
      • 2016-01-04 00415, 2016

      • weeksio
        on it
      • 2016-01-04 00432, 2016

      • alastairp
        if it was more commits from the same branch, adding a remote and using cherry-pick would probably be faster
      • 2016-01-04 00412, 2016

      • weeksio
        where do I put it?
      • 2016-01-04 00419, 2016

      • weeksio
        the download?
      • 2016-01-04 00428, 2016

      • alastairp
        anywhere you want
      • 2016-01-04 00444, 2016

      • alastairp
        it’s an argument to git apply, so you just put in the path
      • 2016-01-04 00458, 2016

      • alastairp
        probably easiest to put it in your working directory though (Sir)
      • 2016-01-04 00403, 2016

      • weeksio
        k
      • 2016-01-04 00451, 2016

      • JesseW has quit
      • 2016-01-04 00411, 2016

      • CJ_
        ruaok, Looking now. It looks like SOLR-1 is closed. I guess I'll start on SOLR-2?
      • 2016-01-04 00436, 2016

      • ruaok
        plz
      • 2016-01-04 00445, 2016

      • ruaok
        I think Mineo is also looking at it.
      • 2016-01-04 00440, 2016

      • CJ_
        ruaok, Is that jeff?
      • 2016-01-04 00401, 2016

      • ruaok
        jeff == weeksio
      • 2016-01-04 00416, 2016

      • weeksio
        :P
      • 2016-01-04 00418, 2016

      • CJ_
        Understood. Was just trying to match server users with irc users. :)
      • 2016-01-04 00430, 2016

      • CJ_
        Also trying to avoid stepping on toes. :)
      • 2016-01-04 00450, 2016

      • CJ_
        weeksio, Are you in the middle of things on the server or can I make some changes?
      • 2016-01-04 00450, 2016

      • weeksio
        stomp away
      • 2016-01-04 00421, 2016

      • weeksio
        go for it
      • 2016-01-04 00454, 2016

      • CJ_
        You are running out of /opt? I see a lot of things pointing back to your /home.
      • 2016-01-04 00431, 2016

      • CJ_
        Including the log configuration.
      • 2016-01-04 00458, 2016

      • weeksio
        I was just patching SOLR-1
      • 2016-01-04 00433, 2016

      • weeksio
        wondering if I need to reindex to make that take...
      • 2016-01-04 00412, 2016

      • CJ_
        Maybe? Let me look.
      • 2016-01-04 00423, 2016

      • CJ_
        It looks like the fix is in the import so I think you will have to reindex for it to work.
      • 2016-01-04 00453, 2016

      • weeksio
        should I do that now?
      • 2016-01-04 00417, 2016

      • CJ_
        Go for it. I will wait.
      • 2016-01-04 00417, 2016

      • weeksio
        those take for ever
      • 2016-01-04 00427, 2016

      • CJ_
        Oh. Then maybe wait. :)
      • 2016-01-04 00429, 2016

      • weeksio
        like several days iirc
      • 2016-01-04 00434, 2016

      • CJ_
        Really?
      • 2016-01-04 00446, 2016

      • weeksio
        releases particularly
      • 2016-01-04 00452, 2016

      • CJ_
        That seems like an awful long time.
      • 2016-01-04 00404, 2016

      • CJ_
        Where is the code for MBXMLWriter?
      • 2016-01-04 00455, 2016

      • weeksio
      • 2016-01-04 00443, 2016

      • weeksio
        I forget how long it took last time I indexed releases...it might have been more like 20ish hours
      • 2016-01-04 00456, 2016

      • CJ_
        weeksio, Can you add a logging line outputting the contents of con and con.docs?
      • 2016-01-04 00415, 2016

      • weeksio
        uhhhh
      • 2016-01-04 00428, 2016

      • CJ_
        It's unclear where exactly the NPE is ocurring.
      • 2016-01-04 00408, 2016

      • CJ_
        weeksio, Line 328 of MBXMLWriter is where the NPE is thrown. The two candidates are con or con.docs.
      • 2016-01-04 00419, 2016

      • CJ_
        One of them is null.
      • 2016-01-04 00456, 2016

      • weeksio
        k...not sure how/where
      • 2016-01-04 00407, 2016

      • weeksio
        I didn't write this
      • 2016-01-04 00458, 2016

      • weeksio
        just made a few edits as needed over the summer
      • 2016-01-04 00425, 2016

      • CJ_
        Understood. But if you could make that change for me it would help me troubleshoot.
      • 2016-01-04 00440, 2016

      • CJ_
        I assume the code is not on the server were I could modify and build it myself.
      • 2016-01-04 00435, 2016

      • weeksio
        I'm not sure how to make that change
      • 2016-01-04 00451, 2016

      • weeksio
        is this in MBS?
      • 2016-01-04 00407, 2016

      • CJ_
        It is the code you linked me to.
      • 2016-01-04 00416, 2016

      • CJ_
      • 2016-01-04 00416, 2016

      • stanislas
        LordSputnik: Can I change the name 'search' in bbws/custom.py::106 to es_conn_search ? (it shadows the name from outher scope)
      • 2016-01-04 00428, 2016

      • stanislas
        (In the next commit)
      • 2016-01-04 00400, 2016

      • weeksio
        ok...yes I see
      • 2016-01-04 00439, 2016

      • LordSputnik
        stanislas: better to call it "results", I think :)
      • 2016-01-04 00455, 2016

      • stanislas
        ok
      • 2016-01-04 00416, 2016

      • stanislas
        LordSputnik: I've no idea what it does, just looke on the previous line :)
      • 2016-01-04 00420, 2016

      • LordSputnik
        stanislas: Or, if you prefer, do that in a separate PR and we can merge straight away
      • 2016-01-04 00424, 2016

      • CJ_
        weeksio, How are you building and deploying things? If it is on the box I can do it myself. :)
      • 2016-01-04 00440, 2016

      • weeksio
        I'm entirely on the box...I had something set up on my machine over the summer to build and test before putting it on the box, but that setup is long gone
      • 2016-01-04 00408, 2016

      • stanislas
        And I've been thinking about merging my branch with master, because there is no point in keeping it this way. Do you want to make some copy of master (if you need one - I've creator/id task accepted from the old version, but the recent one is also capable of doing it) ?
      • 2016-01-04 00416, 2016

      • stanislas
        LordSputnik: ^
      • 2016-01-04 00443, 2016

      • LordSputnik
        stanislas: The issue is these are multi-instance tasks, so I'd rather wait until all instances are used up, or GCI is over, before merging (just to make it less likely that another student will just tweak your tests and submit)
      • 2016-01-04 00426, 2016

      • stanislas
        I've meant to merge my own branch
      • 2016-01-04 00432, 2016

      • opatel99 joined the channel
      • 2016-01-04 00434, 2016

      • stanislas
        to my own master
      • 2016-01-04 00459, 2016

      • opatel99
        Freso: ping
      • 2016-01-04 00411, 2016

      • opatel99
        Screencasts, essentis
      • 2016-01-04 00419, 2016

      • stanislas
        LordSputnik: So should I do it ?
      • 2016-01-04 00437, 2016

      • weeksio
        CJ_: does it look like you'll be able to do it yourself?
      • 2016-01-04 00457, 2016

      • weeksio
        CJ_: not trying to avoid it, it's just you know what to do and how to do it and I have to figure things out a bit
      • 2016-01-04 00459, 2016

      • LordSputnik
        stanislas: ohh, I see - yes, that should be fine :)
      • 2016-01-04 00449, 2016

      • stanislas
        LordSputnik: Great :)
      • 2016-01-04 00421, 2016

      • opatel99
        Freso: any status on unblocking the brainz at my school?
      • 2016-01-04 00449, 2016

      • Freso
        opatel99: Are you able to get through now? I got a mail saying it isn't blocked.
      • 2016-01-04 00450, 2016

      • opatel99
      • 2016-01-04 00410, 2016

      • stanislas
        LordSputnik: Should I write about all cases, when some sort of exception appeared ? (like bad type of 'languages' attribute in WorkData passed)
      • 2016-01-04 00409, 2016

      • opatel99
        Freso: apparently not
      • 2016-01-04 00413, 2016

      • kepstin
        opatel99: it looks like they have it more or less correctly categorized, your school must be explicitly blocking the "Music" category
      • 2016-01-04 00432, 2016

      • LordSputnik
        stanislas: like you've done in the bugs encountered file?
      • 2016-01-04 00434, 2016

      • kepstin
        maybe that category can be removed from musicbrainz, since we don't actually host any music?
      • 2016-01-04 00440, 2016

      • stanislas
        LordSputnik: This example is not quite correct, I've already written about in Bugs_encountered.md.
      • 2016-01-04 00444, 2016

      • kepstin
        they're probably trying to block e.g. spotify
      • 2016-01-04 00406, 2016

      • stanislas
        LordSputnik: Yes
      • 2016-01-04 00428, 2016

      • stanislas
        LordSputnik: You've said some time ago, that I should put this bugs into bookbrainz Jira ? Should I make only one issue there, containing these 5 bugs, or 5 separate ?
      • 2016-01-04 00440, 2016

      • kepstin
        Freso: maybe poke opendns about getting the 'Music' category removed so mbz isn't bundled with music streaming sites?
      • 2016-01-04 00440, 2016

      • LordSputnik
        stanislas: separate bugs in JIRA please :) Give as much information as you can
      • 2016-01-04 00457, 2016

      • LordSputnik
        (stack traces would be useful, for example)
      • 2016-01-04 00441, 2016

      • weeksio
        is there anything I need to do to start automatic replication on a RT_SLAVE setup?
      • 2016-01-04 00435, 2016

      • weeksio
        I believe I have the DBDefs.pm setup properly and have followed Mineo 's instructions for getting sir to listen for changes...but nothing seems to be happening
      • 2016-01-04 00409, 2016

      • CJ_
        weeksio, I have not looked. I am still trying to understand your setup.
      • 2016-01-04 00400, 2016

      • Freso
        LordSputnik: Did Last.FM open up their developer/API (sub)site again?
      • 2016-01-04 00401, 2016

      • weeksio
        np...I'm going to have to leave soon (probably should have left a few hours ago) ...I can be back in irc, but won't be able to do anything for about 5.5hrs
      • 2016-01-04 00415, 2016

      • CJ_
        Understood.
      • 2016-01-04 00430, 2016

      • CJ_
        I will continue to look around.
      • 2016-01-04 00441, 2016

      • CJ_
        I am surprised there is no logging configured.
      • 2016-01-04 00403, 2016

      • weeksio
        I'm off school all this week...so I intend to be around quite a bit
      • 2016-01-04 00411, 2016

      • CJ_
        Understood.
      • 2016-01-04 00446, 2016

      • CJ_
        Have you been successful in seeing log statements?
      • 2016-01-04 00412, 2016

      • weeksio
        Solr logs, yes
      • 2016-01-04 00426, 2016

      • kepstin
        Freso: ooh, looks like the 'create api account' page is updated now, it might be working :)
      • 2016-01-04 00434, 2016

      • weeksio
      • 2016-01-04 00408, 2016

      • kepstin
        Freso: it works, nice! :)