#metabrainz

/

      • CJ_
        Because I can return all of those already but I am unclear of the function of the mbjson.
      • 2016-01-21 02138, 2016

      • gcilou
        I'm trying to get metabrainz.org working on my computer and am wondering what I need to tweak in the configuration file..
      • 2016-01-21 02154, 2016

      • reosarevok
        Hmm. I can't find it.
      • 2016-01-21 02136, 2016

      • reosarevok
        chirlu` might be able to help if he's around
      • 2016-01-21 02157, 2016

      • chirlu`
      • 2016-01-21 02100, 2016

      • reosarevok
        Looks the same as the json one
      • 2016-01-21 02114, 2016

      • reosarevok
        What's supposed to be the difference between search jsonnew and mb json? :)
      • 2016-01-21 02123, 2016

      • reosarevok
        Anyway, off for a bit now :)
      • 2016-01-21 02121, 2016

      • CJ_
        Mineo, Do you have a minute to explain mbjson to me? Or can you point me to anything that explains it? Thanks.
      • 2016-01-21 02133, 2016

      • stanislas
        gcilou: I guess you followed https://github.com/metabrainz/metabrainz.org/blob…, right ?
      • 2016-01-21 02136, 2016

      • gcilou
        stanislas: Actually I was following this: https://github.com/metabrainz/metabrainz.org/blob…
      • 2016-01-21 02121, 2016

      • zas
        chirlu`, bitmap, ruaok: i found from where the performance difference between pingu & astro comes. It is related to local dns cache, which impacts negatively the upstream response time for a reason i can't explain. resolv.conf on pingu didn't have 127.0.0.1 as first line, and was using gateway dnscaches. Using the local dnscache on each mb server .... makes
      • 2016-01-21 02121, 2016

      • zas
        it slower, which is quite counter-intuitive (it is meant to be faster, since dns responses are cached locally). I removed this line from all servers, and they have now all the same mean response time than pingu.
      • 2016-01-21 02144, 2016

      • CJ_
        zas, That is odd.
      • 2016-01-21 02144, 2016

      • zas
        This is why new installs were behaving like pingu, resolv.conf was using gateway dnscaches only.
      • 2016-01-21 02146, 2016

      • chirlu`
        Hm, interesting.
      • 2016-01-21 02104, 2016

      • gcilou
      • 2016-01-21 02121, 2016

      • gcilou
        ^ that's what I get when I try to run "python run.py"
      • 2016-01-21 02126, 2016

      • zas
        CJ_: especially odd, because the mean response time is divided by 10 when NOT using local dns cache ...
      • 2016-01-21 02135, 2016

      • opatel99
        gcilou: Did you install the requirements with `pip install -r requirements.txt`
      • 2016-01-21 02113, 2016

      • CJ_
        zas, How many responses are you seeing? Perhaps it is trashing the disk vs caching in memory?
      • 2016-01-21 02126, 2016

      • gcilou
        opatel99: no.. Im just following the README.md on metabrainz.org github
      • 2016-01-21 02132, 2016

      • opatel99
        gcilou: Run that command.
      • 2016-01-21 02134, 2016

      • gcilou
        opatel99: It did something but also had an error and "python run.py" still didn't work
      • 2016-01-21 02147, 2016

      • opatel99
        Traceback now?
      • 2016-01-21 02103, 2016

      • gcilou
        traceback?
      • 2016-01-21 02127, 2016

      • opatel99
        The error code.
      • 2016-01-21 02159, 2016

      • gcilou
        Command "python setup.py egg_info" failed with error code 1 in /private/var/folders/5f/0dttw86s14g_24ych3b8vbl40000gn/T/pip-build-4PLKAg/psycopg2
      • 2016-01-21 02159, 2016

      • gcilou
        You are using pip version 7.1.2, however version 8.0.0 is available.
      • 2016-01-21 02159, 2016

      • gcilou
        You should consider upgrading via the 'pip install --upgrade pip' command.
      • 2016-01-21 02104, 2016

      • gcilou
        urg
      • 2016-01-21 02120, 2016

      • gcilou
        sorry. That was the error from the pip install command
      • 2016-01-21 02133, 2016

      • opatel99
        type python -V and tell me what you get
      • 2016-01-21 02159, 2016

      • gcilou
        python 2.7.11
      • 2016-01-21 02147, 2016

      • opatel99
        Hmm. Go ahead and upgrade pip via pip install --upgrade pip
      • 2016-01-21 02157, 2016

      • opatel99
        and then try installing the requirements
      • 2016-01-21 02112, 2016

      • gcilou
        Ok it upgraded
      • 2016-01-21 02135, 2016

      • zas
        CJ_: not many at all, and it is dnscache, which is using memory only.
      • 2016-01-21 02155, 2016

      • CJ_
        zas, Hmm. I am out of ideas, then.
      • 2016-01-21 02100, 2016

      • zas
        i don't think this is a dns cache issue, but more a nginx/resolver issue
      • 2016-01-21 02102, 2016

      • gcilou
        opatel99, same error after installing
      • 2016-01-21 02107, 2016

      • stanislas
        opatel99, gcilou: I am quite sure it is not a matter of pip
      • 2016-01-21 02129, 2016

      • gcilou
        Am I supposed to be following the README or the INSTALL ?
      • 2016-01-21 02137, 2016

      • stanislas
        opatel99, gcilou: pip's just said that it can be upgraded
      • 2016-01-21 02117, 2016

      • stanislas
        gcilou: in README.md "If you want to do development you should use instructions above. It is much easier way to start. For more detailed installation instructions see INSTALL.md file."
      • 2016-01-21 02101, 2016

      • gcilou
        stanislas, yeah so I followed the instructions, but I'm not sure what to tweak in the config.py file..so I think that's the problem
      • 2016-01-21 02135, 2016

      • stanislas
        gcilou: You've pasted the whole error ?
      • 2016-01-21 02109, 2016

      • gcilou
        stanislas, Yes, the pastebin above.
      • 2016-01-21 02138, 2016

      • adesh joined the channel
      • 2016-01-21 02100, 2016

      • Gentlecat
        gcilou: paste your config file as well
      • 2016-01-21 02129, 2016

      • gcilou
      • 2016-01-21 02122, 2016

      • adesh
        Gentlecat: I had an earlier PR from a few weeks back, I recently fixed a merge conflict that had occurred due to the commits after the PR. Can I get any kind of update if the PR is okay? So that if it's not I can fix it.
      • 2016-01-21 02137, 2016

      • adesh
      • 2016-01-21 02145, 2016

      • adesh
      • 2016-01-21 02113, 2016

      • adesh
      • 2016-01-21 02154, 2016

      • Gentlecat
        adesh: sorry, I don't have time at all at look these right now
      • 2016-01-21 02112, 2016

      • adesh
        Gentlecat: That's fine. Update me at your own convenience. But I will appreciate if I atleast get any status update for the PR, even if late.
      • 2016-01-21 02114, 2016

      • Gentlecat
        and these are not very basic changes
      • 2016-01-21 02119, 2016

      • gcilou
        The pastebin above is my config file
      • 2016-01-21 02119, 2016

      • adesh
        Thanks a lot
      • 2016-01-21 02127, 2016

      • Gentlecat
        I will for sure, don't worry
      • 2016-01-21 02148, 2016

      • Gentlecat
        probably after GCI ends and I get some more time off the university
      • 2016-01-21 02151, 2016

      • adesh
        Thank you.. Update me whenever you can
      • 2016-01-21 02104, 2016

      • adesh
        okay that will do.. ill wait
      • 2016-01-21 02106, 2016

      • adesh
        thanks
      • 2016-01-21 02102, 2016

      • gcilou
        Gentlecat, what do I need to change in the config file?
      • 2016-01-21 02128, 2016

      • Gentlecat
        config looks ok
      • 2016-01-21 02142, 2016

      • Gentlecat
        try "pip install raven[flask]"
      • 2016-01-21 02144, 2016

      • Gentlecat
        and run again
      • 2016-01-21 02148, 2016

      • gcilou
        ok
      • 2016-01-21 02110, 2016

      • gcilou
        same error.
      • 2016-01-21 02133, 2016

      • gcilou
        "no module named raven.contrib.flask"
      • 2016-01-21 02106, 2016

      • Gentlecat
        you are running it in vagrant vm, right?
      • 2016-01-21 02117, 2016

      • gcilou
        what's vm?
      • 2016-01-21 02146, 2016

      • Gentlecat
        VM - Virtual Machine
      • 2016-01-21 02155, 2016

      • gcilou
        im in "vagrant@metabrainz:/vagrant$"
      • 2016-01-21 02100, 2016

      • adesh has quit
      • 2016-01-21 02104, 2016

      • Gentlecat
        same thing you used to run CB
      • 2016-01-21 02112, 2016

      • Gentlecat
        ok
      • 2016-01-21 02120, 2016

      • Gentlecat
        try to comment out "from raven.contrib.flask import Sentry"
      • 2016-01-21 02127, 2016

      • gcilou
        ok
      • 2016-01-21 02105, 2016

      • gcilou
        erm what are comments in python? I forget
      • 2016-01-21 02109, 2016

      • Gentlecat
        #
      • 2016-01-21 02114, 2016

      • gcilou
        k
      • 2016-01-21 02142, 2016

      • gcilou
        "No module named flask_debugtoolbar"
      • 2016-01-21 02104, 2016

      • gcilou
      • 2016-01-21 02112, 2016

      • Gentlecat
        did you have any errors after you ran "vagrant up"?
      • 2016-01-21 02149, 2016

      • gcilou
        no
      • 2016-01-21 02140, 2016

      • Gentlecat
        "pip install Flask-DebugToolbar"
      • 2016-01-21 02154, 2016

      • Gentlecat
        and paste the output please
      • 2016-01-21 02105, 2016

      • Gentlecat
        then try to run again
      • 2016-01-21 02121, 2016

      • gcilou
        I mean there was some red when it was installing the first time but at the end it said it was successful
      • 2016-01-21 02122, 2016

      • gcilou
        ok
      • 2016-01-21 02152, 2016

      • gcilou
        paste what that command printed out?
      • 2016-01-21 02143, 2016

      • gcilou
      • 2016-01-21 02124, 2016

      • Gentlecat
        what happens when you run it now?
      • 2016-01-21 02151, 2016

      • gcilou
      • 2016-01-21 02159, 2016

      • gcilou
        ^that happens again
      • 2016-01-21 02113, 2016

      • Gentlecat
        I'm not sure what's wrong
      • 2016-01-21 02148, 2016

      • Gentlecat
        going away for some time now
      • 2016-01-21 02110, 2016

      • gcilou
        hm ok. Was there something special I was supposed to install/download before beginning this? Oh ok bye
      • 2016-01-21 02104, 2016

      • stanislas
        gcilou: Haven't you restarted vagrant after installing Flask-DebugToolbar ?
      • 2016-01-21 02112, 2016

      • gcilou
        stanislas, yes I quit the terminal and then restarted with "vagrant up" "vagrant ssh" and then "python run.py" once I was in the proper dir
      • 2016-01-21 02139, 2016

      • stanislas
        gcilou: you should install Flask-DebugToolbar in the vagrant
      • 2016-01-21 02122, 2016

      • gcilou
        stanislas, so install Flask-DebugToolbar while "vagrant up" is running?
      • 2016-01-21 02108, 2016

      • stanislas
        gcilou: yes, not exactly when vagrant up is running but after you login into your vagrant using ssh
      • 2016-01-21 02123, 2016

      • gcilou
        ok I'll try
      • 2016-01-21 02117, 2016

      • gcilou
      • 2016-01-21 02127, 2016

      • gcilou
        stanislas^ this is what I got
      • 2016-01-21 02137, 2016

      • stanislas
        try with sudo
      • 2016-01-21 02101, 2016

      • gcilou
        where does the sudo go in the command?
      • 2016-01-21 02107, 2016

      • stanislas
        at first
      • 2016-01-21 02111, 2016

      • gcilou
        ok
      • 2016-01-21 02114, 2016

      • stanislas
        like sudo pip install sth
      • 2016-01-21 02116, 2016

      • gcilou
        ok it installed successfully, but then running run.py sent this error
      • 2016-01-21 02123, 2016

      • gcilou
      • 2016-01-21 02153, 2016

      • stanislas
        I guess that's not very special error, try doing the same as you've done just now.
      • 2016-01-21 02126, 2016

      • stanislas
        No module named flask_admin means that you should install flask_admin
      • 2016-01-21 02151, 2016

      • stanislas
        sudo pip install Flask-Admin
      • 2016-01-21 02129, 2016

      • stanislas
        (leave the VM as it was, don't restart it)
      • 2016-01-21 02135, 2016

      • gcilou
        Ok that worked but running run.py set an error that "no module named memcache" so I tried installing that and it said there is no matching distribution found for memcache
      • 2016-01-21 02144, 2016

      • CatmanIX is now known as The_Catman
      • 2016-01-21 02148, 2016

      • zas
        search servers down, on it
      • 2016-01-21 02115, 2016

      • stanislas
        btw. I am pretty sure you haven't followed https://github.com/metabrainz/metabrainz.org/blob… after strarting vagrant
      • 2016-01-21 02145, 2016

      • gcilou
        Right I was just doing the development part
      • 2016-01-21 02152, 2016

      • stanislas
        pip install -r requirements.txt
      • 2016-01-21 02152, 2016

      • guest__ joined the channel
      • 2016-01-21 02158, 2016

      • stanislas
        this file includes for example : Flask-DebugToolbar, Flask-admin, python-memcached :)
      • 2016-01-21 02119, 2016

      • gcilou
        stanislas, ok well that worked for a while but then this red error stopped it
      • 2016-01-21 02124, 2016

      • gcilou
      • 2016-01-21 02127, 2016

      • stanislas
        sudo ?
      • 2016-01-21 02149, 2016

      • gcilou
        same with sudo
      • 2016-01-21 02103, 2016

      • Gentlecat
        ok, I'm back home
      • 2016-01-21 02118, 2016

      • stanislas
        gcilou: no, sudo is not the answer but you should run it with sudo
      • 2016-01-21 02139, 2016

      • gcilou
        Well, it still had that error when I ran with sduo
      • 2016-01-21 02141, 2016

      • gcilou
        sudo
      • 2016-01-21 02150, 2016

      • stanislas
        that's what I thought :)
      • 2016-01-21 02101, 2016

      • Gentlecat
        one thing I can suggest is to create a VM again
      • 2016-01-21 02117, 2016

      • Gentlecat
        I'll do that as well too, to make sure it still works
      • 2016-01-21 02141, 2016

      • gcilou
        OK. so creating by just running vagrant up? Or am I missing something?
      • 2016-01-21 02104, 2016

      • Gentlecat
        you don't have some requirements installed, which might suggest that something went wrong
      • 2016-01-21 02110, 2016

      • stanislas
        vagrant destroy and the vagrant up
      • 2016-01-21 02113, 2016

      • Gentlecat
        log out of VM, go to project root
      • 2016-01-21 02128, 2016

      • Gentlecat
        then run these to commands that stanislas just posted
      • 2016-01-21 02136, 2016

      • Gentlecat
        r/to/two
      • 2016-01-21 02138, 2016

      • stanislas
      • 2016-01-21 02140, 2016

      • gcilou
        log out?
      • 2016-01-21 02145, 2016

      • stanislas
        exit
      • 2016-01-21 02154, 2016

      • stanislas
        run 'exit'
      • 2016-01-21 02124, 2016

      • stanislas
        and it will close the connection (to vagrant)