#metabrainz

/

      • CatQuest
        :(
      • 2017-12-18 35200, 2017

      • naiveai
        Granted my life is not a lot
      • 2017-12-18 35204, 2017

      • CatQuest
        aawww
      • 2017-12-18 35209, 2017

      • CatQuest
        sorry that's adorable
      • 2017-12-18 35229, 2017

      • reosarevok
        dragonzeron: naiveai could do it very easily if he managed to get the site set up...
      • 2017-12-18 35235, 2017

      • reosarevok
        Others probably could too :)
      • 2017-12-18 35249, 2017

      • dragonzeron
        ok so should I speak to him
      • 2017-12-18 35205, 2017

      • reosarevok
        naiveai: did you get stuck on setting up the DB? (did you get the site itself running?)
      • 2017-12-18 35206, 2017

      • naiveai
        reosarevok: excuse moi. as you very well know i am the master of all things, and as such no one else can do what I can do /s
      • 2017-12-18 35221, 2017

      • naiveai
        reosarevok: no, it's importing the dumps that's taking forever.
      • 2017-12-18 35238, 2017

      • reosarevok
        bitmap: are the tiny dev dumps ready to use?
      • 2017-12-18 35245, 2017

      • Leftmost
        No one else can do what I can do, but no one else wants to do what I can do or needs me to do what I can do, so it's not a great position.
      • 2017-12-18 35249, 2017

      • reosarevok
        If so, can you point naiveai to them? :)
      • 2017-12-18 35201, 2017

      • naiveai
        that would help tremendously
      • 2017-12-18 35211, 2017

      • reosarevok
        Leftmost: fiddle while the servers burn?
      • 2017-12-18 35247, 2017

      • bitmap
      • 2017-12-18 35209, 2017

      • Leo_Verto
        > Dropbox
      • 2017-12-18 35218, 2017

      • naiveai
        > DROPBOX AS A FILE SHARING SERVICE
      • 2017-12-18 35223, 2017

      • naiveai
        > angrypepe.jpg
      • 2017-12-18 35227, 2017

      • CatQuest
        :(
      • 2017-12-18 35231, 2017

      • CatQuest
        yvanzo:
      • 2017-12-18 35237, 2017

      • reosarevok
        naiveai: give it a go and see if it works for you :)
      • 2017-12-18 35238, 2017

      • CatQuest
        ping
      • 2017-12-18 35242, 2017

      • naiveai
        reosarevok: will do
      • 2017-12-18 35200, 2017

      • Daniel54321 has quit
      • 2017-12-18 35252, 2017

      • KassOtsimine joined the channel
      • 2017-12-18 35202, 2017

      • KassOtsimine
        hhello it's catcat on a different machine
      • 2017-12-18 35204, 2017

      • naiveai
        KassOtsimine: indeed.
      • 2017-12-18 35210, 2017

      • KassOtsimine
        the mac needs help, it's gonna explode :(
      • 2017-12-18 35237, 2017

      • naiveai
        reosarevok: ping
      • 2017-12-18 35257, 2017

      • reosarevok
        naiveai: still here :p
      • 2017-12-18 35220, 2017

      • naiveai
        reosarevok: tried doing with the sample, got an error "Peer authentication failed for user postgres"
      • 2017-12-18 35237, 2017

      • reosarevok
        You shouldn't be asking me, I haven't tested this myself yet :D
      • 2017-12-18 35244, 2017

      • reosarevok
        bitmap: ^ can you help naiveai here?
      • 2017-12-18 35235, 2017

      • bitmap
        naiveai: do you know where to find the pg_hba.conf and DBDefs.pm files, and can you paste their contents?
      • 2017-12-18 35245, 2017

      • naiveai
        I do know
      • 2017-12-18 35246, 2017

      • dragonzeron
        also nicholas could you take a look at a few of my lyric pages to be added to the possibly whitelist
      • 2017-12-18 35247, 2017

      • naiveai
        Gimme a sec
      • 2017-12-18 35250, 2017

      • reosarevok
        dragonzeron: I won't see your comment if you use that name, just use reosarevok :) I can take a look in a bit
      • 2017-12-18 35201, 2017

      • dragonzeron
        ok
      • 2017-12-18 35203, 2017

      • dragonzeron
        thank you
      • 2017-12-18 35229, 2017

      • naiveai
        bitmap: this is pg_hba.conf: https://pastebin.com/KFQUakxA
      • 2017-12-18 35236, 2017

      • naiveai
        bitmap: and this is DBDefs.pm: https://pastebin.com/SmZQuRj1
      • 2017-12-18 35214, 2017

      • bitmap
        thanks
      • 2017-12-18 35211, 2017

      • KassOtsimine
        :/
      • 2017-12-18 35213, 2017

      • bitmap
        did you restart postgresql after modifying pg_hba.conf, and did you actually set the password for the musicbrainz user to 'musicbrainz'? by default the password is empty, so if you didn't explicitly set it, probably not
      • 2017-12-18 35252, 2017

      • naiveai
        bitmap: did both of those things
      • 2017-12-18 35200, 2017

      • bitmap
        er sorry, user postgres. you set the password to 'admin'?
      • 2017-12-18 35237, 2017

      • naiveai
        yes
      • 2017-12-18 35248, 2017

      • naiveai
        using \password
      • 2017-12-18 35200, 2017

      • naiveai
        figured it's just a devserver, so....
      • 2017-12-18 35210, 2017

      • naiveai
        ok now it somehow works
      • 2017-12-18 35221, 2017

      • naiveai
        I exited the VM
      • 2017-12-18 35224, 2017

      • naiveai
        and halted
      • 2017-12-18 35242, 2017

      • naiveai
        and then restarted, and then tried again. and it worked. so ._.
      • 2017-12-18 35248, 2017

      • naiveai
        sorry bout that.
      • 2017-12-18 35214, 2017

      • bitmap
        np, maybe wasn't picking up the pg_hba.conf changes
      • 2017-12-18 35232, 2017

      • naiveai
        Well I did do a "sudo -u postgres pg_ctlcluster 9.6 main restart"
      • 2017-12-18 35247, 2017

      • naiveai
        maybe an explicit start/stop would've worked better, idk
      • 2017-12-18 35251, 2017

      • naiveai
        either way, heisenbug
      • 2017-12-18 35259, 2017

      • naiveai
        thanks a lot!
      • 2017-12-18 35239, 2017

      • naiveai has left the channel
      • 2017-12-18 35201, 2017

      • gcilou joined the channel
      • 2017-12-18 35258, 2017

      • github joined the channel
      • 2017-12-18 35258, 2017

      • github
        [sir] samj1912 closed pull request #65: Use batched multiprocessing for live indexing in the handler (master...multiproc) https://git.io/vbV6T
      • 2017-12-18 35258, 2017

      • github has left the channel
      • 2017-12-18 35210, 2017

      • samj1912
        finally \o/
      • 2017-12-18 35204, 2017

      • KassOtsimine
        hey GCI peeps, cna i get link t othe GCI hangout?
      • 2017-12-18 35250, 2017

      • reosarevok
        KassOtsimine: it should just show from your appropriate Gmail account (or is there a separate Hangouts site I can link to? I have no clue)
      • 2017-12-18 35202, 2017

      • dragonzeron
        could I join possibly
      • 2017-12-18 35211, 2017

      • reosarevok
        dragonzeron: that's for mentors :)
      • 2017-12-18 35235, 2017

      • dragonzeron
        dang ok
      • 2017-12-18 35224, 2017

      • CatQuest
        reosarevok: I gave myself the lnik no worries
      • 2017-12-18 35229, 2017

      • CatQuest
        bye this machine
      • 2017-12-18 35204, 2017

      • creature_ joined the channel
      • 2017-12-18 35237, 2017

      • CatQuest has quit
      • 2017-12-18 35205, 2017

      • creature has quit
      • 2017-12-18 35205, 2017

      • creature_ is now known as creature
      • 2017-12-18 35205, 2017

      • creature has quit
      • 2017-12-18 35205, 2017

      • creature joined the channel
      • 2017-12-18 35232, 2017

      • reosarevok
      • 2017-12-18 35229, 2017

      • creature_ joined the channel
      • 2017-12-18 35242, 2017

      • creature has quit
      • 2017-12-18 35242, 2017

      • creature_ is now known as creature
      • 2017-12-18 35243, 2017

      • creature has quit
      • 2017-12-18 35243, 2017

      • creature joined the channel
      • 2017-12-18 35248, 2017

      • samj1912
        ruaok: bitmap sir is up and working fabulously :D!
      • 2017-12-18 35234, 2017

      • ruaok
        great! any idea of the throughput yet?
      • 2017-12-18 35241, 2017

      • samj1912
        the latest PR managed to speed it up 30 times
      • 2017-12-18 35244, 2017

      • samj1912
        yup :D
      • 2017-12-18 35250, 2017

      • samj1912
        we are looking at live logs :D
      • 2017-12-18 35201, 2017

      • ruaok
        so, it is no longer falling behind?
      • 2017-12-18 35204, 2017

      • samj1912
        its more than able to keep up with the editing
      • 2017-12-18 35217, 2017

      • ruaok
        ok, that's freaking great.
      • 2017-12-18 35219, 2017

      • samj1912
        and not stressing our pg with large queries either
      • 2017-12-18 35201, 2017

      • samj1912
      • 2017-12-18 35208, 2017

      • creature_ joined the channel
      • 2017-12-18 35213, 2017

      • ruaok
        but I think we need to continue -- editing peaks and other "anomalies" are going to accasionally push mountains of edits (or yield mountains of updates) into sir.
      • 2017-12-18 35220, 2017

      • ruaok
        and it needs to be able to handle it.
      • 2017-12-18 35247, 2017

      • samj1912
        yeah, we should stress test it
      • 2017-12-18 35202, 2017

      • samj1912
        but I think if we have sir running on 2 nodes it can keep up pretty well
      • 2017-12-18 35211, 2017

      • ruaok
        first, lets see where the bottlenecks are now.
      • 2017-12-18 35233, 2017

      • ruaok
        and see if we can find more low-hanging fruit
      • 2017-12-18 35245, 2017

      • samj1912
      • 2017-12-18 35249, 2017

      • samj1912
        these are the current values
      • 2017-12-18 35259, 2017

      • samj1912
        we can push them up a bit I think
      • 2017-12-18 35214, 2017

      • samj1912
        I set some considerate values for initial testing
      • 2017-12-18 35201, 2017

      • ruaok
        I need to get access to that console, so I can spy on the LB queues.
      • 2017-12-18 35215, 2017

      • creature has quit
      • 2017-12-18 35215, 2017

      • creature_ is now known as creature
      • 2017-12-18 35216, 2017

      • creature has quit
      • 2017-12-18 35216, 2017

      • creature joined the channel
      • 2017-12-18 35216, 2017

      • samj1912
        rmq?
      • 2017-12-18 35221, 2017

      • ruaok
        y
      • 2017-12-18 35254, 2017

      • samj1912
        you can enable the management plugin and then forward the port via ssh
      • 2017-12-18 35240, 2017

      • samj1912
        I think the new triggers really helped
      • 2017-12-18 35206, 2017

      • samj1912
        we are getting very conservative changes as compared to before( no more VA reindexes due to ref_count :P)
      • 2017-12-18 35235, 2017

      • ruaok
        here is something that might be worthwhile to check and should not be too much effort.
      • 2017-12-18 35252, 2017

      • ruaok
        get a data dump that is older, maybe a month old.
      • 2017-12-18 35209, 2017

      • ruaok
        setup everything up at glcoud or wherever.
      • 2017-12-18 35238, 2017

      • ruaok
        then replay all of the replication packets and see how many hours it takes to process 30 days of data.
      • 2017-12-18 35209, 2017

      • samj1912
        hmm, okay
      • 2017-12-18 35211, 2017

      • ruaok
        applying replication packets isn't very fast either.
      • 2017-12-18 35222, 2017

      • samj1912
        I will prolly need zas and bitmap to help me with the slave setup
      • 2017-12-18 35232, 2017

      • ruaok
        just load a VM.
      • 2017-12-18 35240, 2017

      • ruaok
        and point sir to it.
      • 2017-12-18 35233, 2017

      • Leftmost
        LordSputnik, what would you say to replacing the test.bb.o instance with the docker image so that we can iron out any potential issues with the image and config process?
      • 2017-12-18 35226, 2017

      • creature_ joined the channel
      • 2017-12-18 35216, 2017

      • creature has quit
      • 2017-12-18 35216, 2017

      • creature_ is now known as creature
      • 2017-12-18 35216, 2017

      • creature has quit
      • 2017-12-18 35216, 2017

      • creature joined the channel
      • 2017-12-18 35201, 2017

      • alastairp
        reosarevok: I mean, it's not like super low inflation in the rest of europe is necessarily a spectacular thing either :)
      • 2017-12-18 35247, 2017

      • reosarevok
        alastairp: sure, but with my wage being stable, I know which one I'd pick :p
      • 2017-12-18 35217, 2017

      • alastairp
        I mean, your landlord is going to put your rent up each year anyway
      • 2017-12-18 35232, 2017

      • alastairp
        and the restaurant down the road is going to put up their prices
      • 2017-12-18 35238, 2017

      • reosarevok
        Oh, no, they don't - this isn't Barcelona :p
      • 2017-12-18 35256, 2017

      • alastairp
        hah
      • 2017-12-18 35257, 2017

      • reosarevok
        I haven't stayed in the same place for long, admittedly, but I'm yet to have someone put my rent up
      • 2017-12-18 35205, 2017

      • reosarevok
        Food prices do go up though
      • 2017-12-18 35227, 2017

      • reosarevok
        But yeah, rent in BCN is not inflation, it's airbnb :p
      • 2017-12-18 35218, 2017

      • alastairp
        absolutely
      • 2017-12-18 35220, 2017

      • creature_ joined the channel
      • 2017-12-18 35235, 2017

      • creature has quit
      • 2017-12-18 35235, 2017

      • creature_ is now known as creature
      • 2017-12-18 35235, 2017

      • creature has quit
      • 2017-12-18 35235, 2017

      • creature joined the channel
      • 2017-12-18 35214, 2017

      • MajorLurker has quit
      • 2017-12-18 35237, 2017

      • MajorLurker joined the channel
      • 2017-12-18 35237, 2017

      • creature has quit