#metabrainz

/

      • ruaok
        not hotmail. not spam folder.
      • 2016-11-11 31637, 2016

      • zas
        This is confirmation email from ?
      • 2016-11-11 31656, 2016

      • ruaok
        Username: yatahaze
      • 2016-11-11 31603, 2016

      • ruaok
        on mb.org I guess
      • 2016-11-11 31631, 2016

      • Gentlecat
        we now have dockerized jenkins running tests in docker containers https://ci.metabrainz.org/job/critiquebrainz/3/co…
      • 2016-11-11 31641, 2016

      • Gentlecat
        this is amazing
      • 2016-11-11 31645, 2016

      • ruaok
        woooo, Gentlecat
      • 2016-11-11 31612, 2016

      • kyan joined the channel
      • 2016-11-11 31650, 2016

      • zas
        \o/
      • 2016-11-11 31611, 2016

      • Gentlecat
      • 2016-11-11 31637, 2016

      • Gentlecat
        perhaps we can dedicate some less important server for it
      • 2016-11-11 31612, 2016

      • alastairp
        Gentlecat: that's neat. can it be public? I would really like to set it up at the uni
      • 2016-11-11 31636, 2016

      • alastairp
        also, when you have time I'd be up for talking about how we do it with AB
      • 2016-11-11 31601, 2016

      • Gentlecat
        not until challenges get merged :grumpyface:
      • 2016-11-11 31605, 2016

      • Gentlecat
        but yeah, sure
      • 2016-11-11 31608, 2016

      • alastairp
        ooo
      • 2016-11-11 31613, 2016

      • alastairp
        what a blackmailer
      • 2016-11-11 31647, 2016

      • alastairp
        "oh but it's more important that we set up docker now, because challenges introduces another task runner and I want them all in docker before I add *another*"
      • 2016-11-11 31650, 2016

      • Gentlecat
        this repo can't be public, but I'll make the jenkins container and setup public after a bit of cleanup
      • 2016-11-11 31658, 2016

      • alastairp
        sweet
      • 2016-11-11 31605, 2016

      • bitmap
        ruaok: I see an email sent to that user in the logs, so not sure why it doesn't arrive
      • 2016-11-11 31618, 2016

      • bitmap
        in the exim logs
      • 2016-11-11 31620, 2016

      • ruaok
        ok, good enough.
      • 2016-11-11 31632, 2016

      • zas
        bitmap: let's talk about metrics & our services, i would like we implement a simple thing: return a json with few metrics about the service
      • 2016-11-11 31635, 2016

      • ruaok
        I'm now certain it isn't our setup. :)
      • 2016-11-11 31636, 2016

      • bitmap
        maybe we need to set up dkim and other crap so we're not blocked
      • 2016-11-11 31640, 2016

      • bitmap
        idk
      • 2016-11-11 31653, 2016

      • Gentlecat
        yeah, I wouldn't be so sure
      • 2016-11-11 31601, 2016

      • bitmap
        oh, but it wasn't in their spam folder
      • 2016-11-11 31636, 2016

      • zas
        bitmap: the idea would be to be able to use https://github.com/influxdata/telegraf/tree/maste…
      • 2016-11-11 31637, 2016

      • Gentlecat
        some other container I was testing didn't even deliver emails
      • 2016-11-11 31642, 2016

      • bitmap
        I assume it would still go there even if our server isn't trusted
      • 2016-11-11 31601, 2016

      • Gentlecat
        that wasn't the case before
      • 2016-11-11 31607, 2016

      • Gentlecat
        at least with gmail
      • 2016-11-11 31625, 2016

      • Gentlecat
        it was just like "nope, don't need that"
      • 2016-11-11 31629, 2016

      • bitmap
        okay, I'll need to finish the postfix container then
      • 2016-11-11 31643, 2016

      • Gentlecat
        I'll try again now
      • 2016-11-11 31643, 2016

      • bitmap
        zas: which service?
      • 2016-11-11 31602, 2016

      • zas
        how does this exim server works ? was it whitelisted somewhere as sending emails for mb.o ?
      • 2016-11-11 31620, 2016

      • bitmap
        Gentlecat: with postfix?
      • 2016-11-11 31631, 2016

      • Gentlecat
        no, with current setup
      • 2016-11-11 31635, 2016

      • bitmap
        ok
      • 2016-11-11 31651, 2016

      • zas
        bitmap: mbws, mbwebsite, caa-indexer, etc
      • 2016-11-11 31654, 2016

      • Gentlecat
      • 2016-11-11 31609, 2016

      • bitmap
        it was working fine for me too
      • 2016-11-11 31614, 2016

      • bitmap
        (gmail)
      • 2016-11-11 31621, 2016

      • bitmap
        this user had gmail
      • 2016-11-11 31622, 2016

      • zas
        bitmap: for example, number of requests, per type, queue length, things like that
      • 2016-11-11 31632, 2016

      • bitmap
        maybe we can start with caa-indexer since that's easier to deploy
      • 2016-11-11 31656, 2016

      • bitmap
        queue size would be nice
      • 2016-11-11 31603, 2016

      • bitmap
        I have no idea how much stuff it's processing atm
      • 2016-11-11 31612, 2016

      • zas
        bitmap: the service needs to listen on a port so we can get the json through http
      • 2016-11-11 31620, 2016

      • zas
        bitmap: exactly
      • 2016-11-11 31634, 2016

      • zas
        if i get this, i can draw whatever you may think of ;)
      • 2016-11-11 31646, 2016

      • bitmap
        hmm
      • 2016-11-11 31659, 2016

      • zas
        and using kapacitor even generate alerts from that
      • 2016-11-11 31614, 2016

      • bitmap
        caa-indexer doesn't use http at all, or even expose anything
      • 2016-11-11 31625, 2016

      • bitmap
        just connects to rabbitmq
      • 2016-11-11 31643, 2016

      • bitmap
        so we'd have to write a small http service?
      • 2016-11-11 31600, 2016

      • zas
        yes, minimal one just to get status
      • 2016-11-11 31616, 2016

      • zas
        most languages provide such in few lines
      • 2016-11-11 31606, 2016

      • bitmap
        I'll try to write something in a few mins
      • 2016-11-11 31627, 2016

      • zas
        ok, in the meantime i'll add rabbitmq metrics ;)
      • 2016-11-11 31620, 2016

      • bitmap
        does it matter what the endpoint names or the json keys are?
      • 2016-11-11 31650, 2016

      • bitmap
        I assume that's all configuration on your side
      • 2016-11-11 31606, 2016

      • zas
        yes
      • 2016-11-11 31610, 2016

      • zas
        doesn't matter
      • 2016-11-11 31632, 2016

      • zas
        values can be anything int, float, strings
      • 2016-11-11 31633, 2016

      • Gentlecat
      • 2016-11-11 31659, 2016

      • Gentlecat
        I have time to talk about how to do it with AB
      • 2016-11-11 31604, 2016

      • alastairp
        cool
      • 2016-11-11 31618, 2016

      • alastairp
        you should come to the uni some time
      • 2016-11-11 31634, 2016

      • alastairp
        maybe I'll come to the office too
      • 2016-11-11 31646, 2016

      • Gentlecat
        who's coming to who first?
      • 2016-11-11 31651, 2016

      • dboys has quit
      • 2016-11-11 31605, 2016

      • Gentlecat
        I haven't been at the uni for a very long time
      • 2016-11-11 31634, 2016

      • Gentlecat
        maybe I'll come on monday after my free spanish class
      • 2016-11-11 31644, 2016

      • alastairp imagines Obi-Wan
      • 2016-11-11 31653, 2016

      • alastairp
        cool. where are you taking classes?
      • 2016-11-11 31602, 2016

      • Gentlecat
        free as in 40 euros
      • 2016-11-11 31627, 2016

      • alastairp
        ah, right. now I remember. Freso said that he was't doing it because of all this month's travel
      • 2016-11-11 31630, 2016

      • Gentlecat
        at that school you suggested us
      • 2016-11-11 31653, 2016

      • alastairp
        ¿qué tal?
      • 2016-11-11 31616, 2016

      • Gentlecat
        bien
      • 2016-11-11 31643, 2016

      • Freso
        I should look at whether they have anything in January and plan my travels around that.
      • 2016-11-11 31659, 2016

      • Freso goes to bed
      • 2016-11-11 31608, 2016

      • Gentlecat
        yo no hablo español
      • 2016-11-11 31617, 2016

      • Gentlecat
        that's my most use phrase now
      • 2016-11-11 31631, 2016

      • Gentlecat
        perhaps that will change one day
      • 2016-11-11 31633, 2016

      • alastairp
        por favor, ¿puedes hablar más despacio?
      • 2016-11-11 31649, 2016

      • alastairp
        I have a device on my network which I don't know
      • 2016-11-11 31650, 2016

      • alastairp
        hmm
      • 2016-11-11 31658, 2016

      • alastairp
        it keeps stealing my laptop's IP
      • 2016-11-11 31604, 2016

      • alastairp
        sketchy dhcp server?
      • 2016-11-11 31633, 2016

      • Gentlecat
        I have a tutorial in works about making this whole thing work
      • 2016-11-11 31607, 2016

      • Gentlecat
        perhaps just making it a proper documentation would be more useful for the world
      • 2016-11-11 31629, 2016

      • alastairp
        what whole thing?
      • 2016-11-11 31624, 2016

      • alastairp
        ohhhhh. that's what the problem is
      • 2016-11-11 31625, 2016

      • Gentlecat
        jenkins running in a docker container while spawning more containers to test things
      • 2016-11-11 31639, 2016

      • Gentlecat
        something funny happened
      • 2016-11-11 31600, 2016

      • alastairp
        I had changed the mac of my laptop to the same one of my chromecast, when I was hacking the captive portal on my apartment internet
      • 2016-11-11 31606, 2016

      • alastairp
        I guess I never changed it back
      • 2016-11-11 31611, 2016

      • bitmap
        this email issue is definitely a problem with our setup
      • 2016-11-11 31626, 2016

      • alastairp
        and it seems like I was trying to ssh to my chromecast
      • 2016-11-11 31629, 2016

      • Gentlecat
        I have some cleanup code which deletes all "jenkins" containers
      • 2016-11-11 31632, 2016

      • Gentlecat
        so when I started jobs with it, jenkins just killed itself
      • 2016-11-11 31609, 2016

      • alastairp
        not ideal
      • 2016-11-11 31611, 2016

      • Gentlecat
        as in connected to its own host and stopped itself
      • 2016-11-11 31653, 2016

      • Gentlecat
        alastairp: when are you going to put AB into docker?
      • 2016-11-11 31616, 2016

      • Gentlecat
        maybe students can do that instead
      • 2016-11-11 31616, 2016

      • alastairp
        yeah, that too
      • 2016-11-11 31616, 2016

      • Gentlecat
        unless that's what you wanted to talk about
      • 2016-11-11 31631, 2016

      • alastairp
        it's just that now there's lots of institutional knowledge in MeB, about how to do it in a consistent way
      • 2016-11-11 31600, 2016

      • zas
        bitmap: i'm trying to use https://github.com/influxdata/telegraf/blob/maste… but when i connect to exposed port (the one of the service) i get malformed HTTP response "AMQP\x00\x00\t\x01" errors, so i think there's another port (but not sure it is published)
      • 2016-11-11 31604, 2016

      • zas
        any idea?
      • 2016-11-11 31633, 2016

      • zas
      • 2016-11-11 31604, 2016

      • zas
        but with 5672 -> cannot connect
      • 2016-11-11 31630, 2016

      • bitmap
        there might be a separate api port which isn't exposed
      • 2016-11-11 31643, 2016

      • bitmap
      • 2016-11-11 31649, 2016

      • bitmap
        not sure if this is enabled even
      • 2016-11-11 31637, 2016

      • bitmap
        ah we need the 3.6.5-management image
      • 2016-11-11 31607, 2016

      • bitmap
      • 2016-11-11 31616, 2016

      • Slurpee joined the channel
      • 2016-11-11 31642, 2016

      • bitmap
        I'll change it
      • 2016-11-11 31656, 2016

      • zas
        ok ty
      • 2016-11-11 31646, 2016

      • chirlu sighs at the replication packet thing.
      • 2016-11-11 31619, 2016

      • chirlu
        zas, bitmap: There is an SPF entry for musicbrainz.org that whitelists the old IP range.
      • 2016-11-11 31641, 2016

      • chirlu
        It doesn’t disallow other senders, though, only marks them as suspicious.
      • 2016-11-11 31605, 2016

      • zas
        yes, no one changed that i think
      • 2016-11-11 31640, 2016

      • chirlu
        metabrainz.org has an SPF entry whitelisting Google.
      • 2016-11-11 31649, 2016

      • bitmap
        zas: new container is running
      • 2016-11-11 31610, 2016

      • zas
        chirlu: i think we also have dkim entries
      • 2016-11-11 31602, 2016

      • chirlu
        No, doesn’t look like it.
      • 2016-11-11 31619, 2016

      • chirlu
        Only google-site-verification entries in addition to SPF.
      • 2016-11-11 31628, 2016

      • bitmap
        I think it's important we used named volumes everywhere
      • 2016-11-11 31648, 2016

      • bitmap
        when I recreated the rabbitmq container it generated a new volume
      • 2016-11-11 31658, 2016

      • bitmap
        which didn't have any of the old data
      • 2016-11-11 31617, 2016

      • zas
        bitmap: i agree, and if we don't we'll end with tons of orphans
      • 2016-11-11 31652, 2016

      • bitmap
        I had to stop the container immediate once I realized it, hopefully no requests went there
      • 2016-11-11 31658, 2016

      • bitmap
        immediately*
      • 2016-11-11 31611, 2016

      • zas
        and you fixed the volume ?
      • 2016-11-11 31624, 2016

      • bitmap
        yeah
      • 2016-11-11 31636, 2016

      • zas
        what did you do exactly? copy old unnamed to new one ?
      • 2016-11-11 31640, 2016

      • bitmap
        I created a named volume and copied the data from the previous into it
      • 2016-11-11 31653, 2016

      • bitmap
        then deleted both orphans
      • 2016-11-11 31657, 2016

      • zas
        ok
      • 2016-11-11 31620, 2016

      • zas
        btw, what is the port of the rabbitmq api ? can you check it is actually listening
      • 2016-11-11 31649, 2016

      • bitmap
        should be 65414
      • 2016-11-11 31625, 2016

      • bitmap
        seems to be working
      • 2016-11-11 31657, 2016

      • magerharz has quit