#metabrainz

/

      • cedric
        that would be nicer
      • 2016-10-10 28400, 2016

      • Freso
        <BANG>
      • 2016-10-10 28403, 2016

      • Freso
        Hi people!
      • 2016-10-10 28411, 2016

      • Gentlecat
        Hi
      • 2016-10-10 28424, 2016

      • Freso
        Got a couple of agenda items, but not too much.
      • 2016-10-10 28438, 2016

      • Freso
        So shouldn't be *too* long of a meeting today. :)
      • 2016-10-10 28450, 2016

      • Freso
        So let's get started. Gentlecat, want to go first?
      • 2016-10-10 28400, 2016

      • Gentlecat
        I kept working on docker stuff
      • 2016-10-10 28411, 2016

      • Gentlecat
        Fixed tests that got broken
      • 2016-10-10 28437, 2016

      • Gentlecat
        Wrote configuration templates for projects that needed it
      • 2016-10-10 28407, 2016

      • Gentlecat
        Still need to try and deploy all that
      • 2016-10-10 28411, 2016

      • Gentlecat
        Fin
      • 2016-10-10 28440, 2016

      • Freso
        (Pick the next one to go. :))
      • 2016-10-10 28413, 2016

      • Freso
        Or I'll just go.
      • 2016-10-10 28413, 2016

      • Gentlecat
        Freso
      • 2016-10-10 28417, 2016

      • Freso
        🙋
      • 2016-10-10 28455, 2016

      • Freso
        So it's been another slow week for me. More apartment hunting and such.
      • 2016-10-10 28410, 2016

      • Freso
        Sent an update for some MBS docs and for the MeB.org site.
      • 2016-10-10 28442, 2016

      • Freso
        And has tried to keep up with IRC at least. Still lots of catching up on forums needed. :(
      • 2016-10-10 28420, 2016

      • Freso
        Oh, and my phone seems to have taken its last breath today. :'( Not sure yet what I'm gonna do about that, but what a time for that to happen at. :|
      • 2016-10-10 28425, 2016

      • Freso
        Ah well.
      • 2016-10-10 28427, 2016

      • Freso
        Fin.
      • 2016-10-10 28429, 2016

      • Freso
        reosarevok!
      • 2016-10-10 28430, 2016

      • Freso
        Or bitmap at least was around a few minutes ago. :)
      • 2016-10-10 28439, 2016

      • bitmap
        okay. hi
      • 2016-10-10 28451, 2016

      • bitmap
        I was also working on docker things
      • 2016-10-10 28431, 2016

      • bitmap
        I fixed rsync between postgres master & slave containers but had trouble getting pg_hba.conf working with swarm mode (it couldn't get the right IPs)
      • 2016-10-10 28452, 2016

      • Freso
        (Other people up: reosarevok ruaok CatQuest? zas Leftmost? — anyone else?)
      • 2016-10-10 28457, 2016

      • reosarevok
        Support. Plus transcluded the soundtrack etc updates.
      • 2016-10-10 28401, 2016

      • bitmap
        then we decided to not use swarm mode, so I was testing the containers with just `docker run` using host networking
      • 2016-10-10 28406, 2016

      • reosarevok
        Oh. Whoops.
      • 2016-10-10 28411, 2016

      • Leftmost
        Nothing from me this week.
      • 2016-10-10 28414, 2016

      • bitmap
        that seems to be working great so far
      • 2016-10-10 28438, 2016

      • zas is around
      • 2016-10-10 28418, 2016

      • bitmap
        I'm still doing tests and fixing configuration but I haven't had any more networking issues at least
      • 2016-10-10 28428, 2016

      • cedric
        bitmap: ALTER DATABASE musicbrainz_db SET search_path TO musicbrainz,public;
      • 2016-10-10 28448, 2016

      • zas
        bitmap: are you using net=host everywhere now ?
      • 2016-10-10 28455, 2016

      • bitmap
        I looked at the phusion/baseimage image zas linked and was testing it in place of alpine
      • 2016-10-10 28458, 2016

      • bitmap
        zas: yes
      • 2016-10-10 28427, 2016

      • bitmap
        since alpine doesn't use glibc and locale support is weird, that might be better to use in production
      • 2016-10-10 28436, 2016

      • Freso
        cedric: We're currently in meeting mode - it would be great if you can wait until after the meeting (~50 minutes at most - watch out for the </BANG>) for further debugging help. :) ( https://musicbrainz.org/doc/MetaBrainz_Meeting )
      • 2016-10-10 28409, 2016

      • bitmap
        that's all from me last week, fin
      • 2016-10-10 28430, 2016

      • Freso
        bitmap: Pick the next to go. :)
      • 2016-10-10 28433, 2016

      • bitmap picks zas
      • 2016-10-10 28435, 2016

      • zas
        yes, alpine is very light, but i think it is better to use more complete images for now, decreasing weights of our containers will come later (optimization)
      • 2016-10-10 28405, 2016

      • zas
        i didnt a lot of research about issues we had with swarm
      • 2016-10-10 28408, 2016

      • cedric
        freso: apologies, I didn't need any help anymore, just gave the solution to set permanently the search_path for the database, I leave you to it.
      • 2016-10-10 28411, 2016

      • bitmap
        cedric: right, you can set it on the database too, that should work
      • 2016-10-10 28422, 2016

      • Freso
        cedric: No worries. :)
      • 2016-10-10 28449, 2016

      • zas
        ruaok poke panda (who is working on docker) and panda presented me Andreas i will ask them more things soon
      • 2016-10-10 28457, 2016

      • zas
        i'm in contact with both now
      • 2016-10-10 28401, 2016

      • ruaok
        \ø/
      • 2016-10-10 28408, 2016

      • zas
        Andreas is working on swarm
      • 2016-10-10 28413, 2016

      • ruaok
        that was worth it. I'll buy him beer in 3 weeks. :)
      • 2016-10-10 28453, 2016

      • zas
        for now, we stick to simple docker, we still have a lot of things to do, and bothering with swarm limitations is too much of time now
      • 2016-10-10 28411, 2016

      • zas
        we'll move to swarm later
      • 2016-10-10 28425, 2016

      • zas
        i was confirmed one thing: docker compose is there to stay
      • 2016-10-10 28441, 2016

      • zas
        apart that, i reviewed docker & ufw mess, and ended to disable docker iptables stuff, so it doesnt change things and create security holes as it was doing...
      • 2016-10-10 28459, 2016

      • zas
        it means we need to manually add rules to open ports to the world
      • 2016-10-10 28422, 2016

      • zas
        local network (10.2.2.x) is fully open
      • 2016-10-10 28439, 2016

      • zas
        so no need to add anything for local services
      • 2016-10-10 28421, 2016

      • zas
        i also fixed ntp on kiki which was failing after a reboot
      • 2016-10-10 28450, 2016

      • zas
        i deployed yet another bunch of security updates on servers
      • 2016-10-10 28453, 2016

      • zas
        i'm working on openresty container, moved to phusion for it, and now figuring out how to add upstreams using consul template
      • 2016-10-10 28426, 2016

      • zas
        the template "language" is a bit ... unclear to me ;)
      • 2016-10-10 28402, 2016

      • zas
        i also set up a local proxy for docker registry, so it caches downloaded images, speeding up deployments
      • 2016-10-10 28445, 2016

      • zas
        this part was awfully tedious, mostly because of the lack of good documentation (and change to registry v2, most docs are outdated)
      • 2016-10-10 28405, 2016

      • zas
        but it works now
      • 2016-10-10 28410, 2016

      • zas
        fin.
      • 2016-10-10 28417, 2016

      • zas
        ruaok?
      • 2016-10-10 28420, 2016

      • ruaok
        k
      • 2016-10-10 28434, 2016

      • ruaok
        last week was paying people, balancing accounts, that sort of guff.
      • 2016-10-10 28440, 2016

      • ruaok
        some metabrainz stuff, biz dev catch up.
      • 2016-10-10 28451, 2016

      • ruaok
        and learning about docker swarm mode, realizing it isn't up to snuff.
      • 2016-10-10 28413, 2016

      • ruaok
        so, now I need to undo what I've done there and go back to plain vanilla docker.
      • 2016-10-10 28437, 2016

      • ruaok
        hopefully I can get the search servers up an running before i skip for the weekend.
      • 2016-10-10 28445, 2016

      • ruaok
        I'm out friday and monday for sure.
      • 2016-10-10 28406, 2016

      • ruaok
        tuesday and wed my presence on IRC depends on mobile coverage on the canal du midi. :)
      • 2016-10-10 28409, 2016

      • ruaok
        fin.
      • 2016-10-10 28419, 2016

      • zas
        ahah ;)
      • 2016-10-10 28430, 2016

      • Freso
        reosarevok is still up, but I think that's about it.
      • 2016-10-10 28432, 2016

      • ruaok
        oh yeah, zas, I'm coming to france.
      • 2016-10-10 28444, 2016

      • ruaok
        not really your neck of the woods, but still.
      • 2016-10-10 28450, 2016

      • ruaok
        Freso: anyone else left?
      • 2016-10-10 28456, 2016

      • Freso
        ruaok: reosarevok :
      • 2016-10-10 28456, 2016

      • reosarevok
        So what I said earlier pretty much
      • 2016-10-10 28458, 2016

      • Freso
        * :)
      • 2016-10-10 28407, 2016

      • reosarevok
        22:07 <reosarevok> Support. Plus transcluded the soundtrack etc updates.
      • 2016-10-10 28447, 2016

      • chirlu
        I worked with yvanz to convert the rest of the URL validation rules to the new (and better) format.
      • 2016-10-10 28403, 2016

      • Freso
        :)
      • 2016-10-10 28410, 2016

      • Freso
        !m yvanz & chirlu
      • 2016-10-10 28410, 2016

      • BrainzBot
        You're doing good work, yvanz & chirlu!
      • 2016-10-10 28417, 2016

      • chirlu
        It’s not 100% ready yet because I think it might be to strict in some regards, but I haven’t really wrapped my head around it yet.
      • 2016-10-10 28421, 2016

      • chirlu
        fin
      • 2016-10-10 28431, 2016

      • Freso
        reosarevok: That was a fin from you too, right?
      • 2016-10-10 28437, 2016

      • Freso
        Anyone else?
      • 2016-10-10 28424, 2016

      • reosarevok
        Yup
      • 2016-10-10 28431, 2016

      • Freso
        Alright then.
      • 2016-10-10 28435, 2016

      • Freso
        chirlu: canonical URLs for VIAF!
      • 2016-10-10 28438, 2016

      • TOPIC: MetaBrainz Community and Development channel | MusicBrainz non-development: #musicbrainz | MeB meeting agenda: canonical URLs for VIAF (chirlu), HTTPS for YouTube, Amazon, RateYourMusic and SHS (chirlu)
      • 2016-10-10 28447, 2016

      • reosarevok
        Sorry, my kendo ends just when the meeting starts so it's messy
      • 2016-10-10 28409, 2016

      • chirlu
        So, this is about how we store VIAF URLs.
      • 2016-10-10 28438, 2016

      • chirlu
        Generally, for URLs, we tend to use the “final” form, i.e. we want to avoid redirects.
      • 2016-10-10 28454, 2016

      • Freso
        Oh, snap, I was supposed to mail VIAF about this. :|
      • 2016-10-10 28417, 2016

      • Freso
        Well, I meant to anyway.
      • 2016-10-10 28435, 2016

      • chirlu
        In the case of VIAF, that would be, e.g., https://viaf.org/viaf/27092134/
      • 2016-10-10 28415, 2016

      • chirlu
        However, VIAF itself gives an official permalink form on each page, which is http://viaf.org/viaf/2709213 in that example.
      • 2016-10-10 28432, 2016

      • chirlu
        (Note: http, not https; trailing slash vs. not.)
      • 2016-10-10 28447, 2016

      • Freso
        I'd say we stick with what VIAF themselves declare as the official URL.
      • 2016-10-10 28437, 2016

      • chirlu
        I’d tend to that, too. The question then is whether we still want to use a different URL for the actual linking.
      • 2016-10-10 28457, 2016

      • Freso
        Right. I'd be happy to inject an 's' into the schema. :)
      • 2016-10-10 28400, 2016

      • chirlu
        Like is the case with Amazon, where we add a partner ID for linking only.
      • 2016-10-10 28421, 2016

      • chirlu
        So that we would still store the official permalink, but avoid people being redirected.
      • 2016-10-10 28455, 2016

      • Freso
        +1
      • 2016-10-10 28400, 2016

      • chirlu
        This came up in connection with the whole s/http/https/ thing, obviously. :)
      • 2016-10-10 28423, 2016

      • Freso is generally a fan of injecting HTTPS as much/often as possible :)
      • 2016-10-10 28428, 2016

      • chirlu
        If we agree on this, I’d make a pull request (should be easy enough).
      • 2016-10-10 28432, 2016

      • bitmap
        I don't have any strong opinion but that sounds fine
      • 2016-10-10 28446, 2016

      • ruaok nods
      • 2016-10-10 28416, 2016

      • mihaitish joined the channel
      • 2016-10-10 28429, 2016

      • Freso
        Seems like that motion has been carried.
      • 2016-10-10 28432, 2016

      • Freso
        Thank you chirlu :)
      • 2016-10-10 28444, 2016

      • Freso
        chirlu: HTTPS for YouTube, Amazon, RateYourMusic and SHS!
      • 2016-10-10 28445, 2016

      • TOPIC: MetaBrainz Community and Development channel | MusicBrainz non-development: #musicbrainz | MeB meeting agenda: HTTPS for YouTube, Amazon, RateYourMusic and SHS (chirlu)
      • 2016-10-10 28401, 2016

      • Freso
        +1 to HTTPS'ing all the things ;)
      • 2016-10-10 28443, 2016

      • chirlu
        So this is the more standard case. YT and Amazon redirect everything to HTTPS now. RYC and SHS are available under both at the moment; SHS forces HTTPS for logged-in users and intends to go HTTPS-only (like MB ;-) ).
      • 2016-10-10 28414, 2016

      • chirlu
        Convert to HTTPS as with Discogs, Wikidata etc. previously?
      • 2016-10-10 28422, 2016

      • Freso
        +1
      • 2016-10-10 28432, 2016

      • bitmap
        +1 to HTTPS for the same reasons as before
      • 2016-10-10 28441, 2016

      • Freso
        Unless someone speaks up, I'd say this motion has also been carried.
      • 2016-10-10 28455, 2016

      • ruaok
        dah
      • 2016-10-10 28409, 2016

      • TOPIC: MetaBrainz Community and Development channel | MusicBrainz non-development: #musicbrainz | MeB meeting agenda: (empty)
      • 2016-10-10 28410, 2016

      • zas
        +1
      • 2016-10-10 28416, 2016

      • Freso
        chirlu: Will you put in the PRs?
      • 2016-10-10 28424, 2016

      • chirlu
        Yes.
      • 2016-10-10 28428, 2016

      • Freso
        ❤️
      • 2016-10-10 28430, 2016

      • Freso
        !m chirlu
      • 2016-10-10 28430, 2016

      • BrainzBot
        You're doing good work, chirlu!
      • 2016-10-10 28434, 2016

      • Freso
        Alright then.
      • 2016-10-10 28448, 2016

      • Freso
        If no one else has anything to add, let's call it a night. :)
      • 2016-10-10 28451, 2016

      • ruaok
        I'm looking forward to a more fun post docker phase.
      • 2016-10-10 28403, 2016

      • Freso
        I think everyone is.
      • 2016-10-10 28425, 2016

      • Freso
        Well, post-moving-to-NewHost-phase actually.
      • 2016-10-10 28439, 2016

      • Freso
        Anyway…
      • 2016-10-10 28442, 2016

      • Freso
        </BANG>
      • 2016-10-10 28450, 2016

      • Freso
        Thank you for your time everyone! :)
      • 2016-10-10 28457, 2016

      • chirlu
        Post-moving-and-ironing-out-issues. ;-)
      • 2016-10-10 28458, 2016

      • TOPIC: MetaBrainz Community and Development channel | MusicBrainz non-development: #musicbrainz | MeB meeting agenda: reviews
      • 2016-10-10 28406, 2016

      • Freso
        chirlu: Yes. :)
      • 2016-10-10 28409, 2016

      • gcilou is looking forward to gci :)