#metabrainz

/

      • ruaok
        bitmap: are you getting the cron daemon emails about hourly.sh?
      • 2015-10-08 28158, 2015

      • bitmap
        yeah, there were some issues with the sitemaps stuff not running...now it's taking a while to catch up :/
      • 2015-10-08 28106, 2015

      • ruaok
        ok, cool.
      • 2015-10-08 28120, 2015

      • bitmap
        there was a bug in the XML library it was using causing it to crash
      • 2015-10-08 28141, 2015

      • MBJenkins
        Project musicbrainz-server_master build #209: SUCCESS in 20 min: http://ci.musicbrainz.org/job/musicbrainz-server_…
      • 2015-10-08 28141, 2015

      • MBJenkins
        * Michael Wiencek: Significantly speed up writing the overall sitemaps
      • 2015-10-08 28142, 2015

      • MBJenkins
        * Michael Wiencek: Move log() to Sitemap::Utils
      • 2015-10-08 28142, 2015

      • MBJenkins
        * Michael Wiencek: Missing copyright
      • 2015-10-08 28144, 2015

      • LordSputnik
        I love refactoring :) Scrapped 80 lines of a 380 line file
      • 2015-10-08 28155, 2015

      • LordSputnik has quit
      • 2015-10-08 28102, 2015

      • JesseW joined the channel
      • 2015-10-08 28141, 2015

      • ruaok has quit
      • 2015-10-08 28119, 2015

      • JonnyJD has quit
      • 2015-10-08 28142, 2015

      • Gentlecat has quit
      • 2015-10-08 28154, 2015

      • JesseW has quit
      • 2015-10-08 28148, 2015

      • legoktm
        uh, I lost track of the time, gonna start in a few minutes
      • 2015-10-08 28156, 2015

      • legoktm
        started
      • 2015-10-08 28121, 2015

      • legoktm
        wiki is down now
      • 2015-10-08 28103, 2015

      • Bookzombie has quit
      • 2015-10-08 28124, 2015

      • Bookzombie joined the channel
      • 2015-10-08 28148, 2015

      • legoktm
        aaand done
      • 2015-10-08 28134, 2015

      • legoktm
        banners removed
      • 2015-10-08 28137, 2015

      • legoktm
        woot \o/
      • 2015-10-08 28148, 2015

      • legoktm
        please ping me if you notice anything wrong with the wiki
      • 2015-10-08 28141, 2015

      • bitmap
        nice work, thanks for helping with that :)
      • 2015-10-08 28159, 2015

      • jcazevedo has quit
      • 2015-10-08 28126, 2015

      • JesseW joined the channel
      • 2015-10-08 28145, 2015

      • jcazevedo joined the channel
      • 2015-10-08 28156, 2015

      • legoktm
        thanks, and np :)
      • 2015-10-08 28142, 2015

      • adhawkins has quit
      • 2015-10-08 28108, 2015

      • adhawkins joined the channel
      • 2015-10-08 28147, 2015

      • Clint has quit
      • 2015-10-08 28154, 2015

      • Clint joined the channel
      • 2015-10-08 28129, 2015

      • MBJenkins
        Project musicbrainz-server_master build #210: SUCCESS in 20 min: http://ci.musicbrainz.org/job/musicbrainz-server_…
      • 2015-10-08 28129, 2015

      • MBJenkins
        Michael Wiencek: More sitemaps perf (avoid IO unless necessary)
      • 2015-10-08 28103, 2015

      • MBJenkins
        Project musicbrainz-server_master build #211: SUCCESS in 20 min: http://ci.musicbrainz.org/job/musicbrainz-server_…
      • 2015-10-08 28104, 2015

      • MBJenkins
        Michael Wiencek: Remove unneeded ORDER BY
      • 2015-10-08 28132, 2015

      • Gentlecat joined the channel
      • 2015-10-08 28157, 2015

      • diana_olhovik joined the channel
      • 2015-10-08 28121, 2015

      • MBJenkins
        Project musicbrainz-server_master build #212: SUCCESS in 20 min: http://ci.musicbrainz.org/job/musicbrainz-server_…
      • 2015-10-08 28121, 2015

      • MBJenkins
        Michael Wiencek: No point building sitemaps for entities blocked in robots.txt
      • 2015-10-08 28130, 2015

      • JesseW has quit
      • 2015-10-08 28142, 2015

      • ariscop has quit
      • 2015-10-08 28119, 2015

      • UmkaDK joined the channel
      • 2015-10-08 28157, 2015

      • UmkaDK_ joined the channel
      • 2015-10-08 28119, 2015

      • UmkaDK has quit
      • 2015-10-08 28144, 2015

      • ariscop joined the channel
      • 2015-10-08 28109, 2015

      • samphippen joined the channel
      • 2015-10-08 28138, 2015

      • ruaok joined the channel
      • 2015-10-08 28117, 2015

      • zas
        Good morning, ruaok
      • 2015-10-08 28128, 2015

      • ruaok
        mr cfe.
      • 2015-10-08 28145, 2015

      • ruaok
        mor cofee
      • 2015-10-08 28127, 2015

      • JonnyJD joined the channel
      • 2015-10-08 28157, 2015

      • ruaok
      • 2015-10-08 28111, 2015

      • ruaok
        morning zas.
      • 2015-10-08 28132, 2015

      • ruaok
        how does one make a 3-cup coffee series like that one?
      • 2015-10-08 28147, 2015

      • zas
        :))
      • 2015-10-08 28148, 2015

      • ruaok
        afterall no one may speak to before I'm starting my second cup.
      • 2015-10-08 28138, 2015

      • zas
        well, time for me to prepare another one, first one was hours ago... (children side-effect)
      • 2015-10-08 28151, 2015

      • zas
        btw, i fixed few things this morning, and i have a better view concerning graphite (and luks's suggestion: grafana <--- whooaa).
      • 2015-10-08 28149, 2015

      • zas
        current setup is very broken, but i fixed collectd on pino & astro, data gathered is visible in graphite now (only nginx status was available)
      • 2015-10-08 28120, 2015

      • zas
        and the whole thing is totally undocumented afaik
      • 2015-10-08 28124, 2015

      • alastairp
        nice
      • 2015-10-08 28133, 2015

      • alastairp
        ruaok: you'll not be needed soon
      • 2015-10-08 28121, 2015

      • zas
        he is very needed
      • 2015-10-08 28129, 2015

      • zas
        think about the fun he is able to provide to many people by just using a train and posting few photos ;)
      • 2015-10-08 28106, 2015

      • ruaok
        this is how things are rolling here this morning: https://www.dropbox.com/s/mi3yamjm4ue178q/2015-10…
      • 2015-10-08 28140, 2015

      • ruaok
        alastairp: making yourself superfluous is the #1 job of every manager, no?
      • 2015-10-08 28155, 2015

      • LordSputnik joined the channel
      • 2015-10-08 28139, 2015

      • ruaok
        zas: feel free to create a brand new VM for a new graphite install.
      • 2015-10-08 28150, 2015

      • ruaok
        once that is done, we can ditch the existing one.
      • 2015-10-08 28158, 2015

      • alastairp
        ruaok: great, we can finally get rid of you
      • 2015-10-08 28106, 2015

      • alastairp
        I'll speak with the board
      • 2015-10-08 28112, 2015

      • ruaok
        wouldn't that be nice!
      • 2015-10-08 28116, 2015

      • alastairp
        oh, I mean, that was supposed to be in our secret channel
      • 2015-10-08 28144, 2015

      • ruaok
        I mean after 15 years of doing the same 1000 jobs every month it gets kinda old, ya know?
      • 2015-10-08 28107, 2015

      • ruaok
        OMFG, graphana. yes, please.
      • 2015-10-08 28115, 2015

      • zas
        ruaok: can i re-use cosgrove or pinoprime for that ?
      • 2015-10-08 28131, 2015

      • ruaok
        if they're suited, sure.
      • 2015-10-08 28139, 2015

      • zas
        i'll have a look at their state
      • 2015-10-08 28114, 2015

      • zas
        we'll have to define what we need on dashboards
      • 2015-10-08 28127, 2015

      • zas
        i guess one dashboard could display the load of all servers (cpu - mem - disk r/w), another one for websites + databases, and few more for details on critical servers
      • 2015-10-08 28134, 2015

      • zas
        once we have all metrics on graphite it is quite easy to do whatever we want anyway
      • 2015-10-08 28143, 2015

      • ruaok
        perfect.
      • 2015-10-08 28108, 2015

      • zas
        i think about deploying collectd using chef
      • 2015-10-08 28124, 2015

      • ruaok
        TBH, my go to metric is load average, so having a clear overview would be good.
      • 2015-10-08 28138, 2015

      • ruaok
        and it might also be nice to have a MusicBrainz core servers overview.
      • 2015-10-08 28158, 2015

      • zas
        well, first, i'll do a clean install of the needed stuff
      • 2015-10-08 28103, 2015

      • ruaok
        because when someone screams 502, I want to see app servers, search servers and DB.
      • 2015-10-08 28115, 2015

      • ruaok nods
      • 2015-10-08 28127, 2015

      • zas
        we can do great things with graphite, and grafana is even better
      • 2015-10-08 28154, 2015

      • ruaok
      • 2015-10-08 28152, 2015

      • ruaok
        Gentlecat: nice first ride.
      • 2015-10-08 28121, 2015

      • ruaok
        a little glutton for punished riding through gotico, but hey. :)
      • 2015-10-08 28149, 2015

      • ruaok
        I've got my new tyre ready to go. \ø/
      • 2015-10-08 28150, 2015

      • zas
        ruaok: there is already a collectd cookbook https://github.com/metabrainz/chef-cookbooks/tree…
      • 2015-10-08 28120, 2015

      • ruaok
        we'd just need to deploy that onto each server?
      • 2015-10-08 28133, 2015

      • zas
        yes, i fixed the config
      • 2015-10-08 28145, 2015

      • zas
        how do we proceed to do that ?
      • 2015-10-08 28149, 2015

      • ruaok
        I'm pretty sure it involves more coffee.
      • 2015-10-08 28108, 2015

      • alastairp
        ruaok: I saw it
      • 2015-10-08 28151, 2015

      • ruaok
        zas: I think we ought to discuss this with bitmap.
      • 2015-10-08 28111, 2015

      • ruaok
        because right now that is deployed via the chef scripts that administer mb-server
      • 2015-10-08 28127, 2015

      • zas
        ok, we'll see with bitmap
      • 2015-10-08 28134, 2015

      • ruaok
        but clearly that needs to move to a server farm wide setup.
      • 2015-10-08 28112, 2015

      • ruaok
        ideally, the cobbled together scripts that we have syswiki/server-setup should be moved to chef.
      • 2015-10-08 28115, 2015

      • zas
        where is defined @graphite['host'] ? https://github.com/metabrainz/chef-cookbooks/blob…
      • 2015-10-08 28119, 2015

      • ruaok
        and the collectd stuff needs to be there as well
      • 2015-10-08 28135, 2015

      • ruaok
        I have no idea -- I never touched any of this.
      • 2015-10-08 28144, 2015

      • ruaok
        so, what I think we should do is start a "server setup" chef script and collectd can be the first element.
      • 2015-10-08 28152, 2015

      • ruaok
        and then remove that recipe from mb-server.
      • 2015-10-08 28155, 2015

      • zas
        yes, and the issue i fixed this morning on pino (gamekeeper/rabbitmq) was just a command to give the right perms on rabbitmq to the monitoring user, i don't know if this is in chef (there's a rabbitmq cookbook), bitmap will prolly know
      • 2015-10-08 28111, 2015

      • zas
        ruaok: i agree
      • 2015-10-08 28120, 2015

      • ruaok
        possibly in the supermarket, yes.
      • 2015-10-08 28109, 2015

      • ruaok
      • 2015-10-08 28125, 2015

      • ruaok
        the out* stuff is pretty clever.
      • 2015-10-08 28127, 2015

      • ruaok
        our*
      • 2015-10-08 28149, 2015

      • ruaok
        the main recipe comes from the supermarket. and all the chef recipe does is add installation details.
      • 2015-10-08 28100, 2015

      • ruaok
        we should consider using the same sort of setup
      • 2015-10-08 28108, 2015

      • zas
        yes, and basebox is nice too
      • 2015-10-08 28137, 2015

      • ruaok
        yeah.
      • 2015-10-08 28126, 2015

      • alastairp
        I need to do this chef stuff for my other projects too
      • 2015-10-08 28111, 2015

      • alastairp
        " Windows used to run on ninety per cent of computing devices; now, with the rise of Android and Apple phones, it runs on eleven per cent."
      • 2015-10-08 28120, 2015

      • alastairp
        wow, I didn't realise the change was so vast
      • 2015-10-08 28120, 2015

      • ruaok
        the definition of computing device has also changed.
      • 2015-10-08 28131, 2015

      • alastairp
        yeah, of course
      • 2015-10-08 28139, 2015

      • alastairp
      • 2015-10-08 28156, 2015

      • alastairp
        it looks like MSs new phones will tether to keboard/mouse/screen
      • 2015-10-08 28107, 2015

      • alastairp
        that's interesting. some android phones have also tried to do it
      • 2015-10-08 28120, 2015

      • ruaok has quit
      • 2015-10-08 28144, 2015

      • zas has quit
      • 2015-10-08 28151, 2015

      • samphippen has quit
      • 2015-10-08 28110, 2015

      • ruaok joined the channel
      • 2015-10-08 28154, 2015

      • demonimin has quit
      • 2015-10-08 28144, 2015

      • demonimin joined the channel
      • 2015-10-08 28141, 2015

      • zas joined the channel
      • 2015-10-08 28127, 2015

      • demonimin has quit
      • 2015-10-08 28105, 2015

      • alastairp
        ruaok: any plans this weekend? (long weekend, holiday monday)
      • 2015-10-08 28109, 2015

      • alastairp
        other than cycling
      • 2015-10-08 28139, 2015

      • ruaok
        there is oktoberfest happening this weekend.
      • 2015-10-08 28154, 2015

      • ruaok
        aleta and I are going to beat the crowds and go early tonight.
      • 2015-10-08 28121, 2015

      • alastairp
        ah, cool
      • 2015-10-08 28131, 2015

      • ruaok
        other than that, no real plans yet
      • 2015-10-08 28141, 2015

      • alastairp
        mini hackday?
      • 2015-10-08 28148, 2015

      • alastairp
        we can get Gentlecat over and tell him what to do
      • 2015-10-08 28109, 2015

      • ruaok
        sounds great to me.
      • 2015-10-08 28121, 2015

      • ruaok
        my living room is always open for such shenanigans.
      • 2015-10-08 28143, 2015

      • alastairp
        cycle sat, hack+oktoberfest sun, cycle mon
      • 2015-10-08 28153, 2015

      • alastairp
        maybe not. monday might be a bit off
      • 2015-10-08 28105, 2015

      • alastairp
        anyway, let's play it by ear