#metabrainz

/

      • antlarr joined the channel
      • 2018-05-10 13018, 2018

      • antlarr2 has quit
      • 2018-05-10 13039, 2018

      • G0re joined the channel
      • 2018-05-10 13020, 2018

      • Gore|woerk has quit
      • 2018-05-10 13059, 2018

      • Major_Lurker joined the channel
      • 2018-05-10 13027, 2018

      • MajorLurker has quit
      • 2018-05-10 13021, 2018

      • d4rkie joined the channel
      • 2018-05-10 13024, 2018

      • D4RK-PH0ENiX has quit
      • 2018-05-10 13049, 2018

      • d4rkie has quit
      • 2018-05-10 13017, 2018

      • D4RK-PH0ENiX joined the channel
      • 2018-05-10 13017, 2018

      • d4rkie joined the channel
      • 2018-05-10 13027, 2018

      • D4RK-PH0ENiX has quit
      • 2018-05-10 13020, 2018

      • pingupingu joined the channel
      • 2018-05-10 13057, 2018

      • samj1912
        Hey everyone o/
      • 2018-05-10 13017, 2018

      • samj1912
        ruaok, bitmap, zas ping
      • 2018-05-10 13034, 2018

      • Major_Lurker
        hi samj1912 how did the exams go?
      • 2018-05-10 13009, 2018

      • samj1912
        Major_Lurker: the pass/fail results are today and the final results on 22nd
      • 2018-05-10 13015, 2018

      • samj1912
        I think I passed though
      • 2018-05-10 13030, 2018

      • Major_Lurker
        Well that should be enough then :)
      • 2018-05-10 13031, 2018

      • samj1912
        So yeah, an official engineer now :p
      • 2018-05-10 13046, 2018

      • Major_Lurker
        Watch out world I would say
      • 2018-05-10 13012, 2018

      • samj1912
        Lol :p
      • 2018-05-10 13029, 2018

      • Major_Lurker
        and congratulations, great achievement
      • 2018-05-10 13042, 2018

      • samj1912
        Thanks :D :p
      • 2018-05-10 13029, 2018

      • Major_Lurker
        You will be lucky if any of those others are up though :)
      • 2018-05-10 13009, 2018

      • samj1912
        Bitmap should be?
      • 2018-05-10 13006, 2018

      • SothoTalKer has quit
      • 2018-05-10 13004, 2018

      • SothoTalKer joined the channel
      • 2018-05-10 13020, 2018

      • D4RK-PH0ENiX joined the channel
      • 2018-05-10 13059, 2018

      • d4rkie has quit
      • 2018-05-10 13045, 2018

      • d4rkie joined the channel
      • 2018-05-10 13032, 2018

      • D4RK-PH0ENiX has quit
      • 2018-05-10 13004, 2018

      • eggg[m] has quit
      • 2018-05-10 13005, 2018

      • vishalchoudhary[ has quit
      • 2018-05-10 13006, 2018

      • sfunk1x has quit
      • 2018-05-10 13006, 2018

      • DunKno[m] has quit
      • 2018-05-10 13027, 2018

      • adhawkins has quit
      • 2018-05-10 13011, 2018

      • adhawkins joined the channel
      • 2018-05-10 13011, 2018

      • adhawkins has quit
      • 2018-05-10 13011, 2018

      • adhawkins joined the channel
      • 2018-05-10 13001, 2018

      • Major_Lurker
      • 2018-05-10 13014, 2018

      • pingupingu has quit
      • 2018-05-10 13055, 2018

      • samj1912
        Major_Lurker: huh?
      • 2018-05-10 13055, 2018

      • Major_Lurker
        I thought you took your engineering degree and made a space suit with it (and I am just kidding)
      • 2018-05-10 13016, 2018

      • samj1912
        XD
      • 2018-05-10 13050, 2018

      • Major_Lurker
        It´s amazing what people will fall for thought
      • 2018-05-10 13055, 2018

      • Major_Lurker
        though
      • 2018-05-10 13027, 2018

      • AfroThundr has quit
      • 2018-05-10 13054, 2018

      • D4RK-PH0ENiX joined the channel
      • 2018-05-10 13014, 2018

      • d4rkie has quit
      • 2018-05-10 13049, 2018

      • madmouser1 joined the channel
      • 2018-05-10 13032, 2018

      • zas
        Hey samj1912 & Major_Lurker
      • 2018-05-10 13037, 2018

      • Major_Lurker
        hi zas trust you had a good sleep
      • 2018-05-10 13007, 2018

      • AfroThundr joined the channel
      • 2018-05-10 13011, 2018

      • samj1912
        Hey zas
      • 2018-05-10 13016, 2018

      • samj1912
        I am back and up
      • 2018-05-10 13026, 2018

      • samj1912
        How are things going with picard and db?
      • 2018-05-10 13008, 2018

      • zas
        Hey engineer samj1912 ! ;)
      • 2018-05-10 13041, 2018

      • zas
        about db, we are fine for now
      • 2018-05-10 13010, 2018

      • zas
        about Picard, i guess we need to go through last reported issues, and eventually plan the final release
      • 2018-05-10 13026, 2018

      • zas
        also the hot thing is solr search
      • 2018-05-10 13026, 2018

      • zas
        we have a disk space issue on queen, solr + slave db = a lot of diskspace used, usage ~85% atm, we have to be find a solution
      • 2018-05-10 13042, 2018

      • zas
        i think we should move solr stuff elsewhere, it uses 40Gb atm
      • 2018-05-10 13012, 2018

      • UmkaDK joined the channel
      • 2018-05-10 13012, 2018

      • samj1912
        Okay
      • 2018-05-10 13036, 2018

      • samj1912
        I just kept it on queen since it was one of the higher specced machines iirc
      • 2018-05-10 13033, 2018

      • samj1912
        So solr is top priority for now, yes?
      • 2018-05-10 13048, 2018

      • zas
        yes, clearly
      • 2018-05-10 13012, 2018

      • zas
        i wonder about the setup for production, how many machines etc... can you explain the requirements for a prod solr setup ?
      • 2018-05-10 13047, 2018

      • UmkaDK has quit
      • 2018-05-10 13023, 2018

      • UmkaDK joined the channel
      • 2018-05-10 13003, 2018

      • eggg[m] joined the channel
      • 2018-05-10 13003, 2018

      • vishalchoudhary[ joined the channel
      • 2018-05-10 13003, 2018

      • DunKno[m] joined the channel
      • 2018-05-10 13003, 2018

      • sfunk1x joined the channel
      • 2018-05-10 13006, 2018

      • zas
        samj1912: ?
      • 2018-05-10 13003, 2018

      • sfunk1x has quit
      • 2018-05-10 13003, 2018

      • DunKno[m] has quit
      • 2018-05-10 13014, 2018

      • Guest41701 has quit
      • 2018-05-10 13015, 2018

      • GregKNicholson[m has quit
      • 2018-05-10 13017, 2018

      • yagyanshbhatia[m has quit
      • 2018-05-10 13018, 2018

      • suhas2go[m]1 has quit
      • 2018-05-10 13018, 2018

      • Leo_Verto has quit
      • 2018-05-10 13019, 2018

      • sagar-kohli[m] has quit
      • 2018-05-10 13020, 2018

      • mitansh1398[m] has quit
      • 2018-05-10 13021, 2018

      • vikrantprasad5[m has quit
      • 2018-05-10 13021, 2018

      • anomie[m] has quit
      • 2018-05-10 13024, 2018

      • maxlath[m] has quit
      • 2018-05-10 13025, 2018

      • uditgulati0[m] has quit
      • 2018-05-10 13026, 2018

      • eggg[m] has quit
      • 2018-05-10 13026, 2018

      • vishalchoudhary[ has quit
      • 2018-05-10 13033, 2018

      • bukwurm_ has quit
      • 2018-05-10 13033, 2018

      • anshuman73[m] has quit
      • 2018-05-10 13034, 2018

      • ferbncode[m] has quit
      • 2018-05-10 13035, 2018

      • dns[m] has quit
      • 2018-05-10 13019, 2018

      • arthelon[m] has quit
      • 2018-05-10 13046, 2018

      • ruaok is glad samj1912 is back
      • 2018-05-10 13056, 2018

      • ruaok
        It's been too quiet without you. :-)
      • 2018-05-10 13039, 2018

      • samj1912
        ruaok hey o/
      • 2018-05-10 13012, 2018

      • samj1912
        zas, wait let me fetch the solr doc I wrote a while back
      • 2018-05-10 13022, 2018

      • Freso
        samj1912: Wb, and congrats. :)
      • 2018-05-10 13026, 2018

      • samj1912
        And apart from that the current config is on sys wiki
      • 2018-05-10 13058, 2018

      • samj1912
      • 2018-05-10 13023, 2018

      • samj1912
        Although I haven't investigated solr cloud which is probably what we will need
      • 2018-05-10 13035, 2018

      • samj1912
        Basically, we will have 1 queue
      • 2018-05-10 13045, 2018

      • samj1912
        That is being fed by the master
      • 2018-05-10 13012, 2018

      • samj1912
        Once the master - slave sync is done properly we can distribute sir workers on any slave / master
      • 2018-05-10 13028, 2018

      • samj1912
        And they will be feeding data to the solr instance
      • 2018-05-10 13050, 2018

      • samj1912
        Which might be one or many end points depending on solr cloud / normal solr
      • 2018-05-10 13058, 2018

      • samj1912
        zas^
      • 2018-05-10 13002, 2018

      • zas
        samj1912: we'll deploy solr cloud on hetzner VMs and start to experiment
      • 2018-05-10 13008, 2018

      • ruaok
        How will we manage firewalls?
      • 2018-05-10 13038, 2018

      • ruaok
        Having a common solution for VM machine/firewall setup would be good.
      • 2018-05-10 13051, 2018

      • ruaok
        I need that for the spark cluster as well.
      • 2018-05-10 13046, 2018

      • samj1912
        Currently for solr zas has setup some firewalls which allow internal access and external access to some end points with certain parameter restrictions
      • 2018-05-10 13024, 2018

      • zas
        let's define what we need first
      • 2018-05-10 13033, 2018

      • ruaok
        It would be nice to have common scripts, with solr/spark flags. And have the fw do the right thing.
      • 2018-05-10 13044, 2018

      • ruaok
        Zas: sure.
      • 2018-05-10 13052, 2018

      • ruaok
        A pony. Pink, please.
      • 2018-05-10 13059, 2018

      • ruaok
        What else? Unicorns?
      • 2018-05-10 13013, 2018

      • ruaok
        Maybe some open ports? Nah, superfluous.
      • 2018-05-10 13016, 2018

      • ruaok
        :-)
      • 2018-05-10 13018, 2018

      • zas
        first, do we have specs for a "good" solr cloud node ?
      • 2018-05-10 13059, 2018

      • zas
        we know solr cloud requires 3 nodes minimum to work, the idea is to scale the cluster to our needs, which are hard to evaluate atm
      • 2018-05-10 13025, 2018

      • ruaok
        Just start with 3 of the 8 core, 32gb nodes.
      • 2018-05-10 13043, 2018

      • ruaok
        At least setup of new nodes should be fast if we need to mix it up.
      • 2018-05-10 13058, 2018

      • zas
        ok, i'll create those nodes
      • 2018-05-10 13013, 2018

      • samj1912
        I think this explains things a bit https://lucene.apache.org/solr/guide/7_3/shards-a…
      • 2018-05-10 13014, 2018

      • reosarevok
      • 2018-05-10 13015, 2018

      • BrainzBot
        MBS-9710: Release editor: Add a new recording: You haven’t made any changes!
      • 2018-05-10 13059, 2018

      • ruaok
        I wonder if we might want more instances for redundancy. Maybe smaller ones...
      • 2018-05-10 13026, 2018

      • slacko64_8900 joined the channel
      • 2018-05-10 13016, 2018

      • zas
        samj1912: which version of java ? the proprietary one ? i'm trying to figure how to make a good default node (and ofc Oracle java requires tricks to be installed automatically...)
      • 2018-05-10 13030, 2018

      • samj1912
        I use the one bundled with the default solr docker image
      • 2018-05-10 13038, 2018

      • samj1912
        On my machine I use openjdk
      • 2018-05-10 13051, 2018

      • ruaok
        Oracle is strongly recommended for production.
      • 2018-05-10 13018, 2018

      • Rotab has quit
      • 2018-05-10 13018, 2018

      • Protab joined the channel
      • 2018-05-10 13008, 2018

      • vikrantprasad5[m joined the channel
      • 2018-05-10 13007, 2018

      • Darkloke joined the channel
      • 2018-05-10 13016, 2018

      • slacko64_8900 has quit
      • 2018-05-10 13007, 2018

      • slacko64_8900 joined the channel
      • 2018-05-10 13014, 2018

      • d4rkie joined the channel
      • 2018-05-10 13048, 2018

      • maxlath[m] joined the channel
      • 2018-05-10 13049, 2018

      • sagar-kohli[m] joined the channel
      • 2018-05-10 13049, 2018

      • GregKNicholson[m joined the channel
      • 2018-05-10 13049, 2018

      • DunKno[m] joined the channel
      • 2018-05-10 13049, 2018

      • Leo_Verto joined the channel
      • 2018-05-10 13049, 2018

      • sfunk1x joined the channel
      • 2018-05-10 13049, 2018

      • dns[m] joined the channel