#metabrainz

/

      • c0smicray has quit
      • 2018-06-17 16823, 2018

      • D4RK-PH0ENiX joined the channel
      • 2018-06-17 16849, 2018

      • Monkey has quit
      • 2018-06-17 16826, 2018

      • Major_Lurker joined the channel
      • 2018-06-17 16858, 2018

      • Monkey joined the channel
      • 2018-06-17 16838, 2018

      • Monkey has quit
      • 2018-06-17 16847, 2018

      • G0re joined the channel
      • 2018-06-17 16858, 2018

      • Gore|woerk has quit
      • 2018-06-17 16803, 2018

      • Major_Lurker has quit
      • 2018-06-17 16857, 2018

      • bukwurm joined the channel
      • 2018-06-17 16846, 2018

      • suhas2go has quit
      • 2018-06-17 16830, 2018

      • Jedee2011 joined the channel
      • 2018-06-17 16826, 2018

      • UmkaDK_ joined the channel
      • 2018-06-17 16834, 2018

      • UmkaDK has quit
      • 2018-06-17 16832, 2018

      • djwhitey_ joined the channel
      • 2018-06-17 16851, 2018

      • djwhitey__ has quit
      • 2018-06-17 16849, 2018

      • Jedee2011 has quit
      • 2018-06-17 16854, 2018

      • samj1912
        morning o/
      • 2018-06-17 16830, 2018

      • zas
        moooin \o/
      • 2018-06-17 16841, 2018

      • ruaok
        moooin! -ø/
      • 2018-06-17 16811, 2018

      • samj1912
        ruaok: about SOLR-84
      • 2018-06-17 16812, 2018

      • BrainzBot
        SOLR-84: Search for !!! artist returns no results https://tickets.metabrainz.org/browse/SOLR-84
      • 2018-06-17 16820, 2018

      • samj1912
        I can fix it, but it might require a reindex
      • 2018-06-17 16827, 2018

      • samj1912
        s/might/will
      • 2018-06-17 16846, 2018

      • samj1912
        forgot about it
      • 2018-06-17 16841, 2018

      • ruaok
        see if there are other issues that need fixing before you reindex...
      • 2018-06-17 16810, 2018

      • samj1912
      • 2018-06-17 16824, 2018

      • samj1912
        just the non latin char improvements
      • 2018-06-17 16834, 2018

      • samj1912
        I fixed/closed most of the tickets
      • 2018-06-17 16858, 2018

      • ruaok
        k, then lets do those two and reindex.
      • 2018-06-17 16802, 2018

      • samj1912
        okay
      • 2018-06-17 16801, 2018

      • samj1912
        ruaok: just for artist?
      • 2018-06-17 16806, 2018

      • samj1912
        or others too?
      • 2018-06-17 16815, 2018

      • samj1912
        I mean the non latin char I can do without reindex
      • 2018-06-17 16821, 2018

      • samj1912
        I already had it in place
      • 2018-06-17 16828, 2018

      • samj1912
        I just need to adjust the query time boosts
      • 2018-06-17 16836, 2018

      • samj1912
        needed reosarevok's help for it, so I was stalling
      • 2018-06-17 16854, 2018

      • reosarevok
        Need more help?
      • 2018-06-17 16801, 2018

      • samj1912
        reosarevok: yup
      • 2018-06-17 16801, 2018

      • reosarevok
        Ok what help :D
      • 2018-06-17 16825, 2018

      • samj1912
        can you help me with accented searches and punctuation type searches
      • 2018-06-17 16837, 2018

      • samj1912
        like ", @ # $" chars like these
      • 2018-06-17 16849, 2018

      • samj1912
        and non latin chars
      • 2018-06-17 16827, 2018

      • samj1912
        also reosarevok do we need those punctuation searches in other entities?
      • 2018-06-17 16830, 2018

      • samj1912
        or just artists?
      • 2018-06-17 16845, 2018

      • reosarevok
        I'm sure there's at least one label called "+-!" or whatever, because people
      • 2018-06-17 16857, 2018

      • samj1912
        sigh
      • 2018-06-17 16805, 2018

      • samj1912
        so all of the entities?
      • 2018-06-17 16823, 2018

      • reosarevok
        Well, I'd hope area is safe :p
      • 2018-06-17 16823, 2018

      • samj1912
        we will have to rebalance the boosts
      • 2018-06-17 16836, 2018

      • reosarevok
        Instrument too
      • 2018-06-17 16852, 2018

      • samj1912
        those dont matter much in terms of reindexing
      • 2018-06-17 16855, 2018

      • reosarevok
        But there's definitely releases, recordings, rgs which are all punctuation
      • 2018-06-17 16801, 2018

      • samj1912
        ah
      • 2018-06-17 16803, 2018

      • samj1912
        the main ones :P
      • 2018-06-17 16826, 2018

      • samj1912
        ill have to take solr down then :P
      • 2018-06-17 16828, 2018

      • samj1912
        let me do all the schema improvements
      • 2018-06-17 16832, 2018

      • samj1912
        then I will re-index
      • 2018-06-17 16846, 2018

      • samj1912
        reosarevok: you available today?
      • 2018-06-17 16859, 2018

      • samj1912
        I might need your help once the index is done and we are fixing boosts
      • 2018-06-17 16807, 2018

      • reosarevok
        Should be, most of the time, if given a bit of advance notice :)
      • 2018-06-17 16852, 2018

      • samj1912
        cool
      • 2018-06-17 16839, 2018

      • samj1912
        ill start working on the improved schema then
      • 2018-06-17 16809, 2018

      • zas
        ruaok: we have an huge performance difference between solr1 and solr2/3, while they receive same amount of queries and output same amount of data, solr 1 load is much lower.
      • 2018-06-17 16829, 2018

      • zas
        there are differences in number of threads and disk reads
      • 2018-06-17 16832, 2018

      • ruaok
        I've noticed similar things on other VMs.
      • 2018-06-17 16850, 2018

      • ruaok
        I would suggest getting a new VM and not releasing the old one. see if the new one is more performant.
      • 2018-06-17 16803, 2018

      • ruaok
        OR report the issue to hetzner.
      • 2018-06-17 16821, 2018

      • ruaok
        maybe do a rudimentary performance check and submit the results to them?
      • 2018-06-17 16829, 2018

      • zas
        i noted solr1 isn't IBRS (cpu) while others are
      • 2018-06-17 16858, 2018

      • zas
        IBRS is a cpu fix for spectre and meltdown
      • 2018-06-17 16823, 2018

      • zas
        yes, i'll do that, just wanted to know if you experienced the same
      • 2018-06-17 16831, 2018

      • ruaok
        yep, I had.
      • 2018-06-17 16839, 2018

      • zas
        the difference is very obvious in our case
      • 2018-06-17 16856, 2018

      • zas
        response time is half on solr than on others
      • 2018-06-17 16859, 2018

      • rsh7 joined the channel
      • 2018-06-17 16832, 2018

      • Monkey joined the channel
      • 2018-06-17 16857, 2018

      • zas
      • 2018-06-17 16802, 2018

      • zas
        basically mb1=240 ops, mb2=120 ops, mb3=160 ops
      • 2018-06-17 16818, 2018

      • zas
        i'll ask hetzner about it
      • 2018-06-17 16836, 2018

      • zas
        because mb1 = same price of mb2, but twice faster...
      • 2018-06-17 16831, 2018

      • samj1912
        so it was the vm difference after all?
      • 2018-06-17 16854, 2018

      • D4RK-PH0ENiX has quit
      • 2018-06-17 16833, 2018

      • zas
        it seems
      • 2018-06-17 16829, 2018

      • D4RK-PH0ENiX joined the channel
      • 2018-06-17 16807, 2018

      • zas
        i sent a support request about this, let's see what hetzner answers.
      • 2018-06-17 16808, 2018

      • zas
        We could try to deploy new VMs and test them and keep best performing ones. Still i'd like an official and technical explanation.
      • 2018-06-17 16826, 2018

      • samj1912
        okay
      • 2018-06-17 16851, 2018

      • zas
        note that results ratio are matching load ratios we have. mb1 > mb3 > mb2
      • 2018-06-17 16811, 2018

      • zas
        and that's also what we have with timings
      • 2018-06-17 16857, 2018

      • github joined the channel
      • 2018-06-17 16857, 2018

      • github
        [acousticbrainz-server] paramsingh closed pull request #275: AB-343: Move number of recordings fetched per batch into config.py (musicbrainz-integration-gsoc...move2config) https://git.io/vh1xA
      • 2018-06-17 16857, 2018

      • github has left the channel
      • 2018-06-17 16845, 2018

      • zas
        i found out that echo 2 > /proc/sys/kernel/ibrs_enabled gives better result on solr2/3 (~15% faster), but we can't get the same perf than on solr1. I think the patched cpu (IBRS) is the cause.
      • 2018-06-17 16804, 2018

      • zas
        solr2 & 3 are on par with same values in /proc/sys/kernel/ibrs_enabled (2) and /proc/sys/kernel/ibpb_enabled (0), and they perform a tad better
      • 2018-06-17 16824, 2018

      • zas
        samj1912: let's do another stress test, one with ibpb=1 and ibrs=0 (worse results), and another with ibpb=0 and ibrs=2 (best results), to see if it is confirmed by graphs
      • 2018-06-17 16819, 2018

      • zas
        samj1912: around?
      • 2018-06-17 16859, 2018

      • samj1912
        yeah
      • 2018-06-17 16812, 2018

      • samj1912
        was working on schema
      • 2018-06-17 16816, 2018

      • samj1912
        gimme a moment
      • 2018-06-17 16816, 2018

      • samj1912
        zas yes
      • 2018-06-17 16820, 2018

      • samj1912
        siege?
      • 2018-06-17 16825, 2018

      • zas
        nvm i found it;)
      • 2018-06-17 16829, 2018

      • zas
        i'll run it
      • 2018-06-17 16832, 2018

      • samj1912
        okay
      • 2018-06-17 16839, 2018

      • samj1912
        use test2 file
      • 2018-06-17 16827, 2018

      • bukwurm has quit
      • 2018-06-17 16824, 2018

      • samj1912
        reosarevok: ruaok about SOLR-85
      • 2018-06-17 16824, 2018

      • BrainzBot
        SOLR-85: Indexed search syntax partially broken https://tickets.metabrainz.org/browse/SOLR-85
      • 2018-06-17 16848, 2018

      • samj1912
        country:xe doesnt work anymore coz it is supposed to be country:Europe now
      • 2018-06-17 16859, 2018

      • samj1912
        was the search using iso code always?
      • 2018-06-17 16816, 2018

      • reosarevok
        yes
      • 2018-06-17 16822, 2018

      • samj1912
        ah ok
      • 2018-06-17 16825, 2018

      • reosarevok
        We translate country names
      • 2018-06-17 16828, 2018

      • samj1912
        do you want name search?
      • 2018-06-17 16830, 2018

      • samj1912
        oh ok
      • 2018-06-17 16800, 2018

      • reosarevok
        So code should work, if English names work too that's great, but not 100% needed
      • 2018-06-17 16821, 2018

      • samj1912
        I am removing english names then
      • 2018-06-17 16845, 2018

      • samj1912
        reosarevok: also what's wrong with the other query?
      • 2018-06-17 16849, 2018

      • samj1912
        format:\-
      • 2018-06-17 16838, 2018

      • reosarevok
        https://musicbrainz.org/search?query=format%3A%5C… apparently it returns all stuff without a format set
      • 2018-06-17 16842, 2018

      • github joined the channel
      • 2018-06-17 16842, 2018

      • github
        [sir] samj1912 opened pull request #88: SOLR-85: Fix country search (master...fix-country) https://git.io/vhM4A
      • 2018-06-17 16842, 2018

      • github has left the channel
      • 2018-06-17 16843, 2018

      • reosarevok
        I didn't know of this one :D
      • 2018-06-17 16810, 2018

      • samj1912
        is unknown a string?
      • 2018-06-17 16832, 2018

      • samj1912
        that's a super weird syntax
      • 2018-06-17 16840, 2018

      • samj1912
        he is escaping the not character
      • 2018-06-17 16842, 2018

      • samj1912
        idk why
      • 2018-06-17 16856, 2018

      • reosarevok
        Lucene probably breaks otherwise
      • 2018-06-17 16804, 2018

      • samj1912
        as in?
      • 2018-06-17 16825, 2018

      • samj1912
        that is basically searching for a hyphen?
      • 2018-06-17 16830, 2018

      • reosarevok
        As in a query of "format:-" is just deemed invalid
      • 2018-06-17 16846, 2018

      • reosarevok
        So it's \- instead
      • 2018-06-17 16850, 2018

      • reosarevok
        Now, *why* that, I dunno
      • 2018-06-17 16854, 2018

      • samj1912
        but I am not getting it why he wants to search for a hyphen
      • 2018-06-17 16806, 2018

      • samj1912
        and how that is returning all unknown results?
      • 2018-06-17 16808, 2018

      • reosarevok
        He wants to search for "stuff with nothing set"
      • 2018-06-17 16815, 2018

      • reosarevok
        I assume this is the hardcoded shortcut for it
      • 2018-06-17 16837, 2018

      • Monkey has quit
      • 2018-06-17 16850, 2018

      • samj1912
        well, its just wrong :P
      • 2018-06-17 16859, 2018

      • reosarevok
        Well, we need to provide the functionality
      • 2018-06-17 16800, 2018

      • samj1912
        I cant see it anywhere in the documentation
      • 2018-06-17 16804, 2018

      • samj1912
        why so?
      • 2018-06-17 16810, 2018

      • reosarevok
        Because it's a useful search
      • 2018-06-17 16818, 2018

      • samj1912
        there is a way to search for that
      • 2018-06-17 16821, 2018

      • reosarevok
        But doing it as "format:unknown" instead is probably better
      • 2018-06-17 16824, 2018

      • samj1912
        just not with that paritcular search
      • 2018-06-17 16833, 2018

      • samj1912
        that syntax is just plain wrong
      • 2018-06-17 16838, 2018

      • samj1912
        I am not even sure how its working