#musicbrainz

/

      • Freso
        sjm_: It's not the servers that are overloaded, it's the bandwidth.
      • 2016-04-25 11605, 2016

      • chirlu
        One database backend server, two load balancers (of which one is active at any time).
      • 2016-04-25 11632, 2016

      • chirlu
        Freso: Not 100% true, the frontend servers are also near the limit of their capacity.
      • 2016-04-25 11657, 2016

      • sjm_
        ahh
      • 2016-04-25 11658, 2016

      • Freso
      • 2016-04-25 11604, 2016

      • chirlu
        Which means that buying more bandwidth alone wouldn’t help much.
      • 2016-04-25 11616, 2016

      • Freso
        chirlu: Sure.
      • 2016-04-25 11639, 2016

      • Freso
        sjm_: Also, the search server is generally flaky and crashes at least once a day - which means that even though there are now things in place to make it restart automatically, there will be some search downtime inevitably.
      • 2016-04-25 11608, 2016

      • Freso
        Hopefully, hopefully, hopefully we'll be able to put a new search server in place during the summer.
      • 2016-04-25 11617, 2016

      • Lingo__ joined the channel
      • 2016-04-25 11617, 2016

      • jcazevedo has quit
      • 2016-04-25 11649, 2016

      • krono has quit
      • 2016-04-25 11625, 2016

      • jcazevedo joined the channel
      • 2016-04-25 11659, 2016

      • diana_olhovyk_ has quit
      • 2016-04-25 11644, 2016

      • _njh_ joined the channel
      • 2016-04-25 11651, 2016

      • Lingo__ has quit
      • 2016-04-25 11640, 2016

      • Lingo__ joined the channel
      • 2016-04-25 11618, 2016

      • _njh_ has quit
      • 2016-04-25 11620, 2016

      • _njh_ joined the channel
      • 2016-04-25 11635, 2016

      • krono joined the channel
      • 2016-04-25 11652, 2016

      • KodeStar
        Freso: what do you use for search?
      • 2016-04-25 11620, 2016

      • KodeStar
        also where are you currently hosted and where are you moving to?
      • 2016-04-25 11617, 2016

      • KodeStar
        and what kind of bandwidth are we talking?
      • 2016-04-25 11633, 2016

      • hibiscuskazeneko joined the channel
      • 2016-04-25 11636, 2016

      • Freso
      • 2016-04-25 11643, 2016

      • sjm_
        Freso: i remember somebody telling me that somebody had written the search server and that they were the only person that understood it and had since disappeared. not a good situation to be in.
      • 2016-04-25 11644, 2016

      • krono has quit
      • 2016-04-25 11653, 2016

      • KodeStar
        nope, looking now
      • 2016-04-25 11623, 2016

      • Freso
        sjm_: Pretty much, yeah.
      • 2016-04-25 11629, 2016

      • KodeStar
        I'm currently looking at elasticsearch for fanart.tv
      • 2016-04-25 11617, 2016

      • KodeStar
        we use cloudflare as well which saves us 146.32 TB saved out of 177.33 TB total bandwidth, which is equivelant to around 600Mbps constant
      • 2016-04-25 11644, 2016

      • Freso
        Our current search server is based on elasticsearch.
      • 2016-04-25 11602, 2016

      • Freso
        The next one will be SOLR based.
      • 2016-04-25 11629, 2016

      • Zastai has quit
      • 2016-04-25 11645, 2016

      • KodeStar
        interesting, why the change?
      • 2016-04-25 11625, 2016

      • Leftmost
        Isn't our current search server based on lucene directly? I'm pretty sure it's not elasticsearch.
      • 2016-04-25 11656, 2016

      • Freso
        ¯\_(ツ)_/¯
      • 2016-04-25 11618, 2016

      • bitmap
        right, we don't use elasticsearch
      • 2016-04-25 11644, 2016

      • Leftmost
        KodeStar, there are some stability issues with the current search server, and I believe also some maintainability problems.
      • 2016-04-25 11658, 2016

      • Leftmost
        BB does use elasticsearch, but we'll probably move toward SOLR after MB paves the way.
      • 2016-04-25 11653, 2016

      • KodeStar
        interesting, is there a reason you are picking 1 over the other?
      • 2016-04-25 11611, 2016

      • Freso
        KodeStar: ^ See, I'm obviously not the best to ask about technical details. ;)
      • 2016-04-25 11629, 2016

      • KodeStar
        I haven't started this part yet, which is why I'm attempting to stand on the shoulders of giants (i.e. you guys) ;)
      • 2016-04-25 11631, 2016

      • Leftmost
        I haven't personally looked at SOLR much, but the main argument against elasticsearch is that there's too much magic, too little ability to introspect.
      • 2016-04-25 11614, 2016

      • Leftmost
        I've used ES in a couple projects, BB included, and I've found that when you're not getting the results you want, practically your only choice is to guess why and look at stackoverflow for some voodoo solutions.
      • 2016-04-25 11651, 2016

      • KodeStar
        hmm
      • 2016-04-25 11652, 2016

      • KodeStar
        from a quick search it seems scaling is much easier with ES, but that wouldn't be an issue for me really, I'll have to look into SOLR when I get to that stage
      • 2016-04-25 11600, 2016

      • KodeStar
        especially as we use musicbrainz ids in the API so there is no searching in the api
      • 2016-04-25 11655, 2016

      • Leftmost
        ES requires very little work out of the box, but I'm personally not versed in arcane rites, so haven't been able to bring it beyond "okay for now".
      • 2016-04-25 11614, 2016

      • KodeStar
        the 300,000 visitors to the site a month won't bother either search platform really, if we had searching on the API at 300-400million hits a month I'd probably be more concerned about using the better performing one, but as I said, I don't
      • 2016-04-25 11622, 2016

      • sjm_ has quit
      • 2016-04-25 11633, 2016

      • regagain has quit
      • 2016-04-25 11622, 2016

      • KodeStar
        Leftmost: I had a look on amazon for you, nothing really on there for arcane rites either so I can't get you a copy, sorry =/
      • 2016-04-25 11635, 2016

      • Leftmost
        Haha. I appreciate the effort.
      • 2016-04-25 11654, 2016

      • KodeStar
        no worries ;)
      • 2016-04-25 11652, 2016

      • KodeStar
        crap, is that the time??? My sone should have been in bed like 1.5 hours ago
      • 2016-04-25 11657, 2016

      • KodeStar
        *son
      • 2016-04-25 11617, 2016

      • _njh_ has quit
      • 2016-04-25 11604, 2016

      • Lingo__ has quit
      • 2016-04-25 11637, 2016

      • Lingo__ joined the channel
      • 2016-04-25 11653, 2016

      • canidae joined the channel
      • 2016-04-25 11633, 2016

      • yeeeargh has quit
      • 2016-04-25 11604, 2016

      • Lingo__ has quit
      • 2016-04-25 11604, 2016

      • Lingo__ joined the channel
      • 2016-04-25 11628, 2016

      • yeeeargh joined the channel
      • 2016-04-25 11614, 2016

      • krono joined the channel
      • 2016-04-25 11658, 2016

      • yeeeargh has quit
      • 2016-04-25 11650, 2016

      • krono has quit
      • 2016-04-25 11651, 2016

      • armalcolite has quit
      • 2016-04-25 11632, 2016

      • Lingo__ has quit
      • 2016-04-25 11603, 2016

      • Leftmost has quit
      • 2016-04-25 11652, 2016

      • VxJasonxV
        json entries for the cover art I added to releases last night is still not there :/
      • 2016-04-25 11653, 2016

      • Leftmost joined the channel
      • 2016-04-25 11602, 2016

      • D4RK-PH0ENiX has quit
      • 2016-04-25 11631, 2016

      • D4RK-PH0ENiX joined the channel
      • 2016-04-25 11653, 2016

      • JoeLlama joined the channel
      • 2016-04-25 11608, 2016

      • D4RK-PH0ENiX has quit
      • 2016-04-25 11621, 2016

      • D4RK-PH0ENiX joined the channel
      • 2016-04-25 11623, 2016

      • QuoraUK has quit
      • 2016-04-25 11638, 2016

      • D4RK-PH0ENiX has quit
      • 2016-04-25 11647, 2016

      • D4RK-PH0ENiX joined the channel
      • 2016-04-25 11602, 2016

      • Lingo__ joined the channel
      • 2016-04-25 11615, 2016

      • Lingo__ has quit
      • 2016-04-25 11651, 2016

      • hibiscuskazeneko has quit
      • 2016-04-25 11645, 2016

      • The_Catman has quit
      • 2016-04-25 11653, 2016

      • The_Catman joined the channel
      • 2016-04-25 11610, 2016

      • mezod has quit
      • 2016-04-25 11642, 2016

      • mezod joined the channel
      • 2016-04-25 11634, 2016

      • ralpheeee joined the channel
      • 2016-04-25 11611, 2016

      • ralpheeee
        hi guys...o/ i have roughly 150 gb of music which i would like to tag....few days ago i just copied the folders over (all) and let it do it things over night....the system eventually froze and not much changed was applied...now i am doing it on per folder base (individually) ...at some point like after 15-20 min picard/muiscbrains just starts to crawl...after each reboot its speedy again...is there any
      • 2016-04-25 11612, 2016

      • ralpheeee
        way to make this process a but more efficient for my needs?
      • 2016-04-25 11616, 2016

      • DocPlatypus
        ralpheeee: I have never used Picard on more than one album at a time
      • 2016-04-25 11634, 2016

      • Leo_Verto
        I have, it used to (and should) work fine
      • 2016-04-25 11651, 2016

      • Leo_Verto
        Though not more than a few at a time
      • 2016-04-25 11621, 2016

      • DocPlatypus
        ralpheeee: how many tracks in that 150 GB?
      • 2016-04-25 11646, 2016

      • ralpheeee
        ok thxs....20k or so
      • 2016-04-25 11653, 2016

      • DocPlatypus
        in FLAC that might be, say, 4000... but in MP3 format it could easily be well into 10,000 or more
      • 2016-04-25 11655, 2016

      • ralpheeee
        painful process
      • 2016-04-25 11603, 2016

      • DocPlatypus
        yeah I would do maybe 500 at a time at most
      • 2016-04-25 11633, 2016

      • ralpheeee
        painful....:(
      • 2016-04-25 11614, 2016

      • peaveyman has quit
      • 2016-04-25 11620, 2016

      • ralpheeee
        like iright now....i did a reboot...choose one album...seems to be frozen now...:9
      • 2016-04-25 11605, 2016

      • Lingo__ joined the channel
      • 2016-04-25 11619, 2016

      • Lingo__ has quit
      • 2016-04-25 11646, 2016

      • darwin
        ralpheeee: beets is a bit better for larger bulk imports...