#metabrainz

/

      • reosarevok
        I'll wait for a dev's approval for, well, approval, but I should still be able to help if needed
      • 2015-12-21 35540, 2015

      • Freso
        bitmap Gentlecat reosarevok: https://codein.withgoogle.com/dashboard/tasks/560… (already published, but please review anyway :))
      • 2015-12-21 35511, 2015

      • reosarevok
        Seems good to me
      • 2015-12-21 35505, 2015

      • chirlu`
        opatel99: If you want something more complex, how about http://tickets.musicbrainz.org/browse/MBS-8169 ?
      • 2015-12-21 35554, 2015

      • travis-ci joined the channel
      • 2015-12-21 35555, 2015

      • travis-ci
        musicbrainz/picard#1269 (PICARD-226 - 7795b66 : Ohm Patel): The build passed.
      • 2015-12-21 35555, 2015

      • travis-ci
      • 2015-12-21 35555, 2015

      • travis-ci
      • 2015-12-21 35555, 2015

      • travis-ci has left the channel
      • 2015-12-21 35528, 2015

      • opatel99
        chirlu`: Do you suggest I link all the https://github.com/metabrainz/musicbrainz-server/… in a dropdown?
      • 2015-12-21 35528, 2015

      • Nyanko-sensei joined the channel
      • 2015-12-21 35545, 2015

      • chirlu`
        Hmm ... It may actually be less complex than I had thought. ;-) I think I’d make a macro to replace the add_commas(stats.statistic('foo.bar')) things.
      • 2015-12-21 35500, 2015

      • D4RK-PH0ENiX has quit
      • 2015-12-21 35501, 2015

      • chirlu`
        This could mostly be done by a search and replace operation.
      • 2015-12-21 35515, 2015

      • opatel99
        chirlu`: Yeah :/
      • 2015-12-21 35537, 2015

      • chirlu`
        Then the macro would do the add_commas(stats.statistic()) part and additionally link to the timeline.
      • 2015-12-21 35538, 2015

      • opatel99
        idk how to do a macro... I know what it is though
      • 2015-12-21 35528, 2015

      • regagain has quit
      • 2015-12-21 35540, 2015

      • chirlu`
        root/components/common-macros.tt has lots of examples for macros.
      • 2015-12-21 35531, 2015

      • chirlu`
        Though this new one would be specific to the statistics pages, so it could probably go there somewhere.
      • 2015-12-21 35516, 2015

      • Freso
        opatel99: If you find something in our Jira that isn't in GCI that you want to try your hand at, let us know so we can add it as a GCI task so you can get GCI credit for it.
      • 2015-12-21 35536, 2015

      • opatel99
        Freso: Seems reasonable.. Worst you could say is no.
      • 2015-12-21 35532, 2015

      • opatel99
        Hey people! Can you test my BookBrainz Flatly theme port at https://twlsemruxn.localtunnel.me and let me know of any inconsistencies?
      • 2015-12-21 35557, 2015

      • reosarevok
        What kind of feedback you want? :)
      • 2015-12-21 35523, 2015

      • reosarevok
        I like bb.org's header size more (it's shorter, at least here)
      • 2015-12-21 35512, 2015

      • reosarevok
        I like the orange warning, although white-on-orange might be a bit hard on the eyes for some, so dunno what others will think :)
      • 2015-12-21 35556, 2015

      • reosarevok
        The search button being slightly larger than the search field feels wrong but the color is nice
      • 2015-12-21 35541, 2015

      • reosarevok
        There's more whitespace at the bottom for some reason, which seems like it could be removed
      • 2015-12-21 35533, 2015

      • reosarevok
        The text in the About etc buttons seems a bit small for how big the buttons are, but I'm not sure if making it bigger would look weird
      • 2015-12-21 35553, 2015

      • regagain joined the channel
      • 2015-12-21 35517, 2015

      • reosarevok
        That's about as much as I can think off visually, if you want me to test/check some specific feature do mention it :)
      • 2015-12-21 35518, 2015

      • YatharthROCK_ has quit
      • 2015-12-21 35539, 2015

      • dpmittal joined the channel
      • 2015-12-21 35503, 2015

      • dpmittal has quit
      • 2015-12-21 35523, 2015

      • regagain has quit
      • 2015-12-21 35549, 2015

      • ariscop has quit
      • 2015-12-21 35535, 2015

      • YatharthROCK_ joined the channel
      • 2015-12-21 35536, 2015

      • dcentral has quit
      • 2015-12-21 35535, 2015

      • JonnyJD joined the channel
      • 2015-12-21 35507, 2015

      • dcentral joined the channel
      • 2015-12-21 35543, 2015

      • reosarevok
        Heh
      • 2015-12-21 35509, 2015

      • reosarevok
        http://tickets.musicbrainz.org/browse/MBS-8697 bitmap, this one seems fun :p Wonder if it's a GCI level fix
      • 2015-12-21 35507, 2015

      • chirlu`
        reosarevok: How did they manage that?
      • 2015-12-21 35516, 2015

      • reosarevok
        I dunno
      • 2015-12-21 35524, 2015

      • reosarevok
        Do we allow submitting tags via the ws?
      • 2015-12-21 35502, 2015

      • chirlu`
        Hm.
      • 2015-12-21 35511, 2015

      • chirlu`
        How would you normally remove a tag?
      • 2015-12-21 35518, 2015

      • chirlu` almost never uses them.
      • 2015-12-21 35530, 2015

      • dcentral has quit
      • 2015-12-21 35555, 2015

      • reosarevok
        downvoting them
      • 2015-12-21 35500, 2015

      • dcentral joined the channel
      • 2015-12-21 35503, 2015

      • CJ_ joined the channel
      • 2015-12-21 35558, 2015

      • dpmittal joined the channel
      • 2015-12-21 35540, 2015

      • YatharthROCK_ has left the channel
      • 2015-12-21 35558, 2015

      • Freso
        CallerNo6: Ping?
      • 2015-12-21 35548, 2015

      • CJ_
        Pong?
      • 2015-12-21 35542, 2015

      • dpmittal has quit
      • 2015-12-21 35509, 2015

      • CJ_
        Is MB really that heavy disk wise or are the instructions just assuming you will be using a full desktop linux machine?
      • 2015-12-21 35529, 2015

      • dpmittal joined the channel
      • 2015-12-21 35550, 2015

      • Freso
        CJ_: ?
      • 2015-12-21 35545, 2015

      • CJ_
        Freso, I am looking at how to set up MB and it recommends that I use 20GB of space. That seems like a lot to me. But the documentation also mentions using Ubuntu, hence the assumption of a full desktop configuration.
      • 2015-12-21 35503, 2015

      • Freso
        CJ_: The disk space requirement is how much a PostgreSQL server will use with the MusicBrainz data.
      • 2015-12-21 35512, 2015

      • Freso
        We have a lot of data, so it will take up a lot of space.
      • 2015-12-21 35534, 2015

      • CJ_
        Understood. I was wondering how big the db dumps were.
      • 2015-12-21 35558, 2015

      • Freso doesn't know off-hand
      • 2015-12-21 35534, 2015

      • CJ_
        Right now however I am just working to understand how the server is setup. I do not need to replicate the live data.
      • 2015-12-21 35503, 2015

      • Freso
        mbdump.tar.bz2 is the core MB data, and the latest dump sits at 1.9 GB. However, this is heavily compressed and will take up a lot more space once imported into pgsql.
      • 2015-12-21 35548, 2015

      • CJ_
        Understood. Unfortunately I do not have much free space currently.
      • 2015-12-21 35528, 2015

      • CallerNo6
        Is Freso pinging me at 5am?
      • 2015-12-21 35532, 2015

      • chirlu`
        CJ_: You can also set up a server with (almost) no data.
      • 2015-12-21 35549, 2015

      • chirlu`
        CallerNo6: No, one minute before that.
      • 2015-12-21 35500, 2015

      • CJ_
        chirlu`, Yes, but I have not seen the instructions for that yet. :)
      • 2015-12-21 35546, 2015

      • chirlu`
        In INSTALL.md, it’s the first option in “4. Create the database”.
      • 2015-12-21 35525, 2015

      • chirlu`
      • 2015-12-21 35505, 2015

      • CJ_
        chirlu`, I haven't gotten that far. :P
      • 2015-12-21 35508, 2015

      • MBJenkins
        Project critiquebrainz build #151: SUCCESS in 3 min 49 sec: http://ci.musicbrainz.org/job/critiquebrainz/151/
      • 2015-12-21 35506, 2015

      • chirlu`
        CJ_: So, the full size for the running server including all the Perl and Node.js dependencies is about 1 GB.
      • 2015-12-21 35526, 2015

      • chirlu`
        Not including the software installed from distribution packages.
      • 2015-12-21 35559, 2015

      • MBJenkins
        Project critiquebrainz build #152: SUCCESS in 3 min 49 sec: http://ci.musicbrainz.org/job/critiquebrainz/152/
      • 2015-12-21 35558, 2015

      • TOPIC: MetaBrainz Community and Development channel | MusicBrainz non-development: #musicbrainz | MeB meeting agenda: Reviews; CB-88 (Freso), DR: CB-187 (Freso), DR: CB-65 (Freso), requirements for CAA-84 (reo), usage of brainz.io (Freso), CB repos (Gentlecat)
      • 2015-12-21 35505, 2015

      • TOPIC: MetaBrainz Community and Development channel | MusicBrainz non-development: #musicbrainz | MeB meeting agenda: Reviews; CB-88 (Freso), DR: CB-187 (Freso), DR: CB-65 (Freso), requirements for CAA-84 (reo), usage of brainz.io (Freso), CB repos (Gentlecat), Postgres update (bitmap)
      • 2015-12-21 35533, 2015

      • TOPIC: MetaBrainz Community and Development channel | MusicBrainz non-development: #musicbrainz | MeB meeting agenda: Reviews; requirements for CAA-84 (reo), usage of brainz.io (Freso), CB repos (Gentlecat), Postgres update (bitmap)
      • 2015-12-21 35510, 2015

      • Freso
        CallerNo6: I'll be pinging you all day, erry day.
      • 2015-12-21 35523, 2015

      • Freso
        CallerNo6: Are you going to merge the "how to edit profile/account" into the "how to create an account"? (#wiki)
      • 2015-12-21 35505, 2015

      • CallerNo6
        Oh, I should have asked. I wasn't sure if more instances would be opened up for any of the "how to" tasks.
      • 2015-12-21 35532, 2015

      • CallerNo6
        er, had no idea. Damn.
      • 2015-12-21 35534, 2015

      • Freso
        I wasn't planning to.
      • 2015-12-21 35545, 2015

      • Freso
        I don't think it's fair to make the students do work that will just be tossed aside entirely. If it's good enough for being accepted, we should put it out there. We can make follow-up tasks to improve them too.
      • 2015-12-21 35544, 2015

      • CallerNo6
        copy
      • 2015-12-21 35519, 2015

      • zas
        i upgraded grafana & carbon relay on tails, let me know if you notice issues
      • 2015-12-21 35510, 2015

      • CJ_
        I think I am just going to see about fixing my lvm so I can run the VM.
      • 2015-12-21 35520, 2015

      • CJ_
        Then I can look at everything properly setup.
      • 2015-12-21 35518, 2015

      • Freso
        ruaok: Do you have an easy collection of various presentations you've done on MB/MeB/*B/related over the years?
      • 2015-12-21 35526, 2015

      • Freso
        s/easy //
      • 2015-12-21 35545, 2015

      • Freso
        I'm going to make a WikiPage to collect presentations for these subjects.
      • 2015-12-21 35546, 2015

      • dpmobile joined the channel
      • 2015-12-21 35524, 2015

      • Nyanko-sensei has quit
      • 2015-12-21 35526, 2015

      • zas
        search servers are freaking out, on it
      • 2015-12-21 35515, 2015

      • dcentral has quit
      • 2015-12-21 35550, 2015

      • dpmittal has quit
      • 2015-12-21 35506, 2015

      • CJ_
        zas, Freaking out how?
      • 2015-12-21 35521, 2015

      • dpmobile is now known as dpmittal
      • 2015-12-21 35544, 2015

      • D4RK-PH0ENiX joined the channel
      • 2015-12-21 35504, 2015

      • dpmittal has quit
      • 2015-12-21 35547, 2015

      • dpmittal joined the channel
      • 2015-12-21 35530, 2015

      • zas
        CJ_: we have a major issue with our search servers which are quite unstable, and they often stop answering, eating all CPU ressources, and a simple restart isn't enough to make them available again. This is a complex issue i hope we'll fix soon. It implies to fix the search server java code or to deploy an alternative. None of those are trivial.
      • 2015-12-21 35558, 2015

      • CJ_
        zas, Are the search servers running solr?
      • 2015-12-21 35547, 2015

      • zas
        lucene
      • 2015-12-21 35516, 2015

      • zas
      • 2015-12-21 35518, 2015

      • Freso
        In anyone here has done a presentation on any Brainz subject, please add it to https://wiki.musicbrainz.org/Presentations :)
      • 2015-12-21 35520, 2015

      • Freso
        *If
      • 2015-12-21 35509, 2015

      • CJ_
        zas, I saw that. I am in the process of freeing space on my machine so I can load the VM and investigate.
      • 2015-12-21 35514, 2015

      • zas
        Basically, they crash together ... we have a load balancer over the two machines, each of them run one instance under jetty
      • 2015-12-21 35535, 2015

      • zas
        as soon one is starting to fail, the other follow
      • 2015-12-21 35511, 2015

      • zas
        and they both stop to answer, CPU climb to 100% on all cores used
      • 2015-12-21 35517, 2015

      • CJ_
        When was this code originally written?
      • 2015-12-21 35534, 2015

      • zas
        dunno exactly but a long time ago
      • 2015-12-21 35553, 2015

      • CJ_
        Just wondering why it was written with lucene and not solr.
      • 2015-12-21 35554, 2015

      • zas
        ruaok could tell you more
      • 2015-12-21 35532, 2015

      • zas
        to restart them, we need to reduce rate limit to a very low value, else they restart, CPU goes up, and never get down
      • 2015-12-21 35533, 2015

      • CJ_
        Solr works very well for search so I'm not sure why your setup is not working well.
      • 2015-12-21 35536, 2015

      • Freso
        The setup is not a Solr setup.
      • 2015-12-21 35544, 2015

      • zas
        i can't tell you much, we recently upgraded lucene, and switched from tomcat to jetty, upgraded machines to trusty, and even though situation slighly improved they still crash badly
      • 2015-12-21 35549, 2015

      • Freso
        *The current setup
      • 2015-12-21 35523, 2015

      • zas
        the lucene upgrade fixed the huge memory leak we had
      • 2015-12-21 35534, 2015

      • Freso
        CJ_ | Just wondering why it was written with lucene and not solr. -- Solr wasn't created when our current search implementation originally went live.
      • 2015-12-21 35546, 2015

      • CJ_
        Freso, Understood. But solr uses lucene under the hood.
      • 2015-12-21 35509, 2015

      • Freso
        CJ_: Keep in mind that MusicBrainz is a 15 year old project. It's been around for a long time. Longer than some of the things we use, and certainly longer than a lot of things we don't use.
      • 2015-12-21 35522, 2015

      • CJ_
        Freso, Have you considered migrating to solr?
      • 2015-12-21 35523, 2015

      • Freso
        CJ_: Yes, and we are in the process of moving to using Solr.
      • 2015-12-21 35527, 2015

      • Freso
        ^
      • 2015-12-21 35538, 2015

      • Freso
        It's been a project in the last two(?) GSoC's.
      • 2015-12-21 35502, 2015

      • zas
        the thing is we have no production-ready alternative atm
      • 2015-12-21 35515, 2015

      • CJ_
        Understood.
      • 2015-12-21 35529, 2015

      • CJ_
        Are the existing migrations hosted anywhere?
      • 2015-12-21 35519, 2015

      • Freso
        Leftmost has maybe picked it up, so may be able to tell you more, but the "chief architects" behind the mbssssssssssssss (or however many s's there are :p) are currently not available.
      • 2015-12-21 35535, 2015

      • CJ_
        mbssss?
      • 2015-12-21 35549, 2015

      • CJ_
        Currently not available as in not online or abandoned the project?
      • 2015-12-21 35500, 2015

      • Freso
      • 2015-12-21 35511, 2015

      • Freso
        As in currently busy with RL stuff.
      • 2015-12-21 35553, 2015

      • CJ_
        I know that feeling. :)
      • 2015-12-21 35548, 2015

      • CJ_
        Maybe I will be able to help. :)
      • 2015-12-21 35546, 2015

      • Mineo
        the most important part of it that needs finishing is https://github.com/metabrainz/mbsssss/pull/4
      • 2015-12-21 35501, 2015

      • Mineo
        but it's also a 7000+ line xml diff :/
      • 2015-12-21 35500, 2015

      • CJ_
        That is a lot of commits.
      • 2015-12-21 35502, 2015

      • Freso
        CJ_: It was this year's Solr GSoC project.
      • 2015-12-21 35508, 2015

      • regagain joined the channel
      • 2015-12-21 35510, 2015

      • CJ_
        Freso, What is the best place for me to start looking at to help?
      • 2015-12-21 35536, 2015

      • Freso
        CJ_: With Solr stuff? The PR Mineo linked. And possibly talking to Leftmost.
      • 2015-12-21 35524, 2015

      • CJ_
        Freso, Understood. When is Leftmost normally around?