#metabrainz

/

      • kgz joined the channel
      • 2019-05-21 14123, 2019

      • kgz has quit
      • 2019-05-21 14137, 2019

      • kragniz joined the channel
      • 2019-05-21 14158, 2019

      • reosarevok
        Whichever way you do it, if we want to display the preview of the edits that will be entered, we will need to convert the edit display templates
      • 2019-05-21 14106, 2019

      • kragniz is now known as kgz
      • 2019-05-21 14157, 2019

      • antlarr2 is now known as antlarr
      • 2019-05-21 14103, 2019

      • Cyna
        and display the changes in the edit note section
      • 2019-05-21 14112, 2019

      • Cyna
        or tab whichever is used
      • 2019-05-21 14143, 2019

      • reosarevok
        Sure. So please start with the edit templates, which are easier to convert, and many should already be testable in the current release editor :)
      • 2019-05-21 14107, 2019

      • reosarevok
        (and in any case, for testing, you can just enter the edit locally, then look at the edit history to see how it looks)
      • 2019-05-21 14120, 2019

      • reosarevok
        (since the template is the same for previewing than displaying the edit later)
      • 2019-05-21 14117, 2019

      • Cyna
        So I should start by converting the edit templates in https://musicbrainz.org/edit/61302052 , right ?
      • 2019-05-21 14146, 2019

      • BrainzGit
        [acousticbrainz-server] mayhem closed pull request #342 (master…add-ratelimiting): Add ratelimit header injector and ratelimit decorators https://github.com/metabrainz/acousticbrainz-serv…
      • 2019-05-21 14106, 2019

      • spellew
        ferbncode: Ok, I'll take a look at it
      • 2019-05-21 14119, 2019

      • yvanzo
        Cyna: that would be a good start :)
      • 2019-05-21 14109, 2019

      • bitmap
        Cyna: as we talked about yesterday, root/edit/details/add_remove_alias.tt
      • 2019-05-21 14133, 2019

      • Cyna
        Ohh... I'm trying to make sense out of the TT file
      • 2019-05-21 14153, 2019

      • Cyna
        Its difficult to figure out what is happening there
      • 2019-05-21 14143, 2019

      • bitmap
        anything in particular you find confusing?
      • 2019-05-21 14107, 2019

      • bitmap
        some of the macros might be unfamiliar, but
      • 2019-05-21 14108, 2019

      • Cyna
        Most of it is unfamiliar... I'm trying to figure it out
      • 2019-05-21 14156, 2019

      • bitmap
        if you don't know what something does just ask and I'll help :)
      • 2019-05-21 14100, 2019

      • pristine__
      • 2019-05-21 14106, 2019

      • pristine__
        ruaok: ^^
      • 2019-05-21 14142, 2019

      • BrainzGit
        [musicbrainz-server] mwiencek opened pull request #1078 (master…rm-unused-code-2019-05): Remove some unused code https://github.com/metabrainz/musicbrainz-server/…
      • 2019-05-21 14123, 2019

      • BrainzGit
        [musicbrainz-server] mwiencek merged pull request #1060 (master…mbs-10153): MBS-10153: Fix stats table icon URLs https://github.com/metabrainz/musicbrainz-server/…
      • 2019-05-21 14124, 2019

      • BrainzBot
        MBS-10153: Database statistic tables' headers' icons are 404s https://tickets.metabrainz.org/browse/MBS-10153
      • 2019-05-21 14102, 2019

      • ruaok
        pristine__: Im still snowed under and still not functioning 100%. :(
      • 2019-05-21 14111, 2019

      • ruaok
        zas: for the API-compat container on lemmy, did you actually enter into the container and verify the the config.py file was missing?
      • 2019-05-21 14145, 2019

      • ruaok
        most of the values are properly filled out, but the QLALCHEMY_DATABASE_URI is missing sometimes.
      • 2019-05-21 14146, 2019

      • ruaok
        which is odd
      • 2019-05-21 14118, 2019

      • ruaok
        because we do loop to wait for the file to appear -- that code is in place and deployed.
      • 2019-05-21 14154, 2019

      • ruaok
        it is all based on the same image, really.
      • 2019-05-21 14156, 2019

      • zas
        i did, but the file was there and complete
      • 2019-05-21 14158, 2019

      • ruaok
      • 2019-05-21 14131, 2019

      • ruaok
        when the api-compat restarts, there is not pgbouncer-master service running, so that block is left empty.
      • 2019-05-21 14154, 2019

      • ruaok
        which then later dies and the container exits.
      • 2019-05-21 14101, 2019

      • ruaok
        then it should re-run and recover.
      • 2019-05-21 14105, 2019

      • ruaok
        but it doesn't.
      • 2019-05-21 14117, 2019

      • ruaok
        but, why is pgbouncer freaking out?
      • 2019-05-21 14133, 2019

      • ruaok
        to me the api-compat issue looks to be a symptom, not the cause.
      • 2019-05-21 14136, 2019

      • zas
        pgbouncer-master = bowie's one ?
      • 2019-05-21 14148, 2019

      • ruaok
        yes
      • 2019-05-21 14151, 2019

      • zas
        it's enough if an health check fails
      • 2019-05-21 14122, 2019

      • zas
        i'm off to diner, i'll have a look after
      • 2019-05-21 14127, 2019

      • ruaok
        k, me too.
      • 2019-05-21 14129, 2019

      • ruaok
        pristine__: how do you define "candidate_recordings" ?
      • 2019-05-21 14146, 2019

      • ruaok
        22M candidate recordings sounds... too big.
      • 2019-05-21 14101, 2019

      • pristine__
        ruaok: recording which the user has never listened to
      • 2019-05-21 14150, 2019

      • pristine__
        All recordings - user recordings
      • 2019-05-21 14159, 2019

      • ruaok
        ok, got it.
      • 2019-05-21 14112, 2019

      • ruaok
        10m just for that step. oy
      • 2019-05-21 14122, 2019

      • pristine__
        Yup and get well soon.
      • 2019-05-21 14125, 2019

      • pristine__
        Yes ruaok
      • 2019-05-21 14128, 2019

      • pristine__
        Nice idea
      • 2019-05-21 14140, 2019

      • ruaok
        ok, these reports are now living up to what I wanted them to do. well done.
      • 2019-05-21 14146, 2019

      • reosarevok
        ruaok: why does this remind me of you? https://www.teepublic.com/t-shirt/3486763-pink-fr…
      • 2019-05-21 14148, 2019

      • ruaok
        I can follow the process and ask better questions.
      • 2019-05-21 14103, 2019

      • pristine__
        We could reduce the number from 22M to make the process fast
      • 2019-05-21 14108, 2019

      • pristine__
        Can*
      • 2019-05-21 14113, 2019

      • pristine__
        Thanks :)
      • 2019-05-21 14120, 2019

      • ruaok
        reosarevok: you can just ship a size XL to the office in lieu of chocolate. thanks. :)
      • 2019-05-21 14139, 2019

      • ruaok
        Reducing the 22M would be one goal, yes.
      • 2019-05-21 14117, 2019

      • ruaok
        ok, I need to go now.
      • 2019-05-21 14125, 2019

      • ruaok
        but tomorrow let me review the trello task list.
      • 2019-05-21 14133, 2019

      • pristine__
        I mean first we will subtract user recordings from all recordings, get the candidate recording and filter around 10M rows
      • 2019-05-21 14136, 2019

      • pristine__
        Sure
      • 2019-05-21 14139, 2019

      • ruaok
        but we should work on merging open PRs now before we open any new ones.
      • 2019-05-21 14150, 2019

      • ruaok runs off
      • 2019-05-21 14157, 2019

      • pristine__
        Did you read the dependent idea?
      • 2019-05-21 14108, 2019

      • pristine__
        Oh lol. Bye ruaok :)
      • 2019-05-21 14120, 2019

      • ruaok
        bye. mañana!
      • 2019-05-21 14149, 2019

      • BrainzGit
        [musicbrainz-server] mwiencek merged pull request #1078 (master…rm-unused-code-2019-05): Remove some unused code https://github.com/metabrainz/musicbrainz-server/…
      • 2019-05-21 14110, 2019

      • Cyna
        The edit templates in `/root/edit/details/` are the ones that get displayed after edit is submitted right. reosarevok
      • 2019-05-21 14151, 2019

      • Cyna
        Im currently working on a different approach... will bounce back in a day or two with results
      • 2019-05-21 14149, 2019

      • bitmap
        Cyna: yes, and they're the same ones used for previewing in the release editor
      • 2019-05-21 14119, 2019

      • bitmap
        we'd rather not have two different approaches to previewing the same edits
      • 2019-05-21 14119, 2019

      • bitmap
        so please work on converting these and not go off on a tangent :)
      • 2019-05-21 14130, 2019

      • Cyna
        By using the other I will propose it would get easier to make it work with other entities... Its hard to understand what macros.tt
      • 2019-05-21 14156, 2019

      • Cyna
        Okay I am trying to figure out the meaning of stuff in macros.tt
      • 2019-05-21 14156, 2019

      • reosarevok
        Well, macros.tt will eventually all be converted to JS
      • 2019-05-21 14104, 2019

      • reosarevok
        Just ask if you have doubts! :)
      • 2019-05-21 14126, 2019

      • Cyna
        Guessing it should be first converted to JS before converting the other templates
      • 2019-05-21 14151, 2019

      • Cyna
        what is Diff class ?
      • 2019-05-21 14138, 2019

      • reosarevok
        We generally convert the macros one at a time when we need them
      • 2019-05-21 14146, 2019

      • bitmap
        most likely lib/MusicBrainz/Server/Plugin/Diff.pm
      • 2019-05-21 14108, 2019

      • bitmap
        I mentioned this yesterday but I have a branch to convert the diff macros to React
      • 2019-05-21 14137, 2019

      • bitmap
        hence starting with root/edit/details/add_remove_alias.tt so that you don't need those yet
      • 2019-05-21 14104, 2019

      • Cyna
        Ohh
      • 2019-05-21 14101, 2019

      • MusicbrainzB0T1 joined the channel
      • 2019-05-21 14123, 2019

      • Zialus has quit
      • 2019-05-21 14112, 2019

      • Zialus joined the channel
      • 2019-05-21 14127, 2019

      • MusicbrainzB0T has quit
      • 2019-05-21 14154, 2019

      • BrainzGit
        [musicbrainz-server] mwiencek opened pull request #1079 (master…babel-eslint-11): Update babel-eslint to 11.0.0-beta.0 https://github.com/metabrainz/musicbrainz-server/…
      • 2019-05-21 14151, 2019

      • reosarevok
        yvanzo: around? :)
      • 2019-05-21 14123, 2019

      • BrainzGit
        [musicbrainz-server] reosarevok merged pull request #1003 (master…MBS-9849): MBS-9849: Convert RG index page to React https://github.com/metabrainz/musicbrainz-server/…
      • 2019-05-21 14125, 2019

      • BrainzBot
        MBS-9849: Convert the release group public pages to React https://tickets.metabrainz.org/browse/MBS-9849
      • 2019-05-21 14159, 2019

      • BrainzGit
        [musicbrainz-server] reosarevok merged pull request #1005 (master…MBS-10104): MBS-10104: Convert the area index page to React https://github.com/metabrainz/musicbrainz-server/…
      • 2019-05-21 14100, 2019

      • BrainzBot
        MBS-10104: Convert the area index page to React https://tickets.metabrainz.org/browse/MBS-10104
      • 2019-05-21 14152, 2019

      • Gazooo joined the channel
      • 2019-05-21 14101, 2019

      • iliekcomputers
        upgraded api-compat-prod with latest mbdata
      • 2019-05-21 14107, 2019

      • zas
        ruaok: i think issues with lemmy are related to docker-proxy (at least for failing nagios checks)
      • 2019-05-21 14129, 2019

      • zas
        it's relaying all incoming connections on port 80 to docker container
      • 2019-05-21 14135, 2019

      • zas
        and i noticed lemmy sysctl values were almost all by default, i set much higher values for such server (accepting a lot of connections), it was very needed (at least maxconn, it was on default 128, which is far too low, now 4096)
      • 2019-05-21 14102, 2019

      • zas
        https://windsock.io/the-docker-proxy/ explains the role of docker-proxy, and we are in the case we have iptables=false
      • 2019-05-21 14122, 2019

      • ruaok
        Yes, we've never tweaked anything. Is it happy now?
      • 2019-05-21 14133, 2019

      • iliekcomputers
        We should move api compat to gateways, no idea why it needs direct connection with lemmy
      • 2019-05-21 14133, 2019

      • zas
        ruaok: dunno, but i think issue is related to docker-proxy, which is used because we don't allow docker to modify iptables (=firewalls), this is something bothering me since a while.
      • 2019-05-21 14119, 2019

      • zas
        I found https://github.com/chaifeng/ufw-docker which basically solves this issue (ufw + docker without disabling iptables in docker conf), i'll prolly give it a try, but deploying such stuff in prod will have to be done very carefully. Getting rid of docker-proxy and relying on iptables instead is very likely more efficient. Plus docker-proxy is known to be rather memory hungry.
      • 2019-05-21 14118, 2019

      • zas
        Experience show that running docker with iptables=false create more issues and only solves one: without, docker messes with iptables and leads to a serious security risk (basically it defeats firewall rules)
      • 2019-05-21 14117, 2019

      • zas
        Letting docker play with iptables is the way to go, it is meant to do that. But a proper firewalling solution is still required, https://github.com/chaifeng/ufw-docker is an attempt to address this issue.
      • 2019-05-21 14125, 2019

      • zas
        So i'll dig this, and see where it goes. I'm rather reluctant to play with iptables on production systems... it can easily turn into a nightmare ;)
      • 2019-05-21 14117, 2019

      • zas
        btw, about impact of docker-proxy over overall performance: https://medium.com/@FranckPachot/high-cpu-usage-i…
      • 2019-05-21 14115, 2019

      • spellew
        ferbncode: I've been playing around with the code, but I haven't been able to reproduce the CB bug to test it. I did do some reading on it though, and it seems the solution here is to provide an expression to `join(tag_model)` as the second parameter. So, `join(tag_model, entity_model.id == tag_model.release_group_id)`.
      • 2019-05-21 14106, 2019

      • spellew
        Of course, it would also have to be changed so other entities are supported.
      • 2019-05-21 14113, 2019

      • reosarevok
        yvanzo: marked some things as resolved in your comments to the collections pr that I didn't get to push yet, will do in the morning
      • 2019-05-21 14117, 2019

      • D4RK-PH0ENiX has quit
      • 2019-05-21 14123, 2019

      • D4RK-PH0ENiX joined the channel