#metabrainz

/

      • akashgp09 has quit
      • 2021-06-30 18124, 2021

      • HenryG has quit
      • 2021-06-30 18126, 2021

      • HenryG joined the channel
      • 2021-06-30 18117, 2021

      • wargreen has quit
      • 2021-06-30 18126, 2021

      • wargreen joined the channel
      • 2021-06-30 18113, 2021

      • MRiddickW joined the channel
      • 2021-06-30 18109, 2021

      • yyoung
        yvanzo: Good morning
      • 2021-06-30 18106, 2021

      • yvanzo
        mo’’in’
      • 2021-06-30 18140, 2021

      • yyoung
        Have you read my PR? :)
      • 2021-06-30 18121, 2021

      • yvanzo
        Yes and also tested it, it works nicely.
      • 2021-06-30 18125, 2021

      • yyoung
        Thanks! Do you mean #2151 or #2114 ?
      • 2021-06-30 18156, 2021

      • yvanzo
        2151
      • 2021-06-30 18155, 2021

      • yyoung
        I see, any suggestions on the code?
      • 2021-06-30 18107, 2021

      • yvanzo
        yyoung: yes, the "raw url" and "clean url" labels refer to the code and will probably not be explicit enough to editors.
      • 2021-06-30 18124, 2021

      • yyoung
        Maybe change it to "URL" and "Cleaned up to" ?
      • 2021-06-30 18145, 2021

      • yvanzo
        That looks better indeed.
      • 2021-06-30 18126, 2021

      • yyoung
        OK, and the variable names remain unchanged in the code, right?
      • 2021-06-30 18144, 2021

      • yvanzo
        yes
      • 2021-06-30 18155, 2021

      • yyoung
        OK
      • 2021-06-30 18103, 2021

      • yyoung
        Any other suggestion? :)
      • 2021-06-30 18116, 2021

      • yvanzo
        It lacks tests.
      • 2021-06-30 18116, 2021

      • yyoung
        I know, just want to have your review first, to ensure I'm on the right way :)
      • 2021-06-30 18146, 2021

      • yyoung
        If so I'll start working on the tests
      • 2021-06-30 18119, 2021

      • yyoung
        yvanzo: Should I do something with the text overflow here? https://imgur.com/Kfyy7IS
      • 2021-06-30 18140, 2021

      • yvanzo
        Probably not, the full URL text must be shown for editors to visually check.
      • 2021-06-30 18157, 2021

      • yyoung
        Alright.
      • 2021-06-30 18119, 2021

      • yvanzo
        When in doubt, ask bitmap and reosarevok too :)
      • 2021-06-30 18142, 2021

      • yyoung
        Then should I disable text wrap?
      • 2021-06-30 18146, 2021

      • yyoung
        OK :)
      • 2021-06-30 18101, 2021

      • yvanzo
        Do not hesitate to ask MB editors for feedback from UI changes, either on #musicbrainz channel or on community forums.
      • 2021-06-30 18100, 2021

      • yvanzo
        (They will be able to test it in beta, but if you want earlier feedback send them screenshots/screencasts.)
      • 2021-06-30 18104, 2021

      • yyoung
        Roger.
      • 2021-06-30 18127, 2021

      • yvanzo
        yyoung: Anything else before I go?
      • 2021-06-30 18100, 2021

      • yyoung
        yvanzo: Yes, look at this screenshot: https://imgur.com/mheBqCV
      • 2021-06-30 18133, 2021

      • yyoung
        It occurs to me that the error targets still need to be enhanced
      • 2021-06-30 18112, 2021

      • yvanzo
        Yes
      • 2021-06-30 18146, 2021

      • yyoung
        This is the default message for ERROR_TARGETS.URL
      • 2021-06-30 18129, 2021

      • yyoung
        And the corresponding URLCleanup rule is indeed a regexp check for URL
      • 2021-06-30 18156, 2021

      • yyoung
        But in this case it shouldn't target URL
      • 2021-06-30 18144, 2021

      • yyoung
        I haven't figure out a reasonable solution though, so maybe deal with it later
      • 2021-06-30 18153, 2021

      • yyoung
        yvanzo: That's all for now, thanks!
      • 2021-06-30 18108, 2021

      • yvanzo
        It should target the discography entry.
      • 2021-06-30 18154, 2021

      • yyoung
        Yes but the problem is URLCleanup did not provide enough information
      • 2021-06-30 18116, 2021

      • yvanzo
        Right, the 'validate' function for 'amazon' should be enhanced.
      • 2021-06-30 18107, 2021

      • yvanzo
        Not only the URLCleanup stuff actually.
      • 2021-06-30 18151, 2021

      • yvanzo
        When it validates one relationship and not the other for the same URL, the target should probably be the second relationship.
      • 2021-06-30 18100, 2021

      • yyoung
        Hmmm maybe we can check whether there're multiple relationships under this URL and react accordingly
      • 2021-06-30 18131, 2021

      • yvanzo
        Yes
      • 2021-06-30 18152, 2021

      • yyoung
        My current mechanism is to display URL-targeted message under the input box
      • 2021-06-30 18115, 2021

      • yyoung
        But the validation is carried out for each relationship
      • 2021-06-30 18147, 2021

      • yyoung
        OK then, I'll try to fix it later
      • 2021-06-30 18155, 2021

      • yyoung
        I'll start working on the tests, and ask editors for their opinions on the UI change the other day
      • 2021-06-30 18132, 2021

      • yvanzo
        yyoung: OK, keep up the good work! :)
      • 2021-06-30 18115, 2021

      • yvanzo
        zas: Some search index updates from Monday were missing, I resent them.
      • 2021-06-30 18151, 2021

      • yvanzo
        But a full rebuild of search indexes will probably be needed for earlier missing items.
      • 2021-06-30 18133, 2021

      • yvanzo
        If search.index queue is messing up again, just stop sir-prod on pink to stop it writing unneeded large logs.
      • 2021-06-30 18155, 2021

      • akashgp09 joined the channel
      • 2021-06-30 18119, 2021

      • lucifer
        zas: hi! ssh connections to bono are timing out. can you please help?
      • 2021-06-30 18117, 2021

      • lucifer
        https://similarity.acousticbrainz.org/ is also hosted on bono and returns a connection timeout as well.
      • 2021-06-30 18138, 2021

      • MRiddickW has quit
      • 2021-06-30 18114, 2021

      • zas
        timeout for me too
      • 2021-06-30 18147, 2021

      • zas
        it doesn't answer to ping either, I reset it
      • 2021-06-30 18145, 2021

      • zas
        lucifer: server is back
      • 2021-06-30 18127, 2021

      • lucifer
        zas: thanks! able to login now.
      • 2021-06-30 18116, 2021

      • okno_ joined the channel
      • 2021-06-30 18105, 2021

      • BrainzGit
        [bookbrainz-site] 14akashgp09 opened pull request #657 (03series-entity…master): Merge master into series-entity https://github.com/bookbrainz/bookbrainz-site/pul…
      • 2021-06-30 18103, 2021

      • lucifer
      • 2021-06-30 18120, 2021

      • lucifer
        alastairp: ^ trying to train dataset on bono raises the above exception
      • 2021-06-30 18146, 2021

      • alastairp
        lucifer: yeah, it can be temperamental. how big is the dataset you were evaluating?
      • 2021-06-30 18104, 2021

      • lucifer
        2 classes, ~150 recordings each.
      • 2021-06-30 18101, 2021

      • alastairp
        that _should_ be enough to prevent the usual errors
      • 2021-06-30 18134, 2021

      • alastairp
        at a guess from the error message, one of the preprocessing tries to delete the ['metadata'] block from the ll json, but maybe AB has filtered that out before?
      • 2021-06-30 18109, 2021

      • alastairp
      • 2021-06-30 18119, 2021

      • alastairp
        maybe this failOnUnmatched could help?
      • 2021-06-30 18141, 2021

      • alastairp
        if not, we could temporarily try and delete the metadata.* from here: https://github.com/MTG/gaia/blob/master/src/bindi…
      • 2021-06-30 18139, 2021

      • lucifer
        i see makes sense.
      • 2021-06-30 18159, 2021

      • lucifer
      • 2021-06-30 18137, 2021

      • lucifer
        so passing failOnUnmatched=False here should be enough?
      • 2021-06-30 18136, 2021

      • alastairp
        unsure - I don't know if our project template file allows this parameter to be changed
      • 2021-06-30 18137, 2021

      • loujine
        https://news.ycombinator.com/item?id=27672508 discussion about beets, picard gets mentioned a lot
      • 2021-06-30 18104, 2021

      • lucifer
      • 2021-06-30 18140, 2021

      • alastairp
        lucifer: yes, that's probably better. however - 1) double-check the git tag that we check out when compiling gaia, that feature may not be present in the version that we're using
      • 2021-06-30 18135, 2021

      • alastairp
        and 2) this process did work, so I'm a bit interested in working out why we're running into problems with it - I suspect that there's a solution to this problem that means we don't need to make such a drastic change
      • 2021-06-30 18142, 2021

      • BrainzGit
        [bookbrainz-site] 14akashgp09 opened pull request #658 (03series-entity…series-collection): feta(collection,series): Extend Collections to include Series Entity. https://github.com/bookbrainz/bookbrainz-site/pul…
      • 2021-06-30 18134, 2021

      • lucifer
        yeah, you're right, we're checking out 2.4.5. the failOnUnmatched is only present in latest master.
      • 2021-06-30 18102, 2021

      • lucifer
        2 makes sense as well.
      • 2021-06-30 18108, 2021

      • alastairp
        unfortunately we may have to dig into the gaia code, but I'm a bit surprised that it's buggy
      • 2021-06-30 18112, 2021

      • alastairp
        which branch are you running this on?
      • 2021-06-30 18146, 2021

      • lucifer
      • 2021-06-30 18127, 2021

      • lucifer is scared of diagnosing c++ code
      • 2021-06-30 18154, 2021

      • lucifer
        on the bright side, sklearn eval completed successfully
      • 2021-06-30 18131, 2021

      • lucifer
      • 2021-06-30 18107, 2021

      • alastairp
        ok great, nice to confirm that the end-to-end works there
      • 2021-06-30 18146, 2021

      • alastairp
        I wonder if there's some changed code that accidentally runs during the gaia flow that shouldn't
      • 2021-06-30 18109, 2021

      • lucifer
        yeah, i would want to try out the dataset on AB prod and see if it works there.
      • 2021-06-30 18121, 2021

      • lucifer
        should we do a release first?
      • 2021-06-30 18148, 2021

      • alastairp
        yeah, sure!
      • 2021-06-30 18127, 2021

      • lucifer
        nice! :D
      • 2021-06-30 18148, 2021

      • lucifer
        any PRs ready to merge or should I create the release?
      • 2021-06-30 18127, 2021

      • alastairp
        no, everything merged for now
      • 2021-06-30 18135, 2021

      • lucifer
        👍
      • 2021-06-30 18102, 2021

      • BrainzGit
        [acousticbrainz-server] release 03v-2021-06-30.0 has been published by 14github-actions[bot]: https://github.com/metabrainz/acousticbrainz-serv…
      • 2021-06-30 18144, 2021

      • outsidecontext
        loujine: thanks for sharing that link
      • 2021-06-30 18106, 2021

      • lucifer
        updating AB prod.
      • 2021-06-30 18148, 2021

      • loujine
        outsidecontext: np
      • 2021-06-30 18154, 2021

      • lucifer
        alastairp: AB didn't start as expected.
      • 2021-06-30 18101, 2021

      • alastairp
        looking
      • 2021-06-30 18134, 2021

      • lucifer
        i have reverted to previous image.
      • 2021-06-30 18102, 2021

      • lucifer
      • 2021-06-30 18126, 2021

      • lucifer
        this was the log before i shut down container from today's image.
      • 2021-06-30 18150, 2021

      • lucifer
        uwsgi didn't start up or exited with some errors proabably?
      • 2021-06-30 18104, 2021

      • alastairp
        there was nothing after the enabling syslog message?
      • 2021-06-30 18109, 2021

      • lucifer
        oh my bad 🤦
      • 2021-06-30 18120, 2021

      • alastairp
        seems like consul was waiting for config items that don't exist?
      • 2021-06-30 18123, 2021

      • lucifer
      • 2021-06-30 18128, 2021

      • lucifer
        yes right
      • 2021-06-30 18133, 2021

      • lucifer
        this is not merged yet
      • 2021-06-30 18137, 2021

      • alastairp
        sure
      • 2021-06-30 18139, 2021

      • alastairp
        go ahead with that one
      • 2021-06-30 18145, 2021

      • lucifer
        👍
      • 2021-06-30 18104, 2021

      • lucifer
        up now.
      • 2021-06-30 18108, 2021

      • alastairp
        nice
      • 2021-06-30 18139, 2021

      • lucifer
        all AB containers updated.
      • 2021-06-30 18133, 2021

      • lucifer
      • 2021-06-30 18113, 2021

      • lucifer
        did something related to AB volumes change recently?
      • 2021-06-30 18151, 2021

      • alastairp
        we moved servers
      • 2021-06-30 18106, 2021

      • alastairp
        I guess we didn't copy the contents/permission of that volume
      • 2021-06-30 18157, 2021

      • lucifer
        but that should be in the docker-server-configs scripts?
      • 2021-06-30 18118, 2021

      • alastairp
        what should be? the definition of the volume, yes
      • 2021-06-30 18154, 2021

      • alastairp
        but given the problems we've had with permissions on dumps on LB, I'm not surprised that AB volumes don't start up properly either :)
      • 2021-06-30 18127, 2021

      • lucifer
        ah right the definitions are there.
      • 2021-06-30 18153, 2021

      • lucifer
        yeah, indedd.
      • 2021-06-30 18132, 2021

      • lucifer
        well, good thing boingo isn't decommissioned yet :)
      • 2021-06-30 18140, 2021

      • alastairp
        so we can fix the definitions of the volumes in the Dockerfile, but we should also copy the contents of the volume from boingo
      • 2021-06-30 18143, 2021

      • alastairp
        yeah. I'll do that now
      • 2021-06-30 18157, 2021

      • alastairp
        we should set up backup to create backups from clash too
      • 2021-06-30 18103, 2021

      • alastairp
        (and disable boingo)
      • 2021-06-30 18114, 2021

      • lucifer
        +1
      • 2021-06-30 18150, 2021

      • alastairp
        lol, suddenly my list for today got really big
      • 2021-06-30 18126, 2021

      • lucifer
        lol XD
      • 2021-06-30 18144, 2021

      • lucifer
        let me if I can help with some of it? :)
      • 2021-06-30 18148, 2021

      • lucifer
        *let me know
      • 2021-06-30 18131, 2021

      • alastairp
        thanks, but I think I'm good
      • 2021-06-30 18159, 2021

      • alastairp
        lucifer: unrelated, I ran into https://serpy.readthedocs.io/en/latest/ yesterday
      • 2021-06-30 18111, 2021

      • alastairp
        something to keep in mind in a possible future
      • 2021-06-30 18134, 2021

      • lucifer
        yes indeed. might be useful to us.
      • 2021-06-30 18135, 2021

      • BrainzGit
        [acousticbrainz-server] 14alastair closed pull request #366 (03master…similarity_paths): Similarity Path Hack https://github.com/metabrainz/acousticbrainz-serv…
      • 2021-06-30 18108, 2021

      • BrainzGit
        [listenbrainz-server] 14mayhem merged pull request #1527 (03master…add-MBID-to-pinned-recording): Add optional recordingMBID to pinned recordings https://github.com/metabrainz/listenbrainz-server…
      • 2021-06-30 18129, 2021

      • lucifer
        rdswift: should i merge 1536?
      • 2021-06-30 18137, 2021

      • lucifer
        ah, sorry. ruaok ^