#metabrainz

/

      • zas
        Yup, but current patch should work
      • 2021-01-22 02203, 2021

      • D4RK-PH0ENiX joined the channel
      • 2021-01-22 02215, 2021

      • reosarevok
        "number of cd ids for the release on a medium in the release"
      • 2021-01-22 02222, 2021

      • reosarevok
        How in hell is this useful
      • 2021-01-22 02229, 2021

      • ruaok
        zas: thanks!
      • 2021-01-22 02252, 2021

      • CatQuest
        everyone vote on the remove elasticsearch from BB ticket: BB-584 (had to create it, it didn't already excist?)
      • 2021-01-22 02253, 2021

      • BrainzBot
        BB-584: Replace ElasticSearch on BookBrainz https://tickets.metabrainz.org/browse/BB-584
      • 2021-01-22 02216, 2021

      • reosarevok
        Improved it to "the number of disc IDs attached to any one medium on the release" but I still find it useless. Just a bit more clear :p
      • 2021-01-22 02231, 2021

      • CatQuest
        🤔 maybe ES search replacement is a gsoc contender? :hm:
      • 2021-01-22 02242, 2021

      • CatQuest
        feel free to remove the label
      • 2021-01-22 02219, 2021

      • sumedh joined the channel
      • 2021-01-22 02247, 2021

      • adhi001 joined the channel
      • 2021-01-22 02219, 2021

      • adhi001
        @iliekcomputers: I agree, the present version of maps would be more maintainable in the long term.
      • 2021-01-22 02215, 2021

      • reosarevok
        yvanzo: what are the possible values of the (so far undocumented) orderingattribute series field?
      • 2021-01-22 02249, 2021

      • reosarevok
        Also, https://wiki.musicbrainz.org/MusicBrainz_API/Sear… - we do expose rowids sometimes ;) But I guess those do not get deleted ever, so
      • 2021-01-22 02238, 2021

      • reosarevok
        Same for tags, dunno if we ever remove those tho
      • 2021-01-22 02245, 2021

      • reosarevok
        Also, why the hell did http://musicbrainz.org/ws/2/tag?query=tag:metal require auth?
      • 2021-01-22 02236, 2021

      • reosarevok
      • 2021-01-22 02229, 2021

      • reosarevok
        yvanzo: Actually, should we unexpose the id? Do we ever expose the tag ID? I don't see where, so that'd be just "guess an ID to query"
      • 2021-01-22 02239, 2021

      • reosarevok
        For now I'll document it, but...
      • 2021-01-22 02250, 2021

      • reosarevok
        Same question for cdstub IDs
      • 2021-01-22 02243, 2021

      • reosarevok
        Also, no idea what url_ancestor and url_descendent are
      • 2021-01-22 02250, 2021

      • reosarevok
        Added SEARCH-642 and SEARCH-643
      • 2021-01-22 02251, 2021

      • BrainzBot
        SEARCH-642: Consider dropping id fields for cdstub and tag https://tickets.metabrainz.org/browse/SEARCH-642
      • 2021-01-22 02251, 2021

      • BrainzBot
        SEARCH-643: Allow querying URLs by relation MBID https://tickets.metabrainz.org/browse/SEARCH-643
      • 2021-01-22 02205, 2021

      • reosarevok
        Added URL to https://wiki.musicbrainz.org/Indexed_Search_Syntax which was missing it completely
      • 2021-01-22 02255, 2021

      • reosarevok
        Hmm, wait, I guess that's because that one is meant for the site search, https://wiki.musicbrainz.org/MusicBrainz_API/Sear… already had it. Nvm then :D
      • 2021-01-22 02240, 2021

      • reosarevok
        Anyway, I'm done except for the few ones I don't understand. yvanzo: halp! :D https://wiki.musicbrainz.org/MusicBrainz_API/Sear…
      • 2021-01-22 02253, 2021

      • yvanzo
        reosarevok: I’m not sure about values for 'orderingattribute'
      • 2021-01-22 02239, 2021

      • yvanzo
        It seems that it looks at 'name' column in 'link_attribute_type' but http://musicbrainz.org/ws/2/series?query=ordering… doesn’t return meaningful results.
      • 2021-01-22 02252, 2021

      • reosarevok
        We should probably either figure it out or drop it :)
      • 2021-01-22 02230, 2021

      • yvanzo
        Or it might be 'number' stands for automatic ordering.
      • 2021-01-22 02204, 2021

      • reosarevok
        Is it useful to search by automatic/manual anyway?
      • 2021-01-22 02219, 2021

      • reosarevok
        Do we actually expose that data in the ws in the first place?
      • 2021-01-22 02232, 2021

      • yvanzo
        It seems we do expose ordering keys in ws series lookup
      • 2021-01-22 02208, 2021

      • yvanzo
        And it seems they do not match the order used to return results :D
      • 2021-01-22 02230, 2021

      • reosarevok
        Yep
      • 2021-01-22 02239, 2021

      • reosarevok
        Are those the actual orderingattributes though?
      • 2021-01-22 02249, 2021

      • yvanzo
        no
      • 2021-01-22 02227, 2021

      • yvanzo
        But they are related.
      • 2021-01-22 02215, 2021

      • yvanzo
      • 2021-01-22 02250, 2021

      • yvanzo
        I suspect SIR follows the same logic.
      • 2021-01-22 02246, 2021

      • reosarevok
        No, that's not a fallback, that's the printable name :)
      • 2021-01-22 02200, 2021

      • reosarevok
        (it's a combination of types, but IIRC our type name on the WS is always one type?)
      • 2021-01-22 02203, 2021

      • reosarevok
        Oh
      • 2021-01-22 02208, 2021

      • reosarevok
      • 2021-01-22 02224, 2021

      • yvanzo
        right
      • 2021-01-22 02238, 2021

      • reosarevok
        Added that link to the docs so there's at least *some* info
      • 2021-01-22 02253, 2021

      • BrainzGit
        [musicbrainz-server] reosarevok merged pull request #1767 (master…eslint-no-extra-semi): Eslint fixes (few more rules for CI) https://github.com/metabrainz/musicbrainz-server/…
      • 2021-01-22 02225, 2021

      • ruaok
        zas, alastairp you about?
      • 2021-01-22 02210, 2021

      • alastairp
        ruaok: hi
      • 2021-01-22 02254, 2021

      • ruaok
        hey
      • 2021-01-22 02214, 2021

      • ruaok
        I'm trying to get the mbid mapper running, which is running in a different image from the rest of LB.
      • 2021-01-22 02241, 2021

      • ruaok
        the container starts fine with the python:3.8-20210115 base image.
      • 2021-01-22 02203, 2021

      • ruaok
        the Dockerfile copies the consul-template file:
      • 2021-01-22 02204, 2021

      • ruaok
        COPY docker/consul-template.conf /etc/consul-template.conf
      • 2021-01-22 02227, 2021

      • ruaok
        but on startup, the config file is not generated. nor are any errors printed.
      • 2021-01-22 02233, 2021

      • ruaok
        how can I debug this further?
      • 2021-01-22 02246, 2021

      • alastairp
        you've got either the wrong base image, or the wrong config file
      • 2021-01-22 02202, 2021

      • alastairp
        /etc/consul-template.conf is automatically read only in the 2020 image
      • 2021-01-22 02239, 2021

      • ruaok
        do I need to invoke it manually with the 2021 image?
      • 2021-01-22 02255, 2021

      • BrainzGit
        [musicbrainz-server] reosarevok merged pull request #1815 (master…MBS-11256): MBS-11256: Make adding tracklist to empty medium an autoedit https://github.com/metabrainz/musicbrainz-server/…
      • 2021-01-22 02256, 2021

      • alastairp
        if you want to use the 2021 image file you'll have to create an explicit runit file that calls run-consul-template like https://github.com/metabrainz/listenbrainz-server…
      • 2021-01-22 02212, 2021

      • ruaok
        ahhh, that is what I was missing.
      • 2021-01-22 02251, 2021

      • ruaok
        thanks!
      • 2021-01-22 02259, 2021

      • alastairp
        👍
      • 2021-01-22 02240, 2021

      • alastairp
        by next week this confusion won't exist any more, which will be a relief
      • 2021-01-22 02256, 2021

      • alastairp
        _lucifer is doing well migrating the other apps
      • 2021-01-22 02253, 2021

      • BrainzGit
        [musicbrainz-server] reosarevok merged pull request #1774 (master…MBS-11111): MBS-11111: Set edit_pendings on recordings merged with release https://github.com/metabrainz/musicbrainz-server/…
      • 2021-01-22 02236, 2021

      • diru1100 joined the channel
      • 2021-01-22 02224, 2021

      • BrainzGit
        [musicbrainz-server] reosarevok merged pull request #1838 (master…MBS-11296): MBS-11296 / MBS-11297: More blocks for Wikipedia/Wikidata at release level https://github.com/metabrainz/musicbrainz-server/…
      • 2021-01-22 02241, 2021

      • ruaok
        alastairp: still no luck.
      • 2021-01-22 02251, 2021

      • alastairp
        got the code somewhere?
      • 2021-01-22 02207, 2021

      • ruaok
        let me make a new branch
      • 2021-01-22 02216, 2021

      • alastairp
        how are you starting the mapper? what server software is it?
      • 2021-01-22 02227, 2021

      • ruaok
        its a cron job.
      • 2021-01-22 02237, 2021

      • ruaok
        I don;t want anything to fire up at all until cron fires it off.
      • 2021-01-22 02247, 2021

      • ruaok
        so, I have no exec section on my consul config stuff.
      • 2021-01-22 02259, 2021

      • alastairp
        right. that's how we are planning to do it
      • 2021-01-22 02211, 2021

      • ruaok
        ok, hang on.
      • 2021-01-22 02227, 2021

      • BrainzGit
        [listenbrainz-server] mayhem opened pull request #1252 (master…typesense-index-deploy): Typesense index deploy https://github.com/metabrainz/listenbrainz-server…
      • 2021-01-22 02234, 2021

      • ruaok
        alastairp: ^^
      • 2021-01-22 02257, 2021

      • ruaok adds missing file
      • 2021-01-22 02259, 2021

      • yvanzo
        reosarevok: this one requires small changes only: https://github.com/metabrainz/musicbrainz-server/…
      • 2021-01-22 02206, 2021

      • alastairp
        ruaok: is docker/mapper.service chmod +x?
      • 2021-01-22 02230, 2021

      • ruaok
      • 2021-01-22 02253, 2021

      • ruaok
        file added
      • 2021-01-22 02234, 2021

      • alastairp
        and when you are having no luck - is this testing locally, or are you deploying it?
      • 2021-01-22 02249, 2021

      • ruaok
        deploying to gaga
      • 2021-01-22 02259, 2021

      • yvanzo
        reosarevok: also there is a comment on: https://github.com/metabrainz/musicbrainz-server/…
      • 2021-01-22 02241, 2021

      • reosarevok
        Ok, pushed the change for the first, let's let the test run
      • 2021-01-22 02244, 2021

      • alastairp
        right, was just checking if consul-template was actually connecting to a server. so, you're seeing that the container comes up, but the config file that you want isn't there?
      • 2021-01-22 02257, 2021

      • ruaok
        corect.
      • 2021-01-22 02245, 2021

      • ruaok
        running `run-consul-template -config /etc/consul-template.conf` just hangs, eats all keyboard IO and produces no config file
      • 2021-01-22 02258, 2021

      • reosarevok
        And commented on the second. If you want a second commit let me know
      • 2021-01-22 02213, 2021

      • reosarevok
        yvanzo: another for you it seems: https://tickets.metabrainz.org/browse/MBBE-33 - although we don't currently https them automatically either. Maybe we should add a MBS ticket for that
      • 2021-01-22 02214, 2021

      • BrainzBot
        MBBE-33: Update Rateyourmusic URLs to use HTTPS
      • 2021-01-22 02257, 2021

      • reosarevok
        (only one or two days of decoda for artists for my bot...)
      • 2021-01-22 02205, 2021

      • reosarevok
        (we had so many, jeez)
      • 2021-01-22 02258, 2021

      • alastairp
        ruaok: what env vars are you setting in the startup?
      • 2021-01-22 02225, 2021

      • ruaok
      • 2021-01-22 02249, 2021

      • ruaok
        is it missing CONSUL_PORT ?
      • 2021-01-22 02245, 2021

      • yvanzo
        reosarevok: yes, we should have https normalization deployed before running the script.
      • 2021-01-22 02259, 2021

      • reosarevok
        Ok, will add a ticket
      • 2021-01-22 02219, 2021

      • reosarevok
        Can deal with that next week
      • 2021-01-22 02256, 2021

      • alastairp
        ruaok: no, it defaults to the correct port if CONSUL_PORT isn't set. however it does need DEPLOY_ENV, because that's used in the consul template file (line 2)
      • 2021-01-22 02222, 2021

      • yvanzo
        reosarevok: tests passed for 1835 :)
      • 2021-01-22 02235, 2021

      • reosarevok
        Added MBS-11344
      • 2021-01-22 02236, 2021

      • BrainzBot
        MBS-11344: Use HTTPS for rateyourmusic URLs and add validation https://tickets.metabrainz.org/browse/MBS-11344
      • 2021-01-22 02248, 2021

      • BrainzGit
        [musicbrainz-server] reosarevok merged pull request #1835 (master…MBS-11289): MBS-11289: Stop autocleaning YouTube Music -> YouTube https://github.com/metabrainz/musicbrainz-server/…
      • 2021-01-22 02248, 2021

      • reosarevok
        Neat, merged
      • 2021-01-22 02205, 2021

      • chaban
        Something to worry about? Got this when trying to add a release. https://www.irccloud.com/pastebin/RmwmSLHh/
      • 2021-01-22 02252, 2021

      • yvanzo
        chaban: were you able to recover from this error by resubmiting again?
      • 2021-01-22 02258, 2021

      • chaban
        Yes
      • 2021-01-22 02238, 2021

      • yvanzo
        Ok, did it errored at 18:00:26 CET?
      • 2021-01-22 02213, 2021

      • chaban
      • 2021-01-22 02219, 2021

      • yvanzo
        Ok, it might be due to concurrent hourly cron job.
      • 2021-01-22 02215, 2021

      • yvanzo
        It isn’t, I found similar events unrelated to hourly cron job.
      • 2021-01-22 02219, 2021

      • yvanzo
      • 2021-01-22 02219, 2021

      • BrainzBot
        MBS-11345: Error when submitting edit: deadlock detected
      • 2021-01-22 02224, 2021

      • sumedh has quit
      • 2021-01-22 02220, 2021

      • diru1100 has quit
      • 2021-01-22 02228, 2021

      • sumedh joined the channel
      • 2021-01-22 02224, 2021

      • bitmap
        reosarevok: in the json fmt the count properties are only useful for paged lists (where it's a count of all results) or usage counts (e.g. for tags). this 'count' inside release searches is definitely errant
      • 2021-01-22 02201, 2021

      • v6lur_ joined the channel
      • 2021-01-22 02253, 2021

      • bitmap
        the only other case where they're useful is when they provide a count of something that's not loaded, e.g. track-count is given even if you don't have inc=recordings
      • 2021-01-22 02257, 2021

      • bitmap
        so something like medium-count might make sense (but not 'count'), but I guess we only have track-count for lookups because it's cached in the medium table
      • 2021-01-22 02243, 2021

      • sumedh has quit
      • 2021-01-22 02236, 2021

      • yef has quit
      • 2021-01-22 02259, 2021

      • yef joined the channel
      • 2021-01-22 02213, 2021

      • yef has quit
      • 2021-01-22 02213, 2021

      • yef joined the channel
      • 2021-01-22 02201, 2021

      • Gazooo79494 has quit
      • 2021-01-22 02245, 2021

      • Gazooo79494 joined the channel
      • 2021-01-22 02224, 2021

      • adhi001 has quit
      • 2021-01-22 02258, 2021

      • BrainzGit
        [acousticbrainz-server] amCap1712 opened pull request #388 (master…master): Prepare for Consul upgrade https://github.com/metabrainz/acousticbrainz-serv…
      • 2021-01-22 02243, 2021

      • ruaok
        alastairp: d'oh! thanks for spotting that!
      • 2021-01-22 02217, 2021

      • ruaok
        any idea how we can have this type of error generate an error message?
      • 2021-01-22 02246, 2021

      • d4rkie joined the channel
      • 2021-01-22 02253, 2021

      • alastairp
        ruaok: consul-template doesn't appear to throw an error if the env isn't there. We could update the run-consul-template script to emit a warning if that's the case, though I don't know if MBS uses that variable
      • 2021-01-22 02247, 2021

      • ruaok
        any indication that something went wrong would be a good start.
      • 2021-01-22 02215, 2021

      • alastairp
        I guess it doesn't consider that it's "wrong"
      • 2021-01-22 02242, 2021

      • alastairp
        I only worked it out because I was running the consul server and I saw it trying to request the variable LB..json instead of LB.prod.json
      • 2021-01-22 02237, 2021

      • alastairp
        let's check up with zas, perhaps we could have some pre-processing that reads the template file, looks for things that are env variables, and checks if they're set. Should be doable with grep
      • 2021-01-22 02226, 2021

      • D4RK-PH0_ has quit
      • 2021-01-22 02235, 2021

      • ruaok
        if it didn't consider it wrong, why didn't it generate a file?
      • 2021-01-22 02251, 2021

      • alastairp
        because it couldn't find the variable in consul
      • 2021-01-22 02256, 2021

      • ruaok
        if the file is wrong, that is one thing. but no filte generated and no error is a bit hard to debug
      • 2021-01-22 02242, 2021

      • alastairp
        yeah, I see what you mean
      • 2021-01-22 02258, 2021

      • ruaok
        well, I got the indexer working now. it took me all day to deploy one stupid container. :(