#metabrainz

/

      • lucifer
        mayhem: i see. so crawl albums, discover artists from tracks and query their albums and add it to queue?
      • 2022-09-14 25719, 2022

      • alastairp
        reosarevok: have you tried listening to music by people with only real characters in their name?
      • 2022-09-14 25735, 2022

      • mayhem
        lucifer: yep!
      • 2022-09-14 25753, 2022

      • mayhem wonders how "real characters" is defined
      • 2022-09-14 25706, 2022

      • lucifer
        makes sense, so we'll need to maintain 2 sets. one for artist ids and one for album ids.
      • 2022-09-14 25706, 2022

      • alastairp
        a-zA-Z0-9 of course :)
      • 2022-09-14 25731, 2022

      • mayhem
        two sets of internal queues? yes.
      • 2022-09-14 25719, 2022

      • lucifer
        1 queue should suffice i think. for artist we only need a set.
      • 2022-09-14 25713, 2022

      • mayhem
        yeah
      • 2022-09-14 25732, 2022

      • alastairp
        ansh do we have any examples where there is a relationship of 1 author -> 2 artists? (or the other way around)
      • 2022-09-14 25759, 2022

      • alastairp
        I think I discussed this with monkey a bit and we came up with some cases where it might make sense, but we don't know any concrete examples
      • 2022-09-14 25704, 2022

      • alastairp
      • 2022-09-14 25713, 2022

      • alastairp
        ansh: I'm just looking at this with monkey now, in the office
      • 2022-09-14 25750, 2022

      • ansh
        alastairp: I found some such cases in the database. I'll find them again
      • 2022-09-14 25758, 2022

      • alastairp
        the one thing that we both saw at first is that the 3 sections (list of reviews, list of this entity in the other db, list of related entities) are difficult to visually separate
      • 2022-09-14 25715, 2022

      • alastairp
        I think the best solution here would be to add some more whitespace and open a ticket for aerozol to make it look better
      • 2022-09-14 25707, 2022

      • ansh
        Yes, that would fix the issue for now
      • 2022-09-14 25755, 2022

      • alastairp
        I'm going to open a ticket
      • 2022-09-14 25719, 2022

      • alastairp
        for now let's not overthink it, and just add some more whitespace, and leave it as-is
      • 2022-09-14 25721, 2022

      • alastairp
        so that we can merge it
      • 2022-09-14 25708, 2022

      • alastairp
        yvanzo: hi! I want to do a push for updating translations on CB after all of ansh's work. should we remain with transifex for now?
      • 2022-09-14 25748, 2022

      • skelly37 has quit
      • 2022-09-14 25719, 2022

      • alastairp
      • 2022-09-14 25725, 2022

      • alastairp
        this is what monkey and I just prototyped
      • 2022-09-14 25750, 2022

      • alastairp
        in this case, the "this entity also appears" is currently in the table, as `<tr><td colspan=3></td></tr>`
      • 2022-09-14 25706, 2022

      • alastairp
        rather than your version which has a separate table per list of reviews
      • 2022-09-14 25714, 2022

      • alastairp
        and it also explicitly says "no reviews" in the case there aren't any, which was one of the things that made the earlier Ann Leckie example a bit confusing as to where each section starts and ends
      • 2022-09-14 25754, 2022

      • alastairp
        one thing we're not sure about is what it will look like if a) the main entity you are viewing has no reviews, but a related one does, or b) none of the main entity or related entities have reviews
      • 2022-09-14 25727, 2022

      • monkey
        ^what he said
      • 2022-09-14 25700, 2022

      • monkey
        It turns out we're too smart for our own good and your way of doing is is both simpler and more future-proof (with the CB-442 redesign we will soon lose the table elements)
      • 2022-09-14 25701, 2022

      • BrainzBot
        CB-442: Improve layout of CB entity page https://tickets.metabrainz.org/browse/CB-442
      • 2022-09-14 25722, 2022

      • monkey
        Lesson of the day: don't over-engineer
      • 2022-09-14 25731, 2022

      • BrainzGit
        [musicbrainz-server] 14mwiencek merged pull request #2582 (03master…relationship-editor-react): Convert the relationship editors to React https://github.com/metabrainz/musicbrainz-server/…
      • 2022-09-14 25703, 2022

      • monkey
        reosarevok: Your track example was really great. I just discovered that there is an undocumented limit to the size of the query parameter sent to the Spotify API which if reached results in a 404
      • 2022-09-14 25743, 2022

      • monkey
        144 characters max
      • 2022-09-14 25733, 2022

      • reosarevok
        hah!
      • 2022-09-14 25754, 2022

      • lucifer
        mayhem: deployed the album crawler and surprisingly. nothing pending...
      • 2022-09-14 25701, 2022

      • mayhem
        so if i listed to stuff now it should start crawling them?
      • 2022-09-14 25730, 2022

      • mayhem plays more music
      • 2022-09-14 25724, 2022

      • mayhem
        huh, but listens should come in and start causing items to be downloaded. but that hasn't happened in a few minutes, so something seems off.
      • 2022-09-14 25718, 2022

      • lucifer
        even before i took it off, the artist id crawler only had 1/2 ids in pending
      • 2022-09-14 25734, 2022

      • lucifer
        for approx ~30 mins or so.
      • 2022-09-14 25707, 2022

      • mayhem
        ok, I guess it fetches everything and then goes back to sleep.
      • 2022-09-14 25718, 2022

      • mayhem
        maybe print out how many albums have been fetched since start?
      • 2022-09-14 25745, 2022

      • lucifer
        can see that in redis.
      • 2022-09-14 25755, 2022

      • lucifer
        118 so far in 5 mins
      • 2022-09-14 25742, 2022

      • mayhem
        question: if you find an artist id, do you automatically download all albums for that artist?
      • 2022-09-14 25748, 2022

      • mayhem
        and also then add new artist ids to the queue?
      • 2022-09-14 25739, 2022

      • lucifer
      • 2022-09-14 25752, 2022

      • lucifer
        add album ids for incoming listens to queue.
      • 2022-09-14 25719, 2022

      • lucifer
        then discover albums from tracks artists.
      • 2022-09-14 25757, 2022

      • mayhem
        looks about right. odd.
      • 2022-09-14 25723, 2022

      • mayhem
        let add more stats about albums fetched, artist/album ids discovered, etc.
      • 2022-09-14 25712, 2022

      • lucifer
        🤦
      • 2022-09-14 25723, 2022

      • mayhem
        oh?
      • 2022-09-14 25703, 2022

      • heyarne[m] joined the channel
      • 2022-09-14 25750, 2022

      • heyarne[m]
        I think I hat a bug on LB; the msid of the last couple of tracks (by DJ Python) aren't resolved correctly on https://listenbrainz.org/user/heyarne/, even though https://labs.api.listenbrainz.org/explain-mbid-ma… looks fine?
      • 2022-09-14 25715, 2022

      • heyarne[m]
        They are properly linked to their MB entries (i.e. resolved?) while playing, but as soon as they appear in the list on the left not anymore
      • 2022-09-14 25720, 2022

      • heyarne[m]
        Should I open a bug report?
      • 2022-09-14 25735, 2022

      • mayhem
        let lucifer take a look at it -- he's more up on the current idiosyncrasies of the mapper.
      • 2022-09-14 25757, 2022

      • lucifer
      • 2022-09-14 25709, 2022

      • lucifer
      • 2022-09-14 25713, 2022

      • mayhem
        duh
      • 2022-09-14 25715, 2022

      • lucifer
        working fine now
      • 2022-09-14 25717, 2022

      • mayhem
        lol
      • 2022-09-14 25704, 2022

      • mayhem
        great, good output!
      • 2022-09-14 25753, 2022

      • lucifer
        this is already getting stored in grafana as well, if you want to graph it
      • 2022-09-14 25701, 2022

      • lucifer
        oh well, the fanout setup is wrong which broke the mapper.
      • 2022-09-14 25710, 2022

      • lucifer
        heyarne[m], thanks for the report. will fix.
      • 2022-09-14 25741, 2022

      • heyarne[m]
        🌄 amazing
      • 2022-09-14 25759, 2022

      • lucifer
        mayhem: my understanding of fanout messages was incomplete. we can reuse the exchange but still need a unique name for this queue to ensure both the mapper and the cache get the listens. "spotify_metadata" for a new queue name?
      • 2022-09-14 25757, 2022

      • lucifer
        heyarne[m]: can you try listening to that song again and see if it gets mapped now?
      • 2022-09-14 25734, 2022

      • BrainzGit
        [musicbrainz-server] 14mwiencek merged pull request #2603 (03master…import-sort): Eslint: autosort imports by path https://github.com/metabrainz/musicbrainz-server/…
      • 2022-09-14 25756, 2022

      • ansh
        alastairp: monkey: I think keeping white spaces would be good for now. The prototype looks good, but I am also not fully sure for those two cases. Because if there are no reviews for the main entity, It would be kinda unclear for the users
      • 2022-09-14 25731, 2022

      • ansh
        Should we say 'No reviews' for the related entities btw?
      • 2022-09-14 25746, 2022

      • heyarne[m]
        <lucifer> "heyarne: can you try listening..." <- Yup! That was fast
      • 2022-09-14 25758, 2022

      • lucifer
        awesome!
      • 2022-09-14 25751, 2022

      • rozlav has quit
      • 2022-09-14 25754, 2022

      • rozlav joined the channel
      • 2022-09-14 25754, 2022

      • mayhem
        lucifer: that sounds fine to me.
      • 2022-09-14 25728, 2022

      • mayhem
        `Pending IDs in Queue: 211652`
      • 2022-09-14 25736, 2022

      • mayhem
        oy, that is clearly working ok.
      • 2022-09-14 25749, 2022

      • HorusHorrendus has quit
      • 2022-09-14 25733, 2022

      • lucifer
        mayhem: yeah but something still seems off, 2000 ids in 30 mins is clearly too slow.
      • 2022-09-14 25740, 2022

      • mayhem
        alastairp: do you have a current email for Paul Lamere?
      • 2022-09-14 25714, 2022

      • mayhem
        fetched or discovered ids?
      • 2022-09-14 25747, 2022

      • lucifer
        fetched
      • 2022-09-14 25749, 2022

      • alastairp
        mayhem: the only one I have in my inbox is @echonest.com, which I suspect no longer exists
      • 2022-09-14 25758, 2022

      • lucifer
        discovered is > 200k
      • 2022-09-14 25709, 2022

      • mayhem
        alastairp: ok, I'll dm him on twitter, that should work.
      • 2022-09-14 25732, 2022

      • mayhem
        not sure what the rate limits are lucifer, so not sure.
      • 2022-09-14 25749, 2022

      • mayhem
        are we fetching one album at a time or multiples at a time?
      • 2022-09-14 25759, 2022

      • lucifer
        1 album at a time.
      • 2022-09-14 25719, 2022

      • mayhem
        there is an endpoint for fetching multiples in one call -- lets use that.
      • 2022-09-14 25744, 2022

      • lucifer
        hmm which one?
      • 2022-09-14 25710, 2022

      • lucifer
      • 2022-09-14 25723, 2022

      • mayhem
        yep
      • 2022-09-14 25735, 2022

      • mayhem
        (beat me to it)
      • 2022-09-14 25756, 2022

      • lucifer
        this does not accept a limit variable as far as i can see so not sure if it'll cut off tracks.
      • 2022-09-14 25705, 2022

      • lucifer
        do you know some long albums so that we can test?
      • 2022-09-14 25719, 2022

      • mayhem
        I don't, but reosarevok does
      • 2022-09-14 25738, 2022

      • reosarevok
        Long as in many many tracks?
      • 2022-09-14 25703, 2022

      • mayhem runs off
      • 2022-09-14 25757, 2022

      • lucifer
        reosarevok: yes
      • 2022-09-14 25715, 2022

      • reosarevok
        Hmm
      • 2022-09-14 25736, 2022

      • lucifer
        > 50 tracks to be specific
      • 2022-09-14 25751, 2022

      • lucifer
        uh. i mean more than 50 tracks
      • 2022-09-14 25703, 2022

      • reosarevok
      • 2022-09-14 25717, 2022

      • lucifer
        reosarevok: thanks
      • 2022-09-14 25747, 2022

      • lucifer
        mayhem: yes, tracks are cut off after 50. i guess we could detect and do separate queries in that case though.
      • 2022-09-14 25729, 2022

      • chrisshepherd has quit
      • 2022-09-14 25732, 2022

      • ssam has quit
      • 2022-09-14 25727, 2022

      • chrisshepherd joined the channel
      • 2022-09-14 25711, 2022

      • ssam joined the channel
      • 2022-09-14 25750, 2022

      • chrisshepherd has quit
      • 2022-09-14 25752, 2022

      • ssam has quit
      • 2022-09-14 25737, 2022

      • chrisshepherd joined the channel
      • 2022-09-14 25707, 2022

      • ssam joined the channel
      • 2022-09-14 25704, 2022

      • mayhem
        Yes, a pita, but bound to be faster.
      • 2022-09-14 25705, 2022

      • reosarevok
        loujine, jesus2099 (and probably most other userscript makers): the new React relationship editors are out in beta. They'll be there for a while (longer than the usual week)
      • 2022-09-14 25741, 2022

      • reosarevok
        They'll almost certainly break several of your scripts - feel free to ask bitmap or me if you need help with something (well, bitmap knows a lot more since it's his code, but I can try to help)
      • 2022-09-14 25708, 2022

      • BrainzGit
        [musicbrainz-server] 14reosarevok opened pull request #2636 (03master…MBS-12205): MBS-12205: Add "play on ListenBrainz" button https://github.com/metabrainz/musicbrainz-server/…
      • 2022-09-14 25727, 2022

      • reosarevok
        mayhem, monkey ^ (seems to work, anyway)
      • 2022-09-14 25706, 2022

      • reosarevok
        Given LB has MB database access, though, wouldn't it be nice to just give it a collection ID instead and it would build the playlist from the DB? :p
      • 2022-09-14 25739, 2022

      • reosarevok
        The current way is kinda hackish and is limited to the first page of results
      • 2022-09-14 25743, 2022

      • reosarevok
        (for large collections)
      • 2022-09-14 25748, 2022

      • v6lur joined the channel
      • 2022-09-14 25729, 2022

      • v6lur has quit
      • 2022-09-14 25719, 2022

      • v6lur joined the channel
      • 2022-09-14 25707, 2022

      • lucifer
        mayhem: added batches but that doesn't seem faster either.
      • 2022-09-14 25726, 2022

      • lucifer
      • 2022-09-14 25737, 2022

      • v6lur has quit
      • 2022-09-14 25710, 2022

      • chrisshepherd has quit
      • 2022-09-14 25711, 2022

      • ssam has quit
      • 2022-09-14 25759, 2022

      • chrisshepherd joined the channel
      • 2022-09-14 25714, 2022

      • ssam joined the channel
      • 2022-09-14 25745, 2022

      • aerozol
        Aheno: thanks! I did see, I'm just recovering from a little collection of injury and illness. But should get onto it today
      • 2022-09-14 25713, 2022

      • aerozol
        Also fair warning - everything here usually moves at a slow pace. So I would get used to playing the loong game. And doing a lot of editing/scanning while you wait!
      • 2022-09-14 25703, 2022

      • mayhem
        lucifer: oh heh, lol. we'll we'll find out soon enough why it is slow.
      • 2022-09-14 25724, 2022

      • eharris joined the channel
      • 2022-09-14 25711, 2022

      • eharris has quit
      • 2022-09-14 25711, 2022

      • eharris joined the channel
      • 2022-09-14 25733, 2022

      • eharris has quit
      • 2022-09-14 25744, 2022

      • eharris joined the channel
      • 2022-09-14 25731, 2022

      • eharris has quit
      • 2022-09-14 25740, 2022

      • eharris joined the channel
      • 2022-09-14 25727, 2022

      • eharris has quit
      • 2022-09-14 25736, 2022

      • eharris joined the channel
      • 2022-09-14 25736, 2022

      • eharris has quit
      • 2022-09-14 25751, 2022

      • eharris joined the channel