#metabrainz

/

      • mayhem
        but I think you already saved the day.
      • 2021-12-09 34332, 2021

      • mayhem
        hopefully I'll get the new and improved data process going in a minute
      • 2021-12-09 34351, 2021

      • lucifer
        ah ok. how are you adding the column?
      • 2021-12-09 34301, 2021

      • goldenshimmer has quit
      • 2021-12-09 34314, 2021

      • tandy1000 has quit
      • 2021-12-09 34327, 2021

      • JuniorJPDJ has quit
      • 2021-12-09 34342, 2021

      • santiagofn has quit
      • 2021-12-09 34342, 2021

      • elomatreb[m] has quit
      • 2021-12-09 34351, 2021

      • mayhem
        I just joined the recording_name column and added it to the new table. trivial.
      • 2021-12-09 34304, 2021

      • mayhem
        now I just need to get the script to run, lo.
      • 2021-12-09 34332, 2021

      • Lorenzo[m] has quit
      • 2021-12-09 34338, 2021

      • yyoung[m] has quit
      • 2021-12-09 34345, 2021

      • legoktm[m] has quit
      • 2021-12-09 34357, 2021

      • kepstin has quit
      • 2021-12-09 34303, 2021

      • mayhem
        `psycopg2.OperationalError: FATAL: role "musicbrainz" is not permitted to log in` for the MB DB on bono
      • 2021-12-09 34307, 2021

      • lucifer
        right, i meant we can try directly in psql instead of the python script.
      • 2021-12-09 34337, 2021

      • reg[m] has quit
      • 2021-12-09 34338, 2021

      • lucifer
        huh
      • 2021-12-09 34359, 2021

      • mayhem
        how is that going to work? my script needs a connection to two databases... gaga and MB on bono
      • 2021-12-09 34312, 2021

      • mayhem
        I've got a tunnel setup between bono and gaga.
      • 2021-12-09 34319, 2021

      • lucifer
      • 2021-12-09 34337, 2021

      • mayhem
        go for it.
      • 2021-12-09 34342, 2021

      • lucifer
        👍
      • 2021-12-09 34351, 2021

      • mayhem
        I'll see what is up with this, because it needs to run at some point.
      • 2021-12-09 34351, 2021

      • riksucks has quit
      • 2021-12-09 34314, 2021

      • lucifer
        yes makes sense
      • 2021-12-09 34339, 2021

      • lucifer
        query is running
      • 2021-12-09 34320, 2021

      • mayhem
        uhm. we still join on artist_credit_id. I wonder if we should add two columns.
      • 2021-12-09 34326, 2021

      • riksucks joined the channel
      • 2021-12-09 34357, 2021

      • mayhem
        yes, we need to do that.
      • 2021-12-09 34308, 2021

      • lucifer
        sure we can do that as well.
      • 2021-12-09 34309, 2021

      • mayhem
        or we need to add the artist_credit_id column.
      • 2021-12-09 34326, 2021

      • mayhem
        yeah, lets add the second column when the first one is in.
      • 2021-12-09 34322, 2021

      • kepstin joined the channel
      • 2021-12-09 34320, 2021

      • mayhem
        I really need to get more comfortable with the WITH notation of PG queries
      • 2021-12-09 34352, 2021

      • mayhem
        but it seems that in your query the last two queries can be collapsed into one, right, lucifer ?
      • 2021-12-09 34312, 2021

      • lucifer
        mayhem, ah right. yes that can be one.
      • 2021-12-09 34328, 2021

      • mayhem
      • 2021-12-09 34335, 2021

      • mayhem
        like that?
      • 2021-12-09 34354, 2021

      • mayhem
        group by need fixing
      • 2021-12-09 34308, 2021

      • legoktm[m] joined the channel
      • 2021-12-09 34324, 2021

      • lucifer
        yes looks right, but need to fix the select clause entries as well.
      • 2021-12-09 34329, 2021

      • mayhem
        y
      • 2021-12-09 34348, 2021

      • lucifer
        lol me too. spark is probably filled with unnecessary with's
      • 2021-12-09 34357, 2021

      • mayhem
      • 2021-12-09 34335, 2021

      • mayhem
        well, let me know when that updated table is done and I'll try this query
      • 2021-12-09 34301, 2021

      • lucifer
        looks like its done. let me check
      • 2021-12-09 34332, 2021

      • lucifer
        no something went wrong
      • 2021-12-09 34330, 2021

      • lucifer
        uhh recording_name = recording_name :facepalming:
      • 2021-12-09 34352, 2021

      • mayhem feels less alone
      • 2021-12-09 34353, 2021

      • lucifer
        running fixed query now.
      • 2021-12-09 34337, 2021

      • lucifer
        done
      • 2021-12-09 34350, 2021

      • lucifer
        spot checked a couple of entries as well.
      • 2021-12-09 34359, 2021

      • lucifer
        adding artist credit name now
      • 2021-12-09 34348, 2021

      • mayhem
        ok, script config is done. if this works, I'll regenerate the table later when you're in bed.
      • 2021-12-09 34333, 2021

      • lucifer
        sounds good.
      • 2021-12-09 34353, 2021

      • lucifer
        running add artist credit name values query.
      • 2021-12-09 34349, 2021

      • lucifer
        done
      • 2021-12-09 34338, 2021

      • lucifer
      • 2021-12-09 34310, 2021

      • lucifer
        had seen some null entries so looked this up. maybe redirects?
      • 2021-12-09 34311, 2021

      • mayhem
        hmmm.
      • 2021-12-09 34332, 2021

      • lucifer
        or missing data?
      • 2021-12-09 34352, 2021

      • mayhem
        I'd really like to see if that is present in the newly generated table.
      • 2021-12-09 34304, 2021

      • lucifer
        anyways lets run the tests for now. if after regeneration this persists can dig deeper
      • 2021-12-09 34309, 2021

      • lucifer
        yup 👍
      • 2021-12-09 34313, 2021

      • mayhem
        ohh, very snappy now.
      • 2021-12-09 34359, 2021

      • mayhem
        restarting bono data sets.
      • 2021-12-09 34359, 2021

      • mayhem
      • 2021-12-09 34307, 2021

      • mayhem
        !m lucifer
      • 2021-12-09 34307, 2021

      • BrainzBot
        You're doing good work, lucifer!
      • 2021-12-09 34336, 2021

      • lucifer
        actually the people in #postgresql and that explain site :D
      • 2021-12-09 34350, 2021

      • mayhem
        I gotta save that link
      • 2021-12-09 34326, 2021

      • mayhem
        I'm gonnga get 429ed I'm sure. lol
      • 2021-12-09 34316, 2021

      • lucifer
        lol :D
      • 2021-12-09 34321, 2021

      • lucifer
        mv lucifer /dev/bed
      • 2021-12-09 34341, 2021

      • mayhem
        thanks again. nn!
      • 2021-12-09 34351, 2021

      • lucifer
        nn!
      • 2021-12-09 34303, 2021

      • Sophist-UK joined the channel
      • 2021-12-09 34307, 2021

      • MRiddickW joined the channel
      • 2021-12-09 34303, 2021

      • reg[m] joined the channel
      • 2021-12-09 34353, 2021

      • aerozol joined the channel
      • 2021-12-09 34305, 2021

      • tandy1000 joined the channel
      • 2021-12-09 34304, 2021

      • tandy1000 has quit
      • 2021-12-09 34305, 2021

      • riksucks has quit
      • 2021-12-09 34306, 2021

      • reg[m] has quit
      • 2021-12-09 34306, 2021

      • legoktm[m] has quit
      • 2021-12-09 34306, 2021

      • kepstin has quit
      • 2021-12-09 34344, 2021

      • elomatreb[m] joined the channel
      • 2021-12-09 34311, 2021

      • v6lur has quit
      • 2021-12-09 34305, 2021

      • JuniorJPDJ joined the channel
      • 2021-12-09 34305, 2021

      • legoktm[m] joined the channel
      • 2021-12-09 34305, 2021

      • reg[m] joined the channel
      • 2021-12-09 34305, 2021

      • Lorenzo[m] joined the channel
      • 2021-12-09 34305, 2021

      • riksucks joined the channel
      • 2021-12-09 34305, 2021

      • tandy1000 joined the channel
      • 2021-12-09 34319, 2021

      • kepstin joined the channel
      • 2021-12-09 34332, 2021

      • reg[m] has quit
      • 2021-12-09 34339, 2021

      • riksucks has quit
      • 2021-12-09 34354, 2021

      • elomatreb[m] has quit
      • 2021-12-09 34312, 2021

      • JuniorJPDJ has quit
      • 2021-12-09 34334, 2021

      • goldenshimmer joined the channel
      • 2021-12-09 34350, 2021

      • MRiddickW has quit