-
mayhem
but I think you already saved the day.
2021-12-09 34332, 2021
-
mayhem
hopefully I'll get the new and improved data process going in a minute
2021-12-09 34351, 2021
-
lucifer
ah ok. how are you adding the column?
2021-12-09 34301, 2021
-
goldenshimmer has quit
2021-12-09 34314, 2021
-
tandy1000 has quit
2021-12-09 34327, 2021
-
JuniorJPDJ has quit
2021-12-09 34342, 2021
-
santiagofn has quit
2021-12-09 34342, 2021
-
elomatreb[m] has quit
2021-12-09 34351, 2021
-
mayhem
I just joined the recording_name column and added it to the new table. trivial.
2021-12-09 34304, 2021
-
mayhem
now I just need to get the script to run, lo.
2021-12-09 34332, 2021
-
Lorenzo[m] has quit
2021-12-09 34338, 2021
-
yyoung[m] has quit
2021-12-09 34345, 2021
-
legoktm[m] has quit
2021-12-09 34357, 2021
-
kepstin has quit
2021-12-09 34303, 2021
-
mayhem
`psycopg2.OperationalError: FATAL: role "musicbrainz" is not permitted to log in` for the MB DB on bono
2021-12-09 34307, 2021
-
lucifer
right, i meant we can try directly in psql instead of the python script.
2021-12-09 34337, 2021
-
reg[m] has quit
2021-12-09 34338, 2021
-
lucifer
huh
2021-12-09 34359, 2021
-
mayhem
how is that going to work? my script needs a connection to two databases... gaga and MB on bono
2021-12-09 34312, 2021
-
mayhem
I've got a tunnel setup between bono and gaga.
2021-12-09 34319, 2021
-
lucifer
2021-12-09 34337, 2021
-
mayhem
go for it.
2021-12-09 34342, 2021
-
lucifer
👍
2021-12-09 34351, 2021
-
mayhem
I'll see what is up with this, because it needs to run at some point.
2021-12-09 34351, 2021
-
riksucks has quit
2021-12-09 34314, 2021
-
lucifer
yes makes sense
2021-12-09 34339, 2021
-
lucifer
query is running
2021-12-09 34320, 2021
-
mayhem
uhm. we still join on artist_credit_id. I wonder if we should add two columns.
2021-12-09 34326, 2021
-
riksucks joined the channel
2021-12-09 34357, 2021
-
mayhem
yes, we need to do that.
2021-12-09 34308, 2021
-
lucifer
sure we can do that as well.
2021-12-09 34309, 2021
-
mayhem
or we need to add the artist_credit_id column.
2021-12-09 34326, 2021
-
mayhem
yeah, lets add the second column when the first one is in.
2021-12-09 34322, 2021
-
kepstin joined the channel
2021-12-09 34320, 2021
-
mayhem
I really need to get more comfortable with the WITH notation of PG queries
2021-12-09 34352, 2021
-
mayhem
but it seems that in your query the last two queries can be collapsed into one, right, lucifer ?
2021-12-09 34312, 2021
-
lucifer
mayhem, ah right. yes that can be one.
2021-12-09 34328, 2021
-
mayhem
2021-12-09 34335, 2021
-
mayhem
like that?
2021-12-09 34354, 2021
-
mayhem
group by need fixing
2021-12-09 34308, 2021
-
legoktm[m] joined the channel
2021-12-09 34324, 2021
-
lucifer
yes looks right, but need to fix the select clause entries as well.
2021-12-09 34329, 2021
-
mayhem
y
2021-12-09 34348, 2021
-
lucifer
lol me too. spark is probably filled with unnecessary with's
2021-12-09 34357, 2021
-
mayhem
2021-12-09 34335, 2021
-
mayhem
well, let me know when that updated table is done and I'll try this query
2021-12-09 34301, 2021
-
lucifer
looks like its done. let me check
2021-12-09 34332, 2021
-
lucifer
no something went wrong
2021-12-09 34330, 2021
-
lucifer
uhh recording_name = recording_name :facepalming:
2021-12-09 34352, 2021
-
mayhem feels less alone
2021-12-09 34353, 2021
-
lucifer
running fixed query now.
2021-12-09 34337, 2021
-
lucifer
done
2021-12-09 34350, 2021
-
lucifer
spot checked a couple of entries as well.
2021-12-09 34359, 2021
-
lucifer
adding artist credit name now
2021-12-09 34348, 2021
-
mayhem
ok, script config is done. if this works, I'll regenerate the table later when you're in bed.
2021-12-09 34333, 2021
-
lucifer
sounds good.
2021-12-09 34353, 2021
-
lucifer
running add artist credit name values query.
2021-12-09 34349, 2021
-
lucifer
done
2021-12-09 34338, 2021
-
lucifer
2021-12-09 34310, 2021
-
lucifer
had seen some null entries so looked this up. maybe redirects?
2021-12-09 34311, 2021
-
mayhem
hmmm.
2021-12-09 34332, 2021
-
lucifer
or missing data?
2021-12-09 34352, 2021
-
mayhem
I'd really like to see if that is present in the newly generated table.
2021-12-09 34304, 2021
-
lucifer
anyways lets run the tests for now. if after regeneration this persists can dig deeper
2021-12-09 34309, 2021
-
lucifer
yup 👍
2021-12-09 34313, 2021
-
mayhem
ohh, very snappy now.
2021-12-09 34359, 2021
-
mayhem
restarting bono data sets.
2021-12-09 34359, 2021
-
mayhem
2021-12-09 34307, 2021
-
mayhem
!m lucifer
2021-12-09 34307, 2021
-
BrainzBot
You're doing good work, lucifer!
2021-12-09 34336, 2021
-
lucifer
actually the people in #postgresql and that explain site :D
2021-12-09 34350, 2021
-
mayhem
I gotta save that link
2021-12-09 34326, 2021
-
mayhem
I'm gonnga get 429ed I'm sure. lol
2021-12-09 34316, 2021
-
lucifer
lol :D
2021-12-09 34321, 2021
-
lucifer
mv lucifer /dev/bed
2021-12-09 34341, 2021
-
mayhem
thanks again. nn!
2021-12-09 34351, 2021
-
lucifer
nn!
2021-12-09 34303, 2021
-
Sophist-UK joined the channel
2021-12-09 34307, 2021
-
MRiddickW joined the channel
2021-12-09 34303, 2021
-
reg[m] joined the channel
2021-12-09 34353, 2021
-
aerozol joined the channel
2021-12-09 34305, 2021
-
tandy1000 joined the channel
2021-12-09 34304, 2021
-
tandy1000 has quit
2021-12-09 34305, 2021
-
riksucks has quit
2021-12-09 34306, 2021
-
reg[m] has quit
2021-12-09 34306, 2021
-
legoktm[m] has quit
2021-12-09 34306, 2021
-
kepstin has quit
2021-12-09 34344, 2021
-
elomatreb[m] joined the channel
2021-12-09 34311, 2021
-
v6lur has quit
2021-12-09 34305, 2021
-
JuniorJPDJ joined the channel
2021-12-09 34305, 2021
-
legoktm[m] joined the channel
2021-12-09 34305, 2021
-
reg[m] joined the channel
2021-12-09 34305, 2021
-
Lorenzo[m] joined the channel
2021-12-09 34305, 2021
-
riksucks joined the channel
2021-12-09 34305, 2021
-
tandy1000 joined the channel
2021-12-09 34319, 2021
-
kepstin joined the channel
2021-12-09 34332, 2021
-
reg[m] has quit
2021-12-09 34339, 2021
-
riksucks has quit
2021-12-09 34354, 2021
-
elomatreb[m] has quit
2021-12-09 34312, 2021
-
JuniorJPDJ has quit
2021-12-09 34334, 2021
-
goldenshimmer joined the channel
2021-12-09 34350, 2021
-
MRiddickW has quit
