-
mayhem
but I think you already saved the day.
-
hopefully I'll get the new and improved data process going in a minute
-
lucifer
ah ok. how are you adding the column?
-
goldenshimmer has quit
-
tandy1000 has quit
-
JuniorJPDJ has quit
-
santiagofn has quit
-
elomatreb[m] has quit
-
mayhem
I just joined the recording_name column and added it to the new table. trivial.
-
now I just need to get the script to run, lo.
-
Lorenzo[m] has quit
-
yyoung[m] has quit
-
legoktm[m] has quit
-
kepstin has quit
-
`psycopg2.OperationalError: FATAL: role "musicbrainz" is not permitted to log in` for the MB DB on bono
-
lucifer
right, i meant we can try directly in psql instead of the python script.
-
reg[m] has quit
-
huh
-
mayhem
how is that going to work? my script needs a connection to two databases... gaga and MB on bono
-
I've got a tunnel setup between bono and gaga.
-
lucifer
-
mayhem
go for it.
-
lucifer
👍
-
mayhem
I'll see what is up with this, because it needs to run at some point.
-
riksucks has quit
-
lucifer
yes makes sense
-
query is running
-
mayhem
uhm. we still join on artist_credit_id. I wonder if we should add two columns.
-
riksucks joined the channel
-
yes, we need to do that.
-
lucifer
sure we can do that as well.
-
mayhem
or we need to add the artist_credit_id column.
-
yeah, lets add the second column when the first one is in.
-
kepstin joined the channel
-
I really need to get more comfortable with the WITH notation of PG queries
-
but it seems that in your query the last two queries can be collapsed into one, right, lucifer ?
-
lucifer
mayhem, ah right. yes that can be one.
-
mayhem
-
like that?
-
group by need fixing
-
legoktm[m] joined the channel
-
lucifer
yes looks right, but need to fix the select clause entries as well.
-
mayhem
y
-
lucifer
lol me too. spark is probably filled with unnecessary with's
-
mayhem
-
well, let me know when that updated table is done and I'll try this query
-
lucifer
looks like its done. let me check
-
no something went wrong
-
uhh recording_name = recording_name :facepalming:
-
mayhem feels less alone
-
running fixed query now.
-
done
-
spot checked a couple of entries as well.
-
adding artist credit name now
-
mayhem
ok, script config is done. if this works, I'll regenerate the table later when you're in bed.
-
lucifer
sounds good.
-
running add artist credit name values query.
-
done
-
-
had seen some null entries so looked this up. maybe redirects?
-
mayhem
hmmm.
-
lucifer
or missing data?
-
mayhem
I'd really like to see if that is present in the newly generated table.
-
lucifer
anyways lets run the tests for now. if after regeneration this persists can dig deeper
-
yup 👍
-
mayhem
ohh, very snappy now.
-
restarting bono data sets.
-
-
!m lucifer
-
BrainzBot
You're doing good work, lucifer!
-
lucifer
actually the people in #postgresql and that explain site :D
-
mayhem
I gotta save that link
-
I'm gonnga get 429ed I'm sure. lol
-
lucifer
lol :D
-
mv lucifer /dev/bed
-
mayhem
thanks again. nn!
-
lucifer
nn!
-
Sophist-UK joined the channel
-
MRiddickW joined the channel
-
reg[m] joined the channel
-
aerozol joined the channel
-
tandy1000 joined the channel
-
tandy1000 has quit
-
riksucks has quit
-
reg[m] has quit
-
legoktm[m] has quit
-
kepstin has quit
-
elomatreb[m] joined the channel
-
v6lur has quit
-
JuniorJPDJ joined the channel
-
legoktm[m] joined the channel
-
reg[m] joined the channel
-
Lorenzo[m] joined the channel
-
riksucks joined the channel
-
tandy1000 joined the channel
-
kepstin joined the channel
-
reg[m] has quit
-
riksucks has quit
-
elomatreb[m] has quit
-
JuniorJPDJ has quit
-
goldenshimmer joined the channel
-
MRiddickW has quit