iliekcomputers: second part of the sponsorship paid.
aside from moving to the office, I'm ready to hack on LB things with you.
iliekcomputers
ruaok: yep, cool. Just got electricity back here, give me 15 mins?
ruaok
sure.
iliekcomputers
Thanks. :)
hi
so when I run this: `root@cfdc9891b3f4:/rec# /usr/local/spark/bin/spark-submit --master spark://spark-master.spark-network:7077 --executor-memory 29g import.py /listenbrainz-listens-dump-20190101-000402.tar.xz`
Hi akhilesh ! I've seen it this morning, thanks a lot! At first glance everything looked all right, but I haven't had time to test it yet. Will do today.
a few days ago, remember when I told you, I tried uploading to HDFS and it worked but was very slow.
ruaok
ok, yes.
iliekcomputers
maybe i was submitting it wrong...
ruaok
do you remember the exact command line?
iliekcomputers
anyways, the spark status page shows a job running with 3 workers, each using ~20G of memory.
ruaok
how are you viewing the status pages?
iliekcomputers
i dled the html lol
ruaok
doh.
ok, I think that ought to be my first project for the day.
get this bridge up and running again. it might be awkward, but it works.
iliekcomputers
the command was something along the lines of `spark-submit --master spark://spark-master.spark-network:7077 import.py <dump>`
ruaok: yeah, that'd be great.
ruaok
ok, let me get on that.
iliekcomputers: the payment to jalaz should have arrived now.
iliekcomputers
ruaok: ok, i'll check on that once.
ruaok
no rush. since it worked the first time, it should be fine the second time.
ruaok crosses tentacles
which port do you want to have an HTTP interface up for?
amCap1712 joined the channel
iliekcomputers
8080
amCap1712
Hi, ruaok: are you around?
ruaok
I am.
amCap1712
I have ported the code base of MusicBrainz for Android to gradle file system and made it compatible with the current android dev tools.
But many of dependencies of the app are now deprecated, so I have disabled a couple of features currently.
ruaok
iliekcomputers: can you run `ssh -p 2222 -L 8080:spark-master:8080 root@localhost`
amCap1712
The codebase has changed considerably, it would not be wise to work on existing Jira tickets without doing other work.
iliekcomputers
need a password.
ruaok
amCap1712: please know that I am not likely to be very involved in this project. samj1912, zas and phw are much more likely to be good people to talk to.
iliekcomputers: hmm. it should have your key installed.
amCap1712
ruaok: ok, i'll ask them
ruaok
which ssh key should I be using?
I added the one from syswiki/localhost-setup
iliekcomputers
that one is it.
ruaok
I didn't see an SSH key in your account. are you forwarding your credentials when you log into leader?
you may need to install your SSH key into your leader account. or make a new one and have me rebuild the container.
iliekcomputers
one sec.
sorry about that, i was just doing that.
ruaok
the spark cluster shows a running app, btw.
no pasó nada!
iliekcomputers
i see it running, noice.
ruaok
does the tunnel work now?
iliekcomputers
yup.
ruaok
yay!
let me document things a wee bit so that you can start/stop the gateway when you need it.
iliekcomputers
yeah, ok.
the hackonhills people received the money.
yayy, meb! <3
reosarevok
:)
Is any of you people going too?
iliekcomputers
me and rashi have a team. :)
ruaok
I'm not. but I am sure that iliekcomputers will enjoy attending in this "big man on campus" role. :)
iliekcomputers
heh, i'm just happy to be with meb.
reosarevok
Neat!
Build something not-with-MB for once :p
Otherwise it's too easy
ruaok
easy? that's the goal no? make meb look good by how brainy our team is!
reosarevok
Oh. Then fair enough. As long as they don't get bored
bitmap: pushed an update to the commit, you'll have to import it into gerrit I guess
ruaok
iliekcomputers: I restarted the container after renaming it to listenbrainz-tunnel
Would l({typeName] by {artist}), {artist: _.escape(item.artist), typeName: lp_attributes(item.typeName, release_group_primary_type} or something to that effect work?
iliekcomputers
ruaok: i'll get dinner and get back on this, in a few hours.
ruaok
few hours? boo.
should we plan on working tomorrow instead?
I really want to set aside a time of a few hours where we're working continuously.
reosarevok
So Indian dinners are like Spanish dinners, then? :D
iliekcomputers
reosarevok: have to get dinner early so i don't fall asleep during the meeting. :P