0:14 AM
D4RK-PH0ENiX joined the channel
0:31 AM
rdswift_lt has quit
0:40 AM
Leo_Verto has quit
0:51 AM
Leo_Verto joined the channel
1:04 AM
Nyanko-sensei joined the channel
1:08 AM
D4RK-PH0ENiX has quit
1:12 AM
thefar8 has quit
1:36 AM
Nyanko-sensei has quit
1:37 AM
D4RK-PH0ENiX joined the channel
2:15 AM
moufl has quit
3:45 AM
Leo_Verto_ joined the channel
3:47 AM
Leo_Verto has quit
3:47 AM
Leo_Verto_ is now known as Leo_Verto
4:01 AM
Leo_Verto has quit
4:02 AM
Leo_Verto joined the channel
4:44 AM
ferbncode has quit
4:44 AM
michelv joined the channel
6:40 AM
outsidecontext joined the channel
6:51 AM
iliekcomputers
moin!
6:51 AM
6:52 AM
ruaok: there isn't a hadoop container on the master node, how do I start one?
6:52 AM
6:55 AM
ruaok
moin. odd.
6:55 AM
when I last looked, I left it running.
6:56 AM
Jaykin joined the channel
6:56 AM
use the start-master-service.sh in listenbrainz-recommendation-playground/docker
6:57 AM
as well as start-worker-service and the corresponding stop scripts
6:58 AM
master and slaves both restarted. good luck!
6:59 AM
iliekcomputers
ruaok: connected =)
6:59 AM
hdfs.util.HdfsError: Permission denied: user=dr.who, access=WRITE, inode="/":root:supergroup:drwxr-xr-x
6:59 AM
what user should I auth with? Did you create a user somewhere?
7:26 AM
ok started with root and got an error while uploading, progress :D
7:27 AM
7:27 AM
7:32 AM
I think it's because the namenode isn't able to talk to the datanodes
7:32 AM
`hdfs dfs -put test.txt /` from inside the `hadoop-master` container gives the same error
7:56 AM
Jaykin
7:56 AM
I entered the docker container where port 5000 is, but admin/psql aint working out
7:57 AM
george
Jaykin: `cpan install JSON`?
7:58 AM
UmkaDK joined the channel
7:58 AM
Jaykin
umm i myself dont even know what dat is, run it?
7:59 AM
george
yea
7:59 AM
It'll install the JSON module
8:00 AM
Jaykin
btw that website you sent me made me really confused, that is until i just went searching for BASIC docker tutorials, oops forgot the basics
8:00 AM
george
Oh fair enough 😄
8:02 AM
Nyanko-sensei joined the channel
8:02 AM
Did installing that module work?
8:04 AM
D4RK-PH0ENiX has quit
8:20 AM
github joined the channel
8:20 AM
github
[picard] phw opened pull request #1031: PICARD-1410: load vorbis file with invalid rating (master...PICARD-1410-load-vorbis-file-with-invalid-rating)
https://git.io/fpqu8
8:20 AM
github has left the channel
8:21 AM
Jaykin
8:21 AM
sorry for the late reply
8:21 AM
cpn install aliased lemme guess
8:22 AM
george
yeah that would be it
8:23 AM
There’s a command to install all the dependencies at once somewhere
8:23 AM
Jaykin
yeah i really need that, installing a moose module now
8:25 AM
george
I’m not sure how you’d go about it in docker, but it’s explained in the manual setup instructions
8:28 AM
Jaykin
8:28 AM
i think i got it down
8:28 AM
psql works yay
8:28 AM
thefar8 joined the channel
8:29 AM
thanks
8:31 AM
ferbncode joined the channel
8:47 AM
george
No problem :)
8:48 AM
github joined the channel
8:48 AM
github
[picard] phw opened pull request #1032: PICARD-1405: Do not allow rich text input in script editors (master...PICARD-1405-disable-script-rich-text-input)
https://git.io/fpqzP
8:48 AM
github has left the channel
8:52 AM
UmkaDK has quit
9:00 AM
UmkaDK joined the channel
9:05 AM
loujine joined the channel
9:05 AM
Jaykin
is this supposed to be the expected output?
9:05 AM
9:07 AM
george
Probably not, but does it work?
9:09 AM
Jaykin
well is there a command to run to check?
9:09 AM
travis-ci joined the channel
9:09 AM
travis-ci
metabrainz/picard#4036 (master - b8253c9 : Philipp Wolfer): The build passed.
9:09 AM
9:09 AM
9:09 AM
travis-ci has left the channel
9:11 AM
ruaok
iliekcomputers: hmm interesting.
9:12 AM
what port should the namennode talk to datanode on?
9:12 AM
george
Jaykin: idk, i'd just visit the site and see if all works as expected
9:13 AM
Jaykin
localhost:5000 ok
9:17 AM
cant login. but otherwise website seems ok, so one can start development i guess, altho i dont get the point of the steps...
9:21 AM
iliekcomputers
9:21 AM
9866
9:22 AM
ruaok
9:22 AM
antara_ joined the channel
9:22 AM
and I do all of them except the https one. given that we have no https setup, I doubt that is our case.
9:22 AM
I'll add it in any case
9:26 AM
george
Jaykin: That's great :)
9:26 AM
What's the error when logging in?
9:27 AM
ruaok
iliekcomputers:
9:27 AM
tcp 0 0 0.0.0.0:9866 0.0.0.0:* LISTEN 31/java
9:28 AM
9866 is being listenend on
9:30 AM
so, it isn't reachable via hadoop-master:9866, but via <nodename>:9866
9:31 AM
iliekcomputers
9:31 AM
Excluding datanode DatanodeInfoWithStorage[10.0.0.50:9866,DS-2d5d63e3-6b0b-4a0a-8dd3-a83d1b1dc8e7,DISK]
9:32 AM
9:38 AM
ruaok
The IP address 10.1.1.50 doesn't exist right now. that is the odd thing.
9:38 AM
Jaykin
george: like incorrect username or password when i tried to log in with my account, that's all
9:39 AM
george
Jaykin: log in as `admin`, with the password `mb`
9:46 AM
ruaok
hehe, 10.0.0.50 does. lol
9:54 AM
Nyanko-sensei has quit
9:55 AM
D4RK-PH0ENiX joined the channel
9:58 AM
iliekcomputers: fixed. I bet there are others that need the same treatment.
9:58 AM
try again and in the meantime I'm going to forage for some food.
9:58 AM
iliekcomputers
ruaok: cool
9:59 AM
where exactly do we specify the datanodes in config?
9:59 AM
9:59 AM
that doesn't have anything.
10:04 AM
Jaykin
george: thanks, i got in, so now... development?
10:05 AM
george
Yep, good luck 😄
10:09 AM
Jaykin
so how to do it? Like if i want to git pull and stuff? How do i use git with the server? Git in the virtual machine or, i'm not really sure.
10:09 AM
iliekcomputers
ruaok: still the smae error but this time it was trying different IPs for datanodes
10:09 AM
10:09 AM
2018-11-12 10:08:52,358 WARN hdfs.DataStreamer: Excluding datanode DatanodeInfoWithStorage[10.0.0.59:9866,DS-90d1b848-d898-43da-a429-1376919fee6b,DISK]
10:10 AM
2018-11-12 10:08:52,409 WARN hdfs.DataStreamer: Excluding datanode DatanodeInfoWithStorage[10.0.0.61:9866,DS-2d5d63e3-6b0b-4a0a-8dd3-a83d1b1dc8e7,DISK]
10:10 AM
george
Jaykin: I think codecademy has a Git course which might help
10:12 AM
Jaykin
just found out that git is automatically installed in the vm... ok, thanks for the help george!
10:14 AM
Jaykin has quit
10:15 AM
ruaok
iliekcomputers: yeah, I restarted the datanodes.
10:15 AM
Can you sanity check me, please?
10:15 AM
I just thought that the nodes we're now pingable.
10:16 AM
george
Jaykin no worries, happy to help
10:16 AM
ruaok
Network tools are installed on the containers.
10:18 AM
iliekcomputers
10:20 AM
ping works, but the port is refusing connections
10:29 AM
10:31 AM
zas
hmmm, something wrong with docker on williams, after upgrade, on it
10:32 AM
iliekcomputers
docker is down on frank too
10:33 AM
reosarevok
That sounds frankly problematic
10:33 AM
iliekcomputers
which is why AB warnings on telegram
10:51 AM
alastairp
iliekcomputers: speaking of AB, will you have time this week to help me with a deploy?
10:51 AM
I just want to get a bunch of PRs merged
10:51 AM
maybe an hour or so, some time Weds-Friday
10:52 AM
(hello, good morning)
10:55 AM
zas
something very broken between docker & systemd on few nodes, i didn't find the exact issue yet
10:57 AM
ruaok
Iliekcomputers: weird. Hopefully this will work better with more food. Hang on a bit.
10:58 AM
george
Hi Freso, are you around?
11:00 AM
iliekcomputers
alastairp: sure, thursday would be ideal. =)
11:01 AM
alastairp
ok, cool
11:11 AM
zas
anyone very familiar with systemd ?
11:11 AM
alastairp
very - no, but I've written some unit files
11:12 AM
zas
you may help me
11:12 AM
upgrade to last systemd broke docker
11:12 AM
can you log in frank so i can explain what i found?
11:13 AM
ok, np, let me explain
11:13 AM
D4RK-PH0ENiX has quit