22:12 PM
ruaok
du -s /mnt/*
2016-10-27 30129, 2016
22:12 PM
ruaok
yes, good move.
2016-10-27 30141, 2016
22:12 PM
ymsc
20128960 /mnt/data
2016-10-27 30141, 2016
22:12 PM
ymsc
4 /mnt/indexdata
2016-10-27 30141, 2016
22:12 PM
ymsc
23961016 /mnt/pgdata
2016-10-27 30106, 2016
22:13 PM
ruaok
remember, I'm flying blind on this since my VM is still being built...
2016-10-27 30111, 2016
22:13 PM
ruaok
ah yes, that would be the problem.
2016-10-27 30139, 2016
22:13 PM
ymsc
no problem. Mine kept crashing everyday trying to do the replication
2016-10-27 30140, 2016
22:13 PM
ruaok ponders a quick fix.
2016-10-27 30157, 2016
22:14 PM
ruaok
I won't really have time to make the right fix happen this second.
2016-10-27 30120, 2016
22:15 PM
ymsc
no problem
2016-10-27 30133, 2016
22:15 PM
ruaok
let's try a hack.
2016-10-27 30139, 2016
22:15 PM
LordSputnik
zas: know much about systemd targets? what would you suggest waiting for before starting postgres and node?
2016-10-27 30151, 2016
22:15 PM
ruaok
sudo rm -rf /mnt/data
2016-10-27 30122, 2016
22:16 PM
ymsc
done
2016-10-27 30154, 2016
22:17 PM
ruaok
are you still user search?
2016-10-27 30108, 2016
22:18 PM
MajorLurker has quit
2016-10-27 30110, 2016
22:18 PM
ymsc
no, I'm still user vagrant
2016-10-27 30131, 2016
22:18 PM
ymsc
2016-10-27 30152, 2016
22:18 PM
ruaok
yeah, I see the problem.
2016-10-27 30105, 2016
22:19 PM
ruaok
not sure why it worked on my test setup.
2016-10-27 30109, 2016
22:19 PM
ruaok
ok, lets go with this.
2016-10-27 30115, 2016
22:19 PM
ruaok
sudo su - search
2016-10-27 30117, 2016
22:19 PM
ruaok
cd /mnt
2016-10-27 30125, 2016
22:19 PM
ruaok
mkdir pgdata/search
2016-10-27 30135, 2016
22:19 PM
ymsc
No passwd entry for user 'search'
2016-10-27 30150, 2016
22:19 PM
ymsc
do I need to get the containers back up?
2016-10-27 30101, 2016
22:20 PM
ruaok
not yet.
2016-10-27 30103, 2016
22:21 PM
ruaok
sudo mkdir /mnt/pgdata/search
2016-10-27 30107, 2016
22:21 PM
ymsc
is it ok to run the commands as the vagrant user
2016-10-27 30112, 2016
22:21 PM
ruaok
sudo ln -s /mnt/pgdata/search /mnt/search
2016-10-27 30128, 2016
22:21 PM
ruaok
yeah, since you correctly point out that there are no other users.
2016-10-27 30140, 2016
22:21 PM
ruaok
I'm still so very used to our production systems and not very much so the -vm setup.
2016-10-27 30119, 2016
22:22 PM
ruaok
did that sudo work?
2016-10-27 30124, 2016
22:22 PM
ymsc
yes
2016-10-27 30125, 2016
22:22 PM
ruaok
sudo ls -la /mnt
2016-10-27 30125, 2016
22:23 PM
ruaok
I <3 google guest wifi
2016-10-27 30147, 2016
22:23 PM
ymsc
pretty fast?
2016-10-27 30152, 2016
22:23 PM
ruaok
amazeballs.
2016-10-27 30102, 2016
22:24 PM
ruaok
I was getting under a 1mbit at the hotel.
2016-10-27 30122, 2016
22:24 PM
ruaok
here is is something more akin to what I get at the office where we have 300mbit fiber.
2016-10-27 30130, 2016
22:24 PM
ymsc
did you want the output for the ls -la /mnt?
2016-10-27 30146, 2016
22:24 PM
ruaok
plz
2016-10-27 30103, 2016
22:25 PM
ymsc
last speed test I ran at work was just under 1gb
2016-10-27 30124, 2016
22:25 PM
ymsc
2016-10-27 30135, 2016
22:25 PM
ruaok
nice, where do you work?
2016-10-27 30148, 2016
22:25 PM
ymsc
a public university
2016-10-27 30156, 2016
22:25 PM
ruaok
ah, ok.
2016-10-27 30102, 2016
22:26 PM
ymsc
we have 2 10gb connections
2016-10-27 30109, 2016
22:26 PM
ruaok
sudo du -s /mnt
2016-10-27 30126, 2016
22:26 PM
ymsc
23961032 /mnt
2016-10-27 30154, 2016
22:26 PM
ruaok
sudo du -s /mnt/*
2016-10-27 30109, 2016
22:27 PM
ymsc
4 /mnt/indexdata
2016-10-27 30109, 2016
22:27 PM
ymsc
23961024 /mnt/pgdata
2016-10-27 30109, 2016
22:27 PM
ymsc
0 /mnt/search
2016-10-27 30126, 2016
22:27 PM
Freso
LordSputnik: What do you need to know about about systemd targets?
2016-10-27 30129, 2016
22:28 PM
ruaok
something is still a bit fishy. lets cleanup more.
2016-10-27 30135, 2016
22:28 PM
ruaok
sudo rm -rf /mnt/indexdata
2016-10-27 30152, 2016
22:28 PM
ruaok
sudo ln -s /mnt/indexdata /mnt/pgdata/search
2016-10-27 30119, 2016
22:30 PM
ymsc
those are done
2016-10-27 30121, 2016
22:30 PM
ruaok
sudo ls -ls /mnt
2016-10-27 30146, 2016
22:30 PM
ymsc
total 4
2016-10-27 30146, 2016
22:30 PM
ymsc
4 drwxr-xr-x 5 root root 4096 Oct 27 22:21 pgdata
2016-10-27 30146, 2016
22:30 PM
ymsc
0 lrwxrwxrwx 1 root root 18 Oct 27 22:22 search -> /mnt/pgdata/search
2016-10-27 30112, 2016
22:31 PM
ruaok
I cocked up the last ln
2016-10-27 30123, 2016
22:31 PM
ruaok
sudo ln -s /mnt/pgdata/search /mnt/search
2016-10-27 30133, 2016
22:31 PM
ruaok
sudo ls -la /mnt
2016-10-27 30142, 2016
22:31 PM
ymsc
total 4
2016-10-27 30142, 2016
22:31 PM
ymsc
4 drwxr-xr-x 5 root root 4096 Oct 27 22:21 pgdata
2016-10-27 30142, 2016
22:31 PM
ymsc
0 lrwxrwxrwx 1 root root 18 Oct 27 22:22 search -> /mnt/pgdata/search
2016-10-27 30142, 2016
22:33 PM
ruaok
there should be a link /mnt/indexdata link that also points to /mnt/pgdata/search
2016-10-27 30100, 2016
22:34 PM
ruaok
well, you can try the reindex after we start the containers.
2016-10-27 30107, 2016
22:34 PM
ruaok
if something borks, try setting up that link as well.
2016-10-27 30109, 2016
22:34 PM
ruaok
for now
2016-10-27 30112, 2016
22:34 PM
ymsc
ok
2016-10-27 30119, 2016
22:34 PM
ruaok
cd ~/musicbrainz-docker
2016-10-27 30133, 2016
22:34 PM
ruaok
docker-compose build && docker-compose up
2016-10-27 30147, 2016
22:34 PM
ruaok
that will give you logs in one window. open another window and log back into the vm.
2016-10-27 30112, 2016
22:35 PM
LordSputnik
Freso: I'm trying to get
bb.org/test.bb.org to start cleanly when the server restarts. Sometimes they are and sometimes they aren't. I think that pg is perhaps starting too soon in some cases - I'm using After=network.target and Requires=network.target
2016-10-27 30116, 2016
22:35 PM
ruaok
"docker-compose up -d" will run that in the background.
2016-10-27 30127, 2016
22:35 PM
ruaok
for now, make sure to keep that window open.
2016-10-27 30155, 2016
22:35 PM
ymsc
ok
2016-10-27 30113, 2016
22:36 PM
ruaok
does it look like things are happy?
2016-10-27 30119, 2016
22:36 PM
ruaok
in the new window try
2016-10-27 30120, 2016
22:36 PM
ruaok
docker ps
2016-10-27 30124, 2016
22:36 PM
ruaok
and pastebin that
2016-10-27 30126, 2016
22:36 PM
Freso
LordSputnik: But the site itself should work without network, right? (I mean, it won't be accessible, but it should be as soon as network comes up.)
2016-10-27 30144, 2016
22:36 PM
Freso
LordSputnik: Maybe try and see if there's pgsql .socket you can use?
2016-10-27 30152, 2016
22:36 PM
ymsc
should I do the git pull first?
2016-10-27 30155, 2016
22:36 PM
ruaok
yes
2016-10-27 30151, 2016
22:37 PM
ymsc
Failed to write all bytes for _bisect.so
2016-10-27 30157, 2016
22:37 PM
ymsc
when I tried to bring them up
2016-10-27 30133, 2016
22:38 PM
ruaok
wha?
2016-10-27 30136, 2016
22:38 PM
ruaok
pastebin
2016-10-27 30138, 2016
22:39 PM
ymsc
one sec
2016-10-27 30123, 2016
22:40 PM
ymsc
2016-10-27 30128, 2016
22:41 PM
ymsc
looks like /tmp fills up when I run it
2016-10-27 30151, 2016
22:43 PM
ruaok
df -h
2016-10-27 30159, 2016
22:43 PM
ruaok
didn't we take care of the disk issues now?
2016-10-27 30119, 2016
22:44 PM
ymsc
2016-10-27 30131, 2016
22:44 PM
ymsc
there is free space, but /tmp is full
2016-10-27 30136, 2016
22:44 PM
JonnyJD_ has quit
2016-10-27 30100, 2016
22:45 PM
ruaok
/tmp is 1mb? da hell?
2016-10-27 30109, 2016
22:45 PM
ruaok
what is in tmp? can you try do do some cleanup?
2016-10-27 30119, 2016
22:45 PM
ymsc
I did, and it filled up again
2016-10-27 30129, 2016
22:45 PM
ymsc
when I ran the docker compose command
2016-10-27 30148, 2016
22:45 PM
ymsc
2016-10-27 30113, 2016
22:47 PM
ruaok
that is exceptionally dumb.
2016-10-27 30159, 2016
22:47 PM
ruaok
how about trying to umount /tmp
2016-10-27 30107, 2016
22:48 PM
ruaok
and then doing a softlink to / ?
2016-10-27 30142, 2016
22:48 PM
ymsc
can try it
2016-10-27 30140, 2016
22:50 PM
ymsc
once I unmounted it /tmp looks better
2016-10-27 30155, 2016
22:52 PM
ruaok
does docker compose now run ok?
2016-10-27 30119, 2016
22:53 PM
ymsc
2016-10-27 30121, 2016
22:53 PM
ymsc
nope
2016-10-27 30125, 2016
22:53 PM
ymsc
error is at the bottom
2016-10-27 30112, 2016
22:54 PM
LordSputnik
Freso: this is a really weird issue
2016-10-27 30134, 2016
22:54 PM
LordSputnik
docker-compose isn't correctly setting up the link to the dependency, so the site can't find the database hostname
2016-10-27 30136, 2016
22:56 PM
ruaok
do a git pull in musicbrainz-docker and try again
2016-10-27 30114, 2016
22:58 PM
ymsc
looks to be doing better, it is still doing the build
2016-10-27 30108, 2016
23:04 PM
Gentlecat
zas: I think stuff is running properly on serge now
2016-10-27 30152, 2016
23:04 PM
ruaok
still building, ymsc ?
2016-10-27 30106, 2016
23:05 PM
ymsc
yes
2016-10-27 30128, 2016
23:05 PM
Leftmost` joined the channel
2016-10-27 30147, 2016
23:05 PM
ymsc
taking a lot longer then the last time I ran the build
2016-10-27 30107, 2016
23:06 PM
ruaok
yeah.
2016-10-27 30111, 2016
23:06 PM
Leftmost`
In Cali.
2016-10-27 30115, 2016
23:06 PM
ruaok
check disk space.
2016-10-27 30123, 2016
23:06 PM
ruaok
welcome Leftmost`
2016-10-27 30131, 2016
23:06 PM
ruaok
are you headed to the hotel tonight?
2016-10-27 30143, 2016
23:06 PM
Leftmost`
Yep. There now.
2016-10-27 30104, 2016
23:07 PM
ruaok
oh sweet. I'm over at the google compus.
2016-10-27 30113, 2016
23:07 PM
ruaok
I'll walk back as soon as this data import is done.
2016-10-27 30121, 2016
23:07 PM
ruaok
did you get any montana wiskey?
2016-10-27 30128, 2016
23:07 PM
ruaok
it is drink o'clock after all.
2016-10-27 30130, 2016
23:07 PM
Leftmost`
No, couldn't find any that'd travel.
2016-10-27 30149, 2016
23:07 PM
ruaok
booo.
2016-10-27 30108, 2016
23:08 PM
ruaok
I have catalan vermut, but none of the things required to drink it.
2016-10-27 30119, 2016
23:08 PM
ruaok
maybe the reception has an orange and plastic knife.
2016-10-27 30124, 2016
23:08 PM
ruaok
then we could manage.
2016-10-27 30126, 2016
23:08 PM
Leftmost`
I'll just have to make sure to bring a bottle to BCN the next time.
2016-10-27 30132, 2016
23:08 PM
ruaok
that works.
2016-10-27 30142, 2016
23:08 PM
ruaok
ymsc: what is it stuck on?
2016-10-27 30153, 2016
23:08 PM
ruaok
Leftmost`: what room are you in? 212 here.
2016-10-27 30101, 2016
23:09 PM
ymsc
looks like it finished building
2016-10-27 30111, 2016
23:09 PM
ruaok
docker-compose up
2016-10-27 30114, 2016
23:09 PM
bitmap
you're both at the sheraton right?
2016-10-27 30114, 2016
23:09 PM
ruaok
or docker-compose up -d
2016-10-27 30118, 2016
23:09 PM
ruaok
I am.
2016-10-27 30123, 2016
23:09 PM
ymsc
indexer_1 | stdin: is not a tty