#metabrainz

/

      • ruaok
        du -s /mnt/*
      • 2016-10-27 30129, 2016

      • ruaok
        yes, good move.
      • 2016-10-27 30141, 2016

      • ymsc
        20128960 /mnt/data
      • 2016-10-27 30141, 2016

      • ymsc
        4 /mnt/indexdata
      • 2016-10-27 30141, 2016

      • ymsc
        23961016 /mnt/pgdata
      • 2016-10-27 30106, 2016

      • ruaok
        remember, I'm flying blind on this since my VM is still being built...
      • 2016-10-27 30111, 2016

      • ruaok
        ah yes, that would be the problem.
      • 2016-10-27 30139, 2016

      • ymsc
        no problem. Mine kept crashing everyday trying to do the replication
      • 2016-10-27 30140, 2016

      • ruaok ponders a quick fix.
      • 2016-10-27 30157, 2016

      • ruaok
        I won't really have time to make the right fix happen this second.
      • 2016-10-27 30120, 2016

      • ymsc
        no problem
      • 2016-10-27 30133, 2016

      • ruaok
        let's try a hack.
      • 2016-10-27 30139, 2016

      • LordSputnik
        zas: know much about systemd targets? what would you suggest waiting for before starting postgres and node?
      • 2016-10-27 30151, 2016

      • ruaok
        sudo rm -rf /mnt/data
      • 2016-10-27 30122, 2016

      • ymsc
        done
      • 2016-10-27 30154, 2016

      • ruaok
        are you still user search?
      • 2016-10-27 30108, 2016

      • MajorLurker has quit
      • 2016-10-27 30110, 2016

      • ymsc
        no, I'm still user vagrant
      • 2016-10-27 30131, 2016

      • ymsc
        just for your info, here is the errors when I kicked off the reindex: https://gist.github.com/anonymous/5136bb18d40de48…
      • 2016-10-27 30152, 2016

      • ruaok
        yeah, I see the problem.
      • 2016-10-27 30105, 2016

      • ruaok
        not sure why it worked on my test setup.
      • 2016-10-27 30109, 2016

      • ruaok
        ok, lets go with this.
      • 2016-10-27 30115, 2016

      • ruaok
        sudo su - search
      • 2016-10-27 30117, 2016

      • ruaok
        cd /mnt
      • 2016-10-27 30125, 2016

      • ruaok
        mkdir pgdata/search
      • 2016-10-27 30135, 2016

      • ymsc
        No passwd entry for user 'search'
      • 2016-10-27 30150, 2016

      • ymsc
        do I need to get the containers back up?
      • 2016-10-27 30101, 2016

      • ruaok
        not yet.
      • 2016-10-27 30103, 2016

      • ruaok
        sudo mkdir /mnt/pgdata/search
      • 2016-10-27 30107, 2016

      • ymsc
        is it ok to run the commands as the vagrant user
      • 2016-10-27 30112, 2016

      • ruaok
        sudo ln -s /mnt/pgdata/search /mnt/search
      • 2016-10-27 30128, 2016

      • ruaok
        yeah, since you correctly point out that there are no other users.
      • 2016-10-27 30140, 2016

      • ruaok
        I'm still so very used to our production systems and not very much so the -vm setup.
      • 2016-10-27 30119, 2016

      • ruaok
        did that sudo work?
      • 2016-10-27 30124, 2016

      • ymsc
        yes
      • 2016-10-27 30125, 2016

      • ruaok
        sudo ls -la /mnt
      • 2016-10-27 30125, 2016

      • ruaok
        I <3 google guest wifi
      • 2016-10-27 30147, 2016

      • ymsc
        pretty fast?
      • 2016-10-27 30152, 2016

      • ruaok
        amazeballs.
      • 2016-10-27 30102, 2016

      • ruaok
        I was getting under a 1mbit at the hotel.
      • 2016-10-27 30122, 2016

      • ruaok
        here is is something more akin to what I get at the office where we have 300mbit fiber.
      • 2016-10-27 30130, 2016

      • ymsc
        did you want the output for the ls -la /mnt?
      • 2016-10-27 30146, 2016

      • ruaok
        plz
      • 2016-10-27 30103, 2016

      • ymsc
        last speed test I ran at work was just under 1gb
      • 2016-10-27 30124, 2016

      • ymsc
      • 2016-10-27 30135, 2016

      • ruaok
        nice, where do you work?
      • 2016-10-27 30148, 2016

      • ymsc
        a public university
      • 2016-10-27 30156, 2016

      • ruaok
        ah, ok.
      • 2016-10-27 30102, 2016

      • ymsc
        we have 2 10gb connections
      • 2016-10-27 30109, 2016

      • ruaok
        sudo du -s /mnt
      • 2016-10-27 30126, 2016

      • ymsc
        23961032 /mnt
      • 2016-10-27 30154, 2016

      • ruaok
        sudo du -s /mnt/*
      • 2016-10-27 30109, 2016

      • ymsc
        4 /mnt/indexdata
      • 2016-10-27 30109, 2016

      • ymsc
        23961024 /mnt/pgdata
      • 2016-10-27 30109, 2016

      • ymsc
        0 /mnt/search
      • 2016-10-27 30126, 2016

      • Freso
        LordSputnik: What do you need to know about about systemd targets?
      • 2016-10-27 30129, 2016

      • ruaok
        something is still a bit fishy. lets cleanup more.
      • 2016-10-27 30135, 2016

      • ruaok
        sudo rm -rf /mnt/indexdata
      • 2016-10-27 30152, 2016

      • ruaok
        sudo ln -s /mnt/indexdata /mnt/pgdata/search
      • 2016-10-27 30119, 2016

      • ymsc
        those are done
      • 2016-10-27 30121, 2016

      • ruaok
        sudo ls -ls /mnt
      • 2016-10-27 30146, 2016

      • ymsc
        total 4
      • 2016-10-27 30146, 2016

      • ymsc
        4 drwxr-xr-x 5 root root 4096 Oct 27 22:21 pgdata
      • 2016-10-27 30146, 2016

      • ymsc
        0 lrwxrwxrwx 1 root root 18 Oct 27 22:22 search -> /mnt/pgdata/search
      • 2016-10-27 30112, 2016

      • ruaok
        I cocked up the last ln
      • 2016-10-27 30123, 2016

      • ruaok
        sudo ln -s /mnt/pgdata/search /mnt/search
      • 2016-10-27 30133, 2016

      • ruaok
        sudo ls -la /mnt
      • 2016-10-27 30142, 2016

      • ymsc
        total 4
      • 2016-10-27 30142, 2016

      • ymsc
        4 drwxr-xr-x 5 root root 4096 Oct 27 22:21 pgdata
      • 2016-10-27 30142, 2016

      • ymsc
        0 lrwxrwxrwx 1 root root 18 Oct 27 22:22 search -> /mnt/pgdata/search
      • 2016-10-27 30142, 2016

      • ruaok
        there should be a link /mnt/indexdata link that also points to /mnt/pgdata/search
      • 2016-10-27 30100, 2016

      • ruaok
        well, you can try the reindex after we start the containers.
      • 2016-10-27 30107, 2016

      • ruaok
        if something borks, try setting up that link as well.
      • 2016-10-27 30109, 2016

      • ruaok
        for now
      • 2016-10-27 30112, 2016

      • ymsc
        ok
      • 2016-10-27 30119, 2016

      • ruaok
        cd ~/musicbrainz-docker
      • 2016-10-27 30133, 2016

      • ruaok
        docker-compose build && docker-compose up
      • 2016-10-27 30147, 2016

      • ruaok
        that will give you logs in one window. open another window and log back into the vm.
      • 2016-10-27 30112, 2016

      • LordSputnik
        Freso: I'm trying to get bb.org/test.bb.org to start cleanly when the server restarts. Sometimes they are and sometimes they aren't. I think that pg is perhaps starting too soon in some cases - I'm using After=network.target and Requires=network.target
      • 2016-10-27 30116, 2016

      • ruaok
        "docker-compose up -d" will run that in the background.
      • 2016-10-27 30127, 2016

      • ruaok
        for now, make sure to keep that window open.
      • 2016-10-27 30155, 2016

      • ymsc
        ok
      • 2016-10-27 30113, 2016

      • ruaok
        does it look like things are happy?
      • 2016-10-27 30119, 2016

      • ruaok
        in the new window try
      • 2016-10-27 30120, 2016

      • ruaok
        docker ps
      • 2016-10-27 30124, 2016

      • ruaok
        and pastebin that
      • 2016-10-27 30126, 2016

      • Freso
        LordSputnik: But the site itself should work without network, right? (I mean, it won't be accessible, but it should be as soon as network comes up.)
      • 2016-10-27 30144, 2016

      • Freso
        LordSputnik: Maybe try and see if there's pgsql .socket you can use?
      • 2016-10-27 30152, 2016

      • ymsc
        should I do the git pull first?
      • 2016-10-27 30155, 2016

      • ruaok
        yes
      • 2016-10-27 30151, 2016

      • ymsc
        Failed to write all bytes for _bisect.so
      • 2016-10-27 30157, 2016

      • ymsc
        when I tried to bring them up
      • 2016-10-27 30133, 2016

      • ruaok
        wha?
      • 2016-10-27 30136, 2016

      • ruaok
        pastebin
      • 2016-10-27 30138, 2016

      • ymsc
        one sec
      • 2016-10-27 30123, 2016

      • ymsc
      • 2016-10-27 30128, 2016

      • ymsc
        looks like /tmp fills up when I run it
      • 2016-10-27 30151, 2016

      • ruaok
        df -h
      • 2016-10-27 30159, 2016

      • ruaok
        didn't we take care of the disk issues now?
      • 2016-10-27 30119, 2016

      • ymsc
      • 2016-10-27 30131, 2016

      • ymsc
        there is free space, but /tmp is full
      • 2016-10-27 30136, 2016

      • JonnyJD_ has quit
      • 2016-10-27 30100, 2016

      • ruaok
        /tmp is 1mb? da hell?
      • 2016-10-27 30109, 2016

      • ruaok
        what is in tmp? can you try do do some cleanup?
      • 2016-10-27 30119, 2016

      • ymsc
        I did, and it filled up again
      • 2016-10-27 30129, 2016

      • ymsc
        when I ran the docker compose command
      • 2016-10-27 30148, 2016

      • ymsc
      • 2016-10-27 30113, 2016

      • ruaok
        that is exceptionally dumb.
      • 2016-10-27 30159, 2016

      • ruaok
        how about trying to umount /tmp
      • 2016-10-27 30107, 2016

      • ruaok
        and then doing a softlink to / ?
      • 2016-10-27 30142, 2016

      • ymsc
        can try it
      • 2016-10-27 30140, 2016

      • ymsc
        once I unmounted it /tmp looks better
      • 2016-10-27 30155, 2016

      • ruaok
        does docker compose now run ok?
      • 2016-10-27 30119, 2016

      • ymsc
      • 2016-10-27 30121, 2016

      • ymsc
        nope
      • 2016-10-27 30125, 2016

      • ymsc
        error is at the bottom
      • 2016-10-27 30112, 2016

      • LordSputnik
        Freso: this is a really weird issue
      • 2016-10-27 30134, 2016

      • LordSputnik
        docker-compose isn't correctly setting up the link to the dependency, so the site can't find the database hostname
      • 2016-10-27 30136, 2016

      • ruaok
        do a git pull in musicbrainz-docker and try again
      • 2016-10-27 30114, 2016

      • ymsc
        looks to be doing better, it is still doing the build
      • 2016-10-27 30108, 2016

      • Gentlecat
        zas: I think stuff is running properly on serge now
      • 2016-10-27 30152, 2016

      • ruaok
        still building, ymsc ?
      • 2016-10-27 30106, 2016

      • ymsc
        yes
      • 2016-10-27 30128, 2016

      • Leftmost` joined the channel
      • 2016-10-27 30147, 2016

      • ymsc
        taking a lot longer then the last time I ran the build
      • 2016-10-27 30107, 2016

      • ruaok
        yeah.
      • 2016-10-27 30111, 2016

      • Leftmost`
        In Cali.
      • 2016-10-27 30115, 2016

      • ruaok
        check disk space.
      • 2016-10-27 30123, 2016

      • ruaok
        welcome Leftmost`
      • 2016-10-27 30131, 2016

      • ruaok
        are you headed to the hotel tonight?
      • 2016-10-27 30143, 2016

      • Leftmost`
        Yep. There now.
      • 2016-10-27 30104, 2016

      • ruaok
        oh sweet. I'm over at the google compus.
      • 2016-10-27 30113, 2016

      • ruaok
        I'll walk back as soon as this data import is done.
      • 2016-10-27 30121, 2016

      • ruaok
        did you get any montana wiskey?
      • 2016-10-27 30128, 2016

      • ruaok
        it is drink o'clock after all.
      • 2016-10-27 30130, 2016

      • Leftmost`
        No, couldn't find any that'd travel.
      • 2016-10-27 30149, 2016

      • ruaok
        booo.
      • 2016-10-27 30108, 2016

      • ruaok
        I have catalan vermut, but none of the things required to drink it.
      • 2016-10-27 30119, 2016

      • ruaok
        maybe the reception has an orange and plastic knife.
      • 2016-10-27 30124, 2016

      • ruaok
        then we could manage.
      • 2016-10-27 30126, 2016

      • Leftmost`
        I'll just have to make sure to bring a bottle to BCN the next time.
      • 2016-10-27 30132, 2016

      • ruaok
        that works.
      • 2016-10-27 30142, 2016

      • ruaok
        ymsc: what is it stuck on?
      • 2016-10-27 30153, 2016

      • ruaok
        Leftmost`: what room are you in? 212 here.
      • 2016-10-27 30101, 2016

      • ymsc
        looks like it finished building
      • 2016-10-27 30111, 2016

      • ruaok
        docker-compose up
      • 2016-10-27 30114, 2016

      • bitmap
        you're both at the sheraton right?
      • 2016-10-27 30114, 2016

      • ruaok
        or docker-compose up -d
      • 2016-10-27 30118, 2016

      • ruaok
        I am.
      • 2016-10-27 30123, 2016

      • ymsc
        indexer_1 | stdin: is not a tty