19:35 PM
nelgin
musicbrainz@wibble:/restore/musicbrainz/musicbrainz-docker$ sudo docker-compose ps
19:35 PM
Name Command State Ports
19:35 PM
------------------------------------------------------------------------------------------------------------------------------------------
19:35 PM
musicbrainz-docker_db_1 docker-entrypoint.sh postg ... Up 5432/tcp
19:35 PM
musicbrainz-docker_indexer_1 python -m sir amqp_watch Exit 1
19:35 PM
Yes, it shows it,but it shows it's dead.
19:36 PM
yvanzo
admin/configure rm live-indexing-search
19:36 PM
sudo docker-compose up -d
19:36 PM
nelgin
and for some reason, Ihave to do all my admin commands with sudo.
19:36 PM
yvanzo
19:37 PM
nelgin
configure: cannot set docker command: please either
19:37 PM
* add the user 'musicbrainz' to the group 'sudo' or 'wheel'
19:37 PM
* or set the variable $DOCKER_CMD
19:37 PM
Is that usual?
19:37 PM
yvanzo
Yes
19:37 PM
It's because configure is using docker command.
19:37 PM
nelgin
Ah ok.
19:39 PM
musicbrainz-docker_indexer_1 /sbin/my_init
19:40 PM
Does that look better?
19:40 PM
yvanzo
So running sudo admin/configure works, but you can set the shell variables instead: export DOCKER_CMD='sudo docker' DOCKER_COMPOSE_CMD='sudo docker-compose'
19:40 PM
Yes
19:40 PM
19:41 PM
nelgin
Installing indexer AMQP extension into PostgreSQL ...
19:41 PM
BEGIN
19:41 PM
psql:/tmp/CreateExtensionAMQP.sql:5: ERROR: extension "amqp" already exists
19:41 PM
I assume that's ok.
19:41 PM
yvanzo
Yes, sorry, just: sudo docker-compose exec indexer python -m sir amqp_setup
19:42 PM
nelgin
Ah ok
19:42 PM
DOne
19:42 PM
then admin/configure add live-indexing-search ?
19:42 PM
yvanzo
Does mq have queues now?
19:42 PM
nelgin
It does.
19:43 PM
yvanzo
Did you build search indexes already?
19:44 PM
nelgin
Yes, did those last night
19:44 PM
yvanzo
Cool, so yes, you can proceed with step 4 :)
19:44 PM
nelgin
so if I do sudo docker-compose down; sudo docker-compose up -d I should still see the queues right, before I proceed?
19:44 PM
yvanzo
Yes.
19:44 PM
nelgin
Right...let me try that.
19:45 PM
yvanzo
The queues are stored in 'mqdata' volume.
19:45 PM
nelgin
Just says "no items"
19:45 PM
I'll give it a minute
19:46 PM
Nope, just says "no items" still.
19:48 PM
What do I check in the indexer container to see if the amqp setup stuck?
19:54 PM
So open to suggestions cos I'm stuck and don't want to have to run the setup everytime I restart the containers.
19:55 PM
yvanzo
19:56 PM
nelgin
Will I find that in a file in the indexer container?
19:57 PM
But yes, I got that output when I first ran sudo docker-compose exec indexer python -m sir amqp_setup
19:57 PM
yvanzo
Ok, no it's not logged elsewhere.
19:57 PM
nelgin
19:58 PM
yvanzo
I don't get why the queues disappear from rabbitmq, never seen that before.
19:58 PM
nelgin
Well, it's the same with cron. admin/configure just isn't making things stick, or not working or something.
19:59 PM
yvanzo
That is normal output (for indexer container without live indexing enabled).
19:59 PM
admin/configure is just editing .env
19:59 PM
nelgin
Right but sudo docker-compose exec mq rabbitmqadmin -u sir -p sir -V /search-index-rebuilder list queues shoudl list the queues, not "no items" right?
20:00 PM
If I've not done step 4 as yet.
20:01 PM
yvanzo
Yes
20:01 PM
nelgin
20:01 PM
There's my .env file. Maybe something is amiss there?
20:02 PM
yvanzo
What is in /restore/musicbrainz/musicbrainz-docker/local/indexer.ini ?
20:02 PM
nelgin
same as default.ini but with index_limit = 2000000 per your suggestion.
20:03 PM
20:04 PM
yvanzo
I don’t see anything wrong.
20:05 PM
nelgin
I wonder if something got corrupted when /var/lib ran out of space, but that was only importing data into the database so I doubt it.
20:06 PM
I could just blow it all away and start again to be sure. I don't want to keep on a wild goose chase.
20:06 PM
yvanzo
I can try to reproduce that but it will take some time.
20:08 PM
nelgin
Before you waste time on that, let me just start over. What's the best way to clean up ?
20:11 PM
Finally, is there a way to get createdb.sh to use the existing .gz files without downloading them again? If I leave off -fetch will that work?
20:11 PM
yvanzo
Yes
20:13 PM
I don’t think it is related to /var/lib ran out of space, but I can be wrong.
20:13 PM
What is your docker version?
20:13 PM
nelgin
Docker version 20.10.2, build 20.10.2-0ubuntu1~20.04.2
20:13 PM
docker-compose version 1.25.0, build unknown
20:16 PM
yvanzo
nelgin: which packages? dpkg --list | grep docker
20:16 PM
nelgin
docker-compose 1.25.0-1
20:16 PM
docker.io 20.10.2-0ubuntu1~20.04.2
20:16 PM
python3-docker 4.1.0-1
20:16 PM
python3-dockerpty 0.4.1-2
20:17 PM
yvanzo
Thanks
20:18 PM
nelgin
Running sudo docker-compose build - will check back in about 20 minutes :)
20:19 PM
How much longer will you be around?
20:19 PM
yvanzo
Probably 1h30 at most.
20:20 PM
I’m setting up a fresh instance to try to reproduce these issues.
20:29 PM
nelgin
It would be nice if the Vm came with all the perl modules already installed. That's one of the time consuming parts.
20:31 PM
build done.
20:32 PM
Ihave the .gz files in my local system, how do I get them into the right container so I don't have to -fetch ?
20:40 PM
yvanzo
Using 'docker cp'
20:40 PM
nelgin
I'm just going to configure my linux box with ftp so it'll be reusable without having to worry about that.
20:41 PM
yvanzo
Or move the files directly to /var/lib/...
20:42 PM
nelgin
..docker/...
20:42 PM
yvanzo
sudo docker inspect -f '{{.Mountpoint}}' musicbrainz-docker_dbdump
20:43 PM
nelgin
Error: No such object: musicbrainz-docker_dbdump
20:43 PM
I've done the build, not at the stage to bring up the containers yet.
20:44 PM
yvanzo
Ok, do you start with no .env (or a fresh .env without replication set?)
20:45 PM
nelgin
No .env file. Everything was removed and did a new git clone
20:46 PM
yvanzo
sudo docker-compose up musicbrainz # it will create dbdump volume at least, then kill it.
20:51 PM
nelgin
$ sudo docker inspect -f '{{.Mountpoint}}' musicbrainz-docker_dbdump
20:51 PM
/var/lib/docker/volumes/musicbrainz-docker_dbdump/_data
20:51 PM
So I throw the files in there?
20:52 PM
yvanzo
yes
20:52 PM
including the LATEST file
20:52 PM
nelgin
Yup.
20:53 PM
Ok, copied. Now shut it down before running createdb ?
20:54 PM
yvanzo
Yes.
20:54 PM
nelgin
Since I didn't use -d can I just ^C to kill it or should I do the docker-compose down ?
20:55 PM
yvanzo
Yes ^C
20:55 PM
nelgin
Super.
20:56 PM
musicbrainz is down, the others are up, should I should those down too?
20:56 PM
yvanzo
yep, sudo docker-compose down
21:04 PM
nelgin
the sudo docker-compose run --rm musicbrainz createdb.sh should do it.
21:04 PM
right?
21:06 PM
repo has quit
21:07 PM
OK, it's creating the databases
21:11 PM
Can I do similar with the searchdata ?
21:14 PM
BrainzGit
21:14 PM
nelgin
Yes I can. :)
21:14 PM
BrainzGit
21:14 PM
21:14 PM
[bookbrainz-site] snyk-bot opened pull request #612 (master…snyk-upgrade-cbb35c04e742531e4ebe22439f641b47): [Snyk] Upgrade: @fortawesome/fontawesome-svg-core, @fortawesome/free-brands-svg-icons, @fortawesome/free-solid-svg-icons, @fortawesome/react-fontawesome
https://github.com/bookbrainz/bookbrainz-site/p...
21:18 PM
nelgin
need to get ready to go out. I'll bbl. Thanks yvanzo for your help.
21:19 PM
travis-ci joined the channel
21:19 PM
travis-ci
21:19 PM
travis-ci has left the channel
21:28 PM
v6lur has quit
21:28 PM
travis-ci joined the channel
21:28 PM
21:28 PM
travis-ci has left the channel
21:33 PM
travis-ci joined the channel
21:33 PM
21:33 PM
travis-ci has left the channel
21:38 PM
yvanzo
No problem, am off now.
21:41 PM
thomasross joined the channel
21:43 PM
travis-ci joined the channel
21:43 PM
travis-ci
21:43 PM
travis-ci has left the channel
21:50 PM
MRiddickW has quit
22:31 PM
MRiddickW joined the channel
23:07 PM
MRiddickW has quit