#metabrainz

/

      • bitmap
        nelgin: heh. if they're forwarded to docker, `docker logs --tail 100 docker-mq` might have them
      • 2020-09-01 24527, 2020

      • bitmap
        I'm assuming docker-mq is the name of that container here
      • 2020-09-01 24514, 2020

      • shivam-kapila
        iliekcomputers: added tests
      • 2020-09-01 24523, 2020

      • bitmap
        might need `docker-compose logs ...` instead
      • 2020-09-01 24552, 2020

      • nelgin
        OK there we go
      • 2020-09-01 24559, 2020

      • CallerNo6 has quit
      • 2020-09-01 24559, 2020

      • Lotheric has quit
      • 2020-09-01 24525, 2020

      • nelgin
        mq_1 | =ERROR REPORT==== 1-Sep-2020::17:44:02 ===
      • 2020-09-01 24526, 2020

      • nelgin
        mq_1 | Channel error on connection <0.157.11> (172.18.0.5:38782 -> 172.18.0.3:5672, vhost: '/search-index-rebuilder', user: 'sir'), channel 2:
      • 2020-09-01 24526, 2020

      • nelgin
        mq_1 | operation basic.publish caused a channel exception not_found: no exchange 'search' in vhost '/search-index-rebuilder'
      • 2020-09-01 24556, 2020

      • bitmap
        interesting
      • 2020-09-01 24530, 2020

      • CallerNo6 joined the channel
      • 2020-09-01 24530, 2020

      • Lotheric joined the channel
      • 2020-09-01 24547, 2020

      • nelgin
        It seems to be constantly throwing out those messages
      • 2020-09-01 24548, 2020

      • bitmap
        is the indexer container running? I'm pretty sure sir should create those
      • 2020-09-01 24550, 2020

      • BrainzGit
        [listenbrainz-server] paramsingh merged pull request #1054 (master…fix-spotify-imports): Improve spotify imports https://github.com/metabrainz/listenbrainz-server…
      • 2020-09-01 24501, 2020

      • nelgin
        every 2 minutes
      • 2020-09-01 24526, 2020

      • nelgin
        Ah. no it isn't
      • 2020-09-01 24526, 2020

      • bitmap
        might need to check sir/indexer logs (not sure what the name of it is)
      • 2020-09-01 24539, 2020

      • nelgin
        musicbrainz-docker_indexer_1 python -m sir amqp_watch Exit 1
      • 2020-09-01 24549, 2020

      • iliekcomputers
        shivam-kapila: thank yoU!
      • 2020-09-01 24521, 2020

      • bitmap
        can you start it, or does it always crash on that command?
      • 2020-09-01 24549, 2020

      • nelgin
        Let me see. I'm lagging it bit on my pc due to the vm.
      • 2020-09-01 24541, 2020

      • bitmap
        np
      • 2020-09-01 24547, 2020

      • nelgin
        Ok, it's now saying that it's up
      • 2020-09-01 24559, 2020

      • nelgin
        $ sudo docker-compose up -d indexer
      • 2020-09-01 24559, 2020

      • nelgin
        musicbrainz-docker_search_1 is up-to-date
      • 2020-09-01 24559, 2020

      • nelgin
        musicbrainz-docker_mq_1 is up-to-date
      • 2020-09-01 24559, 2020

      • nelgin
        musicbrainz-docker_db_1 is up-to-date
      • 2020-09-01 24559, 2020

      • nelgin
        Starting musicbrainz-docker_indexer_1 ... done
      • 2020-09-01 24509, 2020

      • nelgin
        musicbrainz-docker_indexer_1 python -m sir amqp_watch Up
      • 2020-09-01 24504, 2020

      • bitmap
        cool. unclear why it was down, but :)
      • 2020-09-01 24513, 2020

      • bitmap
        hopefully that resolves the amqp errors?
      • 2020-09-01 24516, 2020

      • nelgin
        Nope.
      • 2020-09-01 24517, 2020

      • nelgin
        operation basic.consume caused a channel exception not_found: no queue 'search.index' in vhost '/search-index-rebuilder'
      • 2020-09-01 24521, 2020

      • nelgin
        Still getting that error
      • 2020-09-01 24539, 2020

      • bitmap
        hmph
      • 2020-09-01 24557, 2020

      • nelgin
        Let me pastebin something from the indexer
      • 2020-09-01 24559, 2020

      • bitmap
        try running `sudo docker-compose exec indexer python -m sir amqp_setup` again since that *should* declare those
      • 2020-09-01 24557, 2020

      • nelgin
      • 2020-09-01 24520, 2020

      • nelgin
        Ok done. Let me try again.
      • 2020-09-01 24529, 2020

      • bitmap
        yeah...those should be created by amqp_setup in theory
      • 2020-09-01 24515, 2020

      • nelgin
        Ok, now it looks like I'm getting some success.
      • 2020-09-01 24549, 2020

      • nelgin
        Now it's processin 2020-08-16 and earlier it was 2020-08-14. Would I have lost anything in the database replication or should it be good?
      • 2020-09-01 24511, 2020

      • bitmap
        great
      • 2020-09-01 24520, 2020

      • nelgin
        *processing
      • 2020-09-01 24532, 2020

      • bitmap
        if it's running smoothly it should be good since it wouldn't allow applying packets out of order
      • 2020-09-01 24553, 2020

      • nelgin
        Hmm, still getting a spurious error
      • 2020-09-01 24508, 2020

      • nelgin
        WARNING: SET CONSTRAINTS can only be used in transaction blocks
      • 2020-09-01 24508, 2020

      • nelgin
        XIDs Stmts est% XIDs/sec Stmt/sec
      • 2020-09-01 24508, 2020

      • nelgin
        832 3625 54% 13 60WARNING: amqp could not commit tx mode on broker 1, reply_type=2, library_errno=4
      • 2020-09-01 24508, 2020

      • nelgin
        1507 6631 100% 18 81 81.58 sec
      • 2020-09-01 24518, 2020

      • bitmap
        that SET CONSTRAINTS warning can be ignored (I should look into fixing that), but the amqp one is troubling since I thought we fixed that :)
      • 2020-09-01 24535, 2020

      • bitmap
        are you still getting errors in the mq logs?
      • 2020-09-01 24541, 2020

      • nelgin
        Yeah, I knew about the SET CONSTRAINTS
      • 2020-09-01 24550, 2020

      • nelgin
        I think I need to get another 32gb of memory for my pc if I'm going to be running docker on a vm lol
      • 2020-09-01 24547, 2020

      • bitmap
        how much do you have now? :)
      • 2020-09-01 24555, 2020

      • nelgin
        mq_1 | client unexpectedly closed TCP connection
      • 2020-09-01 24522, 2020

      • nelgin
        I wonder if that's caused by the load on the server.
      • 2020-09-01 24528, 2020

      • nelgin
        runq is a t5.8
      • 2020-09-01 24533, 2020

      • nelgin
        is at 5.8
      • 2020-09-01 24549, 2020

      • nelgin
        32gb now
      • 2020-09-01 24556, 2020

      • nelgin
        I think. Let me check, it might be 16 lol.
      • 2020-09-01 24514, 2020

      • bitmap
        might be an important detail to check
      • 2020-09-01 24545, 2020

      • bitmap
        I'd hope 16gb should me more than enough in either case, but
      • 2020-09-01 24549, 2020

      • bitmap
        be*
      • 2020-09-01 24554, 2020

      • nelgin
        16gb
      • 2020-09-01 24528, 2020

      • nelgin
        I gave 10gb to the VM.
      • 2020-09-01 24543, 2020

      • bitmap
        the indexer likes to suck up ram I guess
      • 2020-09-01 24504, 2020

      • nelgin
        the vm has 127mb free, so yeah. I think it likes it.
      • 2020-09-01 24539, 2020

      • nelgin
        Oh hell. I only gave it 1 core lol.
      • 2020-09-01 24552, 2020

      • bitmap
        yikes
      • 2020-09-01 24520, 2020

      • ruaok
        iliekcomputers: I now have a docker setup with goaccess that could be a simple starting point.
      • 2020-09-01 24521, 2020

      • nelgin
        That explains everything lol
      • 2020-09-01 24539, 2020

      • bitmap
        also, unsure about those TCP connection errors, but you can probably ignore them too...
      • 2020-09-01 24514, 2020

      • nelgin
        They seemed to happen why my pc was hanging so probably caused by timeouts rather than anything else.
      • 2020-09-01 24521, 2020

      • bitmap
        ah, could be
      • 2020-09-01 24531, 2020

      • nelgin
        Ok, lets try this again with 4 cores :)
      • 2020-09-01 24546, 2020

      • nelgin
        Alright, I need to get back to work. Thanks for your help, it seems to be going smoothly now.
      • 2020-09-01 24534, 2020

      • bitmap
        np, glad it's working!
      • 2020-09-01 24545, 2020

      • nelgin
        Are you going to let yvanzo know about the issues?
      • 2020-09-01 24509, 2020

      • bitmap
        I'll be sure to link him the chatlogs once he's back
      • 2020-09-01 24559, 2020

      • nelgin
        Cool thanks.
      • 2020-09-01 24548, 2020

      • v6lur has quit
      • 2020-09-01 24542, 2020

      • d4rkie joined the channel
      • 2020-09-01 24525, 2020

      • Nyanko-sensei has quit
      • 2020-09-01 24533, 2020

      • Gazooo794 joined the channel
      • 2020-09-01 24558, 2020

      • Gazooo79 has quit
      • 2020-09-01 24503, 2020

      • d4rkie has quit
      • 2020-09-01 24552, 2020

      • Nyanko-sensei joined the channel