#metabrainz

/

      • alastairp
        it doesn't log requests
      • 2021-05-28 14846, 2021

      • lucifer
        it does or maybe only invalid requests. i remember seeing some stuff there during earlier upgrades
      • 2021-05-28 14855, 2021

      • alastairp
        right
      • 2021-05-28 14858, 2021

      • alastairp
        I just made some requests to the nginx container and got some response (and some error messages in the uwsgi container when I made a bad request)
      • 2021-05-28 14835, 2021

      • lucifer
        ah yes, i see that in prod and nginx both now
      • 2021-05-28 14859, 2021

      • alastairp
        so maybe something related to the service being exposed from the gateways
      • 2021-05-28 14842, 2021

      • ruaok
        oh. I remember now. we need to open port 80 on kiss for the compat api
      • 2021-05-28 14854, 2021

      • ruaok
        should be fixed now.
      • 2021-05-28 14834, 2021

      • ruaok
        alastairp: has the copy from the storage box finished? are we finished with it now?
      • 2021-05-28 14850, 2021

      • alastairp
        sorry, didn't mention that. yes, copy has finished
      • 2021-05-28 14811, 2021

      • alastairp
        in /root/lemmy-docker-volumes
      • 2021-05-28 14858, 2021

      • ruaok
        and those are our backup/archival copies, yes?
      • 2021-05-28 14805, 2021

      • alastairp
        that's a direct copy from /var/lib/docker/volumes on lemmy, I think it'll serve fine for our "keep it around until we need to delete something to free up space" storage
      • 2021-05-28 14823, 2021

      • ruaok
        ok, I created the dummy file with those instructions.
      • 2021-05-28 14839, 2021

      • ruaok
        ok to unmount the storage box, yes?
      • 2021-05-28 14856, 2021

      • alastairp
        yes OK to unmount
      • 2021-05-28 14832, 2021

      • ruaok
        storage box unmounted, mount point cleared up, storage box cancelled.
      • 2021-05-28 14850, 2021

      • ruaok
        ok, I think I found yet another problem with the compat api issue.
      • 2021-05-28 14800, 2021

      • ruaok
        the floating IP we have setup for it... floated away.
      • 2021-05-28 14841, 2021

      • alastairp
        ah, I saw that it wasn't the same as kiss.meb.org, but I thought that was just the gateway. does it point directly to that machine?
      • 2021-05-28 14816, 2021

      • ruaok
        it should, but traffic doesn't appear to be routed correctly.
      • 2021-05-28 14848, 2021

      • ruaok
        ah, it was reset. I re-pointed it to kiss.
      • 2021-05-28 14844, 2021

      • ruaok
        ok, the internet installers are en-route. may go dark for a while.
      • 2021-05-28 14830, 2021

      • alastairp
        ok
      • 2021-05-28 14845, 2021

      • ruaok
        it hasn't taken yet...
      • 2021-05-28 14800, 2021

      • ruaok
        max 5 minute delay... which is glacially slow for a failover
      • 2021-05-28 14837, 2021

      • PetrCBR
        ahh ... got it ... docker-compose logs musicbrainz
      • 2021-05-28 14803, 2021

      • lucifer
        laoks like the internet upgrade at office started
      • 2021-05-28 14820, 2021

      • lucifer
        ruaok, another api compat warning
      • 2021-05-28 14821, 2021

      • ruaok
        Yes, the fail over ip we use for it is not working
      • 2021-05-28 14834, 2021

      • ruaok
        I opened a ticket with hetzner.
      • 2021-05-28 14843, 2021

      • lucifer
        ah ok makes sense.
      • 2021-05-28 14821, 2021

      • elomatreb joined the channel
      • 2021-05-28 14834, 2021

      • elomatreb
        The channel logging linked on https://musicbrainz.org/doc/IRC still points to the old channels btw
      • 2021-05-28 14809, 2021

      • ruaok
        zas: hetzner says the failover is working ok.
      • 2021-05-28 14850, 2021

      • ruaok
        and port 80 is open on the firewall and I can't ping proxy.listenbrainz.org .
      • 2021-05-28 14857, 2021

      • ruaok
        what do we need to do to fix this on kiss?
      • 2021-05-28 14833, 2021

      • zas
        138.201.169.196 is kiss now?
      • 2021-05-28 14842, 2021

      • ruaok
        yes.
      • 2021-05-28 14853, 2021

      • zas
        but did you configure this IP on it?
      • 2021-05-28 14854, 2021

      • ruaok
        as a failover IP. its base IP has not changed.
      • 2021-05-28 14814, 2021

      • ruaok
        uhm. no.
      • 2021-05-28 14819, 2021

      • ruaok
        can you please do that.
      • 2021-05-28 14821, 2021

      • ruaok
        ?
      • 2021-05-28 14840, 2021

      • ruaok goes to fix the ddns setup of the office.
      • 2021-05-28 14841, 2021

      • zas
        yes, I thought this IP was pointing on another machine before the switch
      • 2021-05-28 14823, 2021

      • ruaok
        I checked the DNS record and proxy points to this IP and the api proxy rans on lemmy, so it should run on kiss.
      • 2021-05-28 14846, 2021

      • ruaok
        thanks zas!
      • 2021-05-28 14850, 2021

      • zas
        ruaok: it should work now
      • 2021-05-28 14858, 2021

      • ruaok
        it does, nagios just confirmed.
      • 2021-05-28 14807, 2021

      • zas
        btw, floating IPs have to be configured on target machines
      • 2021-05-28 14831, 2021

      • zas
      • 2021-05-28 14831, 2021

      • ruaok
        yeah, I totally forgot that. its not a redirect, lol.
      • 2021-05-28 14855, 2021

      • zas
        I didn't bother because it wasnt pointing on lemmy when we did the switch
      • 2021-05-28 14807, 2021

      • zas
        anyway, fixed
      • 2021-05-28 14858, 2021

      • Major_Lurker has quit
      • 2021-05-28 14807, 2021

      • ruaok
        zas: do you need any ports opened on the router in order for backups to work? I forget.
      • 2021-05-28 14801, 2021

      • zas
        nope, it uses ssh
      • 2021-05-28 14816, 2021

      • zas
        hmmm, I can't log in though
      • 2021-05-28 14838, 2021

      • ruaok
        so you need the ssh port open, then?
      • 2021-05-28 14857, 2021

      • zas
        yes, and it should forward to the backup machine
      • 2021-05-28 14802, 2021

      • zas
        did you change the box?
      • 2021-05-28 14812, 2021

      • ruaok
        yes, we changed providers.
      • 2021-05-28 14835, 2021

      • zas
        ah, so please configure it so it forwards ssh to the backup machine
      • 2021-05-28 14844, 2021

      • ruaok
        on it.
      • 2021-05-28 14855, 2021

      • ruaok
        try 139.47.124.218
      • 2021-05-28 14803, 2021

      • zas
      • 2021-05-28 14812, 2021

      • zas
        it doesn't answer ping
      • 2021-05-28 14818, 2021

      • ruaok
        yep, i just gave you the IP.
      • 2021-05-28 14829, 2021

      • ruaok
        DDNS is not setup yet.
      • 2021-05-28 14801, 2021

      • zas
        ? I ping 139.47.124.218
      • 2021-05-28 14844, 2021

      • zas
        likely that's not the correct one
      • 2021-05-28 14800, 2021

      • ruaok
        that IP should be correct. and it pings fine for me.
      • 2021-05-28 14817, 2021

      • ruaok
        ah, not from the outside.
      • 2021-05-28 14813, 2021

      • shivam-kapila
        Oh lb server upgraded.
      • 2021-05-28 14819, 2021

      • shivam-kapila
        !m lb devs
      • 2021-05-28 14819, 2021

      • BrainzBot
        You're doing good work, lb devs!
      • 2021-05-28 14836, 2021

      • shivam-kapila
        Nice name btw :D
      • 2021-05-28 14847, 2021

      • BrainzGit
        [listenbrainz-server] 14amCap1712 merged pull request #1472 (03master…compress-cron): Merge both crontabs into one https://github.com/metabrainz/listenbrainz-server…
      • 2021-05-28 14842, 2021

      • kepstin joined the channel
      • 2021-05-28 14813, 2021

      • dak180 joined the channel
      • 2021-05-28 14801, 2021

      • dak180 has left the channel
      • 2021-05-28 14811, 2021

      • lucifer
        ruaok: what should be the new location of backup and ftp dirs?
      • 2021-05-28 14836, 2021

      • ruaok
        we made a new docker volume for it
      • 2021-05-28 14804, 2021

      • alastairp
        no, that's the temporary dumps dir
      • 2021-05-28 14808, 2021

      • alastairp
        lucifer: just put them in /mnt
      • 2021-05-28 14813, 2021

      • lucifer
        👍
      • 2021-05-28 14818, 2021

      • ruaok
        ugh, no.
      • 2021-05-28 14830, 2021

      • ruaok
        bad unix dude.
      • 2021-05-28 14837, 2021

      • ruaok
        make a subdir. so /mnt/dumps
      • 2021-05-28 14841, 2021

      • ruaok
        or something
      • 2021-05-28 14859, 2021

      • lucifer
        so /mnt/backup and /mnt/ftp ?
      • 2021-05-28 14805, 2021

      • ruaok
        sure
      • 2021-05-28 14813, 2021

      • lucifer
        👍
      • 2021-05-28 14810, 2021

      • BrainzGit
        [listenbrainz-server] 14amCap1712 opened pull request #1489 (03master…remove-lbdumps-user): Remove lbdumps user from Dockerfile and crontab https://github.com/metabrainz/listenbrainz-server…
      • 2021-05-28 14809, 2021

      • lucifer
        ruaok: alastairp: should we simplify this as well https://github.com/metabrainz/listenbrainz-server… ?
      • 2021-05-28 14833, 2021

      • lucifer
        the chown and -m can be removed.
      • 2021-05-28 14818, 2021

      • lucifer
        also, since we are using -p we can just keep the last directory in that command.
      • 2021-05-28 14843, 2021

      • PetrCBR has quit
      • 2021-05-28 14819, 2021

      • nelgin
        yvanzo ok that worked thank you
      • 2021-05-28 14830, 2021

      • ijc joined the channel
      • 2021-05-28 14837, 2021

      • ruaok
        lucifer: still around?
      • 2021-05-28 14818, 2021

      • lucifer
        ruaok: yes
      • 2021-05-28 14835, 2021

      • ruaok
        are test and beta up to date so I can ask google for reverification?
      • 2021-05-28 14846, 2021

      • yvanzomeu joined the channel
      • 2021-05-28 14850, 2021

      • lucifer
        beta is up to date, test is not.
      • 2021-05-28 14811, 2021

      • ruaok
        can you update test or should we wait?
      • 2021-05-28 14819, 2021

      • lucifer
        i'll be back on my machine in ~30mins and can update test at that time
      • 2021-05-28 14855, 2021

      • ruaok
        great, I'll have another favor to ask you as well.
      • 2021-05-28 14801, 2021

      • lucifer
        i'll ping you after updating and you can request reveification if you still have time.
      • 2021-05-28 14809, 2021

      • ruaok
        I'll be working this whole evening, getting the officebrainz up again.
      • 2021-05-28 14818, 2021

      • ruaok
        the new ISP at the office is making this a bit more challenging.
      • 2021-05-28 14827, 2021

      • ruaok
        so no problem.
      • 2021-05-28 14803, 2021

      • lucifer
        oh ok, i'll be up for another few hours. let me know if you need some help.
      • 2021-05-28 14825, 2021

      • yvanzo has quit
      • 2021-05-28 14857, 2021

      • ruaok
        thanks, perhaps. should be straightforward dockerization of a standalon app.
      • 2021-05-28 14855, 2021

      • lucifer
        sure, sounds fun
      • 2021-05-28 14817, 2021

      • ruaok
        "fun"
      • 2021-05-28 14833, 2021

      • ruaok
      • 2021-05-28 14849, 2021

      • ruaok
        (for when you get back lucifer)
      • 2021-05-28 14821, 2021

      • Freso
        elomatreb: Should be fixed now, thanks. :) (May take a bit to update from cache(s) though, so might not appear updated immediately.)
      • 2021-05-28 14826, 2021

      • Sophist-UK joined the channel
      • 2021-05-28 14830, 2021

      • Sophist-UK is now known as Guest3302
      • 2021-05-28 14843, 2021

      • Guest3302 has quit
      • 2021-05-28 14814, 2021

      • Sophist_UK joined the channel
      • 2021-05-28 14814, 2021

      • Sophist_UK has quit
      • 2021-05-28 14814, 2021

      • Sophist_UK joined the channel
      • 2021-05-28 14823, 2021

      • BrainzGit
        [listenbrainz-server] 14MonkeyDo opened pull request #1490 (03flask-global-props…monkey-react-global-props): Use global app props in React components https://github.com/metabrainz/listenbrainz-server…
      • 2021-05-28 14821, 2021

      • Sophist_UK has quit
      • 2021-05-28 14834, 2021

      • Sophist-UK joined the channel
      • 2021-05-28 14834, 2021

      • Sophist-UK has quit
      • 2021-05-28 14834, 2021

      • Sophist-UK joined the channel
      • 2021-05-28 14823, 2021

      • lucifer
        ruaok: test updated.
      • 2021-05-28 14834, 2021

      • ruaok
        thanks.
      • 2021-05-28 14822, 2021

      • lucifer
        i see docker server configs PR is merged.
      • 2021-05-28 14820, 2021

      • ruaok
        I'll have another PR in a minute.
      • 2021-05-28 14821, 2021

      • lucifer
        ruaok, does that mean the backups also get stored in hetzner machines ?
      • 2021-05-28 14843, 2021

      • ruaok
        no, the backups are actually stored in the office in barcelona.
      • 2021-05-28 14857, 2021

      • ruaok
        in case hetzner goes up in flames, we have off-site backups.
      • 2021-05-28 14823, 2021

      • lucifer
        right, that was my understanding. i was unsure what that PR moved to hetzner.
      • 2021-05-28 14807, 2021

      • ruaok
        "Application Terms of Service Link"
      • 2021-05-28 14827, 2021

      • ruaok
        we currently link to a metabrainz.org link. I suppose they are going to reject us for that next.
      • 2021-05-28 14847, 2021

      • ruaok
        ah, we have nothing to lose, I'm certainly not going to fix it now.
      • 2021-05-28 14801, 2021

      • lucifer
        🤞
      • 2021-05-28 14829, 2021

      • ruaok
        ok, I think I submitted it again. not sure.
      • 2021-05-28 14857, 2021

      • rektide joined the channel
      • 2021-05-28 14854, 2021

      • ruaok
        lucifer: in case you're looking for something to work on... :)
      • 2021-05-28 14855, 2021

      • ruaok
      • 2021-05-28 14856, 2021

      • texke has quit
      • 2021-05-28 14808, 2021

      • ruaok
        I pretty much just ran out of steam for today.