#metabrainz

/

      • reosarevok
        Aren't things often broadcast through several timezones at once?
      • (of course that technically can also affect date itself but)
      • mayhem: I thought you wanted it to be cheaper? :D that sounds like a lot of flying people in
      • (I don't mind the idea, but)
      • (probably tons of nice birds if the smoke hasn't killed them all)
      • mayhem
        I just said: "if the 4 unicorns that are circling, land, then we can do it in india)"
      • In Jan incan look at how much more expensive it might be.
      • So far the smog has not killed the birds. We know that birds are not real
      • kellnerd
        reosarevok: Hmmm, hadn't thought about that... I live in a too small country with just one timezone :P
      • The thing is that broadcast times are usually very well documented (if the date is) so it would be nice to be able to enter them :)
      • Oh, and the closing paren of the "Guidelines" is missing :P
      • reosarevok
        Oh no
      • Fixed, thanks
      • Yeah, I can see that - maybe an American can tell us how that works for the US broadcasts
      • kellnerd
        Would you specifically create a new label for a broadcast channel (which does not already exist as imprint) or would you just use the broadcasting company in that case?
      • (I haven't encountered that case so far, but I was already worrying about this... It would imply that we might need a new label type.)
      • BrainzGit
        [musicbrainz-server] 14mwiencek opened pull request #3097 (03production…lat-inst-aliases): Store instrument_aliases on LinkAttributeType https://github.com/metabrainz/musicbrainz-serve...
      • bitmap
        reosarevok: kellnerd: depends on if the broadcast is live or pre-recorded & aired at the same local time in each region. I guess using the local time where the broadcast is hosted/produced makes the most sense?
      • yvanzo
        bitmap: migration PR up for review :)
      • atj: Are ZFSes ready to go? :)
      • bitmap: Actually I was wrong: a new image isn’t needed right now, it can wait for the next MBS release.
      • atj
        yvanzo: /srv/musicbrainz/dumps
      • bitmap
        yvanzo: thanks, I'm reviewing it now
      • yvanzo
        bitmap: It doesn’t take into account the new mountpoint for creating volumes yet.
      • bitmap
        okay
      • heh, that must be one of the last references to bowie
      • yvanzo
        he never dies ;)
      • BrainzGit
        [listenbrainz-android] 14akshaaatt merged pull request #282 (03dev…dependabot/gradle/dev/com.google.devtools.ksp-1.9.20-1.0.14): Bump com.google.devtools.ksp from 1.9.10-1.0.13 to 1.9.20-1.0.14 https://github.com/metabrainz/listenbrainz-andr...
      • yvanzo
        atj, bitmap: Not sure how to create a volume under a different path than DOCKER_ROOT_DIR? https://docs.docker.com/engine/reference/comman...
      • atj
        you don't create a volume, it's a bind mount
      • check the docker command that creates the PG servers
      • yvanzo
        thanks, found `start_postgres_cluster_node_v2`
      • It means that we cannot run it on any server though.
      • atj
        well, let's worry about that at a later date. you can add a check to make sure the directory exists if you want.
      • yvanzo
        sure, just adding checks for these volumes to exist when running the container.
      • lusciouslover joined the channel
      • reosarevok
        kellnerd: I did consider that, it might make sense to have a radio station label type
      • Still not sure what happens with stuff like podcasts, are those broadcast theoretically? Guess not
      • Broadcast the verb, not the rh type
      • *rg
      • kellnerd
        Classical podcasts are download only, but nowadays they brand a lot of other stuff (comedy, audio drama) as podcast (at least in Germany) which is also broadcast over radio.
      • I think editors will figure it out where to use just the release date and where to use a broadcast relationship for podcasts (but I am optimistic when it comes to editors always applying common sense).
      • *over-optimistic
      • atj
        *delusional ;)
      • relaxoMob has quit
      • relaxoMob joined the channel
      • yvanzo
        atj, bitmap: I pushed commits in the PR for using ZFS volumes. If it looks good to you, I will update volume copy instructions accordingly.
      • atj
        yvanzo: can you link the PR please?
      • didn't see it in the backlog
      • bitmap
      • kellnerd
        reosarevok: I've found the first radio station label which I had to add: https://musicbrainz.org/label/7e9f2c29-a8da-4a1...
      • There is even https://musicbrainz.org/tag/radio%20station already, which also lists some artists :face_with_rolling_eyes:
      • bitmap
        "WHYY" indeed
      • kellnerd
        🤣
      • monkey
        WFMU <3
      • Anyone else having issue (connection timeouts) trying to ssh into wolf?
      • yvanzo
        monkey: not me
      • elomatreb has quit
      • monkey
        OK, thanks. Internet here then, I gues
      • +s
      • FichteFoll has quit
      • trclst has quit
      • yvanzo
        bitmap: Would `/srv/musicbrainz` work for you? Or does it have to be more fine-grained?
      • bitmap
        yeah, I just left a comment agreeing to that, if it's easy to change
      • yvanzo
        Thank you, let’s see how atj it is to change :)
      • bitmap
        lol
      • petitminion joined the channel
      • elomatreb joined the channel
      • trclst joined the channel
      • FichteFoll joined the channel
      • atj
        bitmap: how big are replication packets on the filesystem?
      • bitmap
        atj: 25G
      • petitminion has quit
      • atj
        one file or multiple?
      • bitmap
        multiple
      • yvanzo
        ~180K files
      • bitmap
        individually the last few are between 200K-400K
      • yvanzo
        The plan is to archive the ones that from the previous schema sequence, so about every year, keeping at most 9K files.
      • (but for now, we have that huge directory)
      • bitmap: Does `RequireAuth` imply something such as `$c->user_exists`?
      • (off-topic)
      • bitmap
        it should, yes
      • yvanzo
        (I didn’t find the doc about it.)
      • bitmap
        I guess the only exception is the ConfirmSeed page which shows for cross-origin requests
      • (the original endpoint will have RequireAuth, but the user will be logged-out when viewing the ConfirmSeed page)
      • atj
        are the replication packets compressed?
      • sorry about all the questions
      • bitmap
        yes
      • yvanzo
        atj: no worry, are you creating a ZFS volume for each current docker volume?
      • (or am I misunderstanding the direction of your questions?)
      • atj
        yvanzo: I added a reply on the PR which gives some context around reasons for creating separate ZFS datasets
      • at this point I think it might just be easier to have a single parent dataset
      • unless any of the reasons I gave are applicable here
      • yvanzo
        everything is compressed already but logs
      • full-exports has huge files, while the other have smaller files
      • +s
      • I agree that a single parent would work for now
      • atj
        OK, i'll delete the dump dataset and you can just create sub-directories under /srv/musicbrainz
      • yvanzo
        Thank you.
      • atj
        yvanzo: did the `--device-write-bps` arg fix the issue in the end?
      • yvanzo
        No.
      • atj
        heh, well that's good in a way as i'm wondering whether it will even work with ZFS due to datasets not being "real" devices
      • you may find the docker command fails
      • yvanzo
        It is likely not going to change anything but I just updated it in case it does.
      • Just found your comment to the PR, yes, it will bug, thanks.
      • Nope, actually Docker seems to handle zpool :)
      • bitmap
      • maybe we could set up a jenkins agent on patton?
      • atj
        bitmap: running build agents on internal infra makes me nervous from a security PoC to be honest
      • bitmap
        yea I can understand why
      • atj
        no issues with running an agent but my preference would be on a machine like wolf that is treated as like a DMZ
      • would there be any benefits to an agent running on a machine with internal connectivity?
      • bitmap
        for the jobs I want to parallelize (MB's selenium tests), not really, since they are self-contained
      • we do have one job that rsyncs to the gateways
      • yvanzo
        bitmap: I’ve got to go. When do we move to hendrix?
      • bitmap
        yvanzo: if you want to execute the move, whenever you are able
      • we could do it tomorrow if you'd like
      • sorry, I forgot it was friday
      • yvanzo
        tomorrow is sat, should we disable prod cron?
      • bitmap
        yes
      • yvanzo
        I’m not necessarily needed to execute it either.
      • bitmap
        I can do the move today then
      • yvanzo
        If you have time, otherwise just disable prod cron, thank you.
      • bitmap
        np
      • yvanzo
        (I mean disable `admin/cron/daily.sh` in crontab)
      • bitmap
        yeah
      • thanks for preparing the PR and associated instructions, I'll work on it
      • yvanzo
        I didn’t update instructions for copying Docker volumes to ZFS stuff yet.
      • bitmap
        ok, will do
      • (unless you are planning to before you go)
      • yvanzo
        bitmap: I just updated the step #5 but it has to be tested (step #1) in particular check whether it doesn’t create a `_data` subdirectory on hendrix.
      • yvanzo is off for ~4h from now
      • bitmap
        ok, ty!
      • I guess this line isn't needed: docker volume create --driver local --name "$ZFS_SUBDIRECTORY"
      • ?
      • atj
        nope
      • Sciencentistguy has quit
      • Sciencentistguy joined the channel
      • bitmap: I think the first rsync command in step #5 might be wrong, it depends if the `docker volume create` command creates the _data sub-directory
      • BrainzGit
        [listenbrainz-server] 14amCap1712 opened pull request #2633 (03master…playlist-fix): Link to each artist in artist credit separately on Playlist pages https://github.com/metabrainz/listenbrainz-serv...
      • param
      • bitmap
        atj: it doesn't normally create the sub-directory?
      • atj
        bitmap: i don't know to be honest
      • bitmap
        ok, I'll have it exit if the directory doesn't exist, we'll see
      • atj: rsync isn't installed on the host, I can install it but dunno if that should also be part of ansible
      • atj
        bitmap: hmm, yeah it should be really! i keep coming across stuff that isn't installed by default
      • lsof, strace, htop etc.
      • although, hendrix and jimmy were installed in a different way to most hosts because they run root on ZFS
      • bitmap
        ah ok
      • psql would be nice too