#metabrainz

/

      • BrainzGit
        [troi-recommendation-playground] 14svanzoest opened pull request #156 (03main…patch-1): Update user-guide.rst: resolve subsonic -> troi db subsonic https://github.com/metabrainz/troi-recommendati...
      • minimal has quit
      • d4rkie has quit
      • d4rkie joined the channel
      • d4rkie has quit
      • d4rkie joined the channel
      • d4rkie has quit
      • d4rkie joined the channel
      • d4rkie has quit
      • d4rkie joined the channel
      • vardhan_ joined the channel
      • pite has quit
      • d4rkie has quit
      • Kladky joined the channel
      • d4rkie joined the channel
      • d4rkie has quit
      • d4rkie joined the channel
      • Kladky has quit
      • hemang_mishra[m] has quit
      • vardhan_ has quit
      • vardhan_ joined the channel
      • vardhan_ has quit
      • SothoTalKer_ joined the channel
      • SothoTalKer has quit
      • relaxo[m] joined the channel
      • relaxo[m]
        Will it be possible to make the links in the edit note field (or show them next to the textbox) clickable somehow? Maybe utilizing the url detection from the url archiver?
      • Usecase: Have a seeded event with link to event homepage in the edit note and want to check something. Will spare some clicks.
      • monkey[m]
        <mayhem[m]> "I think the right thing to do is..." <- mayhem: Halo! Question about the format of the service-status endpoint. For alerts stuff, is it better to have a playlists_age dict with each patch as a key in there, or to have everything in a flat dict?
      • vardhan_ joined the channel
      • SothoTalKer__ joined the channel
      • SothoTalKer_ has quit
      • BrainzGit
        [listenbrainz-server] 14MonkeyDo opened pull request #3074 (03master…playlists-service-status): Service status: monitor recommendation playlists separately https://github.com/metabrainz/listenbrainz-serv...
      • adhawkins has quit
      • adhawkins joined the channel
      • mayhem[m]
        <monkey[m]> "mayhem: Halo! Question about the..." <- > <@monkey:chatbrainz.org> mayhem: Halo! Question about the format of the service-status endpoint. For alerts stuff, is it better to have a playlists_age dict with each patch as a key in there, or to have everything in a flat dict?
      • I think what you are doing is great. Run it past @zas to make sure he can parse it correctly.
      • I was planning on doing the same.
      • monkey[m]
        I'll check on grafana
      • reosarevok[m]
        aerozol: it might depend on who releases, this time I did it - and I thought you just let people know yourself, so I haven't posted :D
      • yvanzo[m]
        Hi reosarevok, what's up with collecting metrics?
      • monkey[m]
        zas: Hi! Can this nested structure (playlists_age)be used for grafana alerts? https://test-api.listenbrainz.org/1/status/serv...
      • zas[m]
        > lb_api_status,dc=hetzner,url=https://test-api.l... dump_age=139596,incoming_listen_count=0,playlists_age_daily-jams=56725,playlists_age_top-discoveries-for-year=61031124,playlists_age_top-discoveries-of-2023=26948864,playlists_age_top-missed-recordings-of-2023=26949766,playlists_age_weekly-exploration=833838,playlists_age_weekly-jams=834046,stats_age=31934 1733928399000000000
      • minimal joined the channel
      • BrainzGit
        [listenbrainz-server] 14MonkeyDo opened pull request #3075 (03master…artist-search-disambiguation): LB-1707: Add sort name and disambiguation in artist search pages https://github.com/metabrainz/listenbrainz-serv...
      • zas[m]
        Yes, but it has at least one issue: 2023 -> it will create one entry per year, we expect to use tags for that. Imho we should change the approach
      • monkey[m]
        I think we only want to monitor some of those, and not the year in music ones, so these will probably be removed
      • zas[m]
        if we can drop the per-year thing it would work
      • monkey[m]
        OK, thanks for the confirmation
      • is dash vs. underscore in the playlist names an issue? might make sense to format like the rest?
      • zas[m]
        nope, that's normal, because you have an object named playlists_age, and it creates fields for each property in it. but metrics are flattened. Another approach (likely beter) would be to have one measurement named lb_playlists_age, and use a tag for each playlist. It would help if the number of playlists increase (or if their name change)
      • Could it be provided on another endpoint?
      • like /playlists-status
      • so we could have a tag playlist=top-discoveries-for-year for example and a field age for all, it would also ease adding more metrics about playlists
      • jasje[m]
        monkey: tried the app with background activity set as unrestricted?
      • salaxceitor[m] has quit
      • monkey[m]
        jasje: I'll try now 😊
      • pite joined the channel
      • the4oo4 has quit
      • the4oo4 joined the channel
      • reosarevok[m]
        yvanzo: there's a "# HELP process_cpu_seconds_total Total user and system CPU time spent in seconds."
      • I guess that's something that would be useful
      • There's also this, but not sure how useful they are:
      • reosarevok[m] sent a code block: https://matrix.chatbrainz.org/_matrix/media/v3/download/chatbrainz.org/oThTIEeIYpluGGisqMqiKkIB
      • That seems to be about go not psql though :/
      • Yeah, I think all that is about prometheus itself, heh
      • Useful.
      • Someone suggests that to monitor cpu on specific containers https://github.com/google/cadvisor is useful
      • I wouldn't be surprised if zas already does all of this elsewhere though :) zas, do you already have a good way to monitor psql's cpu and memory usage and can we steal it :p
      • yvanzo[m]
        zas: This is for integration with https://github.com/metabrainz/musicbrainz-docke...
      • reosarevok[m]
        Basically we want to have good ways to get stats on our containers for mb-docker, particularly in the short term to test the indexer (but it'd probably be great to have a way to monitor it in general anyway)
      • zas[m]
      • reosarevok[m]
        In which repo is all of this configured? :)
      • That looks perfect
      • So we can copy as much as possible, heh
      • Oh, I think I found it
      • yvanzo[m]
        reosarevok: Here is a copy of the JSON configuration for this dashboard: https://gist.github.com/yvanzo/c27e4a125b0b2fb7...
      • reosarevok: Also found https://github.com/SmartechOpenSource/PostgreSQ... for checking entity tables ’ size
      • reosarevok[m]
        Yeah, but I have no idea where docker_container_cpu comes from for example - there's a ton of extra jobs in our prometheus config
      • Well, it seems to come from influxdb but I assume it gets there in a different way...
      • Or I guess maybe it's unrelated to prometheus entirely and it comes through influxdb instead?
      • It feels like we should bother one of the sysadmins to set up this rather than ambling and trying to figure out how to do it tbh :)
      • yvanzo[m]
        They (he) are (is) overwhelmed already, it is definitely very useful to have their (his) help on this, but we can't just put everything on their shoulders.
      • zas: How does this data get stored in InfluxDB? Is there another way to get it directly through Prometheus?
      • reosarevok[m]
        I mean, I get that, and I have nothing against learning on the job, it's just I'm not sure the amount of questions I'd need to keep asking would be less effort for them than just doing it and it will cost MeB a lot more... 😅
      • But we'll see
      • (Because I'll struggle for 10 times longer I mean, not because I charge more)
      • yvanzo[m]
        reosarevok: There are other metrics which are not system related that you can look into instead.
      • I updated our testbed doc accordingly.
      • zas[m]
        It all depends, we have both influxdb & prometheus db, and there's a plugin for telegraf to read prometheus format (https://github.com/influxdata/telegraf/tree/mas...) and it can send them to influxdb
      • But we also have telegraf postgres input plugin already
      • yvanzo[m]
        zas: We are looking for the simplest setup. We don't need alerts and notifications, just collecting metrics for the time of a performance test.
      • If we can avoid setting up influxdb, that would be great.
      • If it is necessary for some reason, we will set it up too in https://github.com/metabrainz/musicbrainz-docke...
      • salaxceitor[m] joined the channel
      • salaxceitor[m]
        hi there, does anyone know which app was used for creating the metabrainz projects logos?
      • vardhan_ has quit
      • yvanzo[m]
        Hi salaxceitor, I believe that it is some app from Adobe Creative Cloud. aerozol can give you a more detailed answer when he is up.
      • Maxr1998_ has quit
      • Maxr1998 joined the channel
      • salaxceitor[m]
        hi @yvanzo, thanks! the logo maker from adobe looks awesome, will give it a try
      • MyNetAz has quit
      • MyNetAz joined the channel
      • metadataismydrug has quit
      • kellnerd[m] has quit
      • derat[m] has quit
      • Shreyas[m] has quit
      • BrainzGit
        [metabrainz.org] 14amCap1712 opened pull request #493 (03master…minor-fixes): Remove unneeded oauth config https://github.com/metabrainz/metabrainz.org/pu...
      • Jade[m] has quit
      • texke has quit
      • Kladky joined the channel
      • aerozol[m]
        Btw mayhem: I have seen your homepage wording email, I am just working on YIM atm 👍 thanks for that, it will light a fire to try do a homepage design over Xmas break
      • salaxceitor: the project logos were created in Adobe Illustrator by monkey
      • salaxceitor[m]
        Aerozol (@_discord_537897767968833566:chatbrainz.org) thanks for the reply, have a good one
      • Kladky has quit
      • lusciouslover has quit
      • lusciouslover joined the channel
      • mayhem[m]
        aerozol: i love this: https://www.iamsajid.com/colors/