#metabrainz

/

      • bitmap
        ok
      • sigh, this update_mb_dbdefs_for_hosts.sh script is always broken
      • or I don't understand how it works
      • akshaaatt
        mayhem do let me know if you are able to submit listens. Keep in mind that we do need to improve the submitted data from the app though.
      • mayhem
        I'm not.
      • the last two track changes have not been recorded.
      • akshaaatt
        LB seems to be down
      • That could be an issue?
      • mayhem
        🤦
      • akshaaatt
        Lol
      • mayhem
        one shall not play with these toys during downtime, yes.
      • sorry akshaaatt .
      • akshaaatt
        It’s fine 😂😂
      • bitmap
        yvanzo: update_mb_dbdefs_for_hosts.sh is completely broken for me, it just reports "No matching containers on aphex." for every machine
      • akshaaatt
        We should maintain a local fb though.
      • Thanks for testing mayhem. We got a new ticket because of it
      • Db*
      • yvanzo
        bitmap: should I try it
      • bitmap
        yvanzo: yeah
      • mayhem
        lucifer: looking at the pop data now. what is the difference between those two queries?
      • bitmap
        yvanzo: I'm running it without any arguments because the args in the google doc didn't work
      • mayhem
        akshaaatt: I'll be doogfooding the LB app from now on. if it breaks, you'll hear from me, I promise. :)
      • akshaaatt
        Awesome! ⚡️⚡️
      • bitmap
        yvanzo: you have to edit the file to remove "sleep 30" first
      • jasje
        phew i was worried wtf did i do wrong glad the server is down (i mean not really)
      • mayhem
      • lucifer
        mayhem: first one is popularity by total listen count, second by unique listener count.
      • mayhem
        should we reach out and ask about LB support?
      • yvanzo
        bitmap: it's skipped aphex and aretha as already up-to-date but it's now working for others, using arguments from the doc
      • monkey
        I saw that one, thought the same thing
      • jasje
        lucifer: understood!
      • bitmap
        yvanzo: OK, I guess it's just borked on macOS
      • mayhem
        lucifer: hard to evaluate like this, but it seems ok.
      • bitmap
        I merged the gsed PR already
      • so must be something else
      • mayhem
        would be good to put up on DSH
      • lucifer
        mayhem: there is artist, release, recording data available as well
      • monkey
        But it's limited too, same as other ones I've seen:
      • >automatically detect currently playing music from Apple Music or Spotify
      • yvanzo
        bitmap: it stopped on patton, now restarting
      • mayhem
        packed with radiohead, and RHCP, the data is likely ok, lucifer
      • lucifer
        i didn't put it on dsh because not sure what params to accept.
      • mayhem
        what params?
      • jasje
        mayhem: to record any app in the listening apps list, just play one or two songs.
      • mayhem
        monkey: better than nada.
      • yvanzo
        bitmap: did you update your local working copy of server conf?
      • jasje
        force shutting isn’t necessary
      • lucifer
        top recordings is a mbid with two listen counts.
      • bitmap
        yvanzo: yeah
      • I'm on 6132bf00b231308de41be93da2364c7e5dd9e690
      • mayhem
        jasje: I think the problem is with LB being down. but likely it works now. I'll check once LB is up.
      • jasje
        doesn’t matter if LB is up or no
      • yvanzo
        bitmap: Sometimes it's also stopping with "Host key verification failed. fatal: Could not read from remote repository."
      • lucifer
      • jasje
        listening apps will show regardless
      • lucifer
        all of this is available.
      • yvanzo
        bitmap: done
      • bitmap
        thanks
      • mayhem
        jasje: yes, I can see the LB app knowing the current playing now track.
      • akshaaatt
        jasje those are showing for him.
      • yvanzo
        bitmap: was json-dump not included at purpose?
      • akshaaatt
        The issue is only with the submissions currently
      • jasje
        oh then its okay. looks like i read an older convo
      • mayhem
        lucifer: why dont we have make one DSH query and then have an extra param that tells which table to use. then list the available tables in the desc for the query.
      • bitmap
        services should be coming back now
      • mayhem
        (and please add the available tables for recording and artists similarity while you're at it)
      • oh, LB must be back. listen arrived. :)
      • bitmap
        yvanzo: that looks like an oversight
      • yvanzo
        okay, updating it now
      • bitmap
        apparently if you run the script without any arguments it should update all containers on all hosts?
      • akshaaatt high fives mayhem
      • mayhem
        jasje: akshaaatt: all sorted, thank you!
      • yvanzo
        bitmap: yes
      • done
      • jasje
        yay!
      • bitmap
        yvanzo: ty
      • I'll restore standby service on pink now
      • yvanzo: can you pull docker-server-configs on pink? now that's not working lol
      • yvanzo
        ok
      • bitmap
        I tried ssh agent forwarding
      • yvanzo: I got it working with GIT_SSH_COMMAND='ssh -i ~/.ssh/docker_server_configs_key' git pull origin master
      • yvanzo
        👍
      • I'll try to fix the config still
      • lucifer
        mayhem: i am not sure that will work.
      • how do you want to query this table for instance
      • mayhem
        ah, yes. and each table is going to need different params.
      • if you can load these datasets on wolf, I can add the DSH and test.
      • bitmap
        yvanzo: I guess we have a separate deploy key on pink but not on floyd
      • lucifer
        sure i'll copy those to wolf.
      • yvanzo
        I checked deploy keys in the repo settings
      • mayhem
        thx
      • yvanzo
        bitmap: it seems that all websites are back already, making the announcement
      • bitmap
        yvanzo: yup
      • ty
      • monkey
        Smooth! Nicely done team
      • mayhem
        monkey: neptunes creators have been asked to add LB support, monkey
      • bitmap
        only took an extra 5 mins this time, not terrible
      • monkey
        Thx !
      • mayhem
        👏
      • bitmap
        mayhem: monkey: lucifer: you can restart any cron jobs that were stopped
      • mayhem leaves it to lucifer
      • yvanzo
        monkey: BB is back
      • monkey
        Yep, I checked as well, thanks :)
      • bitmap
        pink standby service is back, barman is running smoothly
      • yvanzo
        (I tweeted about it for MeB and MB only)
      • bitmap
        I restarted cron in json dump, search indexes dump, and production cron containers
      • lucifer
        done
      • (cron jobs)
      • rdswift has quit
      • bitmap
        thanks all
      • working on improving the pg cluster so that switchovers require less (possibly zero) downtime, still in the testing phase though
      • rdswift joined the channel
      • yvanzo
        !m bitmap
      • BrainzBot
        You're doing good work, bitmap!
      • mayhem
        monkey: rescrobbler scrobbles everything, even if it is playing on mobile.
      • but only, of course, if the desktop machine is not sleeping.
      • yvanzo
        bitmap: Found the problem with pink: the key was named docker_server_configs_key instead of the default id_rsa.
      • mayhem
        which leads to .. dups. sigh.
      • monkey
        Yep, that's what I was trying to point out
      • mayhem
        I was trying to ask you exactly this question. lol
      • monkey
        If you have spotify open on desktop with rescrobbler and also on mobile with LB app, you'll get two listens.
      • mayhem
        indeed.
      • monkey
        There's no real way to figure out which one is 'correct"
      • mayhem
        and the listens are not off by some seconds, but by minutes.
      • monkey
        That's the issue indeed where deduplication is concerned
      • mayhem
      • yvanzo
        bitmap: all other repositories have IdendityFile specified in ~/.ssh/config but docker-server-configs
      • monkey
        That is one of the reasons why I wouldn't suggest deprecating the spotify importer
      • mayhem
        I see that the desktop scrobbler and LB app have quite different timestamps as to when the track started playing.
      • yvanzo
        zas: is ~root/.ssh/config managed using ansible?
      • mayhem
        monkey: understood, but I think there is a discrepancy somewhere and when resolved, might fix this issue.
      • jasje
        mayhem: we record the initial play button hit timestamp
      • zas
        yvanzo: nope
      • mayhem
        huh. it seems that rescrobbler does this too.
      • ok, I'll dig into this tomorrow, but outta time for today.
      • akshaaatt
        Right
      • monkey
        Fix how mayhem? Because each scrobbling app might have a different mechanism to decide what the timestamp is
      • yvanzo
        zas: is it fine to keep using id_rsa identity file for cloning docker-server-config repo on hosts?
      • bitmap
        yvanzo: I think that may have been me
      • mayhem
        monkey: right now the duplicates seem to be off by the duration of the track. something is not right.
      • if both were working right, the differences in timestamps should be small.
      • bitmap
        at some point I wanted to separate the keys used for sshing between servers and the deploy keys for our private repos
      • mayhem
        seconds, not minutes.
      • monkey
        My point is that "working right" is vague :) Looks like rescrobbler chooses the end of the track as the listened_at timestamp maybe?
      • zas
        yvanzo: well, it would be better to use deploy keys I guess
      • yvanzo
        bitmap: which is great, and we should probably do for docker-server-configs repo too.
      • zas
      • yvanzo
        zas: it's a deploy key, just the default one
      • jasje
        mayhem: judging by the track_duration /2 and timestamp diff