15:07 PM
bitmap
ok
2023-05-29 14912, 2023
15:08 PM
bitmap
sigh, this update_mb_dbdefs_for_hosts.sh script is always broken
2023-05-29 14920, 2023
15:08 PM
bitmap
or I don't understand how it works
2023-05-29 14905, 2023
15:09 PM
akshaaatt
mayhem do let me know if you are able to submit listens. Keep in mind that we do need to improve the submitted data from the app though.
2023-05-29 14905, 2023
15:11 PM
mayhem
I'm not.
2023-05-29 14919, 2023
15:11 PM
mayhem
the last two track changes have not been recorded.
2023-05-29 14934, 2023
15:11 PM
akshaaatt
LB seems to be down
2023-05-29 14940, 2023
15:11 PM
akshaaatt
That could be an issue?
2023-05-29 14949, 2023
15:11 PM
mayhem
🤦
2023-05-29 14954, 2023
15:11 PM
akshaaatt
Lol
2023-05-29 14913, 2023
15:12 PM
mayhem
one shall not play with these toys during downtime, yes.
2023-05-29 14916, 2023
15:12 PM
mayhem
sorry akshaaatt .
2023-05-29 14931, 2023
15:12 PM
akshaaatt
It’s fine 😂😂
2023-05-29 14946, 2023
15:12 PM
bitmap
yvanzo: update_mb_dbdefs_for_hosts.sh is completely broken for me, it just reports "No matching containers on aphex." for every machine
2023-05-29 14954, 2023
15:12 PM
akshaaatt
We should maintain a local fb though.
2023-05-29 14906, 2023
15:13 PM
akshaaatt
Thanks for testing mayhem. We got a new ticket because of it
2023-05-29 14912, 2023
15:13 PM
akshaaatt
Db*
2023-05-29 14915, 2023
15:13 PM
yvanzo
bitmap: should I try it
2023-05-29 14921, 2023
15:13 PM
bitmap
yvanzo: yeah
2023-05-29 14924, 2023
15:13 PM
mayhem
lucifer: looking at the pop data now. what is the difference between those two queries?
2023-05-29 14937, 2023
15:13 PM
bitmap
yvanzo: I'm running it without any arguments because the args in the google doc didn't work
2023-05-29 14947, 2023
15:13 PM
mayhem
akshaaatt: I'll be doogfooding the LB app from now on. if it breaks, you'll hear from me, I promise. :)
2023-05-29 14959, 2023
15:13 PM
akshaaatt
Awesome! ⚡️⚡️
2023-05-29 14916, 2023
15:14 PM
bitmap
yvanzo: you have to edit the file to remove "sleep 30" first
2023-05-29 14902, 2023
15:15 PM
jasje
phew i was worried wtf did i do wrong glad the server is down (i mean not really)
2023-05-29 14923, 2023
15:15 PM
mayhem
2023-05-29 14926, 2023
15:15 PM
lucifer
mayhem: first one is popularity by total listen count, second by unique listener count.
2023-05-29 14930, 2023
15:15 PM
mayhem
should we reach out and ask about LB support?
2023-05-29 14952, 2023
15:15 PM
yvanzo
bitmap: it's skipped aphex and aretha as already up-to-date but it's now working for others, using arguments from the doc
2023-05-29 14900, 2023
15:16 PM
monkey
I saw that one, thought the same thing
2023-05-29 14901, 2023
15:16 PM
jasje
lucifer: understood!
2023-05-29 14910, 2023
15:16 PM
bitmap
yvanzo: OK, I guess it's just borked on macOS
2023-05-29 14922, 2023
15:16 PM
mayhem
lucifer: hard to evaluate like this, but it seems ok.
2023-05-29 14927, 2023
15:16 PM
bitmap
I merged the gsed PR already
2023-05-29 14932, 2023
15:16 PM
bitmap
so must be something else
2023-05-29 14932, 2023
15:16 PM
mayhem
would be good to put up on DSH
2023-05-29 14941, 2023
15:16 PM
lucifer
mayhem: there is artist, release, recording data available as well
2023-05-29 14944, 2023
15:16 PM
monkey
But it's limited too, same as other ones I've seen:
2023-05-29 14944, 2023
15:16 PM
monkey
>automatically detect currently playing music from Apple Music or Spotify
2023-05-29 14957, 2023
15:16 PM
yvanzo
bitmap: it stopped on patton, now restarting
2023-05-29 14905, 2023
15:17 PM
mayhem
packed with radiohead, and RHCP, the data is likely ok, lucifer
2023-05-29 14911, 2023
15:17 PM
lucifer
i didn't put it on dsh because not sure what params to accept.
2023-05-29 14926, 2023
15:17 PM
mayhem
what params?
2023-05-29 14933, 2023
15:17 PM
jasje
mayhem: to record any app in the listening apps list, just play one or two songs.
2023-05-29 14935, 2023
15:17 PM
mayhem
monkey: better than nada.
2023-05-29 14940, 2023
15:17 PM
yvanzo
bitmap: did you update your local working copy of server conf?
2023-05-29 14946, 2023
15:17 PM
jasje
force shutting isn’t necessary
2023-05-29 14952, 2023
15:17 PM
lucifer
top recordings is a mbid with two listen counts.
2023-05-29 14955, 2023
15:17 PM
bitmap
yvanzo: yeah
2023-05-29 14902, 2023
15:18 PM
bitmap
I'm on 6132bf00b231308de41be93da2364c7e5dd9e690
2023-05-29 14912, 2023
15:18 PM
mayhem
jasje: I think the problem is with LB being down. but likely it works now. I'll check once LB is up.
2023-05-29 14929, 2023
15:18 PM
jasje
doesn’t matter if LB is up or no
2023-05-29 14938, 2023
15:18 PM
yvanzo
bitmap: Sometimes it's also stopping with "Host key verification failed. fatal: Could not read from remote repository."
2023-05-29 14939, 2023
15:18 PM
lucifer
2023-05-29 14947, 2023
15:18 PM
jasje
listening apps will show regardless
2023-05-29 14952, 2023
15:18 PM
lucifer
all of this is available.
2023-05-29 14902, 2023
15:19 PM
yvanzo
bitmap: done
2023-05-29 14909, 2023
15:19 PM
bitmap
thanks
2023-05-29 14928, 2023
15:19 PM
mayhem
jasje: yes, I can see the LB app knowing the current playing now track.
2023-05-29 14930, 2023
15:19 PM
akshaaatt
jasje those are showing for him.
2023-05-29 14947, 2023
15:19 PM
yvanzo
bitmap: was json-dump not included at purpose?
2023-05-29 14949, 2023
15:19 PM
akshaaatt
The issue is only with the submissions currently
2023-05-29 14925, 2023
15:20 PM
jasje
oh then its okay. looks like i read an older convo
2023-05-29 14930, 2023
15:20 PM
mayhem
lucifer: why dont we have make one DSH query and then have an extra param that tells which table to use. then list the available tables in the desc for the query.
2023-05-29 14932, 2023
15:20 PM
bitmap
services should be coming back now
2023-05-29 14958, 2023
15:20 PM
mayhem
(and please add the available tables for recording and artists similarity while you're at it)
2023-05-29 14911, 2023
15:21 PM
mayhem
oh, LB must be back. listen arrived. :)
2023-05-29 14912, 2023
15:21 PM
bitmap
yvanzo: that looks like an oversight
2023-05-29 14919, 2023
15:21 PM
yvanzo
okay, updating it now
2023-05-29 14929, 2023
15:21 PM
bitmap
apparently if you run the script without any arguments it should update all containers on all hosts?
2023-05-29 14932, 2023
15:21 PM
akshaaatt high fives mayhem
2023-05-29 14932, 2023
15:21 PM
mayhem
jasje: akshaaatt: all sorted, thank you!
2023-05-29 14938, 2023
15:21 PM
yvanzo
bitmap: yes
2023-05-29 14912, 2023
15:22 PM
yvanzo
done
2023-05-29 14926, 2023
15:22 PM
jasje
yay!
2023-05-29 14932, 2023
15:22 PM
bitmap
yvanzo: ty
2023-05-29 14948, 2023
15:22 PM
bitmap
I'll restore standby service on pink now
2023-05-29 14906, 2023
15:24 PM
bitmap
yvanzo: can you pull docker-server-configs on pink? now that's not working lol
2023-05-29 14913, 2023
15:24 PM
yvanzo
ok
2023-05-29 14946, 2023
15:24 PM
bitmap
I tried ssh agent forwarding
2023-05-29 14945, 2023
15:27 PM
bitmap
yvanzo: I got it working with GIT_SSH_COMMAND='ssh -i ~/.ssh/docker_server_configs_key' git pull origin master
2023-05-29 14955, 2023
15:27 PM
yvanzo
👍
2023-05-29 14917, 2023
15:28 PM
yvanzo
I'll try to fix the config still
2023-05-29 14924, 2023
15:28 PM
lucifer
mayhem: i am not sure that will work.
2023-05-29 14916, 2023
15:29 PM
lucifer
2023-05-29 14929, 2023
15:29 PM
lucifer
how do you want to query this table for instance
2023-05-29 14902, 2023
15:30 PM
mayhem
ah, yes. and each table is going to need different params.
2023-05-29 14936, 2023
15:30 PM
mayhem
if you can load these datasets on wolf, I can add the DSH and test.
2023-05-29 14948, 2023
15:30 PM
bitmap
yvanzo: I guess we have a separate deploy key on pink but not on floyd
2023-05-29 14913, 2023
15:31 PM
lucifer
sure i'll copy those to wolf.
2023-05-29 14916, 2023
15:31 PM
yvanzo
I checked deploy keys in the repo settings
2023-05-29 14921, 2023
15:31 PM
mayhem
thx
2023-05-29 14957, 2023
15:32 PM
yvanzo
bitmap: it seems that all websites are back already, making the announcement
2023-05-29 14903, 2023
15:33 PM
bitmap
yvanzo: yup
2023-05-29 14907, 2023
15:33 PM
bitmap
ty
2023-05-29 14945, 2023
15:33 PM
monkey
Smooth! Nicely done team
2023-05-29 14914, 2023
15:36 PM
mayhem
monkey: neptunes creators have been asked to add LB support, monkey
2023-05-29 14929, 2023
15:36 PM
bitmap
only took an extra 5 mins this time, not terrible
2023-05-29 14932, 2023
15:36 PM
monkey
Thx !
2023-05-29 14938, 2023
15:36 PM
mayhem
👏
2023-05-29 14942, 2023
15:36 PM
bitmap
mayhem: monkey: lucifer: you can restart any cron jobs that were stopped
2023-05-29 14929, 2023
15:37 PM
mayhem leaves it to lucifer
2023-05-29 14945, 2023
15:37 PM
yvanzo
monkey: BB is back
2023-05-29 14955, 2023
15:37 PM
monkey
Yep, I checked as well, thanks :)
2023-05-29 14924, 2023
15:38 PM
bitmap
pink standby service is back, barman is running smoothly
2023-05-29 14924, 2023
15:38 PM
yvanzo
(I tweeted about it for MeB and MB only)
2023-05-29 14938, 2023
15:38 PM
bitmap
I restarted cron in json dump, search indexes dump, and production cron containers
2023-05-29 14949, 2023
15:38 PM
lucifer
done
2023-05-29 14957, 2023
15:38 PM
lucifer
(cron jobs)
2023-05-29 14928, 2023
15:42 PM
rdswift has quit
2023-05-29 14949, 2023
15:42 PM
bitmap
thanks all
2023-05-29 14915, 2023
15:43 PM
bitmap
working on improving the pg cluster so that switchovers require less (possibly zero) downtime, still in the testing phase though
2023-05-29 14959, 2023
15:46 PM
rdswift joined the channel
2023-05-29 14927, 2023
15:47 PM
yvanzo
!m bitmap
2023-05-29 14927, 2023
15:47 PM
BrainzBot
You're doing good work, bitmap!
2023-05-29 14923, 2023
15:48 PM
mayhem
monkey: rescrobbler scrobbles everything, even if it is playing on mobile.
2023-05-29 14936, 2023
15:48 PM
mayhem
but only, of course, if the desktop machine is not sleeping.
2023-05-29 14939, 2023
15:48 PM
yvanzo
bitmap: Found the problem with pink: the key was named docker_server_configs_key instead of the default id_rsa.
2023-05-29 14942, 2023
15:48 PM
mayhem
which leads to .. dups. sigh.
2023-05-29 14951, 2023
15:48 PM
monkey
Yep, that's what I was trying to point out
2023-05-29 14907, 2023
15:49 PM
mayhem
I was trying to ask you exactly this question. lol
2023-05-29 14922, 2023
15:49 PM
monkey
If you have spotify open on desktop with rescrobbler and also on mobile with LB app, you'll get two listens.
2023-05-29 14933, 2023
15:49 PM
mayhem
indeed.
2023-05-29 14943, 2023
15:49 PM
monkey
There's no real way to figure out which one is 'correct"
2023-05-29 14948, 2023
15:49 PM
mayhem
and the listens are not off by some seconds, but by minutes.
2023-05-29 14902, 2023
15:50 PM
monkey
That's the issue indeed where deduplication is concerned
2023-05-29 14907, 2023
15:50 PM
mayhem
2023-05-29 14909, 2023
15:50 PM
yvanzo
bitmap: all other repositories have IdendityFile specified in ~/.ssh/config but docker-server-configs
2023-05-29 14927, 2023
15:50 PM
monkey
That is one of the reasons why I wouldn't suggest deprecating the spotify importer
2023-05-29 14942, 2023
15:50 PM
mayhem
I see that the desktop scrobbler and LB app have quite different timestamps as to when the track started playing.
2023-05-29 14946, 2023
15:50 PM
yvanzo
zas: is ~root/.ssh/config managed using ansible?
2023-05-29 14908, 2023
15:51 PM
mayhem
monkey: understood, but I think there is a discrepancy somewhere and when resolved, might fix this issue.
2023-05-29 14908, 2023
15:51 PM
jasje
mayhem: we record the initial play button hit timestamp
2023-05-29 14936, 2023
15:51 PM
zas
yvanzo: nope
2023-05-29 14949, 2023
15:51 PM
mayhem
huh. it seems that rescrobbler does this too.
2023-05-29 14959, 2023
15:51 PM
mayhem
ok, I'll dig into this tomorrow, but outta time for today.
2023-05-29 14901, 2023
15:52 PM
akshaaatt
Right
2023-05-29 14902, 2023
15:52 PM
monkey
Fix how mayhem? Because each scrobbling app might have a different mechanism to decide what the timestamp is
2023-05-29 14939, 2023
15:52 PM
yvanzo
zas: is it fine to keep using id_rsa identity file for cloning docker-server-config repo on hosts?
2023-05-29 14956, 2023
15:52 PM
bitmap
yvanzo: I think that may have been me
2023-05-29 14900, 2023
15:53 PM
mayhem
monkey: right now the duplicates seem to be off by the duration of the track. something is not right.
2023-05-29 14917, 2023
15:53 PM
mayhem
if both were working right, the differences in timestamps should be small.
2023-05-29 14919, 2023
15:53 PM
bitmap
at some point I wanted to separate the keys used for sshing between servers and the deploy keys for our private repos
2023-05-29 14921, 2023
15:53 PM
mayhem
seconds, not minutes.
2023-05-29 14949, 2023
15:53 PM
monkey
My point is that "working right" is vague :) Looks like rescrobbler chooses the end of the track as the listened_at timestamp maybe?
2023-05-29 14950, 2023
15:53 PM
zas
yvanzo: well, it would be better to use deploy keys I guess
2023-05-29 14958, 2023
15:53 PM
yvanzo
bitmap: which is great, and we should probably do for docker-server-configs repo too.
2023-05-29 14920, 2023
15:54 PM
zas
2023-05-29 14926, 2023
15:54 PM
yvanzo
zas: it's a deploy key, just the default one
2023-05-29 14930, 2023
15:54 PM
jasje
mayhem: judging by the track_duration /2 and timestamp diff
