A really clear example of comboing various playlists
2023-05-22 14246, 2023
jivte joined the channel
2023-05-22 14220, 2023
jivte has quit
2023-05-22 14250, 2023
jivte joined the channel
2023-05-22 14247, 2023
jivte has quit
2023-05-22 14255, 2023
q3lont joined the channel
2023-05-22 14204, 2023
q3lont has quit
2023-05-22 14225, 2023
Pokey has quit
2023-05-22 14244, 2023
Pokey joined the channel
2023-05-22 14205, 2023
Maxr1998 has quit
2023-05-22 14221, 2023
Maxr1998_ joined the channel
2023-05-22 14237, 2023
v6lur joined the channel
2023-05-22 14238, 2023
zas
bitmap: after I blocked lidarr-extended UA, we didn't get any issue. It was around 3k queries per minute, and 25% of them were for recordings of [unknown] artist (well, parts of it, since they are using offset)
2023-05-22 14210, 2023
zas
not sure what to do from here, I think we should suggest app's author to use its own mirrors. But it doesn't solve the core issue, which is high load on main db due to those specific queries, is there room for improvement in this field?
2023-05-22 14240, 2023
zas
bitmap, yvanzo, lucifer, mayhem: we have to reboot servers to ensure docker upgrades are fully applied. After investigation it happens recent upgrades to latest major docker version didn't play well with live-restore (it is documented, live restore behavior is only guaranteed for minor versions upgrades).
2023-05-22 14229, 2023
zas
with atj, we'll change the Ansible config to prevent such issue in the future.
2023-05-22 14211, 2023
zas
I'll start with few servers that are not critical, but ofc we need to plan a (short) downtime for critical ones. A reboot isn't strictly needed, but safer, and it will also apply kernel changes.
Having dinner now, but will be back on the compy later for other work, so might catch you if you’re around
2023-05-22 14259, 2023
petitminion joined the channel
2023-05-22 14215, 2023
zas
rebooting aphex
2023-05-22 14242, 2023
zas
done
2023-05-22 14234, 2023
zas
rebooting ludwig
2023-05-22 14201, 2023
reosarevok
Hmm
2023-05-22 14204, 2023
zas
morning reo
2023-05-22 14211, 2023
zas
ludwig rebooted
2023-05-22 14227, 2023
reosarevok
I wonder if [unknown] is our entity with the most recordings. It might be the case
2023-05-22 14239, 2023
reosarevok
1700 pages is a lot
2023-05-22 14202, 2023
zas
yes, and requests are done over and over from different IPs
2023-05-22 14217, 2023
reosarevok
Not sure how much can be done to speed it up though, in the sense that those recordings probably *do* belong there...
2023-05-22 14220, 2023
zas
because each user has its own instance (that's a docker image)
2023-05-22 14214, 2023
reosarevok
Is the problem that they're all hitting at the same time of day again?
2023-05-22 14227, 2023
reosarevok
Because I assume one or two at random times wouldn't be a big issue
2023-05-22 14206, 2023
zas
not really, hits come every few seconds, I didn't notice "peaks"
2023-05-22 14218, 2023
reosarevok
Hmm
2023-05-22 14246, 2023
reosarevok
And they're otherwise legit hits which respect waiting times and whatnot, but there's still so many of them that they cause issues?
2023-05-22 14255, 2023
zas
yes
2023-05-22 14205, 2023
reosarevok
Or is it a small amount at a time but our query is so unperformant it causes issues?
2023-05-22 14215, 2023
zas
a bit of both I think
2023-05-22 14233, 2023
zas
heavy queries crossed with high number of hits
2023-05-22 14234, 2023
reosarevok
I mean
2023-05-22 14237, 2023
reosarevok
"Lidarr is a music collection manager for Usenet and BitTorrent users"
2023-05-22 14252, 2023
reosarevok
suggests that probably this is all useless for them too
2023-05-22 14206, 2023
reosarevok
Since I doubt someone is specifically caring whether there's new and exciting [unknown] music
2023-05-22 14241, 2023
zas
I didn't look at their code, but yes, somehow the same problem as QNAP, useless queries, many users
2023-05-22 14208, 2023
reosarevok
And it's a new issue, right? Wonder if it's a recent code change, or just a lot of new users
2023-05-22 14210, 2023
aerozol
I've thought about setting up Lidarr, you can set rules to download stuff automatically, that you don't have yet, from artists you set. No idea why that extension would settle query [unknown]...
2023-05-22 14236, 2023
reosarevok
I would of course happily block the whole thing on grounds that it's clearly just a pirate tool anyway
2023-05-22 14242, 2023
reosarevok
But 🤷♂️
2023-05-22 14218, 2023
zas
reosarevok: not really new, there are hitting us since a while, but for some reason, we reached a point where it becomes a problem. I didn't investigate details, just identified the main source, blocked, in order to preserve services for other users over the week-end.
2023-05-22 14219, 2023
mayhem
if we're getting too much traffic from lidarr or if the queries are BS, let me know and I'll go back to complain to them.
2023-05-22 14224, 2023
aerozol
Lidarr is a pretty big source of editors for us, as it uses MB exclusively afaik
2023-05-22 14240, 2023
reosarevok
mayhem: it's an extension apparently, not lidarr itself
aerozol: of pirate editors, yes. I find it hard to care for someone who still pirates hardcore in the era of affordable streaming tbh
2023-05-22 14239, 2023
reosarevok
I mean, I get "I can't afford music so I download some stuff from artists I love", but this is "I automate piracy at a massive scale2 :p
2023-05-22 14201, 2023
mayhem
ah, that's better. but still, if there is a complaint you'd like me to pass along to lidarr, who might be able to put pressure on the plugin devs.
2023-05-22 14215, 2023
zas
reosarevok: totally agree, that said, it reveals a weakness in our web services, and a more legit tool would have caused the same issue
2023-05-22 14218, 2023
aerozol
reosarevok: I find it hard to respect people who use sites like Spotify to destroy artists but still feel fine about it, because huge behemoth
2023-05-22 14248, 2023
mayhem
aerozol: reosarevok : covering the two sides of this argument perfectly.
2023-05-22 14251, 2023
reosarevok
At least that involves *some* money getting to the artist, not saying it's great, but it's clearly not worse than piracy :)
2023-05-22 14231, 2023
reosarevok
Not that it matters anyway, soon I expect Spotify will be full of AI-generated artists by major labels (or Spotify itself) so they can get the listens without having a pesky artist to manage and pay
2023-05-22 14234, 2023
aerozol
If someone using Lidarr buys one t-shirt they've paid more to musicians than my partner will have in a decade of Spotify use
2023-05-22 14256, 2023
reosarevok
Of course. Just you don't need to use Lidarr for that :D
2023-05-22 14257, 2023
mayhem
amen
2023-05-22 14201, 2023
aerozol
I'm not saying stealing is good... It's just complicated
2023-05-22 14241, 2023
reosarevok
I mean, I assume superfans who stream also buy merch, and they're probably unlikely to buy more merch because they use Lidarr instead
2023-05-22 14243, 2023
reosarevok
But eh
2023-05-22 14251, 2023
yvanzo
O’Moin
2023-05-22 14200, 2023
reosarevok
musicbrainzArtistRecordings=$(curl -s -A "$agent" "$musicbrainzMirror/ws/2/recording?artist=$lidarrArtistMusicbrainzId&limit=1&offset=0&fmt=json")
2023-05-22 14204, 2023
reosarevok
That doesn't have the includes...
2023-05-22 14210, 2023
reosarevok
Wonder where they call this
2023-05-22 14237, 2023
reosarevok
zas: agreed re: a more legit tool, I just wonder if any tool, legit or not, has a real use case for repeatedly requesting [unknown], lol
