bitmap: zas: I'm trying to debug https://github.com/alastair/python-musicbrainzngs…, I tried the url and once got a notification (in json) "unable to connect to db server" or similar - I've since been unable to reproduce it
2019-11-04 30811, 2019
alastairp
is it known that there is some kind of issue with webservice workers unable to connect to the db sometimes?
interesting, though nothing really new to me, we hardly have any TTL under 5-10 minutes, and only for records that may/have change. I'll review this and increasing TTLs if there's no reason for them to be low (most of the times we decreased those to help with hardware/network changes). And gandi doesn't let one set a ttl to values under 300.
2019-11-04 30829, 2019
ruaok
yeah, I wonder if some of our 5 minute TTLs should be moved up to 1hr.
ruaok, zas: i'm not too well informed but is it not possible to override the TTL manually?
2019-11-04 30849, 2019
ruaok
probably, but what impact would that have?
2019-11-04 30815, 2019
alastairp
SothoTalKer: we as owners of the domain set our own ttl, but occasionally we lower it (if for example we want to change it in the near future)
2019-11-04 30840, 2019
SothoTalKer
i mean you set a default long TTL, but in case there's a change you can issue a manual update or something?
2019-11-04 30818, 2019
alastairp
sure, you release a new version of the dns record with a new ttl
2019-11-04 30832, 2019
ruaok
if you need to changes it, you drop the TTL really low, wait for the previously high duration to expire, then move your services, wait for the shorter window to expire and then you can raise the TTL again.
2019-11-04 30832, 2019
alastairp
(but then you have to wait for the old ttl to expire before clients use the new one)
2019-11-04 30841, 2019
ruaok
in theory no one should notice the move.
2019-11-04 30842, 2019
alastairp
^ what he said :)
2019-11-04 30813, 2019
alastairp
btw, hello from ismir 2019
2019-11-04 30827, 2019
ruaok
in the netherlands, yes?
2019-11-04 30833, 2019
SothoTalKer
ok, one could automate that then. :)
2019-11-04 30840, 2019
alastairp
no chocolate table, no sticker table. these conferences could learn a few things from open source confs
2019-11-04 30844, 2019
alastairp
yes, in Delft
2019-11-04 30851, 2019
ruaok
ahh <3 delft.
2019-11-04 30802, 2019
ruaok
yes, why not start a chocolate table at ISMIR?
2019-11-04 30803, 2019
alastairp
old city is really cute
2019-11-04 30811, 2019
ruaok
barfingly cute, even.
2019-11-04 30830, 2019
ruaok
I have a good friend who lives literally on the edge of the market.
2019-11-04 30855, 2019
abhishekpanwar joined the channel
2019-11-04 30828, 2019
ruaok
The HiFiBerryOS folks just offered to ship us a sound card to try out -- I would love for this to replace my sonos system. :)
2019-11-04 30854, 2019
alastairp
reproduced the error with WS:
2019-11-04 30809, 2019
alastairp
this page returns http 200, so we try and parse it (as xml)
2019-11-04 30808, 2019
ruaok
I keep seeing this error being talked about, when it should be an easy fix -- our DB server isn't close to its limitations, why not add more connections. bitmap, can you clue me in as to why we're not doing this?
2019-11-04 30817, 2019
alastairp
regardless of the fix, it'd be great to see this returning xml and an error status code if possible (if the error is raised by the workers), I'll open a ticket for this
2019-11-04 30810, 2019
zas
ruaok: the real question is why do we even reach limits, it happens since we move to floyd.
2019-11-04 30838, 2019
ruaok
I think that problems has existed longer than that. LB hits it occasionally.
2019-11-04 30827, 2019
zas
can it be related to LB? we had issues on lemmy & floyd at the same time, and load on floyd temporarly attained very high values last weeks, it usually solves by itself after few minutes. But for sure it wasn't happening when master db was still on bowie. AFAIK, a lot of things changed on db side with the migration, mainly to have easier master/slave switch
2019-11-04 30842, 2019
ruaok
not sure -- could be. when I looked at that case, I noticed that the load on lemmy was high because of consul config changes being pushed.
2019-11-04 30855, 2019
ruaok
that causes all the containers to restart at the same time, causing a load spike.
2019-11-04 30808, 2019
ruaok
but the random out of connection errors have been around for a quite a long time.
2019-11-04 30800, 2019
zas
alastairp: at which UTC time did you get this error?
2019-11-04 30849, 2019
alastairp
zas: just before I pasted to you in PM, or 1-2 minutes earlier
2019-11-04 30841, 2019
Lotheric has quit
2019-11-04 30831, 2019
Lotheric joined the channel
2019-11-04 30838, 2019
abhishekpanwar has quit
2019-11-04 30849, 2019
abhishekpanwar joined the channel
2019-11-04 30815, 2019
abhishekpanwar
Mr_Monkey: BookBrainz will be part of GSOC 2020, right?
2019-11-04 30850, 2019
Mr_Monkey
Hi abhishekpanwar !
2019-11-04 30850, 2019
Mr_Monkey
We're not there yet, but it was a success this year so I don't see why not !
2019-11-04 30804, 2019
abhishekpanwar
Okay great!
2019-11-04 30832, 2019
abhishekpanwar has quit
2019-11-04 30835, 2019
CatQuest
Mr_Monkey: what about for gci? i would like to have some data entry tasks
2019-11-04 30835, 2019
CatQuest
maybe not a huge amount to start with but we have some "it's a lot harder to do duplicate artists" now
2019-11-04 30822, 2019
Mr_Monkey
CatQuest: I was going to do a lot less entry tasks myself compared to last year, but if you're up for doing *some*, yay ! :)
2019-11-04 30840, 2019
Mr_Monkey
I haven't reviewed the BB tasks yet but I can let you know as soon as that's done
2019-11-04 30808, 2019
Freso just realised we’re in a new month and should send it invoice… - may not get to that until after meeting :x
2019-11-04 30816, 2019
bitmap
ruaok: zas: we should bump max_client_conn at least (maybe from 400 to 500 to start?) though it'd also be great if we had some pgbouncer pool stats in graphana to see where/how we're hitting those limits, then we can tune them better
2019-11-04 30829, 2019
ruaok
moin bitmap. yes, that sounds like a great plan. how can zas collect stats?
2019-11-04 30802, 2019
ruaok
(zas is AFK for the rest of the day, so I am asking the questions that he would naturally ask :) )
2019-11-04 30846, 2019
bitmap
haha okay
2019-11-04 30832, 2019
bitmap
the way I see them is to connect to the 'pgbouncer' database on floyd and run 'show stats;' / 'show databases;'
2019-11-04 30818, 2019
bitmap
sorry, 'show pools;' not stats
2019-11-04 30806, 2019
antlarr joined the channel
2019-11-04 30804, 2019
ruaok
can you please do me a favor and make an MBH ticket for zas that summarizes this info and maybe add a couple of links for more info as well as noting which data values you'd like to see graphed?
2019-11-04 30830, 2019
ruaok
In particular, providing SQL queries that he can run on the command line would be super helpful, methinks.
bitmap: would it be possible to return this error in xml for the ws? (or at the very least return a non-200 status code?)
2019-11-04 30835, 2019
bitmap
yeah, the 200 status code is definitely a bug. I can look into having it return xml too
2019-11-04 30846, 2019
bitmap
can you add a ticket when you have time?
2019-11-04 30832, 2019
antlarr has quit
2019-11-04 30819, 2019
alastairp
yes, will do
2019-11-04 30820, 2019
alastairp
thanks
2019-11-04 30836, 2019
antlarr joined the channel
2019-11-04 30820, 2019
SothoTalKer
i do love the positiveness in here :-)
2019-11-04 30852, 2019
Mr_Monkey
ruaok: Gah. After some more digging, it might just be that the Spotify player will fail if we're not on https (localhost is considered secured so it'll work there too). That could also explain the inconcistent behaviour I've observe depending on where I was testing.
2019-11-04 30852, 2019
Mr_Monkey
Is it possible to put Odyssey on https, and if so could I ask you to do that (no rush ofc) please?
2019-11-04 30851, 2019
ruaok
Yeah, I can look at that tomorrow.
2019-11-04 30802, 2019
Mr_Monkey
(Spotify's player uses EME [Encrypted Media Extensions], which won't work on http)
Freso: alastairp and I were thinking about doing a classification task for AB for GCI. We would do something like ask them to choose 5 genres or classes from a set, and choose 10 or so recordings for each class. We can then use the classification later to build datasets. Does that seem like an appropriate task for GCI?
2019-11-04 30827, 2019
aidanlw17
(by
2019-11-04 30849, 2019
aidanlw17
(by "them" I mean each student)
2019-11-04 30815, 2019
alastairp
I'm away at a conference this week, so am not around much to discuss this, but should be able to reply to messages when I have spare time if you have any questions :)
2019-11-04 30818, 2019
alastairp
--> gone
2019-11-04 30807, 2019
aidanlw17
alastairp: Freso said we still aren't quite ready to add tasks anyways so I think that we can discuss when you get back. Just wanted to open the question while it's on my mind!
2019-11-04 30801, 2019
rdswift
aidanlw17, the only thing that I see that *might* be an issue is that assigning recordings to genres can be somewhat subjective.
2019-11-04 30820, 2019
CatQuest
true
2019-11-04 30841, 2019
CatQuest
but genres are genreally (:D) subjective anyway
2019-11-04 30807, 2019
rdswift
My point exactly. If the mentor has a different *opinion* of a genre, will they be asking the student to redo all or a portion of the task before marking it as complete?
2019-11-04 30854, 2019
CatQuest
if the opinnion is in what genre i'd say no
2019-11-04 30802, 2019
CatQuest
(unless it's obviously trolling)
2019-11-04 30833, 2019
CatQuest
ie beiber being death metal etc
2019-11-04 30821, 2019
rdswift
But to someone, perhaps Bieber *is* death metal. ;-)
2019-11-04 30822, 2019
aidanlw17
rdswift: alastairp can confirm, but I think the idea is that we get more assurance with multiple opinions. If we have multiple students placing tracks from the same artist in a genre, then we get a good idea that the artist fits there
2019-11-04 30834, 2019
CatQuest
nja. thne they gotta explain why i'd say
2019-11-04 30846, 2019
rdswift
aidanlw17, I see your point. If you're looking for data to analyze, then that's probably a good task, understanding that an individual piece of data could be "incorrect".
2019-11-04 30810, 2019
yvanzo joined the channel
2019-11-04 30812, 2019
SothoTalKer
look who's there (:
2019-11-04 30844, 2019
aidanlw17
rdswift: cool, thanks for the feedback! That's just the general idea of it, we'll have to make it more specific and clear
