1:10 AM
Sciencentistguy8 joined the channel
2023-06-15 16605, 2023
1:13 AM
Sciencentistguy has quit
2023-06-15 16605, 2023
1:13 AM
Sciencentistguy8 is now known as Sciencentistguy
2023-06-15 16606, 2023
1:55 AM
Pokey has quit
2023-06-15 16623, 2023
1:55 AM
Pokey joined the channel
2023-06-15 16615, 2023
2:01 AM
wargreen has quit
2023-06-15 16651, 2023
4:05 AM
trolley has quit
2023-06-15 16626, 2023
4:07 AM
trolley joined the channel
2023-06-15 16600, 2023
5:44 AM
reosarevok
mayhem: ignoring the Russian talking about some account in dig.tv (which does not even exist)
2023-06-15 16636, 2023
5:45 AM
reosarevok
aerozol: if you make me the svg and png icons I can implement the pencil for testing
2023-06-15 16641, 2023
6:50 AM
vfosnar
hey guys, I have a question. I'm working on a bot that indexes Genius and links Genius artists to MBZ artists. Is it really not possible to update artist relationships through the API?
2023-06-15 16638, 2023
7:11 AM
q3lont joined the channel
2023-06-15 16611, 2023
7:52 AM
atj
2023-06-15 16609, 2023
8:21 AM
zas
2023-06-15 16629, 2023
8:28 AM
q3lont has quit
2023-06-15 16612, 2023
8:42 AM
dravadhis
mayhem lucifer Hi! Apologies for the delay. Got caught up in a lot of (inescapable (-_-;)) things...Coming to the point. First, I integrated lbserver with ClickHouse. It's able to consume messages from rabbitmq (those which are triggered by submitting listens). Msgs are generated in incoming queue, send to timescale, timescale deduplicates them and publishes to unique and clickhouse consumes those msgs using a bridge to the unique. The
2023-06-15 16612, 2023
8:42 AM
dravadhis
msgs are stored in the required table while preserving the structure of the JSON messages.
2023-06-15 16612, 2023
8:42 AM
dravadhis
Second, to test the querying speed, I made another db inside clickhouse and imported all the incremental dumps (from 15-05-23 to 15-06-23) in a table inside the db. I executed some queries and got some responses. I cannot tell whether the responses were fast or slow since my machine froze for the major duration of the execution. Maybe accurate testing can only be done with better hardware.
2023-06-15 16612, 2023
8:42 AM
dravadhis
TL;DR clickhouse is able to ingest submitted listens via rabbitmq, and speed testing requires better hardware.
2023-06-15 16627, 2023
9:12 AM
atj
zas: probably worth strace'ing the process if it happens again
2023-06-15 16631, 2023
9:19 AM
mayhem
dravadhis: hi! sounds interesting -- and yes I bet ram is they key here. Do you have some code lucifer and I can look at and see how we can test this better?
2023-06-15 16658, 2023
9:27 AM
dravadhis
We can use a structured approach and define the sub-columns (track_metadata.*) beforehand but then we'll have to know upfront all the possible fields and their types.
2023-06-15 16602, 2023
9:28 AM
dravadhis posted a file: (2KiB) < https://libera.ems.host/_matrix/media/v3/download/matrix.org/FKZAdSBMkVQkkaUxjYLdxreW/track_metadata_schema_infered.txt >
2023-06-15 16602, 2023
9:28 AM
dravadhis
Actually this is cleaner
2023-06-15 16602, 2023
9:38 AM
zas
atj: I did (an strace), saved as strace.out on rex /root, I'll send it to them once I have time
2023-06-15 16637, 2023
10:12 AM
ApeKattQuest
ftr about reddit: apparently not even if you are a memeber cna you access "private" ones. i'mm a member of the lupinthe3rd sub and i can't access it becasue "not an approved member" apparently. evne if i replied to many posts and had discussions :/
2023-06-15 16637, 2023
10:14 AM
ApeKattQuest
so i dunno how it even works
2023-06-15 16617, 2023
10:25 AM
rain0r2 has quit
2023-06-15 16628, 2023
10:25 AM
rain0r joined the channel
2023-06-15 16644, 2023
10:28 AM
rdswift has quit
2023-06-15 16646, 2023
10:30 AM
Pratha-Fish has quit
2023-06-15 16655, 2023
10:30 AM
Pratha-Fish joined the channel
2023-06-15 16659, 2023
11:21 AM
vfosnar
<atj> "Vojtěch Fošnár ⚡️: no, you..." <- ah, thanks
2023-06-15 16616, 2023
11:30 AM
shivam_ has quit
2023-06-15 16624, 2023
11:30 AM
shivam_ joined the channel
2023-06-15 16654, 2023
11:50 AM
atj
2023-06-15 16612, 2023
12:21 PM
qookie has quit
2023-06-15 16613, 2023
12:21 PM
Arsen has quit
2023-06-15 16633, 2023
12:22 PM
zas
atj: great, work in progress of course, but I think that's the right approach at this stage
2023-06-15 16637, 2023
12:23 PM
zas
btw, we can perhaps deploy an test env on hetzner next week, to be close to production (access to consul cluster, and to backends)
2023-06-15 16658, 2023
12:26 PM
Arsen joined the channel
2023-06-15 16659, 2023
12:26 PM
qookie joined the channel
2023-06-15 16603, 2023
12:38 PM
reosarevok
2023-06-15 16616, 2023
13:10 PM
atj
2023-06-15 16616, 2023
13:11 PM
reosarevok
Hmm. I wasn't, but mostly because I forgot about it tbh
2023-06-15 16621, 2023
13:11 PM
reosarevok
I can't see a reason why we shouldn't
2023-06-15 16625, 2023
13:11 PM
reosarevok
bitmap, aerozol ^ ?
2023-06-15 16605, 2023
13:14 PM
atj
unless the "info" icon is also used for reasons other than pending edits I don't see why it can't be consistent
2023-06-15 16627, 2023
13:15 PM
reosarevok
Yeah, agreed - I don't think there's any reason other than "this is older than that icon" :)
2023-06-15 16608, 2023
13:16 PM
reosarevok
My only doubt is whether there can be a point where the same icon appears for entity edits *and* AC edits side by side
2023-06-15 16622, 2023
13:16 PM
reosarevok
In which case we could have a third icon in the same vein but with like an artist icon and the clock :D
2023-06-15 16625, 2023
13:16 PM
reosarevok
But hopefully not
2023-06-15 16604, 2023
13:17 PM
atj
i was wondering if there was a reason it has a proper tooltip
2023-06-15 16610, 2023
13:19 PM
mayhem
arsh: hi! I was hoping to see the work you've done so far. do you have any thing for me to look at?
2023-06-15 16655, 2023
13:24 PM
reosarevok
atj: the new icons will *also* have a tooltop
2023-06-15 16658, 2023
13:24 PM
reosarevok
*tooltip
2023-06-15 16603, 2023
13:25 PM
reosarevok
To point to the actual edits, which is useful
2023-06-15 16615, 2023
13:25 PM
atj
ooh, shiny
2023-06-15 16618, 2023
13:36 PM
arsh
Hi mayhem: Sorry I forgot to post the link that day due to the endpoint not working.
2023-06-15 16627, 2023
13:36 PM
arsh
2023-06-15 16636, 2023
13:38 PM
arsh
I believe the link is too long please let me know if you can access it or I can try something to shorten it
2023-06-15 16653, 2023
13:38 PM
mayhem
its working, thanks
2023-06-15 16619, 2023
13:40 PM
mayhem
i see the graph, pretty simple so far. is there anything I can do with it yet?
2023-06-15 16646, 2023
13:40 PM
arsh
Did you try clicking any of the nodes
2023-06-15 16602, 2023
13:41 PM
mayhem
clearly not. ;)
2023-06-15 16610, 2023
13:41 PM
arsh
It should present a new graph with that artist at the center
2023-06-15 16631, 2023
13:41 PM
mayhem
it does -- its fun already. :)
2023-06-15 16643, 2023
13:41 PM
ApeKattQuest
should Inandout be merged with I.A.O. then?
2023-06-15 16631, 2023
13:42 PM
mayhem
arsh: any way I can give it a seed artist?
2023-06-15 16614, 2023
13:43 PM
arsh
I am trying to make that work currently
2023-06-15 16620, 2023
13:43 PM
arsh
but I can add from my end
2023-06-15 16633, 2023
13:43 PM
arsh
Do you have any artist in mind
2023-06-15 16658, 2023
13:43 PM
mayhem
8f6bd1e4-fbe1-4f50-aa9b-94c450ec0f11 please
2023-06-15 16613, 2023
13:45 PM
arsh
Just a moment
2023-06-15 16623, 2023
13:49 PM
arsh
For some reason its creating a new branch and not updating the main
2023-06-15 16639, 2023
13:49 PM
arsh
So if you can please go to this link in the meantime
2023-06-15 16644, 2023
13:49 PM
arsh
2023-06-15 16636, 2023
13:50 PM
mayhem
there, what should I do?
2023-06-15 16655, 2023
13:51 PM
arsh
Ok I see there should be an option to change branches
2023-06-15 16603, 2023
13:52 PM
arsh
Near the middle on the top
2023-06-15 16644, 2023
13:52 PM
mayhem
yes. which branch?
2023-06-15 16657, 2023
13:52 PM
arsh
tender-keller
2023-06-15 16649, 2023
13:53 PM
mayhem
it not letting me access the page anymore.
2023-06-15 16650, 2023
13:53 PM
mayhem
Unable to access this workspace
2023-06-15 16619, 2023
13:54 PM
arsh
Ok just a moment let me see whats wrong
2023-06-15 16603, 2023
14:04 PM
arsh
Can you please try this link
2023-06-15 16609, 2023
14:04 PM
arsh
2023-06-15 16637, 2023
14:04 PM
arsh
For some reason codesandbox was not syncing with my github. Sorry about that
2023-06-15 16625, 2023
14:05 PM
mayhem
ok, cool that works.
2023-06-15 16646, 2023
14:05 PM
mayhem
it would be really nice to be able to visually show the strength of the relationship between artists.
2023-06-15 16657, 2023
14:05 PM
mayhem
right now they all appear more or less equal.
2023-06-15 16612, 2023
14:06 PM
arsh
Sure
2023-06-15 16635, 2023
14:06 PM
arsh
I believe we can make the first few artists appear closer
2023-06-15 16612, 2023
14:07 PM
arsh
Should I also limit the number of artists as well because 100 seems a little overwhelming and slows down the process
2023-06-15 16632, 2023
14:07 PM
mayhem
agreed. lets start with 15-25 and see how that looks.
2023-06-15 16644, 2023
14:07 PM
mayhem
we may need to normalize the scale of the artists too.
2023-06-15 16625, 2023
14:08 PM
arsh
Sure thing I will limit the artists
2023-06-15 16651, 2023
14:08 PM
arsh
I am sorry if can explain what scale means
2023-06-15 16603, 2023
14:11 PM
arsh
Does scale mean the number of similar artists displayed for an artist?
2023-06-15 16616, 2023
14:12 PM
mayhem
2023-06-15 16625, 2023
14:12 PM
mayhem
take a look at the score field for this artist.
2023-06-15 16606, 2023
14:13 PM
mayhem
zas: reosarevok I am getting read timeout on search on
mb.org !
2023-06-15 16613, 2023
14:13 PM
mayhem
sporadic
2023-06-15 16600, 2023
14:14 PM
mayhem
2023-06-15 16616, 2023
14:14 PM
arsh
So the score field should be normalized across artists?
2023-06-15 16620, 2023
14:14 PM
mayhem
arsh: given these two artists (portishead, blümchen) they have different ranges of the score field.
2023-06-15 16629, 2023
14:14 PM
mayhem
higher score means more similar.
2023-06-15 16647, 2023
14:14 PM
mayhem
arsh: yes, I think that may be needed for this to look right.
2023-06-15 16623, 2023
14:15 PM
arsh
Ok I understand
2023-06-15 16636, 2023
14:15 PM
mayhem
👍
2023-06-15 16605, 2023
14:16 PM
arsh
Basically the strength should be based on the scores
2023-06-15 16631, 2023
14:16 PM
arsh
Sure I will start and work on that
2023-06-15 16646, 2023
14:16 PM
arsh
Do you have any other suggestions in mind
2023-06-15 16600, 2023
14:17 PM
reosarevok
mayhem: search timeouts out sporadically, if that's what you mean
2023-06-15 16602, 2023
14:17 PM
reosarevok
It is known
2023-06-15 16608, 2023
14:17 PM
reosarevok
Not sure exactly why tho
2023-06-15 16610, 2023
14:17 PM
mayhem
reosarevok: ok.
2023-06-15 16627, 2023
14:17 PM
mayhem
arsh: another suggestion is to have fewer bubble and to put the artist name inside the bubble.
2023-06-15 16651, 2023
14:17 PM
mayhem
having to mouse over a bubble to find out what artist it is, makes this much less compelling.
2023-06-15 16620, 2023
14:18 PM
mayhem
we should have fewer bubbles, but with text. perhaps with the use of ellipsis ...
2023-06-15 16635, 2023
14:19 PM
arsh
Sure I will work on this feedback and keep you updated
2023-06-15 16640, 2023
14:19 PM
arsh
Thanks for your help
2023-06-15 16623, 2023
14:24 PM
mayhem
np
2023-06-15 16651, 2023
14:25 PM
zas
mayhem: we had high load on certain solr nodes again, sir search.retry queue isn't emptied
2023-06-15 16627, 2023
14:26 PM
mayhem
ok
2023-06-15 16633, 2023
14:26 PM
mayhem
just making sure you knew.
2023-06-15 16649, 2023
14:26 PM
zas
solr response time is very bad atm, but I have no idea why
2023-06-15 16620, 2023
14:28 PM
zas
2023-06-15 16630, 2023
14:50 PM
zas
I'm restarting each solr instance in the cluster, one by one
2023-06-15 16613, 2023
15:01 PM
q3lont joined the channel
2023-06-15 16606, 2023
15:26 PM
zas
solr issues seem to be fixed now, there were a high number of threads and tcp open connections on half of the nodes, apparently stuck
2023-06-15 16653, 2023
15:38 PM
reosarevok
bitmap: perl reminder
2023-06-15 16600, 2023
15:39 PM
reosarevok
2023-06-15 16632, 2023
15:39 PM
reosarevok
I know %opts will expand to take any comma-separated things after the expected params, but is (stuff) equivalent to just stuff?
2023-06-15 16649, 2023
15:39 PM
bitmap
yeah
2023-06-15 16619, 2023
15:41 PM
bitmap
(override_privs => 1), foo => 2 will even be merged into the same hash
2023-06-15 16622, 2023
15:43 PM
reosarevok
Sneaky
2023-06-15 16608, 2023
16:00 PM
reosarevok
2023-06-15 16634, 2023
16:00 PM
q3lont has quit
2023-06-15 16634, 2023
16:04 PM
rdswift joined the channel
2023-06-15 16601, 2023
16:05 PM
bitmap
thanks!
2023-06-15 16641, 2023
16:05 PM
bitmap
2023-06-15 16616, 2023
16:08 PM
BrainzGit
2023-06-15 16630, 2023
16:09 PM
reosarevok
2023-06-15 16609, 2023
16:12 PM
bitmap
do you want me to focus on reviewing these first?
2023-06-15 16603, 2023
16:15 PM
reosarevok
Pratha-Fish: are you available tomorrow at 15 UTC or so?
2023-06-15 16626, 2023
16:15 PM
reosarevok
bitmap: well, the block notes thing is not so important
2023-06-15 16637, 2023
16:15 PM
reosarevok
2023-06-15 16645, 2023
16:15 PM
outsidecontext
2023-06-15 16626, 2023
16:16 PM
reosarevok
