11:26 AM
zas
isn't this search query handled by queen's solr ?
11:26 AM
samj1912
zas: iirc you set some nginx limits on solr
11:26 AM
I can perform those queries if I login to the admin panel on queen's solr
11:27 AM
zas
but in this case, that's the backend returning a 500, i wonder if it even ends on solr
11:30 AM
ok, it does it seems
11:31 AM
KassOtsimine
noo don't skip instruments lol
11:33 AM
hi samj1912 i'm here now!
11:33 AM
was reaading scrollback
11:34 AM
i deff wanna improve instruments search!
11:34 AM
sorry for being afk, was playing botw all yesterday :x
11:35 AM
zas
samj1912: i did a tcp packet capture, and it seems to me that's solr which is truncating the json output, leading to a 500 (because json is invalid)
11:37 AM
samj1912
weird
11:37 AM
it shouldn't be doing that
11:40 AM
zas
i'll redo the capture may be i didn't capture everything
11:41 AM
KassOtsimine
D: u mad at me :(
11:42 AM
reosarevok
KassOtsimine: I don't think anyone is mad at you, we skipped them temporarily specifically to look into it when you're around :)
11:42 AM
HSOWA joined the channel
11:42 AM
(but something seems to be broken now, so I guess we need to wait a bit more :) )
11:42 AM
HSOWA
great and now my client crashed
11:42 AM
meh any link to the chatlogs
11:43 AM
?
11:43 AM
reosarevok
11:43 AM
Or something specific?
11:43 AM
HSOWA
cheers
11:43 AM
samj1912
HSOWA: hey, wasn't mad :P, just was helping zas and Leo_Verto with solr debugging
11:43 AM
HSOWA
my connection has been shit for a while :D
11:43 AM
👍
11:43 AM
samj1912
ill get back to you in a bit when I start doing instruments :)
11:43 AM
HSOWA
:DDDD
11:44 AM
but when is the areas search fix going on prod?
11:44 AM
or eve nbeta?
11:44 AM
i hope asap
11:44 AM
i don't even care about feature aprity. i ant this asafp
11:45 AM
i don't even care about feature parity. i want this asafp
11:45 AM
samj1912
lol :P
11:45 AM
HSOWA: there are some other things we need to take care of
11:45 AM
HSOWA
ahha
11:45 AM
also yo u can still call me catcat or catquest here
11:45 AM
:D
11:46 AM
zas
samj1912: capture was incomplete, solr seems to answer correctly but mb website fails to handle it
11:46 AM
samj1912
seems like it
11:46 AM
is it unable to parse a large json string?
11:46 AM
KassOtsimine has quit
11:47 AM
zas
yvanzo, bitmap ^^
11:47 AM
ruaok
how large?
11:47 AM
zas
this one is about 90kb (a bit less)
11:48 AM
11:48 AM
wiresharked decoded tcp stream
11:48 AM
HSOWA
or wait no. i forget this thing has a broken highlisht. if i select *any* words to highligt on it highlight on EVERYmessage
11:49 AM
ruaok
90kb should be zero problem at all.
11:49 AM
zas
but perhaps that's a json parsing issue, not related to the size
11:51 AM
ruaok
malformed JSON string, neither array, object, number, string or atom, at character offset 0 (before "GET /solr/recording/...") at /usr/local/bin/json_pp line 44.
11:51 AM
ah, there is crap around it.
11:51 AM
zas
where did you get this log line ?
11:51 AM
ruaok
seems to parse fine.
11:52 AM
zas
hmm, the capture file is ascii, but content has utf8
11:52 AM
ruaok
json_pp on the command line, feeding it the whole file, which is not right. ignore that
11:53 AM
json lint thinks its fine too.
11:53 AM
zas
11:53 AM
ruaok
11:53 AM
Leo_Verto
what's up with "{"artist":{"id":"622a275f-659f-4dc6-9964-0d33c34a786e","name":"Michel Fugain","sort-name":"Fugain, Michel","aliases":[{"sort-name":"...........................","name":"...........................","locale":null,"type":null,"primary":null,"begin-date":null,"end-date":null}"?
11:54 AM
are those just japanese characters not being rendered?
11:54 AM
zas
i see them
11:54 AM
sort-name":"Fugain, Michel","aliases":[{"sort-name":"ミッシェル・フガン","name":"ミッシェル・フガン",
11:55 AM
Leo_Verto
11:55 AM
ah okay, just an ascii issue then
11:55 AM
ruaok
does this happen with all requests or just some?
11:55 AM
samj1912
just some
11:55 AM
this is my first time encountering this
11:55 AM
ruaok
it might be an encoding issue.
11:55 AM
zas
there's no encoding header at all in the answer
11:55 AM
ruaok
where the json is valid, but the utf8 is not.
11:57 AM
Leo_Verto
seems like the searches fail if they're similar enough to "viva la"
11:57 AM
HSOWA
samj1912: i'm in the same room doing the dishes. when you are ready, just highlight me with HSOWA :D
11:57 AM
zas
likely because they contain same results
11:58 AM
Leo_Verto
"testing viva la" works but "aaaaaaaaa viva la" doesn't
11:58 AM
this means there's bad data somewhere, right?
11:58 AM
zas
what is happening to this json answer after solr returned it ?
11:59 AM
ruaok
they get parsed, and transformed into HTML or XML or a different JSON format.
11:59 AM
samj1912
HSOWA: okay :)
12:01 PM
github joined the channel
12:01 PM
github
[sir] samj1912 opened pull request #79: Improve query efficiency when calculating ref_counts (master...count)
https://git.io/vppNk
12:01 PM
github has left the channel
12:08 PM
beqn has quit
12:11 PM
samj1912
HSOWA: hey
12:11 PM
HSOWA
hi1
12:12 PM
samj1912
lets do instruments now :)
12:12 PM
HSOWA
i didn't get to finsih the fdishes, but <ny excuse not to do them :D
12:12 PM
any*
12:12 PM
samj1912
lol :P
12:12 PM
so yeah, you know how to test it right?
12:12 PM
can you try out some queries and see how it performs?
12:12 PM
HSOWA
test it on test
12:13 PM
samj1912
yup, with advanced mode on
12:13 PM
HSOWA
question: what about inline search?
12:13 PM
samj1912
inline search?
12:13 PM
12:13 PM
HSOWA
12:13 PM
yes yes i know aoutthat
12:14 PM
my main concern is making usre people don't select "guitar family and viol family" when they want guitars and viol(da gamba)
12:14 PM
samj1912
I have no idea how that works
12:14 PM
HSOWA
lets find out!
12:14 PM
Leo_Verto
samj1912: I like how "eletric guitar" appears before regular guitar
12:14 PM
HSOWA
hmmm
12:14 PM
samj1912
Leo_Verto: I dont think that should happen :P
12:14 PM
HSOWA
indeed
12:15 PM
Leo_Verto
I feel like for instruments, exact name matches should be prioritized
12:15 PM
HSOWA
samj1912: can you make it so that anything with the *name* "family" goees last ?
12:15 PM
samj1912
as in?
12:15 PM
HSOWA
Leo_Verto: kindly butt out for a while (come in later pls :D)
12:15 PM
12:15 PM
samj1912:
12:16 PM
ZaphodBeeblebrox has quit
12:16 PM
anything iwth "family" in thr name should (ideally) show last in the list of anything searched
12:16 PM
reosarevok
(or anything with the "family" instrument type, I guess)
12:16 PM
HSOWA
yes that too
12:16 PM
ZaphodBeeblebrox joined the channel
12:16 PM
ZaphodBeeblebrox has quit
12:16 PM
ZaphodBeeblebrox joined the channel
12:17 PM
Leo_Verto
should it show at all?
12:17 PM
HSOWA
weeel
12:17 PM
reosarevok
Well it should show in inline search when catcat is adding relationships at least
12:17 PM
HSOWA
indeed :D
12:17 PM
reosarevok
I guess
12:17 PM
Otherwise it's hard to use :D
12:17 PM
samj1912
reosarevok: I am not at all sure how inline search is currently hooked
12:17 PM
HSOWA
but i can also search for "viol family"
12:17 PM
inline is my main concern
12:18 PM
*most* do not use the regular search for instrument use
12:18 PM
drsaunder has quit
12:18 PM
thy use inline for adding rels
12:18 PM
samj1912
12:18 PM
well it seems to do that currently as well
12:18 PM
HSOWA
12:19 PM
reosarevok
HSOWA: ? the actual viola is super low, that is bad :p
12:19 PM
HSOWA
for inline seaerch too :O
12:19 PM
on test atleast
12:19 PM
we don't want viola to show up when searching for viol do we? for search "violla" wwe want it to be first
12:19 PM
reosarevok
But that's a "viola" search!
12:19 PM
HSOWA
erh "viola"
12:19 PM
oh duh
12:20 PM
yes that's bad bad
12:20 PM
reosarevok
12:20 PM
(other than violin family, but)
12:20 PM
HSOWA
yea. and honestly viola da gamba should show first, but :D
12:20 PM
samj1912
alias comment description iid instrument^2 ngram tag type
12:20 PM
these are the current boosts
12:20 PM
should I increase alias?
12:20 PM
HSOWA
you can lover the description and annotations
12:21 PM
samj1912
and do you want any particular type boosts?