14:53 PM
samphippen joined the channel
2015-10-23 29638, 2015
14:53 PM
Gentlecat
ruaok: no, just some pans
2015-10-23 29658, 2015
14:53 PM
Gentlecat
also need something to hang all my google shirts on
2015-10-23 29609, 2015
14:54 PM
samphippen has quit
2015-10-23 29629, 2015
14:54 PM
Gentlecat
I'll look at the code when I get back home
2015-10-23 29640, 2015
14:54 PM
Gentlecat
~47 minutes
2015-10-23 29634, 2015
14:55 PM
ruaok
oh broccoli, yes!
2015-10-23 29646, 2015
14:55 PM
ruaok
ok, that should be fine. getting things home from there without a car can be fun.
2015-10-23 29600, 2015
14:56 PM
Gentlecat likes fun
2015-10-23 29619, 2015
14:56 PM
alastairp
brocoli!
2015-10-23 29622, 2015
14:56 PM
alastairp
wait
2015-10-23 29626, 2015
14:56 PM
alastairp
I wanted to say
2015-10-23 29626, 2015
14:56 PM
alastairp
ikea!
2015-10-23 29639, 2015
14:56 PM
Gentlecat
even if I were to buy big things, I have no place to put them
2015-10-23 29648, 2015
14:56 PM
Gentlecat
bike is taking all the space
2015-10-23 29650, 2015
14:56 PM
ruaok
that's what I though.
2015-10-23 29615, 2015
14:57 PM
ruaok will now crawl home and take a nap
2015-10-23 29622, 2015
14:57 PM
ruaok has quit
2015-10-23 29650, 2015
15:01 PM
kepstin-laptop joined the channel
2015-10-23 29649, 2015
15:10 PM
ariscop_ joined the channel
2015-10-23 29630, 2015
15:11 PM
diana_olhovik has quit
2015-10-23 29630, 2015
15:14 PM
ariscop has quit
2015-10-23 29653, 2015
15:15 PM
ariscop__ joined the channel
2015-10-23 29657, 2015
15:15 PM
ruaok joined the channel
2015-10-23 29618, 2015
15:16 PM
ruaok
yay, search freaking out.
2015-10-23 29648, 2015
15:19 PM
ariscop_ has quit
2015-10-23 29606, 2015
15:21 PM
ruaok
zas: the trick of dropping the global limit and raising it again, worked fine. :)
2015-10-23 29635, 2015
15:28 PM
zas
ruaok, yes, but we still need to find a way to prevent this
2015-10-23 29653, 2015
15:30 PM
ariscop_ joined the channel
2015-10-23 29618, 2015
15:34 PM
ariscop__ has quit
2015-10-23 29618, 2015
15:40 PM
reosarevok joined the channel
2015-10-23 29618, 2015
15:40 PM
reosarevok has quit
2015-10-23 29618, 2015
15:40 PM
reosarevok joined the channel
2015-10-23 29652, 2015
15:47 PM
CallerNo6 joined the channel
2015-10-23 29644, 2015
15:52 PM
jcazevedo has quit
2015-10-23 29632, 2015
15:57 PM
Gentlecat
ruaok: there?
2015-10-23 29600, 2015
16:06 PM
JesseW joined the channel
2015-10-23 29628, 2015
16:06 PM
ariscop__ joined the channel
2015-10-23 29615, 2015
16:08 PM
diana_olhovik joined the channel
2015-10-23 29640, 2015
16:09 PM
Gentlecat
alastairp: what if we store dataset as json?
2015-10-23 29656, 2015
16:09 PM
alastairp
I’m not against that idea
2015-10-23 29613, 2015
16:10 PM
Gentlecat
it should be easier to work with them that way
2015-10-23 29628, 2015
16:10 PM
ariscop_ has quit
2015-10-23 29640, 2015
16:10 PM
ariscop_ joined the channel
2015-10-23 29659, 2015
16:11 PM
samphippen joined the channel
2015-10-23 29607, 2015
16:12 PM
Gentlecat
so are we going to use complete dataset for testing?
2015-10-23 29610, 2015
16:12 PM
alastairp
yeah, a lot less work
2015-10-23 29622, 2015
16:12 PM
Gentlecat
or just a part that we cut from it before training?
2015-10-23 29625, 2015
16:12 PM
samphippen has quit
2015-10-23 29629, 2015
16:12 PM
alastairp
no, only the cut part
2015-10-23 29634, 2015
16:12 PM
Gentlecat
also, what is that second part called?
2015-10-23 29639, 2015
16:12 PM
alastairp
training set
2015-10-23 29643, 2015
16:12 PM
Gentlecat
ok, so that's training set
2015-10-23 29650, 2015
16:12 PM
alastairp
yes
2015-10-23 29655, 2015
16:12 PM
alastairp
test set, train set
2015-10-23 29605, 2015
16:13 PM
Gentlecat
let's say there are 2 classes
2015-10-23 29628, 2015
16:13 PM
Gentlecat
one has 2 recordings, another 3 recordings
2015-10-23 29637, 2015
16:13 PM
Gentlecat
all from different artists
2015-10-23 29657, 2015
16:13 PM
Gentlecat
so we remove 1 recording from second dataset during normalization
2015-10-23 29659, 2015
16:13 PM
diana_olhovik has quit
2015-10-23 29606, 2015
16:14 PM
Gentlecat
how are we going to test then?
2015-10-23 29611, 2015
16:14 PM
alastairp
ah, right
2015-10-23 29620, 2015
16:14 PM
Gentlecat
or even if we don't do normalization
2015-10-23 29633, 2015
16:14 PM
Gentlecat
when every single recording in a class is from a different artist
2015-10-23 29634, 2015
16:14 PM
ariscop__ has quit
2015-10-23 29653, 2015
16:14 PM
alastairp
so, for one we’ll have much larger datasets, so this may happen less
2015-10-23 29604, 2015
16:15 PM
alastairp
but you’re right, it still may be a problem
2015-10-23 29606, 2015
16:15 PM
Gentlecat
but that still can happen
2015-10-23 29616, 2015
16:15 PM
alastairp
normally the test set is a proportion of the test set
2015-10-23 29619, 2015
16:15 PM
alastairp
uh
2015-10-23 29625, 2015
16:15 PM
alastairp
test is a proportion of train
2015-10-23 29627, 2015
16:15 PM
Gentlecat
or training set will be too small
2015-10-23 29634, 2015
16:15 PM
Gentlecat
I mean testing
2015-10-23 29601, 2015
16:16 PM
alastairp
so we could do the filtering, and then if the test set is still less than 20% of the full dataset, randomly select more
2015-10-23 29627, 2015
16:16 PM
alastairp
you’re asking questions which are at the limit of my experience
2015-10-23 29629, 2015
16:17 PM
Gentlecat
:(
2015-10-23 29633, 2015
16:17 PM
alastairp
I’ll have to check with some others when they get here, but that won’t be until monday
2015-10-23 29616, 2015
16:18 PM
JesseW has quit
2015-10-23 29641, 2015
16:21 PM
ariscop_ has quit
2015-10-23 29615, 2015
16:22 PM
blup
generally, how many pages is one day of scrobbles? I've got 6 days to import so... how many pages do you reccon?
2015-10-23 29627, 2015
16:22 PM
ariscop joined the channel
2015-10-23 29645, 2015
16:22 PM
blup
(given continuous listening for 24 hours)
2015-10-23 29649, 2015
16:22 PM
ariscop has quit
2015-10-23 29618, 2015
16:23 PM
ariscop joined the channel
2015-10-23 29632, 2015
16:23 PM
ariscop has quit
2015-10-23 29649, 2015
16:23 PM
Gentlecat
alastairp: I'll go take a nap as well
2015-10-23 29601, 2015
16:24 PM
Gentlecat
will try to implement something today
2015-10-23 29602, 2015
16:24 PM
ariscop joined the channel
2015-10-23 29621, 2015
16:24 PM
ariscop has quit
2015-10-23 29650, 2015
16:24 PM
ariscop joined the channel
2015-10-23 29605, 2015
16:25 PM
ariscop has quit
2015-10-23 29621, 2015
16:26 PM
ariscop joined the channel
2015-10-23 29639, 2015
16:26 PM
ariscop has quit
2015-10-23 29619, 2015
16:27 PM
ariscop joined the channel
2015-10-23 29632, 2015
16:27 PM
ariscop has quit
2015-10-23 29614, 2015
16:29 PM
blup
heh, seems 45 pages
2015-10-23 29603, 2015
16:32 PM
ariscop joined the channel
2015-10-23 29642, 2015
16:32 PM
blup
arg.. wtf does the max_ts thing mean? i can't really work with that ot skip pages backwards
2015-10-23 29639, 2015
16:34 PM
kepstin-laptop has quit
2015-10-23 29653, 2015
16:35 PM
blup
2015-10-23 29633, 2015
16:37 PM
ariscop_ joined the channel
2015-10-23 29654, 2015
16:40 PM
ariscop has quit
2015-10-23 29639, 2015
16:47 PM
kepstin-laptop joined the channel
2015-10-23 29626, 2015
16:49 PM
samphippen joined the channel
2015-10-23 29623, 2015
16:57 PM
zas
ruaok, i checked logs about the issue with the search servers today
2015-10-23 29646, 2015
16:57 PM
zas
i isolated queries on public/search and i didn't see anything special about them
2015-10-23 29605, 2015
16:58 PM
ruaok notes that the sausages are in the fridge and wine stashed away.
2015-10-23 29618, 2015
16:58 PM
zas
the cause is the same as yesterday, but this time monit restarted tomcat on roobarb
2015-10-23 29648, 2015
16:58 PM
ruaok
odd, so odd.
2015-10-23 29653, 2015
16:58 PM
zas
monit is restarting both servers a lot of time per day, but it doesn't result in the chaos
2015-10-23 29600, 2015
16:59 PM
zas
i mean doesnt always
2015-10-23 29616, 2015
16:59 PM
zas
Oct 23 14:59:03
2015-10-23 29626, 2015
16:59 PM
zas
is the exact time where all started
2015-10-23 29648, 2015
16:59 PM
zas
confirmed by nginx logs
2015-10-23 29658, 2015
16:59 PM
ruaok
I'm guessing it has to do with the amount of traffic.
2015-10-23 29622, 2015
17:00 PM
zas
not sure, because the traffic was not unusually high
2015-10-23 29626, 2015
17:01 PM
ruaok
but this only happens near our daily traffic peak.
2015-10-23 29647, 2015
17:02 PM
zas
i wonder why search servers can't catch up
2015-10-23 29658, 2015
17:02 PM
UmkaDK has quit
2015-10-23 29606, 2015
17:04 PM
zas
monit restart them when they eat 12Gb
2015-10-23 29637, 2015
17:06 PM
ariscop__ joined the channel
2015-10-23 29659, 2015
17:09 PM
ariscop_ has quit
2015-10-23 29607, 2015
17:10 PM
jcazevedo joined the channel
2015-10-23 29628, 2015
17:17 PM
reosarevok
ruaok: have you seen the email from Cheng Wang? Seems like your kind of thing
2015-10-23 29606, 2015
17:18 PM
ruaok
yea, except he asked about how to change the muffler belt on his flux capacitor.
2015-10-23 29635, 2015
17:18 PM
ruaok
can you please direct him to join us here and ask questions?
2015-10-23 29646, 2015
17:22 PM
reosarevok
Ok!
2015-10-23 29636, 2015
17:23 PM
reosarevok sighs at the BBC. They wanted me to do a short job for them. Which would be much simpler if they didn't send me their non-Latin strings as stuff like "Ðнтон Степанович ÐренÑкий"
2015-10-23 29646, 2015
17:23 PM
reosarevok thought in 2015 we wouldn't see that stuff anymore
2015-10-23 29605, 2015
17:24 PM
ruaok
whaddya mean? I love that piece!
2015-10-23 29620, 2015
17:24 PM
reosarevok
Dude. It's a dude :p
2015-10-23 29627, 2015
17:24 PM
reosarevok
(Anton Arensky, to be precise)
2015-10-23 29637, 2015
17:24 PM
reosarevok
But really, no Unicode support? In 2015? From a major company?
2015-10-23 29638, 2015
17:24 PM
ruaok
lol
2015-10-23 29606, 2015
17:28 PM
reosarevok
Dunno. I know I'm whiny and all, but still.
2015-10-23 29611, 2015
17:28 PM
reosarevok
Sigh
2015-10-23 29620, 2015
17:28 PM
ruaok
not news to us. :)
2015-10-23 29627, 2015
17:31 PM
reosarevok has quit
2015-10-23 29609, 2015
17:32 PM
ariscop_ joined the channel
2015-10-23 29639, 2015
17:32 PM
reosarevok joined the channel
2015-10-23 29648, 2015
17:35 PM
ariscop__ has quit
2015-10-23 29612, 2015
17:45 PM
ariscop__ joined the channel
2015-10-23 29630, 2015
17:48 PM
ariscop_ has quit
2015-10-23 29643, 2015
17:52 PM
ariscop_ joined the channel
2015-10-23 29617, 2015
17:56 PM
ariscop__ has quit
2015-10-23 29643, 2015
18:17 PM
ariscop__ joined the channel
2015-10-23 29606, 2015
18:21 PM
ariscop_ has quit
2015-10-23 29631, 2015
18:29 PM
LordSputnik joined the channel
2015-10-23 29646, 2015
18:38 PM
ariscop__ has quit
2015-10-23 29603, 2015
18:39 PM
ariscop joined the channel
