21:56 PM
Gentlecat
so much problems to fix
2015-09-16 25909, 2015
21:56 PM
Gentlecat
so little time
2015-09-16 25912, 2015
21:56 PM
ruaok
do we have an "ALPHA!!" sign on the site yet?
2015-09-16 25950, 2015
21:56 PM
Gentlecat
¡ALPHA!
2015-09-16 25958, 2015
21:56 PM
ruaok
sure
2015-09-16 25911, 2015
21:58 PM
Gentlecat
ruaok: the timestamp problem you asked me about earlier today
2015-09-16 25932, 2015
21:58 PM
Gentlecat
was timestamp completely missing or just in different format?
2015-09-16 25959, 2015
21:58 PM
Gentlecat
2015-09-16 25902, 2015
21:59 PM
ruaok
I don't know -- that one PR I sent was to fix that one error the scraper threw -- some element was missing apparently.
2015-09-16 25943, 2015
21:59 PM
ruaok
I really don't know what format it was.
2015-09-16 25901, 2015
22:00 PM
Gentlecat
well it should be just that huge integer
2015-09-16 25909, 2015
22:00 PM
Gentlecat
not fancy string
2015-09-16 25916, 2015
22:01 PM
alastairp
I think you’re both talking about different things
2015-09-16 25926, 2015
22:01 PM
chirlu` has quit
2015-09-16 25934, 2015
22:01 PM
alastairp
as I understand, Gentlecat has a problem in the data returned from the LB api to show on the data page
2015-09-16 25935, 2015
22:01 PM
Gentlecat
:(
2015-09-16 25940, 2015
22:01 PM
alastairp
Mineo: fyi, & is fixed too
2015-09-16 25943, 2015
22:01 PM
Gentlecat
correct
2015-09-16 25902, 2015
22:02 PM
ruaok
ah, not the js one from the scaper.
2015-09-16 25906, 2015
22:02 PM
ruaok
what is the question then?
2015-09-16 25913, 2015
22:02 PM
chirlu` joined the channel
2015-09-16 25918, 2015
22:02 PM
Gentlecat
2015-09-16 25922, 2015
22:02 PM
Leftmost
If the LB importer finishes with 183/187 complete, can I assume it actually completed the other four, or did it just stop once it finished sending all 187?
2015-09-16 25938, 2015
22:02 PM
ruaok
Gentlecat: that chatlog link doesn't really help me.
2015-09-16 25939, 2015
22:02 PM
alastairp
you can’t assume anything
2015-09-16 25952, 2015
22:02 PM
Leftmost
I can assume many things, but they might not be right.
2015-09-16 25905, 2015
22:03 PM
Gentlecat
2015-09-16 25913, 2015
22:03 PM
alastairp
Gentlecat: better you explain it to him again
2015-09-16 25928, 2015
22:03 PM
alastairp
easier than trying to understand context + all the other discussions going on
2015-09-16 25942, 2015
22:03 PM
Gentlecat
ok, let me grab another bottle then
2015-09-16 25942, 2015
22:03 PM
ruaok nods
2015-09-16 25958, 2015
22:03 PM
alastairp
Leftmost: one problem is that that counter is “number of requests made”, not “number of requests succeeded” (I’ve changed this and should be released soon)
2015-09-16 25900, 2015
22:04 PM
djpretzel joined the channel
2015-09-16 25940, 2015
22:04 PM
alastairp
another problem is that people seem to have a set of pages at the end of their list with “Unknown date”, and our parser chokes and dies, so who knows if you even succeeded in sending those pages (ruaok has a fix for this too)
2015-09-16 25954, 2015
22:04 PM
alastairp
Leftmost: can you paste a link to page 183 of your profile?
2015-09-16 25922, 2015
22:05 PM
Gentlecat
well, my VM just stopped responding
2015-09-16 25923, 2015
22:05 PM
alastairp
ruaok: my new cassandra schema (table?) isn’t creating. do you know what I need to drop?
2015-09-16 25929, 2015
22:05 PM
Gentlecat
2015-09-16 25936, 2015
22:05 PM
Gentlecat
"listened_at": 1442394540
2015-09-16 25946, 2015
22:05 PM
Leftmost
2015-09-16 25956, 2015
22:05 PM
Gentlecat
instead of that number I get "Wed, 16 Sep 2015 17:27:00 GMT"
2015-09-16 25902, 2015
22:06 PM
ruaok
alastairp: to drop the table, just "drop table listens;"
2015-09-16 25922, 2015
22:06 PM
ruaok
in cqlsh
2015-09-16 25932, 2015
22:06 PM
ruaok
but you need to start with "use listenbrainz;"
2015-09-16 25944, 2015
22:06 PM
Gentlecat
actually, it was completely missing before
2015-09-16 25949, 2015
22:06 PM
alastairp
Leftmost: interesting, you don’t have any unknown date scrobbles. we know that this happens, but don’t know a good solution yet, sorry :(
2015-09-16 25951, 2015
22:06 PM
ruaok
then paste the query that is at the bottom of the listenstore.py
2015-09-16 25955, 2015
22:06 PM
alastairp
ruaok: hm. I thought I did that
2015-09-16 25959, 2015
22:06 PM
alastairp
oh. I need to paste that??
2015-09-16 25906, 2015
22:07 PM
ruaok
yes, that re-creates the table
2015-09-16 25912, 2015
22:07 PM
Leftmost
What seemed to happen was that it stopped updating "completed" as soon as it stopped updating "sent".
2015-09-16 25914, 2015
22:07 PM
ruaok
truncate listens
2015-09-16 25916, 2015
22:07 PM
Gentlecat
2015-09-16 25917, 2015
22:07 PM
ruaok
is much easier.
2015-09-16 25943, 2015
22:07 PM
alastairp
ruaok: I still have the old schema though, whcih is why I need to drop
2015-09-16 25905, 2015
22:08 PM
ruaok
ok, that sequence is what you need then
2015-09-16 25910, 2015
22:08 PM
ruaok
listen, drop, create
2015-09-16 25915, 2015
22:08 PM
ruaok
stop, drop, roll
2015-09-16 25926, 2015
22:08 PM
ruaok
listen? use.
2015-09-16 25931, 2015
22:08 PM
alastairp
weird, because the listenstore constructor seems to imply that it’ll create it for you
2015-09-16 25947, 2015
22:08 PM
alastairp
oh, perhaps only if the /keyspace/ doesn’t exist, not the table
2015-09-16 25908, 2015
22:09 PM
alastairp
yes! bingo
2015-09-16 25911, 2015
22:09 PM
ruaok
try dropping the keyspace
2015-09-16 25915, 2015
22:09 PM
alastairp
thanks
2015-09-16 25926, 2015
22:09 PM
ruaok
np
2015-09-16 25931, 2015
22:09 PM
alastairp reproduces Gentlecat’s cyrilic
2015-09-16 25954, 2015
22:09 PM
Gentlecat
ping me if you need some more
2015-09-16 25902, 2015
22:10 PM
Gentlecat
I've got a whole keyboard of those
2015-09-16 25912, 2015
22:10 PM
Gentlecat
:P
2015-09-16 25913, 2015
22:10 PM
ruaok
lol
2015-09-16 25959, 2015
22:10 PM
ruaok
hmm. next time we need to pick project colors more carefully.
2015-09-16 25905, 2015
22:11 PM
ruaok
I don't have a matching blue sock. :(
2015-09-16 25946, 2015
22:11 PM
Gentlecat
ruaok: did you catch my explanation?
2015-09-16 25903, 2015
22:12 PM
ruaok
no. :(
2015-09-16 25910, 2015
22:12 PM
Gentlecat
:(
2015-09-16 25935, 2015
22:12 PM
ruaok
state your question again, please.
2015-09-16 25946, 2015
22:12 PM
Gentlecat
timestamps
2015-09-16 25955, 2015
22:12 PM
ruaok
not a question.
2015-09-16 25903, 2015
22:13 PM
ruaok
:-p
2015-09-16 25916, 2015
22:13 PM
Gentlecat
I'm still typing
2015-09-16 25921, 2015
22:13 PM
Gentlecat
they are supposed to be returned for each listen, that's what I use in pagination stuff
2015-09-16 25944, 2015
22:13 PM
Gentlecat
2015-09-16 25950, 2015
22:13 PM
Gentlecat
listened_at
2015-09-16 25902, 2015
22:14 PM
Gentlecat
in this case it's 1442391120, as it should be
2015-09-16 25925, 2015
22:14 PM
Gentlecat
what I'm getting locally is "Wed, 16 Sep 2015 17:27:00 GMT"
2015-09-16 25952, 2015
22:14 PM
ruaok
odd.
2015-09-16 25955, 2015
22:14 PM
Gentlecat
before there was no listened_at value at all, but something happened
2015-09-16 25901, 2015
22:15 PM
Gentlecat
so... any ideas?
2015-09-16 25917, 2015
22:15 PM
ruaok
does this happen on forward or backward?
2015-09-16 25933, 2015
22:15 PM
Gentlecat
it happens on this API endpoint
2015-09-16 25939, 2015
22:15 PM
ruaok
here is the background: russss thought that timestamps were datetime objects.
2015-09-16 25949, 2015
22:15 PM
ruaok
when in fact they are ints.
2015-09-16 25900, 2015
22:16 PM
Gentlecat
which means data is not going to be displayed at all, no forward or backward buttons
2015-09-16 25904, 2015
22:16 PM
ruaok
so, I went through and removed unneeded conversions and whatnot.
2015-09-16 25926, 2015
22:16 PM
Gentlecat
what I think is that python's json module is doing conversion differently
2015-09-16 25937, 2015
22:16 PM
ruaok
there is a chance that I missed something.
2015-09-16 25940, 2015
22:16 PM
ruaok
but only for you??
2015-09-16 25923, 2015
22:17 PM
Gentlecat
2015-09-16 25927, 2015
22:17 PM
Gentlecat
maybe that's related
2015-09-16 25957, 2015
22:17 PM
ruaok
that is because my code wasn't putting them into the output.
2015-09-16 25912, 2015
22:18 PM
Gentlecat
and what did you to fix that?
2015-09-16 25912, 2015
22:18 PM
ruaok
I fixed, committed and merged that... last night?
2015-09-16 25932, 2015
22:18 PM
Gentlecat
got a link to commit?
2015-09-16 25938, 2015
22:18 PM
ruaok
looking
2015-09-16 25903, 2015
22:19 PM
ruaok
2015-09-16 25906, 2015
22:19 PM
ruaok
api.py
2015-09-16 25916, 2015
22:19 PM
Gentlecat
and the thing is, I'm on the latest commit in master
2015-09-16 25949, 2015
22:19 PM
Gentlecat
datetime.fromtimestamp(row.id)
2015-09-16 25910, 2015
22:20 PM
alastairp
feh
2015-09-16 25916, 2015
22:20 PM
Gentlecat
why was that removed?
2015-09-16 25920, 2015
22:20 PM
ruaok
the first block was ever more confusing.
2015-09-16 25933, 2015
22:20 PM
ruaok
because row.id is an integer timestamp, which is what we want, no?
2015-09-16 25935, 2015
22:20 PM
alastairp
Gentlecat: did you know that your import is failing only because it cannot print a debug message that it loaded your listen?
2015-09-16 25949, 2015
22:20 PM
Gentlecat
well...
2015-09-16 25912, 2015
22:21 PM
Gentlecat
this is fucking hilarious
2015-09-16 25938, 2015
22:21 PM
Gentlecat
why didn't you use py3 from the start?
2015-09-16 25943, 2015
22:22 PM
Gentlecat
ruaok: let me try to add that back
2015-09-16 25916, 2015
22:24 PM
Gentlecat
nope, that didn't help
2015-09-16 25945, 2015
22:25 PM
ruaok
have you logged the data in the listen to see what it is working with?
2015-09-16 25952, 2015
22:27 PM
Gentlecat
oh wait, I need to rebuild listenstore after modifying it
2015-09-16 25903, 2015
22:28 PM
ruaok
unless you did
2015-09-16 25909, 2015
22:28 PM
ruaok
python setup.py develop
2015-09-16 25920, 2015
22:28 PM
ruaok
in which case it makes symlinks to your local dir
2015-09-16 25949, 2015
22:30 PM
Gentlecat
ok, now I'm getting these integers
2015-09-16 25957, 2015
22:30 PM
Gentlecat
no idea what's going on
2015-09-16 25935, 2015
22:31 PM
ruaok
welcome to my world
2015-09-16 25929, 2015
22:33 PM
demonimin has quit
2015-09-16 25943, 2015
22:34 PM
demonimin joined the channel
2015-09-16 25943, 2015
22:34 PM
demonimin has quit
2015-09-16 25943, 2015
22:34 PM
demonimin joined the channel
2015-09-16 25946, 2015
22:37 PM
diana_olhovik_ has quit
2015-09-16 25950, 2015
22:42 PM
alastairp
I hate unicode
2015-09-16 25907, 2015
22:46 PM
github joined the channel
2015-09-16 25907, 2015
22:46 PM
github
2015-09-16 25907, 2015
22:46 PM
github
listenbrainz-server/link f6f198b Roman Tsukanov: LB-15: Link username in navbar to profile page.
2015-09-16 25907, 2015
22:46 PM
github has left the channel
2015-09-16 25938, 2015
22:46 PM
github joined the channel
2015-09-16 25938, 2015
22:46 PM
github
2015-09-16 25938, 2015
22:46 PM
github has left the channel
2015-09-16 25952, 2015
22:52 PM
Freso
My TV remote is dead. :'(
2015-09-16 25935, 2015
22:53 PM
Freso
chirlu`: I don't think I do.
2015-09-16 25939, 2015
22:53 PM
Freso
navap: They poked me too.
2015-09-16 25903, 2015
22:56 PM
Gentlecat
alastairp: I left "Your listens" link there
2015-09-16 25938, 2015
22:56 PM
Gentlecat
kind of redundant, not sure if we need to remove it
2015-09-16 25905, 2015
22:59 PM
alastairp
Gentlecat: for now, no problem
2015-09-16 25923, 2015
22:59 PM
alastairp
My internet has stopped, and Unicode is getting the better of me
2015-09-16 25932, 2015
22:59 PM
alastairp
I'll follow this up tomorrow morning
2015-09-16 25937, 2015
22:59 PM
Gentlecat
yep
2015-09-16 25950, 2015
22:59 PM
Gentlecat
ruaok: I managed to reproduce that problem with timestamp
2015-09-16 25955, 2015
22:59 PM
ruaok
yay!
