I don't understand how the error in `listening_activity_month` affected the rec commands
2020-11-02 30726, 2020
pristine___
only request_model and request_recommendations was run
2020-11-02 30752, 2020
pristine___
request_dataframes and request_candidate_sets didn't run :(
2020-11-02 30717, 2020
ishaanshah
pristine___: Looks like result for listening_activity_month was empty, which is wierd
2020-11-02 30720, 2020
ishaanshah
I'll take a look
2020-11-02 30748, 2020
pristine___
ishaanshah: okay, so I manually did request_dataframes but leader didn't receive a request
2020-11-02 30757, 2020
pristine___
strange
2020-11-02 30710, 2020
pristine___
iliekcomputers: hi
2020-11-02 30741, 2020
shivam-kapila
ishaanshah: might be possible that its caclulating for nov but data for nov isnt in cluster
2020-11-02 30750, 2020
shivam-kapila
Today is 2nd
2020-11-02 30755, 2020
ishaanshah
pristine___: I think I found the bug
2020-11-02 30711, 2020
pristine___
?
2020-11-02 30723, 2020
ishaanshah
I am not sure why the error in listening_activity caused failure of rec jobs
2020-11-02 30751, 2020
ishaanshah
I'll try to write a fix for the stats error by evening and open a PR
2020-11-02 30717, 2020
pristine___
it didn't i guess, because when i do request_df, leader didn't receive a request
2020-11-02 30722, 2020
pristine___
cool
2020-11-02 30758, 2020
iliekcomputers
Hi
2020-11-02 30750, 2020
pristine___
> okay, so I manually did request_dataframes but leader didn't receive a request
2020-11-02 30754, 2020
pristine___
iliekcomputers: ^
2020-11-02 30703, 2020
iliekcomputers
That's weird
2020-11-02 30720, 2020
iliekcomputers
Can you restart request consumer on leader once
2020-11-02 30756, 2020
pristine___
i don't know how to
2020-11-02 30738, 2020
iliekcomputers
OK, let me try
2020-11-02 30730, 2020
iliekcomputers
when did you trigger it
2020-11-02 30741, 2020
iliekcomputers
i see some logs from ~13 minutes ago
2020-11-02 30747, 2020
pristine___
was triggered a few hours ago by cron, i didn't get an email, so triggered manually a few min ago
2020-11-02 30701, 2020
iliekcomputers
got it
2020-11-02 30749, 2020
iliekcomputers
i think it's because of the listening activity bug
2020-11-02 30702, 2020
iliekcomputers
it calculated listening activity again
2020-11-02 30717, 2020
iliekcomputers
can you try triggering recommendations again, let's see if it works
2020-11-02 30740, 2020
pristine___
i don't think so because after doing request_df, I did request_model and the request was received by leader
2020-11-02 30744, 2020
pristine___
not sure though
2020-11-02 30745, 2020
pristine___
cool
2020-11-02 30736, 2020
pristine___
iliekcomputers: listening activity errord out, I did `request_dataframes`, leader didn't receive a request, I did `request_recommendations` the request was received by the leader. Is there a way to monitor the queue or something? I am not sure what's happening
2020-11-02 30718, 2020
shivam-kapila
Yep
2020-11-02 30732, 2020
shivam-kapila
Rabbitmqctl iirc
2020-11-02 30735, 2020
iliekcomputers
Can you do request dataframes once again
2020-11-02 30706, 2020
pristine___
A sec
2020-11-02 30738, 2020
pristine___
worked now
2020-11-02 30743, 2020
pristine___
iliekcomputers: what was it?
2020-11-02 30706, 2020
iliekcomputers
I'm not sure, I think it's a bug in the consumer
2020-11-02 30731, 2020
iliekcomputers
It's not handling the failure correctly
2020-11-02 30747, 2020
pristine___
iliekcomputers: open a ticket?
2020-11-02 30720, 2020
iliekcomputers
Yes, would be helpful thanks
2020-11-02 30734, 2020
pristine___
iliekcomputers: lol, I was asking you to
2020-11-02 30702, 2020
pristine___
will do anyway.
2020-11-02 30707, 2020
iliekcomputers
Oh! Lol
2020-11-02 30708, 2020
pristine___
thanks :)
2020-11-02 30713, 2020
iliekcomputers
Thanks!
2020-11-02 30744, 2020
Darkloke joined the channel
2020-11-02 30708, 2020
pristine___
iliekcomputers: okay, in order for leader to receive a request, I have to request from lemmy two times in a row, some congestion in the queue.
