seems the build failed while trying to install python
i'll rerun the jobs and see if that goes away
Mr_Monkey
ruaok: Yes, as mentionned I need to update Node version, but I started that last night.
Alternatively, you can merge as-is, I sexuple-checked that the mechanism works correctly, and using a more recent Node version all tests pass.
ruaok
Mr_Monkey: great, thanks for verifying.
Strezless joined the channel
sumedh joined the channel
_lucifer
ruaok, i want to test some further improvements for the spark request consumer. will need to take down/up the container few times and issue some requests. is that fine?
ruaok, what's the right way to run a script in the background? i found nohup, setsid or & but not sure which to use?
ruaok
script.py &
will run in the background, but if you close that terminal, the process gets killed.
nuhup script.py &
will continue running in the background.
nohup script.py 2>&1 > <file> &
should capture output into a file and keep running if the terminal disconnects.
_lucifer
yup that the last command is what i am exactly looking for. thanks!
ruaok
likely to only work in bash.
alias m='make 2>&1 | less'
is an alias I have for make'ing C programs.
_lucifer
ruaok, driver running on newleader without docker now :D
and python deps also managed inside a venv so no issues there.
alastairp, after our discussion yesterday, i revisted the docs. i had misunderstood those, the deps do get distributed to the driver at least in the yarn client mode which is the one we use. thanks!
ruaok
nice. remind me, what was the motivation for getting rid of docker?
_lucifer
doesn't add anything and requires additional setup. right we have to build the driver image and update the git repo on newleader to ensure things work correctly.
now its just update the repo on newleader and execute the startup script.
alastairp
ruaok: I did a preliminary review of the PR, but skipped the listenstore file for now in order to get some comments to you. Looking at listenstore now
ruaok
alastairp: great, thanks.
_lucifer: ahh, I see. I think we may want to make the request_consumer into an actual daemon, rather than starting with with nohup.
alastairp
unit tests are passing in github, but failing for me (`self.listenstore.insert(listens)` -> AttributeError: 'NoneType' object has no attribute 'insert'), looking into why
ruaok
I'll get moving on the other comments.
_lucifer
ruaok, sounds interesting. but i do not know how to do that. let's discuss it in detail later when you are available.
ruaok
+1
alastairp
_lucifer: in fact, the app startup process inside our docker (service files, etc) is exactly the same process as this, so we could reuse the mechanism
Oh, just seeing your comment reosarevok are you on this?
reosarevok
Mr_Monkey (and Freso): I blocked their jira editing privs (if I'm right about how that works) because just deleting the user makes it so that they can re-add it immediately
alastairp
reosarevok: it looks like it's not fixed yet. leave open (or review submittedn) thanks
reosarevok
But this is the second time they do this
So, we could use a better way
They also tried to spam our github at some point
Mr_Monkey
Thanks for dealing with it. Can't imagine what they're trying to get out of that.
ruaok
I dont understand most spammers.
reosarevok
Chances are this specific one just has some sort of mental issue? The whole thing is super rambling. But who knows
Anyway, if you see it happen again, please do ping me, Freso or yvanzo ASAP
Any of us should be able to deal with it
alastairp
Mr_Monkey: I'm seeing some weird frontend interaction issues with the new time ranges PR
after loading some listens from spotify. I'm looking into it a bit more, but I'm not sure if it's due to the time range storage/redis, or something in the frontend code
(local development version)
ruaok
try deleting the redis volume and restarting.
alastairp
trying that
ruaok
first bits of feedback fixes pushed.
alastairp
that doesn't seem to be it - I think it's mostly to do with the older/oldest newer/newest buttons. it's making the queries to get the updated data, but doesn't seem to be displaying it
ruaok
Mr_Monkey: alastairp: https://vacunacovid.catsalut.gencat.cat/ is now starting to have useful info. Even though I fit the age bracket that is being vaccinated now, I tried for a cita and got a: Your group is hasn't been called yet. I'll keep trying.
ruaok: this is what I'm trying to work out with the frontend - now that I see some problems with the frontend I'll try and use the API to test the listenstore independently
ruaok
what problems are you seeing? anything I can help with?