hi Lyto and _lucifer, the link appears to work for me too - take note that it's on an ftp site, not http and your connection may be doing funny things with it
2021-01-11 01158, 2021
_lucifer
alastairp: hi!
2021-01-11 01105, 2021
_lucifer
yeah that's a poosibility
2021-01-11 01106, 2021
_lucifer
I have added the tests for editor to BU as well. These database tests however only work with Python3. I tried testing with Python2 but they fail due to some encoding errors.
2021-01-11 01157, 2021
_lucifer
It might be possible to make the tests work with Python2 byt changing the test data used but I am not sure if its worth the effort.
2021-01-11 01158, 2021
alastairp
specifically, chrome (and I believe firefox now too?), don't support ftp natively any more. on my mac it passed off the download to finder.
2021-01-11 01113, 2021
alastairp
I don't mind not supporting those tests in python2
2021-01-11 01136, 2021
alastairp
early this year I should look at finalising the python3 migration for AB
2021-01-11 01148, 2021
_lucifer
I'd like to help with that :)
2021-01-11 01154, 2021
alastairp
great
2021-01-11 01121, 2021
alastairp
really, the main focus here is jmp_music__'s work on integrating scikit-learn.
2021-01-11 01101, 2021
alastairp
we have to make sure that it's integrated through the whole model training pipeline, and then ensure that the models using both the old and new system are approximately equal
2021-01-11 01118, 2021
alastairp
we did a lot of work on that over the last year, so I'm quite happy with it
2021-01-11 01139, 2021
_lucifer
I do not have any other particular tasks at hand currently so I can take that up.
2021-01-11 01109, 2021
_lucifer
Is there some document or ticket which I can read to get upto date on work, alastairp ?
2021-01-11 01149, 2021
Darkloke joined the channel
2021-01-11 01138, 2021
alastairp
great, let's organise a time to have a quick chat with jmp_music__ about what he's done and what's missing
2021-01-11 01102, 2021
Gazooo79494 has quit
2021-01-11 01121, 2021
alastairp
I'll write up some quick notes about all of the things that we need and we can see what step we're up to
these are the 4 key features that we need. We're still looking at testing the first two items, but you could definitely continue with the third one
2021-01-11 01123, 2021
alastairp
iliekcomputers: !!!
2021-01-11 01127, 2021
alastairp
hi! how are you?
2021-01-11 01136, 2021
ruaok
moin!
2021-01-11 01148, 2021
ruaok
hi alastairp, hi iliekcomputers!
2021-01-11 01152, 2021
ruaok
long time no see!
2021-01-11 01117, 2021
iliekcomputers
alastairp: good good, last 3 months at work were quite busy. i took 3 weeks off for the new years, just getting back now. :D
2021-01-11 01144, 2021
iliekcomputers
congrats on shipping the playlists, they look really nice!
2021-01-11 01132, 2021
ruaok
thanks. loads of cleanup still...
2021-01-11 01129, 2021
iliekcomputers
ooh, we moved off travis to jenkins, nice
2021-01-11 01143, 2021
ruaok
we got a lot of shit done in the past 3 months. :)
2021-01-11 01142, 2021
alastairp
yeah, trying to follow your lead in lots of small incremental improvements
2021-01-11 01156, 2021
zas
Hey iliekcomputers, happy new year to you too!
2021-01-11 01116, 2021
_lucifer waves at iliekcomputers
2021-01-11 01137, 2021
iliekcomputers
hey zas, _lucifer !
2021-01-11 01110, 2021
alastairp
zas: I cleaned up ~10gb of images from williams, but I think that the amount of free space is low enough that this will always be a problem if we don't move stuff
2021-01-11 01136, 2021
alastairp
do you have some thoughts? I'll try and update test scripts to clean up better, I don't know why they weren't doing it
2021-01-11 01111, 2021
alastairp
otherwise we look at moving jenkins? :/
2021-01-11 01140, 2021
ruaok
if jenkins is using the disk space, then lets.
2021-01-11 01158, 2021
ruaok
having the FTP site AND jenkins on one machine is bound to create diskspace issues.
2021-01-11 01121, 2021
ruaok
lets find a machine that has more free diskspace and move there. it would be easier than moving the FTP to the storage box.
2021-01-11 01131, 2021
ruaok
which would likely affect FTP speeds.
2021-01-11 01132, 2021
alastairp
theoretically, if we get it to clean up after itself it should use no more than 1 version of the image per test run
2021-01-11 01153, 2021
alastairp
but that's still looking at many gb given how many tests we have now
2021-01-11 01155, 2021
yvanzo
my guess is that recording's first release date increased search indexes dumps and maybe JSON dumps too.
2021-01-11 01101, 2021
ruaok
it still sounds like a diskspace heavy task that might be best elsewhere.
2021-01-11 01119, 2021
ruaok
yvanzo: very likely yes.
2021-01-11 01120, 2021
alastairp
OK. I'm happy to try and tackle the migration if someone suggests a new location
2021-01-11 01134, 2021
ruaok
zas: do you have an idea for another server?
2021-01-11 01124, 2021
alastairp
iliekcomputers: hey, while I have you here, can you give my user (alastairp) on readthedocs admin on listenbrainz? I see that you're the only other admin there :)
2021-01-11 01140, 2021
iliekcomputers
yes, sure.
2021-01-11 01132, 2021
alastairp
ruaok: you asked me to ping you after we had finished doing playlist stuff to remind you to configure https on similarity.acoustibcrainz.org on bono
2021-01-11 01102, 2021
ruaok
ah yes.
2021-01-11 01138, 2021
ruaok
where does that installation live, again?
2021-01-11 01101, 2021
alastairp
/home/acousticbrainz/acousticbrainz-server
2021-01-11 01114, 2021
alastairp
using the docker-compose.yml file in that directory
2021-01-11 01159, 2021
ruaok
I think your docker-compose foo is stronger than mine... I just got used to using docker run commands from a shell script.
Mr_Monkey: ruaok: I'm teaching the next 3 weeks on weds and thurs, plus the newer restrictions and recommendations I'm not sure I'll make it into the office this week
2021-01-11 01147, 2021
alastairp
maybe next week I'll see how things are going and see if Friday works
2021-01-11 01158, 2021
ruaok
agreed, this week I have too much other stuff that needs doing.
2021-01-11 01114, 2021
ruaok
friday would be better than wed for me now.
2021-01-11 01130, 2021
alastairp
ruaok: is the network flag necessary for LE, or is it just what you use to link your containers to have access to the mb database?
2021-01-11 01139, 2021
Mr_Monkey waves at iliekcomputers
2021-01-11 01150, 2021
ruaok
alastairp: LE
2021-01-11 01152, 2021
Mr_Monkey
alastairp: Sure, I was also thinking of staying in this week at least
2021-01-11 01103, 2021
ruaok
but its both, really, alastairp
2021-01-11 01130, 2021
alastairp
can you please un-vim?
2021-01-11 01148, 2021
ruaok
done
2021-01-11 01110, 2021
ruaok
but what the LE container does is look for HTTP ports that get exposed from containers. if it finds some and these magic variables are set, it configures the HTTPS LE bits and the proxy.
2021-01-11 01131, 2021
ruaok
once you bring your container up, look at the output from the le container.
reosarevok: it was bugged already but rarely triggered until then.
2021-01-11 01141, 2021
reosarevok
Oh, ok. Good catch, thanks
2021-01-11 01125, 2021
yvanzo
Good catch from zas actually ^
2021-01-11 01145, 2021
reosarevok grumbles at MBBE-31
2021-01-11 01112, 2021
reosarevok
New stuff that needs changing keeps appearing even before I'm done with the previous one :D
2021-01-11 01159, 2021
yvanzo
updating beta.mb.o too
2021-01-11 01152, 2021
zas
ruaok, alastairp: you want to move jenkins somewhere else? can it run on a hetzner VM? does it depend on mb-hetzner infrastructure (consul etc...)?
2021-01-11 01137, 2021
alastairp
it has no requirements on other hetzner infrastructure
2021-01-11 01126, 2021
alastairp
although I think bitmap has a few processes that do work on jenkins and then put the data somewhere, but I guess that's just an rsync
2021-01-11 01148, 2021
zas
ok, let's wait for bitmap then, and we'll decide what to do
2021-01-11 01117, 2021
zas
ruaok: I thought about kiki, I think we should just replace the machine, with new OS & SSDs, but can we still have the second interface as an option? I would go for AX41-NVME since they provide more cores. That's the time to upgrade our scripts to fit new Ubuntu versions.
2021-01-11 01136, 2021
zas
So the plan would be to switch to herb (fully, with mbstats)
2021-01-11 01146, 2021
zas
and just replace kiki hardware
2021-01-11 01157, 2021
zas
then I need some time to configure it properly and adapt scripts to new OS, so we are a bit weak for few days... (herb's failure is always possible)
