looks like something may be up with the musicbrainz web container. setting MUSICBRAINZ_WEB_SERVER_HOST is propagating into the container, but isn't being used to generate the correct URLs: https://pastebin.com/SxpvA0RW
this raises the question in my mind though: is that just an artifact of past development? why is it even attempting to supply a hostname? to be able to serve static content from a CDN endpoint?
...and why is everything running as root? :D
yvanzo
red_beard: are you sure your container run with the latest built image? "restart" doesn't seem to have replaced it.
red_beard
yvanzo: regardless, the environment variable supplied at runtime should be overriding the one built into it.
yvanzo
It requires a hostname to build and serve static resources (js, css).
red_beard
yvanzo: ok. i'm firing off stop/rm/up now (and taking the dog for a walk, then i'll come back and check on it)
[listenbrainz-server] vansika opened pull request #1112 (master…remove-rating-sentry-log): update logging level from error to info of rating beyond the range messages https://github.com/metabrainz/listenbrainz-serv...
I assume that's included in "discussing the schedule"
_lucifer
alastairp: the rating issue you fixed seems to be back again, can you check if it is the same or some new issue?
*the rating stars
reosarevok
12:00 UTC is about the earliest I can make it on Sat, but I assume for example bitmap won't be there to talk MB that early anyway
alastairp
off the top of my head, you might need to rebuild static files, or it might be related to your bootstrap downgrade
_lucifer
i'll check if rebuilding the files works
ruaok
reosarevok: for you.... lets see. 6am.
alastairp
otherwise if that doesn't work I'll have a look again later. If you get 302 and 307 done, I'll release to beta then we can take a step back and see what works and what doesn't
I'm not really here today, so let's talk this afternoon closer to meeting time
_lucifer
sure!
reosarevok
ruaok: I'm pressing apples until 2 pm my time, so :p
You know, I could skip it, but it's...
😎
a pressing matter
ruaok
I'm glad our summit rates so high on your list of priorities. :)
Well, I agreed on that when I had forgotten it was this weekend :p
But then I thought "any MB stuff is likely to be later since Chicago"
:)
Oh, cool, no worries then
TOPIC: MetaBrainz Community and Development channel | MusicBrainz non-development: #musicbrainz | Channel is logged; see https://musicbrainz.org/doc/IRC for details | Meeting agenda: Summit schedule (ruaok), Reviews
_lucifer
so the sessions will be like each team presenting the roadmap, progress in the past year and related stuff?
ruaok
I think each team should give at least one session where they do exactly that.
but I think we should also have some sessions where we have general discussion and misc topics should be raised.
we'll discuss all this at the start of today's meeting.
_lucifer
awesome!
ruaok
> Request you to please find the below hint of the baking details that you need to use in Banking verification page.
[listenbrainz-server] vansika merged pull request #1112 (master…remove-rating-sentry-log): update logging level from error to info of rating beyond the range messages https://github.com/metabrainz/listenbrainz-serv...
ruaok: will you be able to restart request consumer? I want to have a look at result of the recent merge
ruaok
on it
iliekcomputers: on leader in ~request_consumer there are a pile of dump files accumulating. eventually that will run out of space. is this on your radar?
iliekcomputers
ruaok: i think we delete the actual files but don't clean up the folders maybe, i'll look into it. thanks for pointing it out.
can you open a ticket?
ruaok
pristine___: iliekcomputers: the request consumer fails to start because a new pythoh dependecy is missing, though it is in requirements.txt -- is there a build step that needs to be carried out?
ah, I see. I only need to run push-request-consumer.sh right?
iliekcomputers
well, i'd push all of them. the dependency will probably be needed on the workers as well, right?
ruaok
unsure, I better do it then
pristine___
Yeah, will be needed on worker since they will run/execute the job.
ruaok
./start-worker-service.sh 5
or ./start-worker-service.sh 4
?
pristine___
It was 3
I think
ruaok
I thought it was 5
pristine___
Three workers we have
total 4 machines, ig
and and one master
not sure if iliekcomputers updated anything
iliekcomputers
3
i've always been doing 3
pristine___
great!
ruaok
so leader only runs namenode. nothing else?
pristine___
yeah!
iliekcomputers
and the spark-master
ruaok
we should be monitoring these nodes to find their utilization.
pristine___
namenode ~ spark-master, namenode is a terminology for HDFS, and spark-master for spark
ruaok
ok, 3 replicas running, master running, consumer request restarted, no error for request consumer.
give it a shot, pristine___
pristine___
likewise, datanode ~ worker
ruaok: yo!
ruaok
we have *5* machines.
are we utilizing them all?
pristine___
i was told we have 4 as far as i remember, not sure about utilizing them all, now I know, i will surely look at the configs
ruaok
yes, one node seems underutilized. please examine when you have a chance.
reosarevok
Your mom seems underutilized (?)
ruaok
yeah, she is bored and at home
_lucifer
just a suggestion, in case if possible how about allocating some resources to experiment with says recs independent of the production
ruaok
not an easy thing to setup.
though, I just learned how we can setup the spark cluster much better than we do now.
I should redo the setup at some point when we can have a bit of time when we don't need the cluster.
d4rkie has quit
iliekcomputers
i was also under the impression that we had 3 workers and 1 master
Nyanko-sensei joined the channel
pristine___
ruaok: recs generated, can you have a look at your recs?
ruaok
the similar artists recs seem more diverse, for sure.
all my scores are `1`
is that right?
pristine___
ruaok: all one on the first page
ruaok
on all pages.
pristine___
Hmm.... The top artist isn't diverse though
Yeah, 1 on all pages for similar artist.
The scores don't make much sense now. They depend on the input to the recommender. _lucifer is working on normalization of input, we can expect better and meaningful scores then.
ruaok
top artist gets better on page 2 and on. so, deffo improvement.
why don't you post on community and ask people to take a look?