-
snazz
I have a lot of free time on my weekends with current world events >_>
2020-09-11 25518, 2020
-
slriv has quit
2020-09-11 25518, 2020
-
reosarevok
yvanzo: unless that's just it trying to keep stuff in some tmp folder, in which case maybe it will work if I index by entity
2020-09-11 25532, 2020
-
yvanzo
reosarevok: sir reads data from pg, and submit it to solr
2020-09-11 25544, 2020
-
slriv joined the channel
2020-09-11 25521, 2020
-
shivam-kapila
snazz: Here's the issue tyracker
2020-09-11 25524, 2020
-
shivam-kapila
tracker*
2020-09-11 25525, 2020
-
shivam-kapila
2020-09-11 25550, 2020
-
snazz
Ah thanks, I already found it in the contrib section of the Listenbrainz website ^_^
2020-09-11 25554, 2020
-
snazz
thats how I found the IRC channel
2020-09-11 25526, 2020
-
yvanzo
reosarevok: in live indexing mode, it also watches rabbitmq
2020-09-11 25546, 2020
-
iliekcomputers
snazz: LB-686 would be really nice to get a newcomer on
2020-09-11 25546, 2020
-
BrainzBot
2020-09-11 25557, 2020
-
shivam-kapila
iliekcomputers: I am working on it now itself
2020-09-11 25505, 2020
-
reosarevok
yvanzo: I'm mostly trying to figure out why the indexer is filling my main partition while docker and sir both live in a different one
2020-09-11 25514, 2020
-
iliekcomputers
shivam-kapila: ah
2020-09-11 25528, 2020
-
shivam-kapila
I got a replacement keyboard yesterday. It has been broken since 10 days
2020-09-11 25545, 2020
-
iliekcomputers
i still think a newcomer's eyes on that would be nice, will probably see something that we're too used to
2020-09-11 25548, 2020
-
yvanzo
reosarevok: swap?
2020-09-11 25517, 2020
-
iliekcomputers
LB-642 is also a nice first bug
2020-09-11 25517, 2020
-
BrainzBot
2020-09-11 25546, 2020
-
reosarevok
yvanzo: maybe - how do I run the indexer on only one entity at a time?
2020-09-11 25554, 2020
-
reosarevok
I tried to follow the instructions but I didn't figure it out
2020-09-11 25502, 2020
-
yvanzo
reosarevok: make sure docker volumes are not on your main partition
2020-09-11 25510, 2020
-
shivam-kapila
iliekcomputers: I tend to agree. I can handover to snazz if you find it perfect
2020-09-11 25551, 2020
-
yvanzo
reosarevok: sudo docker-compose exec indexer python -m sir reindex --entity-type instrument
2020-09-11 25553, 2020
-
snazz
I don't mind which bug you'd like me to pick up. Whatever you think is most suitible :)
2020-09-11 25518, 2020
-
yvanzo
reosarevok: sudo docker-compose exec indexer python -m sir --help # :)
2020-09-11 25533, 2020
-
snazz
Is there anything in particular I need to contribute, other than a jira account on your metabrainz website?
2020-09-11 25540, 2020
-
snazz
and a github account of course..
2020-09-11 25505, 2020
-
yvanzo
snazz: you have it all
2020-09-11 25542, 2020
-
iliekcomputers
snazz: i think LB-686 would be nice for you to start with
2020-09-11 25543, 2020
-
BrainzBot
2020-09-11 25512, 2020
-
snazz
Excellent. I have to hop off the train shortly, but I'll check back in soon with a Jira account and I can pick up either LB-686 or LB-642
2020-09-11 25512, 2020
-
iliekcomputers
and pretty high impact as well
2020-09-11 25513, 2020
-
BrainzBot
2020-09-11 25528, 2020
-
iliekcomputers
sounds good, feel free to ping me if you have any questions
2020-09-11 25540, 2020
-
shivam-kapila
iliekcomputers: I will move to design stuff then
2020-09-11 25544, 2020
-
snazz
iliekcomputers: Okay no worries!
2020-09-11 25512, 2020
-
iliekcomputers
shivam-kapila: sure! I think you could help me build the feed page.
2020-09-11 25524, 2020
-
shivam-kapila
sure thing
2020-09-11 25547, 2020
-
iliekcomputers
once the follow button is done, i'd like to show the feed and following/follower list to users
2020-09-11 25551, 2020
-
snazz has quit
2020-09-11 25532, 2020
-
shivam-kapila
hm
2020-09-11 25541, 2020
-
shivam-kapila
ruaok: Did you get a chance to move the rec_msid lookup to labs
2020-09-11 25548, 2020
-
iliekcomputers
shivam-kapila: if you can come up with a design that is not more than a day's worth of engineering work, that'd be nice.
2020-09-11 25504, 2020
-
shivam-kapila
iliekcomputers: for the feed page right?
2020-09-11 25504, 2020
-
iliekcomputers
more than a day or two*
2020-09-11 25506, 2020
-
iliekcomputers
yeah
2020-09-11 25537, 2020
-
iliekcomputers
and a list of people you're following / people who are following you
2020-09-11 25513, 2020
-
ruaok
shivam-kapila: not yet. do you have something ready to go to production?
2020-09-11 25517, 2020
-
shivam-kapila
ruaok: not yet but till monday I guess my work will be done. I will rely on bono and then when done change the url
2020-09-11 25503, 2020
-
shivam-kapila
iliekcomputers: What else are we gonna show along with the list. what the people I am following shared or what are they listening to?
2020-09-11 25547, 2020
-
iliekcomputers
for now a list of listens.
2020-09-11 25558, 2020
-
iliekcomputers
then when we allow people to recommend recordings, those
2020-09-11 25508, 2020
-
shivam-kapila
hm okay
2020-09-11 25514, 2020
-
iliekcomputers
the listens will be playable
2020-09-11 25554, 2020
-
yokel joined the channel
2020-09-11 25523, 2020
-
yokel has quit
2020-09-11 25548, 2020
-
yvanzo
reosarevok: open a shell with: docker-compose exec musicbrainz bash # then run usual prove and all.
2020-09-11 25504, 2020
-
reosarevok
Ok, seems I need to create a new test db but that's not a big deal
2020-09-11 25533, 2020
-
reosarevok
If I want to connect to pink via ssh, I guess I just need to edit my dbdefs in the same way as usual, then restart the container?
2020-09-11 25558, 2020
-
yvanzo
ssh -L 172.17.0.1:65401:localhost:65401 pink -N
2020-09-11 25549, 2020
-
yvanzo
See PROD_STANDBY in lib/DBDefs.pm
2020-09-11 25530, 2020
-
yvanzo
ssh # from the host
2020-09-11 25556, 2020
-
reosarevok
What's the # ? Is it just your way of marking the rest as not part of the instruction?
2020-09-11 25500, 2020
-
reosarevok
(I assume so but)
2020-09-11 25518, 2020
-
yvanzo
yes, and that was about the ssh -L...
2020-09-11 25524, 2020
-
reosarevok
Sure
2020-09-11 25529, 2020
-
yokel joined the channel
2020-09-11 25503, 2020
-
reosarevok
yvanzo: ok, got that to work :) Now, re: indexing again :D
2020-09-11 25542, 2020
-
reosarevok
2020-09-11 25548, 2020
-
pristine___
where is `dist` dir?
2020-09-11 25550, 2020
-
pristine___
2020-09-11 25501, 2020
-
reosarevok
yvanzo: Looking at the code, it actually seems to want entity_type instead?
2020-09-11 25513, 2020
-
reosarevok
But I couldn't figure out how to pass that from the CLI in the first place :/
2020-09-11 25521, 2020
-
pristine___
shivam-kapila: ^
2020-09-11 25548, 2020
-
shivam-kapila
pristine___ not sure what you are asking
2020-09-11 25534, 2020
-
pristine___
Lol. Nothing.
2020-09-11 25540, 2020
-
pristine___
I just slipped.
2020-09-11 25547, 2020
-
pristine___
shivam-kapila: so will I have to make few changes in main.js as well?
2020-09-11 25506, 2020
-
yvanzo
reosarevok: sudo docker-compose exec indexer python -m sir reindex --entity-type instrument # works for me
2020-09-11 25524, 2020
-
reosarevok
Thanks! Let's see
2020-09-11 25533, 2020
-
yvanzo
see also sudo docker-compose exec indexer python -m sir --help
2020-09-11 25509, 2020
-
reosarevok
Yes, I've seen that, but nothing there says to pass --entity-type to reindex :)
2020-09-11 25527, 2020
-
reosarevok
Anyway, trying
2020-09-11 25523, 2020
-
yvanzo
sudo docker-compose exec indexer python -m sir reindex --help # it does
2020-09-11 25544, 2020
-
shivam-kapila
pristine___: no
2020-09-11 25505, 2020
-
shivam-kapila
thats compiled and generated
2020-09-11 25506, 2020
-
sumedh joined the channel
2020-09-11 25554, 2020
-
yvanzo
reosarevok: sudo docker system df -v # to check disk usage per image/container/volume
2020-09-11 25511, 2020
-
reosarevok
Wtf
2020-09-11 25516, 2020
-
reosarevok
Instrument worked just fine
2020-09-11 25524, 2020
-
reosarevok
I tried work on its own, all froze again
2020-09-11 25555, 2020
-
reosarevok
But for others work indexing isn't broken, right?
2020-09-11 25505, 2020
-
yvanzo
right
2020-09-11 25512, 2020
-
reosarevok
Wat.
2020-09-11 25521, 2020
-
yvanzo
(I didn't try with latest sample dump though)
2020-09-11 25532, 2020
-
reosarevok
It is frozen to the point of probably needing a full hard reboot :/
2020-09-11 25548, 2020
-
reosarevok
Not sure how to debug it though because everything freezes so
2020-09-11 25552, 2020
-
yvanzo
did you try the above docker df?
2020-09-11 25511, 2020
-
reosarevok
Not yet, I was already trying work
2020-09-11 25515, 2020
-
reosarevok
Rebooting and I'll try
2020-09-11 25518, 2020
-
yvanzo
systemctl stop docker
2020-09-11 25536, 2020
-
reosarevok
That would help if I could get to even type in the terminal :D
2020-09-11 25549, 2020
-
reosarevok
Literally nothing responded
2020-09-11 25510, 2020
-
reosarevok
(writing from the phone)
2020-09-11 25526, 2020
-
yvanzo
mabye check if it might be a bug specific to docker and your distro
2020-09-11 25500, 2020
-
reosarevok
I'd be surprised, I'm on latest ubuntu, but I can check :)
2020-09-11 25508, 2020
-
reosarevok
LEt's see the df first
2020-09-11 25530, 2020
-
yokel has quit
2020-09-11 25520, 2020
-
reosarevok
And ok, yeah, reindex --help specifically does, didn't realize there were multiple levels of --help :)
2020-09-11 25546, 2020
-
reosarevok
2020-09-11 25504, 2020
-
MagnusSvensson[m has quit
2020-09-11 25504, 2020
-
ephemer0l has quit
2020-09-11 25504, 2020
-
Leftmost has quit
2020-09-11 25504, 2020
-
revi has quit
2020-09-11 25504, 2020
-
hugo___ has quit
2020-09-11 25504, 2020
-
SomalRudra has quit
2020-09-11 25505, 2020
-
_lucifer has quit
2020-09-11 25505, 2020
-
Glycem has quit
2020-09-11 25505, 2020
-
fs has quit
2020-09-11 25524, 2020
-
ephemer0l joined the channel
2020-09-11 25536, 2020
-
SomalRudra joined the channel
2020-09-11 25542, 2020
-
Leftmost joined the channel
2020-09-11 25545, 2020
-
_lucifer joined the channel
2020-09-11 25501, 2020
-
revi joined the channel
2020-09-11 25529, 2020
-
yvanzo
reosarevok: sudo docker inspect -f '{{.Mountpoint}}' musicbrainz-docker_solrdata
2020-09-11 25504, 2020
-
yvanzo
or even: sudo docker inspect -f '{{.Mountpoint}}' musicbrainz-docker_solrdata | xargs sudo df -h
2020-09-11 25522, 2020
-
reosarevok
2020-09-11 25518, 2020
-
reosarevok
All other big ones are also in the right partition
2020-09-11 25510, 2020
-
reosarevok
I'm trying to reindex release - that should be as big as work, I guess, so if that works it's probably something in work specifically
2020-09-11 25548, 2020
-
yvanzo
docker-compose top # can be useful too
2020-09-11 25558, 2020
-
MagnusSvensson[m joined the channel
2020-09-11 25508, 2020
-
reosarevok
release worked fast and fine
2020-09-11 25521, 2020
-
flamingspinach joined the channel
2020-09-11 25523, 2020
-
yvanzo
go for work then :)
2020-09-11 25534, 2020
-
reosarevok
2020-09-11 25558, 2020
-
hugo___ joined the channel
2020-09-11 25558, 2020
-
Glycem joined the channel
2020-09-11 25500, 2020
-
hugo___ has quit
2020-09-11 25500, 2020
-
hugo___ joined the channel
2020-09-11 25501, 2020
-
reosarevok
Is there anything that I can leave running in another terminal window to maybe log everything in real time? Or can I make the indexer verbose?
2020-09-11 25508, 2020
-
yvanzo
I mean useful when indexer is running, to check number of processes
2020-09-11 25524, 2020
-
reosarevok
Ok
2020-09-11 25534, 2020
-
reosarevok
So run work, then run this?
2020-09-11 25541, 2020
-
yvanzo
while sleep 1; do docker-compose top >> top.log; done
2020-09-11 25515, 2020
-
yvanzo
while sleep 1; do date >> top.log ; docker-compose top >> top.log; done
2020-09-11 25511, 2020
-
yvanzo
reosarevok: yes you can make indexer more verbose too, not sure that will help though
2020-09-11 25506, 2020
-
yvanzo
sudo docker-compose exec indexer python -m sir --debug --sqltimings reindex --entity-type work
