12:55 PM
CatQuest
reosarevok ಠ_ಠ
2017-06-07 15821, 2017
12:55 PM
CatQuest
(here it is rain)
2017-06-07 15827, 2017
12:55 PM
CatQuest
(well the plants like it.. i guess)
2017-06-07 15806, 2017
12:58 PM
Rotab
i like it
2017-06-07 15818, 2017
12:58 PM
Rotab
no pesky sun
2017-06-07 15835, 2017
12:58 PM
CatQuest
but Rotab you're a datepalm anyway :>
2017-06-07 15841, 2017
12:58 PM
CatQuest
a plant
2017-06-07 15842, 2017
12:58 PM
Rotab
heh
2017-06-07 15828, 2017
13:16 PM
ruaok
zas: once again I'm having issues with getting a docker container to stop.
2017-06-07 15839, 2017
13:16 PM
ruaok
it was doing massive amounts of logging, now stopping the container times out.
2017-06-07 15859, 2017
13:16 PM
ruaok
restarting docker daemon just restarts the crappy container.
2017-06-07 15807, 2017
13:17 PM
ruaok
any ideas?
2017-06-07 15815, 2017
13:17 PM
zas
which container on which host?
2017-06-07 15827, 2017
13:17 PM
ruaok
lemmy:listenbrainz-influx-writer
2017-06-07 15811, 2017
13:21 PM
zas
i can stop and restart it without issue
2017-06-07 15808, 2017
13:22 PM
ruaok
meh, now it works. well thanks for your magic.
2017-06-07 15852, 2017
13:22 PM
zas
well, better believe in magic, but i guess in the true world there is a good technical explanation
2017-06-07 15814, 2017
13:23 PM
ruaok
if you have access to that explanation, please share!
2017-06-07 15828, 2017
13:23 PM
zas
the process is writing a lot of logs ? perhaps a sync to disk was somehow hanging
2017-06-07 15827, 2017
13:26 PM
ruaok
damnit.
2017-06-07 15838, 2017
13:26 PM
ruaok gets cockblocked by a 410 error
2017-06-07 15847, 2017
13:26 PM
zas
lol
2017-06-07 15821, 2017
13:27 PM
CatQuest has left the channel
2017-06-07 15836, 2017
13:27 PM
zas
2017-06-07 15809, 2017
13:28 PM
ruaok
thats fine. consult hadn't finished its bit yet.
2017-06-07 15814, 2017
13:29 PM
zas
i think consul-template is started too soon, syslog-ng is not ready yet, hence the "error setting up syslog logger"
2017-06-07 15832, 2017
13:29 PM
zas
a small delay may help
2017-06-07 15844, 2017
13:29 PM
ruaok
who is user marc2k3 ?
2017-06-07 15849, 2017
13:29 PM
ruaok
anyone in here?
2017-06-07 15808, 2017
13:30 PM
ruaok
they are importing my data into LB from last.fm and it keep erroring.
2017-06-07 15807, 2017
13:37 PM
agentsim joined the channel
2017-06-07 15858, 2017
13:38 PM
ruaok
zas: quick favor?
2017-06-07 15817, 2017
13:39 PM
Slurpee joined the channel
2017-06-07 15829, 2017
13:39 PM
ruaok
please change the message from "Please use the API at betaapi.listenbrainz.org" to "Please use the API at beta-api.listenbrainz.org"
2017-06-07 15834, 2017
13:39 PM
ruaok
one has dns that has propagated.
2017-06-07 15842, 2017
13:39 PM
zas
k
2017-06-07 15827, 2017
13:40 PM
ruaok
2017-06-07 15841, 2017
13:40 PM
ruaok
yet
2017-06-07 15845, 2017
13:40 PM
ruaok
2017-06-07 15802, 2017
13:41 PM
ruaok
can I have two front gateways point to the same container?
2017-06-07 15814, 2017
13:41 PM
zas
let me check
2017-06-07 15839, 2017
13:41 PM
agentsim has quit
2017-06-07 15842, 2017
13:42 PM
zas
if ports are different yes
2017-06-07 15854, 2017
13:42 PM
zas
btw, gateways has it, but the backend fails
2017-06-07 15836, 2017
13:43 PM
ruaok
ports are not different though -- just vhost is different.
2017-06-07 15816, 2017
13:44 PM
zas
i mean different ports on the backend host if they run on the same
2017-06-07 15835, 2017
13:44 PM
zas
ah wait
2017-06-07 15843, 2017
13:44 PM
ruaok
I only have one container and for now I want both vhosts to resolve to the same container.
2017-06-07 15847, 2017
13:44 PM
zas
i understand you have ONE container on the backend
2017-06-07 15853, 2017
13:44 PM
ruaok
that!
2017-06-07 15808, 2017
13:45 PM
zas
it can't work, because the health check is based on the name
2017-06-07 15811, 2017
13:45 PM
ruaok
this is future proofing for when we need to move this container to different host.
2017-06-07 15816, 2017
13:45 PM
zas
"beta-api.listenbrainz-web"
2017-06-07 15834, 2017
13:45 PM
ruaok
so, I *have* to run a different container?
2017-06-07 15839, 2017
13:47 PM
zas
yes, for now, it would require a lot of changes in the way we do things to handle the case
2017-06-07 15810, 2017
13:48 PM
ruaok
ok, can you undo the 410 hack then? I can't finish this today.
2017-06-07 15816, 2017
13:48 PM
agentsim joined the channel
2017-06-07 15821, 2017
13:48 PM
ruaok
another docker rabbit hole.
2017-06-07 15822, 2017
13:48 PM
zas
it is theorically possible, but here upstream is considered unavailable because consul is using health checks based on the name
2017-06-07 15839, 2017
13:48 PM
zas
i disable 410, ok
2017-06-07 15806, 2017
13:49 PM
zas
that's not a docker issue, but a consul/our stuff issue
2017-06-07 15824, 2017
13:49 PM
ruaok
s/docker rabbit hole/deployment rabbit hole/
2017-06-07 15851, 2017
13:52 PM
ruaok
back to 3 LB pre-beta issues.
2017-06-07 15826, 2017
14:03 PM
zas
ruaok: can you re-add the beta-api service, but with an extra key/value: "upstream": ""beta.listenbrainz-web", under "proto": "uwsgi", i think i have a solution, but i need to test
2017-06-07 15820, 2017
14:04 PM
ruaok
iliekcomputers: does the last.fm import on beta work for you?
2017-06-07 15825, 2017
14:04 PM
ruaok
doesn't for me. no clue why.
2017-06-07 15836, 2017
14:05 PM
ruaok
2017-06-07 15840, 2017
14:05 PM
ruaok
zas ^^
2017-06-07 15850, 2017
14:05 PM
zas
yes, but remove the double ""
2017-06-07 15855, 2017
14:05 PM
ruaok
:)
2017-06-07 15815, 2017
14:06 PM
zas
not sure if it will work, but worth a try
2017-06-07 15834, 2017
14:06 PM
iliekcomputers
The importer says it is working but nothing shows up on the user page 😕
2017-06-07 15836, 2017
14:06 PM
ruaok
pushed
2017-06-07 15845, 2017
14:06 PM
ruaok
iliekcomputers: yeah, same here. :(
2017-06-07 15834, 2017
14:07 PM
iliekcomputers
I just did two last.fm imports in dev for LB-149 and they worked, weird
2017-06-07 15835, 2017
14:07 PM
BrainzBot
2017-06-07 15839, 2017
14:07 PM
ruaok
still getting 502 on that zas
2017-06-07 15847, 2017
14:07 PM
zas
yes ! should work, wait i'll commit and deploy on kiki, i was testing on herb
2017-06-07 15843, 2017
14:09 PM
ruaok
woot!
2017-06-07 15850, 2017
14:09 PM
ruaok
thanks zas!
2017-06-07 15851, 2017
14:09 PM
zas
it works on kiki
2017-06-07 15802, 2017
14:10 PM
zas
so i can cancel the 410 cancel
2017-06-07 15803, 2017
14:10 PM
ruaok
so, now the 410 block can come back.
2017-06-07 15802, 2017
14:11 PM
zas
done
2017-06-07 15822, 2017
14:11 PM
zas
with "upstream", one can use the upstreams from another service
2017-06-07 15831, 2017
14:11 PM
zas
a bit hacky, but convenient
2017-06-07 15841, 2017
14:11 PM
ruaok
thank you!
2017-06-07 15842, 2017
14:15 PM
ruaok
iliekcomputers: the scraper.js doesn't seem to be using the right API endpoint, even though it was changed in the config.py file.
2017-06-07 15820, 2017
14:16 PM
ruaok
BETA_URL = '''https://beta-api.listenbrainz.org'''
2017-06-07 15825, 2017
14:16 PM
ruaok
from inside the container.
2017-06-07 15841, 2017
14:16 PM
ruaok
didn't we fix that, iliekcomputers?
2017-06-07 15852, 2017
14:16 PM
ruaok
or rather, didn't you fix that? :)
2017-06-07 15845, 2017
14:17 PM
iliekcomputers
ruaok: that is used by alpha_importer
2017-06-07 15858, 2017
14:17 PM
ruaok
rats.
2017-06-07 15805, 2017
14:18 PM
ruaok
we need to have the scraper use it as well.
2017-06-07 15824, 2017
14:18 PM
ruaok
can you whip up a quick PR for what while I debug why the listens are not getting in?
2017-06-07 15807, 2017
14:19 PM
iliekcomputers
ruaok: okay
2017-06-07 15811, 2017
14:19 PM
iliekcomputers
on it
2017-06-07 15831, 2017
14:20 PM
ruaok
thx
2017-06-07 15818, 2017
14:21 PM
arbenina_ joined the channel
2017-06-07 15847, 2017
14:26 PM
ruaok spots two problems
2017-06-07 15855, 2017
14:26 PM
marc2k3 joined the channel
2017-06-07 15854, 2017
14:27 PM
marc2k3
ruaok: I logged in listenbrainz beta yesterday and tried to import from alpha. That's all I've done. I've not tried importing anything from Last.fm
2017-06-07 15816, 2017
14:28 PM
ruaok
ah, great, thanks for letting me know.
2017-06-07 15852, 2017
14:28 PM
ruaok
did the import work as expected?
2017-06-07 15859, 2017
14:29 PM
marc2k3
Checking now...
2017-06-07 15840, 2017
14:31 PM
marc2k3
It looks incomplete compared to the most recent listens on the alpha site.
2017-06-07 15816, 2017
14:32 PM
ruaok
ok, not surprising. thanks.
2017-06-07 15809, 2017
14:34 PM
drsaunders joined the channel
2017-06-07 15827, 2017
14:50 PM
github joined the channel
2017-06-07 15827, 2017
14:50 PM
github
[listenbrainz-server] paramsingh opened pull request #193: Use config.BETA_URL in scraper.js (master...use-beta-api-url)
https://git.io/vH6Os
2017-06-07 15828, 2017
14:50 PM
github has left the channel
2017-06-07 15838, 2017
14:53 PM
ruaok
thanks iliekcomputers.
2017-06-07 15812, 2017
14:54 PM
iliekcomputers
o/
2017-06-07 15830, 2017
14:56 PM
ruaok
next problem: if influx rejects a write, we keep trying to insert it over and over again.
2017-06-07 15847, 2017
14:56 PM
ruaok
2017-06-07 15803, 2017
14:57 PM
ruaok
sorry for the long line. I have zero ideas what are going on there.
2017-06-07 15836, 2017
14:57 PM
ruaok
lets first look at the problem when influx rejects something. we need to log the error and then let the data go.
2017-06-07 15836, 2017
15:02 PM
LordSputnik
anshuman73: about to go, be quick if you're coming!
2017-06-07 15841, 2017
15:03 PM
ruaok
marc2k3: one more question: is this music part of your collection?
2017-06-07 15843, 2017
15:03 PM
ruaok
album=\"Tectonics\",albumartist=\"Adam Freeland\",artist=\"Proper Filthy Naughty\" ?
2017-06-07 15814, 2017
15:04 PM
ruaok
I think we have a bug where we never tested a multi-user setup only with single users and it is failing. lol.
2017-06-07 15852, 2017
15:05 PM
github joined the channel
2017-06-07 15852, 2017
15:05 PM
github
[listenbrainz-server] mayhem closed pull request #193: Use config.BETA_URL in scraper.js (master...use-beta-api-url)
https://git.io/vH6Os
2017-06-07 15852, 2017
15:05 PM
github has left the channel
2017-06-07 15815, 2017
15:06 PM
kyan joined the channel
2017-06-07 15846, 2017
15:07 PM
marc2k3
Yep, that is a legit listen from me
2017-06-07 15800, 2017
15:08 PM
ruaok
ok, great. :)
2017-06-07 15807, 2017
15:08 PM
iliekcomputers
phew
2017-06-07 15819, 2017
15:08 PM
iliekcomputers
2017-06-07 15836, 2017
15:08 PM
ruaok
Audiowerk, 3 Mile Island too marc2k3 ?
2017-06-07 15809, 2017
15:09 PM
ruaok
well, with a 400 error, it will never work and we need to log the error and ditch the data.
2017-06-07 15816, 2017
15:09 PM
ruaok
without any retries.
2017-06-07 15825, 2017
15:09 PM
marc2k3
2017-06-07 15832, 2017
15:09 PM
iliekcomputers
okay
2017-06-07 15857, 2017
15:09 PM
arbenina_ has quit
2017-06-07 15807, 2017
15:10 PM
ruaok
marc2k3: ok, great. then we may not have that problem.
2017-06-07 15824, 2017
15:10 PM
ruaok
it appears that we have similar tastes in music. :)
2017-06-07 15835, 2017
15:11 PM
iliekcomputers
the thing is we get 400 for the entire data, so we have to go down and break it into half, we don't know which listen is causing the error
2017-06-07 15854, 2017
15:11 PM
iliekcomputers
we do ditch the data eventually already
2017-06-07 15805, 2017
15:12 PM
ruaok
but we fill up the logs with data in the meantime. :(
2017-06-07 15815, 2017
15:12 PM
ruaok
and the container just stops responding
2017-06-07 15844, 2017
15:12 PM
iliekcomputers
2017-06-07 15821, 2017
15:13 PM
iliekcomputers
2017-06-07 15823, 2017
15:13 PM
ruaok
maybe only log when we actually drop a listen.
2017-06-07 15834, 2017
15:13 PM
ruaok
great minds. :)
2017-06-07 15841, 2017
15:13 PM
iliekcomputers
haha :)
2017-06-07 15841, 2017
15:13 PM
ruaok
but, what the fuck is up with that error?
2017-06-07 15854, 2017
15:14 PM
iliekcomputers
ruaok: I think we need to take a close look at how we handle measurement names, I think the problem might be somewhere there.
2017-06-07 15837, 2017
15:15 PM
ruaok
I think you're right.
