#musicbrainz-devel

yea we run kafka at work

you've tried this one, right? http://stackoverflow.com/questions/23228222/run...

I don't have a huge amount of hands on, unfortunately

some of the answer below might be interesting to try too.

darwin: bummer.

only one VM experiences this.

no, I haven't tried removing directories

Gentlecat: try it. and then maybe try the lesser answers below.

looks like our data dir for kafka is /var/lib/kafka/kafka-logs

not sure about zookeeper though

it's not /tmp/zookeeper

/var/lib/zookeeper ?

yeah, this one has things

Created topic "listens".

let's try again

"success"

yay?

odd.

at least we have a workaround for this case.

still nothing in my profile though

is the writer script working?

running...

which one is that?

listenstore-kafka-to-cassandra-writer.py?

yes

no, it's not

did you run python setup.py develop in the listenstore dir?

cassandra_consumer.py in the root is the old one.

I think I did

does the script run?

running listenstore-kafka-to-cassandra-writer.py solved the issue with missing listens on my profile page

I guess it's all working now

\ø/

time to update README.md

lel

phew.

fix what?

it happens only for you.

I wonder if it has to do that you're not on a mac.

make a note in README and let's move on

ok

is JIRA broken? I'm getting 502s

rebooting the server, which hosts mail as well.

should be back in a sec.

oh cool. good to see you got it going

Gentlecat: ERROR: 58P01: could not open extension control file "/usr/share/postgresql/9.3/extension/uuid-ossp.control": No such file or directory

9.3?

yes.

do I need 9.4?

I think we run 9.4

k

at least that's what I've been using all this time

I'm putting that into readme

I'll uprade

yes, we’re using 9.4, it’s not available in the version of ubuntu we’re using

huh?

there's postgreql-9.4 package

I coudln't find 9.4 earlier.

what does apt-cache policy say?

apt-cache policy postgresql-9.4

sorry

I see it now.

but I did an apt-get update

ok, using postgresql.org packages

ruaok: fyi, I got the leader error as well

persistent or only once?

everyone gets it once.

I poked it a few times, did the delete thing, used the kafka producer cli to put data in it

and it works now

I’m not sure which of the things fixed it

yeah, i think i understand how it gets it once, if the topic doesn’t exist

delete thing worked for Gentlecat

I wonder if we could disable automatic topic creation, and run the create topic command during setup

perhaps that would stop the error from happening

might be more robust, yes

apparently it is a timeout issue since creating a new topic takes a bit.

ahhh

so it keeps trying to create it again and again with every request that comes in?

usually the second request succeeds, just not in your case.

the easiest fix is to use the kafka-topics.sh script to create the topic upon installation.

cool, that’s a good piece of knowledge to have

ok, 9.4 succeeds in installing that extension but fails on something else

ruaok: do we have a plan of attack for this week? is it written down somewhere?

sqlite3?

why is it using sqlite?

yeah, that

I have a plan of attack, but that is for another important project that I'm working on this week.

is your connection string defined?

none for LB.

we switched to sqlalchemy, so you need to update config file

don't know if you've done that already

PG_CONNECT = "dbname=listenbrainz user=listenbrainz password= host=localhost port=5432"

no, that's the old one for psycopg2

ok

see sample config

or just copy SQLALCHEMY_DATABASE_URI = "postgresql://listenbrainz@/listenbrainz"

thanks.

working, server started.

https://github.com/metabrainz/listenbrainz-serv... did you insert before other statements in that file?

there's a special space for custom stuff

no

"add this line at the beginning" :)

oh, details. :)

I think we had this issue with alastairp before

ok, +1 then.

yup

“I think I had this problem before and alastairp fixed it for me"

alastairp, our problem child.

right

you talk about me because I know you care

I'm only retaliating. :-p

returning None

alastairp is not going to like that :)

did you already read my commit?

heh

I would probably agree

Gentlecat: https://github.com/metabrainz/listenbrainz-serv...

exceptions are the jam :)

?

feh, time to re-merge the schema branch again.

we should really merge that soon.

if not messybrainz_resp: raise MessyBrainzUnavailableException

and in catches below

something like that

ok, at this point there are much bigger fish I would like to fry.

like getting it going. my solution is "good enough".

yeah, I'm just saying :)

make mr fussypants happy

Gentlecat: I won’t tell him that “return” implicitly is the same as “return None” if you don't

:P

ok, I have to head out again. I’ll be back in Barcelona about 7:30 tomorrow afternoon, so will take a look at all the new code then

k

I may merge Russs new schema branch before then.

ok

cool

I've run it several times and understand what it does.

I wanted to fix msb as well

let me update it to resolve the conflicts with sqlalchemy

add in rj’s recommendations about adding artist and album ids