#metabrainz

hmmm how long should it be before a new artist appears in the search (indexed)? I put some in 11 hours ago and I still need to a direct search

e.g. https://musicbrainz.org/artist/db32f2a6-c829-4c...

3 hours

well then something is kaput :)

this one too https://musicbrainz.org/artist/0e78715f-5e6d-4c...

they were around the time zas was rebooting everything

fits.

ok, things have been kicked into the head appropriately.

:)

if things are not better in ... 8 hours, ping me again.

okie dokie

is that wake up time?

thanks for the head sup

not at this rate

no probs

it will be around 10am then :p

zas: I curious, have you set up SMART monitoring via Grafana or directly using cron+smartctl+sendmail?

SothoTalKer, no it will be around 6pm :)

for you

Always ahead

:-)

MajorLurker, ruaok: search indexer stopped to work after bowie fan change, we didn't notice :( Refreshed search indexes were pulled by search servers just now. https://stats.metabrainz.org/d/000000063/search...

bloody fan.....

i hope it wasnt bloody

well the John Lennon one was :)

(thanks to reosarevok)

yep

hehe

zas etc can confirm that it is all good now :)

Leo_Verto: we only few machines with SMART monitoring atm (spike), it's on my todo list, i plan to use https://github.com/influxdata/telegraf/tree/mas... to get metrics in grafana

safe trip samj1912

Using https://mainstream.ghan.nl/export.html and uploading the file compressed does not work

For the life of me IDK which software can produce a JSON structure like the one required in this function https://github.com/metabrainz/listenbrainz-serv...

And the importer fails with `error fetching last.fm page=1, retrying in 3s 49 import%20line%20125%20%3E%20eval:166:9`

which I assume is the JavaScript function lastfm_import()

oh, in chrome works fine...

Not so in the latest Firefox

shmibs: You're in the right place, but it's a Sunday and people who might know might not be sitting in front of their machines right now. Stick around and someone should eventually come around who can answer. :)

(Alternatively, esp. if you can't stick around, you may want to ask on our forums instead: https://community.metabrainz.org/ )

Oops. That was for shackra, not shmibs, but seems shackra already left. C'est la vie.

ah, don't worry; feeling a little less lonely now that you highlit ^_^

awwww

bukwurm_: weekly meeting in 1 and a half hours?

LordSputnik: 👍

You guys mind if I drop in?

oh hai

long time no see. how goes Leftmost?

Goes alright. Work has been hellishly busy lately. How have things been around here?

slow

:D

zas and bitmap are heroes however

also all the other devs

sam has finally done exams \o/

gsoc is officially on the way

aaand. uh 17th of may is this week :D \o/

It is! Trying to figure out what I should make.

o_O

LordSputnik, pong!

Leftmost: you should buy kransekake :D

that is the most traditional iirc

Hi Leftmost LordSputnik!

or just regular bløtkake

bukwurm: so, how have you been this last week, and have you had a chance to do anything? :)

oh i mightnot have madeit clear with my 2oh hai" but i kidna wanted in also if i'm not in the way too much

(pls tell me to stfu if necessary)

LordSputnik: This week unfortunately i was unable to work much in things.

*on

I was trying to finish up my other projects so that dont interfere gsoc coding period.

OK, I haven't made much progress either

I had a water leak in my flat to deal with and a load of other stuff this week which knocked out a few evenings :P

LordSputnik: Ok

But I think I have an idea of how I'd like the functional data-js stuff to work now

LordSputnik: Great!

LordSputnik, do you have any notes on that?

Just to catch Leftmost up: Last week we went through bukwurm's proposal and an architecture document he made to describe how stuff gets from data dumps to our database

He probably has the links to those more accessible than I do - bukwurm, could you paste them here again?

In the meantime, the plan for functional stuff is to convert form data to a "normalized" form in site, which will be a representation of an entity based around Immutable.Records form immutable-js

Then we pass that to data-js functions which compare against the original entity (made really easy, since Immutable-js structure can be compared by value), and based on the comparison results, build up a query to execute

Leftmost:

LordSputnik, sounds great.

Aliases/identifiers/relationships can be represented as Immutable.Sets

There have been some changes to this, primarily regarding shifting logging to consumer side and main raining import records in the db even after updation yo entity status

*to

OK, so we agreed on the architecture and all the aspects of the proposal last week, and the main issues were that bukwurm needed to update the proposal to reflect some changes to the architecture. There was also a need to get some more detail on a validation system for incoming data, and what we should do with data that's incorrect or invalid

(pretty much, what validation do we need on each field, and how severe is a failure - do we throw the record away or just remove the field from the import)

One aspect left was also how we can maintain relationship data (if any)

Ah yeah, and that too

For that I think you were just going to write up your idea so I can read through it and understand it a bit better?

LordSputnik: Sorry wasnt able to finish that writeup. Would it be ok if i finish that up by tomorrow meeting?

Yeah that's fine

I think getting other projects out the way is a good thing to have been doing anyway :)

Yeah, those were some college projects with some pretty close deadlines so i put it on priority this week. 😅

bukwurm: OK, so the coding period starts tomorrow, as far as I can see

LordSputnik: Yeah

This week would primarily involve setting up sql side and access methods

Yup, are you ready to go with that?

Is there a document with the proposed timeline somewhere?

Leftmost: in the proposal :)

Oh

Let me see if I can find a link for that, I though bukwurm linked it

Leftmost: the community site has the project

Proposal

our community site?

At the end of the proposal is a gist link with Kelli Zak time line

*kelli zak === proposal

Is there a copy of the complete proposal somewhere? The link on there doesn't work for me.

OK, so for tomorrow, it'd be good to see a PR with the basic import schema, and also that writeup of the plan for relationship

lefotmost: community link hasn't even loaded for me yet 😅

Leftmost: /\

Cheers.

well I'll say thanks too

LordSputnik: 👍

even if noone has acknowledged my existence :(

Also bear in mind that it would be good to see the work for the first two weeks completed by the end of the first week, to make time for the more complex consumer/producer stuff we have planned now

I'll aim to have your two repositories set up on Github by tomorrow meeting too - we can have a quick 10-15 minute sync up just after the meeting to see how your first day went :D