hi all, just out of curiosity (I am busy with freemusicarchive seeder - testing it now) but something I am thinking off is ... how do we link things like the FreeMusicArchive album id to the MB release id ? else we just end up with another release of the same album with a different external link... surely catching / storing the freemusicarchive id's againgst MB id's make more sense ? or am i on the wrong track here
like discogs id's
QuoraUK_ has quit
madmouser1: Are FMA id's "URLable"?
If so, it might make sense to have FMA added to the "other databases" whitelist and you could link up MBID→FMA ids.
QuoraUK has quit
hi Freso. no but it is in the API
Freso: let me quickly check if tere is a correlation
Freso: I can't find a correlation between FMA URL & FMAid, but teh FMA id is in FMA API for each album & track and that can be referenced in the api.
can I pass (via web seed iow. add realease a "other database" id ? that way I can seed the FMA id for each track and album.
I can get the FMA URL from the FMA id via the API ...
madmouser1: Can you get the FMA id via an FMA URL?
Freso has no idea how the FMA looks like
Freso: No you can't, currently I get it via jQuery in the page then i make an FMA API call to get all the info
the APi have a album_url property that link to FMA URL
I'm thinking about centralizing logs from all servers we run, currently log rate is about 1Mbytes/s (all servers cumulated), this will multiplied by 3 at least soon, and to be safe i target 10Mbytes/s . If someone has experience with a tool able to centralize syslog logs as well as user-defined logs (our nginx logs are not in standard format, and we have
various apps around with very specific log format), i'm curious about that. For now, we just want to centralize, but in the future parsing/analyzing/etc ...
so what I want to do is push (link that FMA album_id to a MBID
zas: what about logstash into elasticsearch for the logs
zas: logstash have grok patterns you can use for logs
madmouser1: yes, that's a possibility, do you use it atm ? at which rate ?
ofc i saw fluentd, nxlog, etc... but my question is more about actual experience with those tools and performance/resources/hardware
zas: yes i do, not at a 10mb rate, at most i do few 1000 log lines from about 10 sources
but logstash can handle it and Elasticsearch can be in a cluster (for scaling)
madmouser1: I don't think there's a good way to have FMA ids in MB at this moment though. We'd either need to add a new field for it (unlikely to happen) or get attributes ("single point releationships") ported to releases. Either approach would be a schema change and would thus not happen before November at the earliest.
But we can probably link to the FMA pages anyway, using either "download for free" relationships or something else. reosarevok would be the one to know that.
Yeah, I've linked to FMA before I think with download for free
Freso: noted, yes I do a "download for free" link at the moment, but just thought it is such a waste to loose a opportunity to pass the FMA id to MB
(you can also store the license as a URL)
Is there a way to get from the URL to the ID?
currently i get the id from the "embed in page" and tehn to a API call
but as I have both pieces of info in the seeder I thought .. let me ask :-0
I mean there's nothing wrong with seeding the ID to the annotation at least
do MB store the notes for each import somewhere ?
or a "comments field" then I can seed the FMA id to that, else I will just leave it for mow and revisit later