pristine_: actually. I have a request/help from you
2019-10-22 29548, 2019
CatQuest
remember when you all linked msuic videos
2019-10-22 29556, 2019
CatQuest
I need a clip of a veena related music (video) that's a bit silly and/or/funny, especially if short and sweet^^HH silly
2019-10-22 29502, 2019
CatQuest
(other indians too of course)
2019-10-22 29502, 2019
CatQuest
AND, it needs to be free to use/link to
2019-10-22 29527, 2019
Matthew_ joined the channel
2019-10-22 29555, 2019
weirditude joined the channel
2019-10-22 29522, 2019
pristine__
Not sure if free :(
2019-10-22 29532, 2019
Matthew_
Hi. We run are running a MusicBrainz Slave and have finally got around to replacing the Lucene search server with Solr and realtime indexing. We have started testing realtime indexing rates and we're not seeing a huge amount of throughput in terms of clearing the backlog on our queue. Can anyone give me any guidance as to what settings you have in SIR's config.ini in production? I did find this but I'm not sure it's up to date?
there are known problems with speed right now ... :(
2019-10-22 29504, 2019
Matthew_
Ah!
2019-10-22 29521, 2019
CatQuest
pristine__: this is beautiful!
2019-10-22 29537, 2019
pristine__
Thanks :(
2019-10-22 29542, 2019
pristine__
:) *
2019-10-22 29507, 2019
Matthew_
FWIW, we aren't able to use amqp functions in our Postgres instance as AWS doesn't allow them on RDS instances. We've forked SIR to push changes onto a database (a simple table) queue, which a SIR amqp publisher then pulls from the table and publishes to RabbitMQ. If yvanzo et al are agreeable to it, I may send a pull request your way: https://github.com/madebykite/sir
2019-10-22 29542, 2019
ruaok
woah. why isn't it allowed? is there a good technical reason?
2019-10-22 29527, 2019
CatQuest
hmm though I don't know.. do you know of something a little. out of the ordinary.. i am looknig for something maybe humourus. maybe silly
2019-10-22 29535, 2019
Matthew_
There are lots of extensions that AWS RDS (and other cloud providers) don't allow as they consider them security risks
2019-10-22 29500, 2019
Matthew_
For example, we can't install MB's collation extensions
Hey ruaok if any time you prepare any file to store in HDFS, JSON is a good idea.... Other formats are a pain..... The commas in the list of artist mbids were difficult to process.
2019-10-22 29541, 2019
pristine__
Just a suggestion :)
2019-10-22 29516, 2019
ruaok
oh, duh. sorry.
2019-10-22 29529, 2019
ruaok
make me a lb-labs ticket please to improve that?
2019-10-22 29540, 2019
pristine__
Yeah. Sure.
2019-10-22 29511, 2019
ruaok
I started with CSV as a proof of concept and then forgot to switch to json. should be easy to fix.
2019-10-22 29521, 2019
jvoisin has left the channel
2019-10-22 29506, 2019
D4RK-PH0ENiX has quit
2019-10-22 29546, 2019
pristine__
ruaok: thats fine. I managed artist mapping with this
I will close it soon. No queries so no need to track view names
2019-10-22 29529, 2019
ruaok
ok
2019-10-22 29553, 2019
pristine__
I just want that anyone who comes after me to carry on should not jump here and there because they are not able to understand stuff and code:)
2019-10-22 29504, 2019
ruaok
<3
2019-10-22 29501, 2019
alastairp
I was looking at this PR recently, I was really surpsed to see that the spark sql api has no positional parameter support :( on the internet it's really difficult to determine if this is an injection attack vector or not
2019-10-22 29518, 2019
alastairp
using native query api sounds like a good idea to reduce this problem
2019-10-22 29535, 2019
iliekcomputers
Sorry for the trouble! SQL was just simpler to write and understand at the time.
