If they don't follow it, they should either be fixed, or it's artist intent.
regagain has quit
Lingo__ has quit
Lingo__ joined the channel
ariscop has quit
krono has quit
D4RK-PH0ENiX has quit
Rasi
why does picard slow down so much, when you add large number of files to it?
from what i can see all it needs to do is to create a list of files internally
doesnt even need to be a sorted list, as long as you dont cluster it. and even then you can continue to work with the much smaller cluster list
div13 joined the channel
Freso
I don't know the internals, but do you have fingerprinting on?
I would imagine it starts fingerprinting files as soon as they're added to it, which means a lot of processes and network traffic it suddenly needs to be aware of.
The same if you have "regular" lookup-on-add enabled too.
Rasi
that doesnt explain what i see
first couple of hundred files are added fast
and then it slows down
fingerprinting should be equally fast for all files
Freso shrugs
Freso
Like I said, I don't know what the bottlenecks or tipping points are
It could be that file 314 is where some magic internal limit is reached that causes the handling of things to be done differently to not overextert some system resources. It could be a Python interpreter thing.
Rasi
yeah
Rasi blames python
:P
yeeeargh has quit
Freso wonders if it's viable to use Cython or Jython or whatever they're called for Picard
wayne, I started making an overview of what technologies are used where within the MetaBrainz projects. Maybe it'll help you get oriented? If not, maybe somebody else wants to jump in and improve it?
I'm not a dev but I often heard in chat about haskell, isn't there something coded in that language too CallerNo6 ?
CallerNo6
Lotheric, I remember ocharles was working on a next gen editing system in haskell. And iirc also the original iteration of bookbrainz.
Lotheric
ah that must be it
CallerNo6
If haskell is actually in use, I don't know about it. But then, not knowing things is in my job description.
Lotheric
lol
CallerNo6
I had some better notes on what bb uses, but they seem to have been lost. Maybe Leftmost wants to remind me when he's around.
Or I could <shudder> look at github I guess.
opatel99 joined the channel
Freso
Lotheric: AFAIK, we don't have any active projects in Haskell (or, maybe there's one tiny one?). BB is currently part Python, part Node.js, but moving towards being entirely Node.js.
'ello. I searched the forum and have retried a few times, but the FTP site for downloads appears to be down or unresponsive. Thought I'd alert y'all.
krono joined the channel
krono has quit
Freso
muraii: Are you using US or EU FTP?
muraii
US. Got a server response that I didn't have access to the EU mirror.
It's possibly my ISP (Verizon cellular data). I have to use znc or the Chrome extension CIRC to do IRC, for instance. Maybe Verizon clobbers some FTP stuff.
Freso
zas ruaok: ^
ariscop joined the channel
muraii
I think this is actually the case, i.e., that I can't get to ftp sites. Please excuse; should've checked that first.