it tooks us almost an entire 24h to get 1.5m lowlevel files on to our compute cluster
but once they were there, running highlevel for them took only an hour or so
ruaok
oh silly computing.
alastairp
next time I do it, I'll just tar the files, not targz them
ruaok
scp or nc?
alastairp
it saved 50% size, but took ages to just compress/uncompress
ruaok
scp is painfully slow. nc is super fast.
alastairp
I used scp, but I think the transfer was actually the faster bit of it
ruaok
and you can do compression in line with nc.
alastairp
granted, those 24h include 8h sleeping too
and fighting with the network at the uni
ruaok
do nc and bzip in the same go and that will likely yield the fastest setup
ah, no help there
alastairp
so I think I can do it better the next time
however, I'm still not sure it was faster than running 12 threads on spike
chrisskye
Omnifone says they don’t use our databases...
comments?
ruaok: tell me how we know?
adesh joined the channel
ruaok
I expected that response.
Phil Sant, one their founders (?), explained in detail on how they use our DB at the last Future Music Forum in Barcelona.
adesh
Gentlecat: In the views, at various places, the views deals with the the existing model as a class(for ex: review's class). and then the instance(s) of this class is played around with. for this reason, i feel we should keep the classes even after removing ORM. your views on this?
armalcolite joined the channel
armalcolite
anyone knows a good markdown to PDF converter which also supports html. Have been looking for a good one since a long time.
Gentlecat: and it would be easier to keep them as classes and won't even affect the performance
Quora joined the channel
although, ofcourse, ORM won't be used anywhere
Gentlecat
why do we need them?
LordSputnik
Leftmost: should we merge master into direct-db? There are quite a few improvements I'm missing in the RE
adesh
it would help us handling the instance as a whole or a list of them. moreover at the views, the present implementation is according to class. and it is hence easier to retrieve and pass around any of the instances of the classes by functions.
okay lemme give u a concrete example
in Review model we have a method called get_popular() which returns list of popular reviews
this method is used by views
specifically index view
and itereated to get all the reviews
iterated*
if we keep it as classes, we won't have to fiddle around with these.
alternative would be get_popular() returning a strings of text (each of which would be a review)
which would cause the view's implementation to change too.
basically, keeping classes would reduce the changes at view's ends and would somewhat reduce the possible bugs since the implementation changes less
umm did you get it?
Gentlecat: this was just an example, there would be more of such instances
adesh has quit
Mike_Aiir
Hey, just wondering is there a way to trigger the rebuilding of search indexes? in the docs it mentions calling bin/reindex but this is for the VM version
ruaok
hey. other than that script, we have nothing.
and that script is trivial -- just the invocation of the builder and nuking files.
copying that should be simple.
LordSputnik
Leftmost: yeah, I'm going to merge master into d-d, we'll have to do the merge anyway at some point and doing most of it now saves time fixing other things
adesh joined the channel
adesh has quit
Mike_Aiir
@ruaok where would I find a copy of that file though, can't seem to find it in the musicbrainz-server
Sadly no. Probably a he said she said sort of situation... Let me think...
Jormangeud joined the channel
reosarevok
I mean, the uni uses it at least, right? They get it for free because they're a public institution, but if they're doing commercial stuff now... Meh
ruaok
Let me see if I can find Phil's email. Let's ask him.
chrisskye
note, the person I was corresponding with is the PR person filling in while the other is on maternity leave...and the people she copied appear to be more on the business than the engineering side. She got back to me quickly. I have asked that she consult with the engineering team and get back to me
ruaok
OK, let me know how that turns out. If that is negative too, we'll talk to Phil.
chrisskye
should be psant@omnifone (based on format of the others) Shall I forward it?
...going to try forwarding my second reply
armalcolite
i have uploaded the proposal but i am unable to view it. Can some mentor verify if its uploaded correctly or not?
On clicking view, the page redirects to a blank page.
mihaitish has quit
mihaitish joined the channel
hellska
Hey, a GSoC question in addition to what I proposed yesterday: new AcousticBrainz client feature or a web interface on AcousticBrainz website that enable community users to import open access datasets used in research with a set of minimum metadata and linked(using the track title or other info) to the original tracks MBID. This last option will improve the datasets quality adding missing metadata and other useful information.
adesh
Gentlecat: Whenever you are free, do tell me what do you think about keeping the classes.
Leftmost
LordSputnik, probably.
alastairp
Freso: final deadline is 25th ? I thought proposals could be changed after that
ruaok
they can be. but final deadline for new submissions is the 25th
mihaitish has quit
alastairp
It's just that Fresos post on discourse talks about final PDFs, and I thought that PDFs were unchanhable
ruaok has a hard time parsing that last bit
Let me get back to the office and I'll try and reread everything