it tooks us almost an entire 24h to get 1.5m lowlevel files on to our compute cluster
2016-03-23 08355, 2016
alastairp
but once they were there, running highlevel for them took only an hour or so
2016-03-23 08322, 2016
ruaok
oh silly computing.
2016-03-23 08328, 2016
alastairp
next time I do it, I'll just tar the files, not targz them
2016-03-23 08305, 2016
ruaok
scp or nc?
2016-03-23 08321, 2016
alastairp
it saved 50% size, but took ages to just compress/uncompress
2016-03-23 08332, 2016
ruaok
scp is painfully slow. nc is super fast.
2016-03-23 08341, 2016
alastairp
I used scp, but I think the transfer was actually the faster bit of it
2016-03-23 08343, 2016
ruaok
and you can do compression in line with nc.
2016-03-23 08356, 2016
alastairp
granted, those 24h include 8h sleeping too
2016-03-23 08310, 2016
alastairp
and fighting with the network at the uni
2016-03-23 08314, 2016
ruaok
do nc and bzip in the same go and that will likely yield the fastest setup
2016-03-23 08320, 2016
ruaok
ah, no help there
2016-03-23 08322, 2016
alastairp
so I think I can do it better the next time
2016-03-23 08343, 2016
alastairp
however, I'm still not sure it was faster than running 12 threads on spike
2016-03-23 08324, 2016
chrisskye
Omnifone says they don’t use our databases...
2016-03-23 08330, 2016
chrisskye
comments?
2016-03-23 08318, 2016
chrisskye
ruaok: tell me how we know?
2016-03-23 08338, 2016
adesh joined the channel
2016-03-23 08319, 2016
ruaok
I expected that response.
2016-03-23 08357, 2016
ruaok
Phil Sant, one their founders (?), explained in detail on how they use our DB at the last Future Music Forum in Barcelona.
2016-03-23 08318, 2016
adesh
Gentlecat: In the views, at various places, the views deals with the the existing model as a class(for ex: review's class). and then the instance(s) of this class is played around with. for this reason, i feel we should keep the classes even after removing ORM. your views on this?
2016-03-23 08330, 2016
armalcolite joined the channel
2016-03-23 08335, 2016
armalcolite
anyone knows a good markdown to PDF converter which also supports html. Have been looking for a good one since a long time.
Gentlecat: and it would be easier to keep them as classes and won't even affect the performance
2016-03-23 08327, 2016
Quora joined the channel
2016-03-23 08340, 2016
adesh
although, ofcourse, ORM won't be used anywhere
2016-03-23 08356, 2016
Gentlecat
why do we need them?
2016-03-23 08337, 2016
LordSputnik
Leftmost: should we merge master into direct-db? There are quite a few improvements I'm missing in the RE
2016-03-23 08340, 2016
adesh
it would help us handling the instance as a whole or a list of them. moreover at the views, the present implementation is according to class. and it is hence easier to retrieve and pass around any of the instances of the classes by functions.
2016-03-23 08301, 2016
adesh
okay lemme give u a concrete example
2016-03-23 08312, 2016
adesh
in Review model we have a method called get_popular() which returns list of popular reviews
2016-03-23 08348, 2016
adesh
this method is used by views
2016-03-23 08300, 2016
adesh
specifically index view
2016-03-23 08314, 2016
adesh
and itereated to get all the reviews
2016-03-23 08319, 2016
adesh
iterated*
2016-03-23 08300, 2016
adesh
if we keep it as classes, we won't have to fiddle around with these.
alternative would be get_popular() returning a strings of text (each of which would be a review)
2016-03-23 08318, 2016
adesh
which would cause the view's implementation to change too.
2016-03-23 08301, 2016
adesh
basically, keeping classes would reduce the changes at view's ends and would somewhat reduce the possible bugs since the implementation changes less
2016-03-23 08317, 2016
adesh
umm did you get it?
2016-03-23 08326, 2016
adesh
Gentlecat: this was just an example, there would be more of such instances
2016-03-23 08353, 2016
adesh has quit
2016-03-23 08353, 2016
Mike_Aiir
Hey, just wondering is there a way to trigger the rebuilding of search indexes? in the docs it mentions calling bin/reindex but this is for the VM version
2016-03-23 08327, 2016
ruaok
hey. other than that script, we have nothing.
2016-03-23 08345, 2016
ruaok
and that script is trivial -- just the invocation of the builder and nuking files.
2016-03-23 08354, 2016
ruaok
copying that should be simple.
2016-03-23 08325, 2016
LordSputnik
Leftmost: yeah, I'm going to merge master into d-d, we'll have to do the merge anyway at some point and doing most of it now saves time fixing other things
2016-03-23 08359, 2016
adesh joined the channel
2016-03-23 08311, 2016
adesh has quit
2016-03-23 08344, 2016
Mike_Aiir
@ruaok where would I find a copy of that file though, can't seem to find it in the musicbrainz-server
Sadly no. Probably a he said she said sort of situation... Let me think...
2016-03-23 08313, 2016
Jormangeud joined the channel
2016-03-23 08319, 2016
reosarevok
I mean, the uni uses it at least, right? They get it for free because they're a public institution, but if they're doing commercial stuff now... Meh
2016-03-23 08327, 2016
ruaok
Let me see if I can find Phil's email. Let's ask him.
2016-03-23 08329, 2016
chrisskye
note, the person I was corresponding with is the PR person filling in while the other is on maternity leave...and the people she copied appear to be more on the business than the engineering side. She got back to me quickly. I have asked that she consult with the engineering team and get back to me
2016-03-23 08324, 2016
ruaok
OK, let me know how that turns out. If that is negative too, we'll talk to Phil.
2016-03-23 08351, 2016
chrisskye
should be psant@omnifone (based on format of the others) Shall I forward it?
2016-03-23 08317, 2016
chrisskye
...going to try forwarding my second reply
2016-03-23 08315, 2016
armalcolite
i have uploaded the proposal but i am unable to view it. Can some mentor verify if its uploaded correctly or not?
2016-03-23 08342, 2016
armalcolite
On clicking view, the page redirects to a blank page.
2016-03-23 08324, 2016
mihaitish has quit
2016-03-23 08337, 2016
mihaitish joined the channel
2016-03-23 08336, 2016
hellska
Hey, a GSoC question in addition to what I proposed yesterday: new AcousticBrainz client feature or a web interface on AcousticBrainz website that enable community users to import open access datasets used in research with a set of minimum metadata and linked(using the track title or other info) to the original tracks MBID. This last option will improve the datasets quality adding missing metadata and other useful information.
2016-03-23 08312, 2016
adesh
Gentlecat: Whenever you are free, do tell me what do you think about keeping the classes.
2016-03-23 08314, 2016
Leftmost
LordSputnik, probably.
2016-03-23 08304, 2016
alastairp
Freso: final deadline is 25th ? I thought proposals could be changed after that
2016-03-23 08352, 2016
ruaok
they can be. but final deadline for new submissions is the 25th
2016-03-23 08342, 2016
mihaitish has quit
2016-03-23 08342, 2016
alastairp
It's just that Fresos post on discourse talks about final PDFs, and I thought that PDFs were unchanhable
2016-03-23 08350, 2016
ruaok has a hard time parsing that last bit
2016-03-23 08318, 2016
alastairp
Let me get back to the office and I'll try and reread everything
