do you want me to use the metabrainz OAuth or the authentication token suggested by me
2016-03-23 08357, 2016
mootwo has quit
2016-03-23 08345, 2016
alastairp
don't worry too much about specifically what option you want to use
2016-03-23 08350, 2016
Guest8612 is now known as leonardo
2016-03-23 08323, 2016
alastairp
I was thinking that we could implement oauth in metabrainz (we have something similar in critiquebrainz)
2016-03-23 08342, 2016
alastairp
with the expectation that there might be other things that we want to do in the future on AB that can use it
2016-03-23 08350, 2016
MBJenkins joined the channel
2016-03-23 08319, 2016
alastairp
I'd be happy for your proposal to just say something like "we need authentication, two options are a simple token, or we can implement oauth"
2016-03-23 08332, 2016
kartikgupta0909
oh okay. So right now I will submit the proposal with the authentication token system and also including the two phase idea for running the jobs. And we can decide on them later.
2016-03-23 08343, 2016
alastairp
and if we go ahead with the project, we spend some more time looking into the options and seeing what one is better
2016-03-23 08346, 2016
kartikgupta0909
and I will mention the two authentication options
2016-03-23 08347, 2016
alastairp
perfect
2016-03-23 08350, 2016
kartikgupta0909
yes
2016-03-23 08354, 2016
kartikgupta0909
Thanks :)
2016-03-23 08332, 2016
alastairp
ruaok: sorry for confusion. looks like I was wrong
2016-03-23 08349, 2016
ruaok
I was confused about what you were wrong on. :)
2016-03-23 08357, 2016
alastairp
everything has to be finished and squared away by Friday evening. no changes. do not pass go. do not collect $200
2016-03-23 08308, 2016
ruaok
oh feck. that blows.
2016-03-23 08325, 2016
alastairp
I was under the impression that if at least something was submitted by friday, it could be tweaked for a few weeks more
2016-03-23 08335, 2016
alastairp
right. see?
2016-03-23 08357, 2016
ruaok
why is the student selection phase a freaking month long?
2016-03-23 08313, 2016
alastairp
2 months between application deadline and official start
2016-03-23 08319, 2016
ruaok
must be all those mega OSS projects ruining it for us little folks.
2016-03-23 08322, 2016
alastairp
something to bring up at the summit, I guess
2016-03-23 08351, 2016
alastairp
yeah, I can see it being changed after people said the previous one didn't work well
2016-03-23 08313, 2016
ruaok
here is the next odd thing.
2016-03-23 08324, 2016
ruaok
I can't view a final proposal until the deadline has passed.
2016-03-23 08327, 2016
ruaok
wtf?
2016-03-23 08337, 2016
alastairp
I guess because we make our community bonding period now, between org announcement and submission
2016-03-23 08341, 2016
alastairp
rather than after acceptance
2016-03-23 08301, 2016
alastairp
yeah, someone mentioned that on the mentors list. I think they said they might be able to change the app for next year's programme...
2016-03-23 08346, 2016
ruaok
armalcolite: I can't see your final proposal. there is one submitted, but I can't see it.
2016-03-23 08358, 2016
ruaok
can you please mail a copy of rob@metab.... ?
2016-03-23 08306, 2016
ruaok
+it to
2016-03-23 08317, 2016
navap1
LordSputnik: Hey, sorry, I've been slacking with the twitter issues. Thanks for the prod. I'll get on it.
2016-03-23 08329, 2016
navap1 is now known as navap
2016-03-23 08358, 2016
gburlet has quit
2016-03-23 08307, 2016
Jormangeud has quit
2016-03-23 08335, 2016
Jormangeud joined the channel
2016-03-23 08345, 2016
ruaok
alastairp: I've reviewed the rate limiting stuff on both the server and the scraper and things on the server side look fine.
2016-03-23 08349, 2016
ruaok
the client, less so.
2016-03-23 08307, 2016
ruaok
do I recall that there are multiple requests happening in parallel on the scraper?
2016-03-23 08311, 2016
ruaok
up to 5 or so?
2016-03-23 08350, 2016
Gentlecat
wasn't there some problem with retries?
2016-03-23 08320, 2016
ruaok
yes and that is why multiple requests were added, right?
2016-03-23 08351, 2016
Jormangeud has quit
2016-03-23 08344, 2016
Jormangeud joined the channel
2016-03-23 08333, 2016
alastairp
yes, the scraper will send a second request before the first one is finished
2016-03-23 08346, 2016
alastairp
up to 10 simultaneous queries
2016-03-23 08300, 2016
ruaok
I've yet to find where that code is that fires that off. :(
2016-03-23 08312, 2016
alastairp
it's all javascripty
2016-03-23 08318, 2016
ruaok
very so.
2016-03-23 08321, 2016
alastairp
without looking at the code:
2016-03-23 08327, 2016
alastairp
there's some sort of getAndSendNextPage
2016-03-23 08354, 2016
alastairp
and somewhere in there is a if numOpenRequests < 10 { do next one }
2016-03-23 08311, 2016
alastairp
and numOpenRequests is decremented in the success handler of the submit function
2016-03-23 08312, 2016
ruaok
k.
2016-03-23 08334, 2016
ruaok
I'll keep digging.
2016-03-23 08338, 2016
LordSputnik
navap: thank you so much, it's really appreciated!
smells tantalizingly close to beer time to celebrate 2M. :)
2016-03-23 08328, 2016
Gentlecat
did someone say beer?
2016-03-23 08304, 2016
ruaok
\ø
2016-03-23 08337, 2016
JesseW joined the channel
2016-03-23 08355, 2016
ruaok
JesseW: just FYI: Discogs and MB are on good terms. At least myself and kevin are. :)
2016-03-23 08319, 2016
CallerNo6
Indeed, Kevin seemed very cool.
2016-03-23 08305, 2016
diana_olhovyk has quit
2016-03-23 08339, 2016
UmkaDK joined the channel
2016-03-23 08337, 2016
UmkaDK
Guys, a bit of a random question but is there an easy way to find an artist that was added to the database with a given replication packet?
2016-03-23 08336, 2016
chirlu
You could look at the artists updated around that time, but otherwise no.
2016-03-23 08356, 2016
chirlu
Well, you could look into the replication packet perhaps, if you have it.
2016-03-23 08314, 2016
UmkaDK
That's what I mean! :)
2016-03-23 08352, 2016
armalcolite
ruaok: sent a copy.
2016-03-23 08301, 2016
ruaok
armalcolite: thanks.
2016-03-23 08303, 2016
UmkaDK
I'm fiddling with the search server indices, so need to find a way to test my changes
2016-03-23 08342, 2016
armalcolite
is the pdf at official website not accessible?
2016-03-23 08352, 2016
armalcolite
even i cannot view it.
2016-03-23 08309, 2016
ruaok
armalcolite: correct. we can only view it when the submission deadline passes.
2016-03-23 08340, 2016
armalcolite
but, when i try to open it it opens up a blank tab.
2016-03-23 08347, 2016
ruaok
armalcolite: you should've spell checked this. :(
2016-03-23 08310, 2016
UmkaDK
I figured that the easiest way to do it would be to set my server to update a bit after the replication packet has been released, download the replication packet, find a new artist, then search for it locally before and after the replication+index update
2016-03-23 08330, 2016
armalcolite
ruaok: oh. i sent the wrong one. should i resend?
2016-03-23 08351, 2016
ruaok
send me the final one that you submitted.
2016-03-23 08356, 2016
UmkaDK
but looking at the replication packet, finding a new artist might be a bit harder then I originally thought. :)
2016-03-23 08359, 2016
armalcolite
ok
2016-03-23 08359, 2016
ruaok
UmkaDK: why not look a the last_updated timestamps in the aritst table?
2016-03-23 08312, 2016
ruaok
keep track of the time you last looked at the artist table.
2016-03-23 08329, 2016
ruaok
then examine all rows that have been changed and look for new ones that you haven't seen.
2016-03-23 08332, 2016
chirlu
UmkaDK: I’m not sure I understand what you actually need. Couldn’t you just look at the artist(s) with the highest IDs?
2016-03-23 08307, 2016
ruaok
chirlu: that would work. even though we keep telling people to not look at the id column. :)
2016-03-23 08339, 2016
Zialus is now known as RMF|away
2016-03-23 08341, 2016
JesseW has quit
2016-03-23 08353, 2016
UmkaDK
Yep, I think that would definitely work for me!! Thanks guys!!!
2016-03-23 08307, 2016
chirlu
Well, not for production use of course.
2016-03-23 08318, 2016
UmkaDK
of course :)
2016-03-23 08353, 2016
ruaok
for production use, i would suggest the last_updated timestamps, UmkaDK
2016-03-23 08319, 2016
UmkaDK
kk, thank ruaok
2016-03-23 08327, 2016
UmkaDK
*thanks
2016-03-23 08331, 2016
hellska joined the channel
2016-03-23 08342, 2016
chirlu
Although those don’t distinguish between new artists and artists that newly got edited.
2016-03-23 08304, 2016
RMF|away is now known as Zialus
2016-03-23 08325, 2016
ruaok
I think I *finally* grokked what is wrong with the rate-limiting branch.
2016-03-23 08351, 2016
ruaok
sadly, hugh's improved code is less readable than what we had before.
2016-03-23 08311, 2016
ruaok
I think I am going to grab armalcolite's latest code and re-add rate limiting to it.
2016-03-23 08312, 2016
ruaok
but now that I understand what is going on, I'll need to have a think on how to add rate-limiting.
2016-03-23 08345, 2016
D4RK-PH0ENiX has quit
2016-03-23 08320, 2016
D4RK-PH0ENiX joined the channel
2016-03-23 08304, 2016
mihaitish has quit
2016-03-23 08344, 2016
Zialus is now known as RMF|away
2016-03-23 08319, 2016
RMF|away is now known as Zialus
2016-03-23 08332, 2016
hellska
I set up a local AcousticBrainz server using vagrant, how can I upload content into the server without dowloading the entire AB DB dump?
2016-03-23 08358, 2016
yeeeargh joined the channel
2016-03-23 08328, 2016
Gentlecat
you can POST data to the api endpoint /<MBID>/low-level
2016-03-23 08339, 2016
kartikgupta0909
hellska: you can use the acousticBrainz client
2016-03-23 08302, 2016
kartikgupta0909
and just edit the config file to upload it on localhost rather than acousticbrainz.org
2016-03-23 08310, 2016
hellska
I tryed to post the data using the API but i get an error
2016-03-23 08334, 2016
Gentlecat
what's the error?
2016-03-23 08336, 2016
hellska
400 BAD FORMAT
2016-03-23 08338, 2016
kartikgupta0909
do you have the acousticbrainz client?
2016-03-23 08305, 2016
hellska
yes I downloaded both the gui and the command line
2016-03-23 08339, 2016
hellska
I posted to the endpoint using python requests
2016-03-23 08343, 2016
yeeeargh has quit
2016-03-23 08345, 2016
kartikgupta0909
well i dont know about the bad format error
2016-03-23 08356, 2016
kartikgupta0909
its better to simply use the acoustic brainz submission client
2016-03-23 08310, 2016
kartikgupta0909
just modify the file default.conf
2016-03-23 08321, 2016
hellska
ok I’ll try to set up it now!!! thanx
2016-03-23 08325, 2016
kartikgupta0909
when you are done setting it up, just modify your default.conf
