Yes, but since BB doesn't have a stable API, could I include revamping the the API in my project as well?
2017-04-03 09358, 2017
Gentlecat
I'd prefer not having to have a separate instance of BB running
2017-04-03 09314, 2017
Gentlecat
that's one more thing to maintain and keep in sync
2017-04-03 09332, 2017
Gentlecat
API of what? BB?
2017-04-03 09351, 2017
muesli has quit
2017-04-03 09351, 2017
muesli joined the channel
2017-04-03 09337, 2017
akashn97
Or how about caching the database indefinitely and then, check if it's time to invalidate it. This should reduce the requests, and we can increase frequency of the data dumps
2017-04-03 09355, 2017
Gentlecat
sure, caching can improve the performance, but that's not the issue
2017-04-03 09356, 2017
Gentlecat
where are these data dumps and how often they are updated? is there an easy way to import them regularly?
2017-04-03 09332, 2017
akashn97
We could import only the invalidated ones, so there would definitely be an easy way around.
2017-04-03 09343, 2017
akashn97
Where would you suggest we store the data dumps?
2017-04-03 09359, 2017
Gentlecat
when you say "the invalidated ones", what do you mean?
2017-04-03 09355, 2017
jasperkirton has quit
2017-04-03 09350, 2017
akashn97
The ones which have a change in them and the cached version is no longer the same as the most up-to-date version.
2017-04-03 09324, 2017
akashn97
It's similar to the dirty bit used in cache
2017-04-03 09334, 2017
Gentlecat
ok, but what data are you talking about importing? BB data?
2017-04-03 09317, 2017
Gentlecat
I don't think I understand how you see parts connecting together
2017-04-03 09358, 2017
Gentlecat
the issue is having access to BB data in the first place
2017-04-03 09334, 2017
Gentlecat
idk if BB has a reliable way to run a separate replica of the main database
2017-04-03 09356, 2017
Gentlecat
since other options of accessing are out of the question currently
2017-04-03 09345, 2017
Gentlecat
and if it doesn't then I don't see this happening at all
2017-04-03 09320, 2017
Gentlecat
"this" being having BB data in CB
2017-04-03 09324, 2017
samj1912
zas: also updated the py3 PR, it isn't in the state to be merged though
2017-04-03 09326, 2017
LordSputnik
Gentlecat: the only way to keep an up to date replica at the moment is to drop the database and reimport
2017-04-03 09336, 2017
LordSputnik
Which takes about a minute
2017-04-03 09337, 2017
UmkaDK has quit
2017-04-03 09323, 2017
LordSputnik
We'd welcome a replication system as part of a proposal though
2017-04-03 09327, 2017
UmkaDK joined the channel
2017-04-03 09350, 2017
Gentlecat
it wouldn't be a CB project anymore though
2017-04-03 09323, 2017
Gentlecat
and I don't see both parts being doable within one GSoC
2017-04-03 09350, 2017
arbenina_ joined the channel
2017-04-03 09339, 2017
deeptibaghel joined the channel
2017-04-03 09301, 2017
agentsim joined the channel
2017-04-03 09317, 2017
saifulbkhan joined the channel
2017-04-03 09332, 2017
agentsim has quit
2017-04-03 09311, 2017
madmouser1 joined the channel
2017-04-03 09300, 2017
justharshal
LordSputnik: Shared my draft on GSOC site. Feedback?
justharshal: ok, needs more technical detail, particularly on how the rate limiting will work
2017-04-03 09357, 2017
LordSputnik
I'd like to know also what the authentication process will be and how it'll work
2017-04-03 09301, 2017
ruaok
LordSputnik: we should use the same method that LB uses.
2017-04-03 09319, 2017
ruaok
which is the twitter way of doing.
2017-04-03 09358, 2017
Slurpee has quit
2017-04-03 09347, 2017
LordSputnik
justharshal: and try to introduce some of your own ideas, because I'm not seeing a lot of thought on there beyond what was in the initial suggestion and the ideas I've discussed with you on IRC
2017-04-03 09337, 2017
LordSputnik
ruaok: I'll investigate later, unless you have time to give a brief description :)
2017-04-03 09319, 2017
ruaok
when you make a request, it gives you a window of time.
2017-04-03 09340, 2017
ruaok
usually for X seconds and it tells you have many more requests you can make inside that window.
2017-04-03 09302, 2017
ruaok
it is up the client to decide how to space the requests. they can make them all at the beginning or space evenly.
