The --deployment flag makes sure that carton will only install modules and versions available in your snapshot, and won't fallback to query for CPAN Meta DB for missing modules.
2017-06-01 15225, 2017
alastairp
so it looks like you need to add things to cpanfile; use carton install; copy the generated cpanfile.snapshot; do the install with carton install --deployment
2017-06-01 15251, 2017
ferbncode
alastairp: makes sense, thanks :D
2017-06-01 15247, 2017
samj1912 has quit
2017-06-01 15237, 2017
m0n0g0n joined the channel
2017-06-01 15214, 2017
to81 has quit
2017-06-01 15258, 2017
to81 joined the channel
2017-06-01 15245, 2017
hibiscuskazeneko has quit
2017-06-01 15220, 2017
agentsim joined the channel
2017-06-01 15228, 2017
agentsim has quit
2017-06-01 15248, 2017
ferbncode
alastairp: works the way you suggested. thanks :)
2017-06-01 15203, 2017
ferbncode goes add more modules to cpanfile :P
2017-06-01 15221, 2017
alastairp
excellent!
2017-06-01 15233, 2017
Gore|woerk joined the channel
2017-06-01 15219, 2017
to81 has quit
2017-06-01 15246, 2017
to81 joined the channel
2017-06-01 15222, 2017
to81 has quit
2017-06-01 15201, 2017
agentsim joined the channel
2017-06-01 15257, 2017
arbenina_ has quit
2017-06-01 15215, 2017
d4rkie has quit
2017-06-01 15241, 2017
D4RK-PH0ENiX joined the channel
2017-06-01 15253, 2017
github joined the channel
2017-06-01 15253, 2017
github
[listenbrainz-server] paramsingh opened pull request #186: Remove .kitchen.yml (master...kitchen) https://git.io/vH0bi
[listenbrainz-server] paramsingh opened pull request #187: LB-93: Migrate to Python 3 (master...2to3) https://git.io/vHEej
2017-06-01 15206, 2017
github has left the channel
2017-06-01 15234, 2017
padraic joined the channel
2017-06-01 15222, 2017
padraic
I'm new to the xml service and REST queries. Can anyone reccommend me something useful on linux, or even browser based, to test queries for the xml service on?
@alastairp I can construct a query string and download the file from the browser alright, it's more that I don't know how to do it with a script properly. Thanks, @Gentlecat, I'll take a look at that
2017-06-01 15218, 2017
github joined the channel
2017-06-01 15218, 2017
github
[metabrainz.org] gentlecat opened pull request #282: MEB-93: Add an API endpoint for serving MB JSON dumps (master...json-api) https://git.io/vHEJZ
2017-06-01 15218, 2017
github has left the channel
2017-06-01 15209, 2017
github joined the channel
2017-06-01 15209, 2017
github
[metabrainz.org] gentlecat opened pull request #283: Switch to Python 3.6 (master...py36) https://git.io/vHEJl
2017-06-01 15209, 2017
github has left the channel
2017-06-01 15257, 2017
padraic has quit
2017-06-01 15253, 2017
alastairp
so much python3 love <3
2017-06-01 15246, 2017
antgel joined the channel
2017-06-01 15229, 2017
antgel
Hi there, I was referred to here from #musicbrainz. Suffering from 503s in Picard when it does lookups. I understand that there has been some discussion on this - would it be possible to get an update?
2017-06-01 15200, 2017
antgel
I came by a few weeks ago with the same issue, and I was told that throttling had been eased. But I would expect throttling not to return 503 ;)
antgel: still suffering from spammers sucking up capacity and host of other inefficiencies in our setup.
2017-06-01 15225, 2017
ruaok
Zas: fuck it. Order two more servers?
2017-06-01 15216, 2017
Mineo joined the channel
2017-06-01 15223, 2017
ruaok
Zas: back to caching. Is this something we can do without engineering effort?
2017-06-01 15249, 2017
zas
ruaok: i don't know enough about current caching in mbs
2017-06-01 15225, 2017
zas
bitmap: ?
2017-06-01 15231, 2017
ruaok
Would an http level cache help at all? We have gobs of ram spare...
2017-06-01 15203, 2017
zas
This is exactly what i think
2017-06-01 15207, 2017
ruaok
That might be so.ethi g you can do without a lot of help from bitmap and yvanzo , right?
2017-06-01 15231, 2017
ruaok
Lo. So.ethi g. #covfefe for life!
2017-06-01 15240, 2017
zas
I'm about to leave for diner, but tomorrow morning (or later this evening if i'm motivated enough) i could evaluate number of unique queries to have an estimation of cacheability.
2017-06-01 15230, 2017
zas
also it would require api changes (somehow) since we would support usual cache management feature, and there still the problem of cache invalidation
2017-06-01 15233, 2017
ruaok
There are plenty of requests to pages that are not really dynamic... E.g account creation.
2017-06-01 15241, 2017
arbenina_ joined the channel
2017-06-01 15248, 2017
ruaok
Not having to render those might help.
2017-06-01 15252, 2017
zas
But since i don't know what exactly is cached or not... it would be great to have bitmap and yvanzo in this discussion, to see where we can improve things
2017-06-01 15204, 2017
ruaok
Not sure if catching the ws would be a good goal.
2017-06-01 15223, 2017
ruaok
Since our web pages are so slow.... Cache those?
2017-06-01 15253, 2017
zas
I vote to use caches everywhere we can ;) plenty of ram / lack of cpu
2017-06-01 15228, 2017
ruaok
Still, we should cache for maximum impact first.
2017-06-01 15235, 2017
zas
Of course
2017-06-01 15216, 2017
zas
But according to my first analysis, i get 200s on pages that didn't change at all between my queries
2017-06-01 15228, 2017
zas
Where i would have expect a not modified (and therefore a client side caching)
2017-06-01 15221, 2017
zas
we never really investigate this, but imho we don't rely enough on various cache possibilities, which lead to excessive traffic, and excessive cpu usage
2017-06-01 15247, 2017
zas
on the website, and on the web service
2017-06-01 15255, 2017
lazka has quit
2017-06-01 15225, 2017
zas
our entities are that much changing (in fact, our db is quite static if you look at number of changes vs number of entries)
2017-06-01 15226, 2017
zas
But proper implementation will need to be done with a proper cache invalidation when entities are modified, i think that's the main issue
Is anyone around with a good experience of Varnish (or similar tools) ?
2017-06-01 15232, 2017
zas
bbl
2017-06-01 15238, 2017
flamingspinach joined the channel
2017-06-01 15238, 2017
kepstin notes that for mbjs.kepstin.ca, he just runs a server side caching reverse proxy which unconditionally stores stuff for 12h :/
2017-06-01 15205, 2017
kepstin
(well, not unconditionally, it doesn't store 503 errors)
2017-06-01 15216, 2017
to81 has quit
2017-06-01 15242, 2017
to81 joined the channel
2017-06-01 15237, 2017
ruaok
kepstin: it can handle a few million requests per day, yes? We'd be happy to use it.
2017-06-01 15240, 2017
ruaok
Lol
2017-06-01 15219, 2017
kepstin
heh, I honestly have no idea. it's just a single DO droplet, but it is behind cloudflare...
2017-06-01 15232, 2017
kepstin
I'd probably run out of disk space for the cache, at least :)
2017-06-01 15233, 2017
ruaok
Tease.
2017-06-01 15248, 2017
kepstin
I guess what I'm saying is that not all applications actually need data that's guaranteed to be fresh, I wonder if there's a market for an api that might serve a bit older data, but has the rate limits eased
2017-06-01 15254, 2017
kepstin
of course, our current ws design doesn't really suit that, since there's so many parameters available that tweak the results :/
2017-06-01 15228, 2017
CatQuest
a "stable.musicbrainz.org" ? wich is less rate limits but also older data?
2017-06-01 15224, 2017
hibiscuskazeneko has quit
2017-06-01 15238, 2017
to81 has quit
2017-06-01 15242, 2017
Sophist_UK
I have some experience with caching. Firstly there are several different types of cache other than web-cache. You can cache: SQL statements (to avoid the SQL server having to recalculate the access plan every time.) You can cache SQL search results. (I am assuming that moving .js / .css etc. onto content management platform is already done.
2017-06-01 15205, 2017
Sophist_UK
The trick is to cache the frequently accessed stuff - because that is where you will make savings - and not cache the vast majority which is accessed once a week or less frequently.
2017-06-01 15252, 2017
to81 joined the channel
2017-06-01 15205, 2017
arbenina_ has quit
2017-06-01 15254, 2017
Sophist_UK
And to know how to invalidate the cache when the underlying data changes.
2017-06-01 15234, 2017
Sophist_UK
Like kepstin I wonder how suitable MBS is for caching. I suspect it has an ultra-long tail.
2017-06-01 15200, 2017
ruaok
ultra long tail is my thought. which is why we need daily updated top-URL reports.
2017-06-01 15205, 2017
ruaok
how are those coming, zas?
2017-06-01 15253, 2017
drsaunders has quit
2017-06-01 15244, 2017
github joined the channel
2017-06-01 15244, 2017
github
[picard-plugins] rdswift closed pull request #105: Standardized Album Artist Name(s) (1.0...1.0) https://git.io/vHRxW
2017-06-01 15244, 2017
github has left the channel
2017-06-01 15213, 2017
yvanzo
ruaok, zas: Only compiled templates are currently cached, not pages. Varnish would be a good fit, but it requires to purge cache from within MBS editing system, just like zas wrote.
2017-06-01 15228, 2017
ruaok
now the big question: what is better: 1) Add caching 2) move templates to react ?
2017-06-01 15221, 2017
yvanzo
both
2017-06-01 15235, 2017
drsaunders joined the channel
2017-06-01 15205, 2017
zas
Yes, i need to generate a daily page, but parser is working
