Django and Varnish

Question

I am currently working on a large website in django(very complex data structure), natively, the load support is extremely low(4 req/s), which is unacceptable, I was advised to use varnish to speed up my application. Now here is where the problem lies, I used memcaching throughout my site, quite heavily i might add(pretty much every single query gets memcached). I could not use the middle ware as there are portions of the website which is per-user dynamic. Now the real problem I ran into with varnish was that a lot of pages need to be cached per user, and with varnish if there are cookies going back and forth it does not cache pages, what I'm wondering is if there is a way to cache pages in varnish per user-agent, and if this is really efficient, and if not, what might be the next best caching solution which allows said flexibility to maximize application performance

On which server you run your application? What's the configuration? I had the similar problem and for me it helped to change the apache mod. — Andrzej Bobak, Jul 21 '12 at 14:19
im using apache with mod_wsgi, and nginx to serve the static files. — flaiks, Jul 21 '12 at 14:55
If you are already using nginx, the best option is deploy django is with nginx+uwsgi. — Paulo Scardine, Jul 21 '12 at 19:22

score 0 · Answer 1 · answered Aug 21 '12 at 14:51

Varnish can be used even with cookies.

I am showing here how varnish can be used for a particular path, see if you can use this to your benefit:

sub vcl_recv {
    if (req.url ~ "^/user1") {
        unset req.http.cookie;
    }
}

sub vcl_fetch {
    if (req.url ~ "^/user1") {
        unset beresp.http.set-cookie;
    }
}

or something like this:

sub vcl_hash {
    if (req.url ~ "^/user1") {
        hash_data(req.http.cookie);
    }
}

Django and Varnish

1 Answers1

or something like this: