I've been using Nginx 0.8.5 as a caching reverse-proxy to build out a custom cdn-like solution to speed up our site's load time. It works great so far except that cache invalidation is really cludgy, even with the cache purge module installed.
For example, sometimes we may need to invalidate 100 urls at once, and this requires 100 different requests to get sent out to each Caching reverse-proxy server.
This hardly works with just two cache servers set up, and our plans are to scale to 20 servers, so we need to find a better solution. Any ideas?
Simply reconfiguring Nginx won't work, and I'm sure that we will need to custom-code something. And we don't want to get involved in custom Nginx module development.