Fetching and caching photos on demand with nginx

Question

I am developing an application, where I use most of the photos provided by a third party service. While building my first prototype, I got the images directly from the service, i.e.

<img src="http://thirdpartyservice.com/img/12345.jpg">

It production though, it makes no sense grabbing the images from the service every time they get requested. It is just to too slow, because it serves millions of users at the same time.

I'd like to build a thin layer on top of nginx, which fetches, and caches images for 24 hours based on demand. So instead of calling the service every time, I'd rather call

<img src="http://myapp.com/img?url=thirdpartyservice.com/img/12345.jpg">

If this is the first time an image is requested, it will be fetched from the remote service and cached on my servers for 24 hours.

Is this possible to do with nginx?

Is this thirdpartyservice really slow, or you think that it will be slow? If they really serve millions of users, probably they already optimized their performance. Why do you think that your simple proxy will have better performance? — Alexey Ten, Mar 08 '14 at 11:41

score 0 · Accepted Answer · answered Mar 08 '14 at 18:23

First I would suggest not to change url format to http://myapp.com/img/12345.jpg in case we always proxy to the same thirdpartyservice.com. Here is config example based on nginx wiki.

http {
    proxy_cache_path  /data/nginx/cache  levels=1:2    keys_zone=STATIC:10m
                                         inactive=24h  max_size=1g;
    server {
        location /img/ {
            proxy_pass             http://thirdpartyservice.com;
            proxy_set_header       Host thirdpartyservice.com;
            proxy_cache            STATIC;
            proxy_cache_valid      200  1d;
            proxy_cache_use_stale  error timeout invalid_header updating
                                   http_500 http_502 http_503 http_504;
        }
    }
}

There are lot of directives about cache tweaking in official documentation.

Fetching and caching photos on demand with nginx

1 Answers1