9

I have a flask app that runs in multiple gunicorn sync processes on a server and uses TimedRotatingFileHandler to log to a file from within the flask application in each worker. In retrospect this seems unsafe. Is there a standard way to accomplish this in python (at high volume) without writing my own socket based logging server or similar? How do other people accomplish this? We do use syslog to aggregate across servers to a logging server already but I'd ideally like to persist the log on the app node first.

Thanks for your insights

Colin Kroll
  • 133
  • 1
  • 7

2 Answers2

2

i use ConcurrentRotatingFileHandler

archer
  • 29
  • 4
1

We ended up changing our application to send logs to stdout and now rely on supervisord to aggregate the logs and write them to a file. We also considered sending logs directly to rsyslog but for now this is working well for us.

Colin Kroll
  • 133
  • 1
  • 7
  • 1
    FYI stdout is generally (block) buffered, which means lines from different writers can get mashed together; stderr is generally line-buffered so you see lines as soon as they're written, which also prevents them from being mashed together. These can vary by environment and program though. – Doctor J Oct 13 '15 at 16:45