4

We have multiple Ec2 servers running and they have a tendency to be started and shut down at unpredictable times (based on load etc). What is the best way to collate and aggregate logs from them in one location?

Tarun Upad
  • 71
  • 1
  • 5
  • See http://stackoverflow.com/questions/83741/best-way-to-aggregate-multiple-log-files-from-several-servers – ripper234 Jan 18 '12 at 17:21
  • I was looking for similar resources myself. I found the following link where they tackled a similar problem and applied solutions with scalability as a consideration: https://www.nopsec.com/news-and-resources/blog/2014/11/26/monitoring-log-aggregation-and-you/ – Epoch Win Feb 19 '15 at 21:19

2 Answers2

5

Install rsyslog on your Ec2 image and have them transfer the logs to a central server.

Andrew M.
  • 11,182
  • 2
  • 35
  • 29
0

Have the server ftp or email then to you at instance startup. We have a script running that takes care of this (and some other housekeeping).

MFauser
  • 1
  • 2
  • While this may fit your needs, it is not a scalable solution. In some instances logs are lost at shutdown. – Andy Aug 19 '11 at 15:36