Questions tagged [amazon-cloudwatch]

Amazon CloudWatch provides monitoring for AWS cloud resources and the applications customers run on AWS. Use this tag when asking about CW features such as metrics or alarms. Use amazon-cloudwatchlogs instead when asking about log groups, log streams, and metric filters.

From the web site:

Developers and system administrators can use it to collect and track metrics, gain insight, and react immediately to keep their applications and businesses running smoothly. Amazon CloudWatch monitors AWS resources such as Amazon EC2 and Amazon RDS DB instances, and can also monitor custom metrics generated by a customer’s applications and services.

Usage Guidance

  • Use this tag when asking about CW metrics or CW alarms, the CW API, etc.
  • Do not use this tag when asking only about log groups, log streams, metric filters, etc; use instead.
  • Use both if asking about both (for example, if asking about a CW Logs metric filter that aggregates in a CW custom metric that triggers a CW alarm)

Resources

4155 questions
14
votes
0 answers

How does Amazon SNS manage CloudWatch log streams for delivery status?

Amazon AWS SNS has a feature allowing delivery status of mobile push notifications to be logged in CloudWatch. This is documented briefly here: http://docs.aws.amazon.com/sns/latest/dg/sns-msg-status.html My goal is to track delivery success of…
14
votes
2 answers

Where are CloudWatch log data stored?

Is there some document available that shows how AWS CloudWatch log data is stored at AWS? Especially, I would like to know: Is an existing service (e.g. Amazon S3) used for the storage of events? Is there any encryption available? Interestingly,…
Black
  • 5,022
  • 2
  • 22
  • 37
14
votes
1 answer

AWS Alarm stuck in INSUFFICIENT_DATA while creating

I tried to create a AWS Alarm to watch the SQS. If the queue has more than 1 message for 2 minutes, I want to create an alarm to trigger a policy. I used this command to create the alarm: aws cloudwatch put-metric-alarm --alarm-name alarmName…
13
votes
2 answers

AWS CloudWatch logs: How to send an email notification when particular error message is logged by lambda

I have to monitor CloudWatch logs for particular lambda. When the specific error message such as HTTP-50X is logged to CloudWatch, then we need to send an email notification to alert that the something is wrong. We need help to create alert email in…
13
votes
2 answers

Sending EMR Logs to CloudWatch

Is there a way to send EMR logs to CloudWatch instead of S3. We would like to have all our services logs in one location. Seems like the only thing you can do is set up alarms for monitoring but that doesn't cover…
13
votes
2 answers

cloudwatch command get-metric-data

I'm not able to get the metric data through this command. aws cloudwatch get-metric-data --metric-data-queries jsonfile.json \ --start-time 2019-02-01T10:40:0000 --end-time 2019-02-27T14:12:0000 The following error is getting shown. Error…
13
votes
2 answers

Including an exit code 1 event in CloudWatch using Terraform for ECS

I've been running containers on ECS, and using AWS Cloudwatch events to notify me when my tasks complete. All of the infrastructure has been created using Terraform. However, I'm unable to get the correct syntax in my event pattern so that I am only…
Yu Chen
  • 6,540
  • 6
  • 51
  • 86
13
votes
2 answers

CloudWatch alarm to SNS in different region

I'm trying to notify an SNS topic from a CloudWatch alarm that's in a different region. The reason is that I want SMS alerting, which isn't available in the region where my services are. If I enter the ARN of the subscription and save the changes…
Mark Probst
  • 7,107
  • 7
  • 40
  • 42
13
votes
3 answers

How to terminate AWS EMR Cluster automatically after some time

I currently have a task at hand to Terminate a long-running EMR cluster after a set period of time (based on some metric). Google Dataproc has this capability in something called "Cluster Scheduled Deletion" Listed here: Cluster Scheduled…
h0mer
  • 353
  • 1
  • 4
  • 10
13
votes
3 answers

AWS - subscribe multiple lambda logs to one elasticsearch service

I have two log groups generated by two different lambda. When I subscribe one log group to my elasticsearch service, it is working. However, when I add the other log group I have the following error in the log generated by cloudwatch :…
13
votes
5 answers

ARN role for API Gateway to enable logs error

I can't enable write access to CloudWatch logs in AWS API Gateway by providing a new IAM Role. I checked several tutorials, checked everything. Even attached AdministratorAccess policy to my IAM Role and checked that The identity provider(s)…
13
votes
4 answers

Memory Utilization for auto scaling group AWS

I am Setting up AWS autoscaling, and while setting scaling policy i ran into this problem. I wanted to use memory as a parameter, so i installed CLoudwatch's script for memory monitoring from below…
amit singh
  • 219
  • 4
  • 22
13
votes
1 answer

AWS IAM Policies to connect AWS Cloudwatch Logs, Kinesis Firehose, S3 and ElasticSearch

I am trying to stream the AWS cloudwatch logs to ES via Kinesis Firehose. Below terraform code is giving an error. Any suggestions.. The error is: aws_cloudwatch_log_subscription_filter.test_kinesis_logfilter: 1 error(s)…
13
votes
6 answers

How can I use AWS Boto3 to get Cloudwatch metric statistics?

I'm working on a Python 3 script designed to get S3 space utilization statistics from AWS CloudFront using the Boto3 library. I started with the AWS CLI and found I could get what I'm after with a command like this: aws cloudwatch…
13
votes
3 answers

CloudWatch Logs Filter case insensitive multiple terms or connected

I'm just trying to create an alarm based on CloudWatch Logs Filter which triggers on multiple terms (or connected, not and) and is case insensitive Using "error warning" as pattern is not working I'm looking for filter pattern reacting to all of the…