Questions tagged [aws-cloudwatch-log-insights]

301 questions
1
vote
1 answer

awscloudwatchlogs exporter in opentelemetry collector

How do I configure my opentelemetry collector to export logs to Amazon awscloudwatchlogs? I have created a log-group called log-group-test-1 and under it a log-stream-test-1 Right now, I am using the current configuration for the exporter as shown…
1
vote
1 answer

Logging RDS table inserts into AWS Cloudwatch

I have a requirement to extract data from a third party RDS Oracle table whenever it is updated or inserted. I thought of creating a trigger in the third party DB and calling a Lambda function to extract data when an insert happens. The third party…
1
vote
0 answers

Filter results dynamically in CloudWatch insights

I want to dynamically omit some results from a query in CloudWatch insights. Let's say I want to include only the results with the filtered request IDs from query A as below. query A fields logMessage.0.reqId | filter @message like…
1
vote
1 answer

AWS CloudWatch filter for multiple log strings

I am creating a line chart in a CloudWatch dashboard. I can create a line representing the frequency with which one string appears the logs, using a filter. But, I don't know how to create two or more such lines. After selecting a log group, I run…
1
vote
1 answer

Cloudwatch: merging the result from 2 fields into one

fields @timestamp, @message | parse durationMs /(?[\d]+ )/ | parse message /(GET \/[^\s]+ [\d]+ )(?[\d]+)/ | display @timestamp, duration, responseTime | sort @timestamp desc This query works for me and fetches the…
1
vote
1 answer

Cloud watch query to get the lambdas which are failed and then succeeded after retry?

As described in the question I want to query the cloud watch logs for the lambdas that are failed and succeeded after consequentive retry attempts to the same lambda, I couldn't figure this out , any approaches on how to achieve this ? I tried and…
1
vote
1 answer

How to find distinct count or display distinct log message in cloudwatch

Here is my cloudwatch logs to count all the event types. I want only distinct values: fields @timestamp, @message | sort @timestamp desc | filter @message like 'RDMErrors::' | parse @message "[*] *" as LType, LMessage | filter LType!= 'Error' |…
1
vote
0 answers

How can I display an entire message field in Cloudwatch Log Insights, regardless of its length?

Currently, when looking through Insights we have several messages that we'll need to look through but it's not out of the ordinary for some of these messages to be 1000+ characters long. Because of the type of data we process, a lot of times we…
1
vote
0 answers

Stacked bar chart options in AWS

I need a stacked bar chart that looks something like below - What are my options to implement the above in AWS? should I use Cloudwatch Dashboard or AWS Quicksight?
1
vote
0 answers

Cannot do aggregation on a non aggregation function in AWS Cloudwatch Log Insights

Is there a way to do avg(latest(@timestamp) - earliest(@timestamp)) or any alternatives to this query?
1
vote
1 answer

Amazon CloudWatch Logs Insights: Aggregating logs using bin(1w) always starts on a Sunday

I want to display a bar diagram where each bar represents a week starting on a Monday. The below meta code does that except that each week starts on a Sunday. I realize that the Query syntax only mentions time periods with m for minutes and h for…
1
vote
0 answers

AWS Fargate instances showing insufficient data for alarms but

I started adding alarms to CloudWatch (ECS/Fargate) but they all show "Insufficient data" My first theories were that there was no CloudWatch agent running on my instances or that the container role or security groups doesn't allow access to…
1
vote
1 answer

CloudWatch Query join two records having same id

I have a cloudwatch log in the following format id name city 1 John 1 New York 2 Seatle 2 Mike I am looking for a way to fetch log data in the following format combining empty and non-empty…
1
vote
0 answers

Query STOPPED Tasks within an AWS ECS Service using CloudWatch Log Insights Queries (Fargate Launch Type)

I've been trying to create an AWS CloudWatch Custom Dashboard to indicate the number of Times a Task running in a ECS Service has STOPPED (Fargate Launch Type) due to containers crashing (could be due to a container related issue or application…
1
vote
1 answer

CloudWatch Logs insights Query to Get count of Given strings

I have a CloudWatch log group that contains log statements in bulk, here I want to filter the logs which contain the string "ABC". Then I want the count of "XYZ", "PQR", My current approach: fields @message | filter @message like /ABC/ | filter…