Questions tagged [aws-cloudwatch-log-insights]

301 questions
0
votes
0 answers

Amazon EFS Logging

I have two EFS entities. I have created a log group inside CloudWatch but still empty (no stream). How do I relay all EFS logs into the log group? The ultimate goal is to monitor the logs especially when throughput % goes high. I have tried the…
0
votes
0 answers

Search AWS CloudWatch Logs across multiple log groups

I have an application with hundreds of lambdas (in the neighborhood of 1000) and I'd like to be able to collate log data across all of the lambdas. I understand CloudWatch Log Insights has some capabilities to do this... but I don't think it can on…
0
votes
0 answers

Add additional details with queries and see them in AWS cloudwatch logs

I have a postgresql server on AWS RDS instance. All the queries that are executed on the instance is recorded in the AWS cloudwatch logs insights and I am able to filter them based on my needs. Now going forward, I also want to log the sessionId of…
0
votes
0 answers

Group By and Count keywords for each log message using log insights

I have a log message for eg: Final list: "locale:locale1, locale=locale2, locale=locale1, locale=locale3" How do I create a CloudWatch log insights query to count and group the locales count for each log message: I want this output: # locales_count…
0
votes
0 answers

Is this old AWS cloudwatch-agent sending some logs or metrics to CloudWatch?

Found out we have some old cloudwatch-agent (version 1.247354.0) pods handled by a DaemonSet running and I'm not able to understand if they are actually sending something to AWS CloudWatch. How can I do? I see no errors in agent logs but the cwagent…
0
votes
0 answers

How do I check if one message is followed by another in AWS Log Insights using query patterns?

Can you write a query for AWS Log Insights that would check 2 messages at a time? What i am looking for is a pattern, where: message like /text1/ is followed by message like /text2/ can you have a query that will check for something like parse…
0
votes
0 answers

How to write log insight query to get percentage of an alias

So I have log messages containing fields like: numberOfPlayers: 50 team: Alice numberOfPlayers: 60 team: Alice numberOfPlayers: 70 team: Bob numberOfPlayers: 40 team: Bob I want to get 99th percentile across largest numberOfPlayers in a team,…
0
votes
0 answers

How to create one single variable for multiple api in cloudwatch

I have a scenario in which there are multiple api each of the api will contain orgId and objectiveId. Now I want to write a cloudwatch query to fetch all the logs for all below api's in the query but I don't want to create sperate variable for each…
0
votes
0 answers

AWS CloudWatch Logs Insights query: How can we write a query to list all the words from logs ordered by frequency

I am working on cloud watch logs, I am having a scenario where I need to list down for all the words from cloud watch logs ordered by its frequency, and I have tried with the below queries but it is not working, I would appreciate any assistance you…
0
votes
0 answers

Separate Cloudwatch @message

I am trying to get one log result per @message instead of having an aggregated one. See image The query I am running is this fields @timestamp, @message, @logStream | parse @logStream /.*\/.*\/(?.*?)\/.*/ | display @timestamp, step, @message |…
0
votes
0 answers

Imported Cloudwatch LogsInsights query to Grafana display only 1 record

Hi I have been trying to import dashboard from cloudwatch to Grafana. Where i have a visual made using LogInsight query. Sample query that i an using is fields @timestamp, @recordCount, @logStream | sort @timestamp desc | parse @message…
0
votes
1 answer

Amazon Cloudwatch Logs Insights

I have to find the results in cloud watch log insights and below are the fields in logs : Field Value @ingestionTime 1681410599635 @log 875721534563:ftp_Logs @logStream server @message MDTM|13/04/2023 06:29:57…
0
votes
1 answer

Pod is in pending stage ( Error : FailedScheduling : didn't match Pod's node affinity/selector )

I have a problem with one of the pods. It says that it is in a pending state. kubectl get pods -n amazon-cloudwatch NAME READY STATUS RESTARTS AGE pod-1 1/1 Running 0 17h pod-2 1/1 Running …
0
votes
0 answers

Cloudwatch insights parse fields from array of objects

I have this sample log and I want retrieve all values of a certain field and concatenate them on the log insight result. I tried to parse this but it can only retrieve its first occurrence. Sample Log: Field Value @message …
0
votes
0 answers

CloudWatch Logs: Timestamp from Message

I have multiple .log files on Linux, sample string from log file: 2023-01-13 15:20:03 [DEBUG] quiet = false. I've set CloudWatch agent to pick up those logs, In CloudWatch UI I can see 2023-01-13 15:20:03 in Message column, in…
kagarlickij
  • 7,327
  • 10
  • 36
  • 71