Questions tagged [stackdriver]

Monitoring, logging, and diagnostics for applications on Google Cloud Platform and AWS.

Part of Google Cloud Platform Google Stackdriver includes monitoring, logging, & diagnostics like Stackdriver Monitoring (aka Google Cloud Monitoring).


Docs:

  • Monitoring - collects metrics, events, and metadata from GCP/AWS/Anthos or custom metrics. Generates insights via dashboarts, charts and alert.
  • Logging - allows to store, search, analyze, monitor, and alert on log data and events from GCP or AWS
  • Error Reporting - aggregates and displays errors produced in users running cloud services.
  • APM
    • Debugger - lets user inspect the state of an application, at any code location, without stopping or slowing down the running app
    • Trace - a distributed tracing system for Google Cloud Platform that collects latency data
    • Profiler - a statistical, low-overhead profiler that continuously gathers CPU usage and memory-allocation information from your production applications
966 questions
0
votes
1 answer

How to set agent metrics for managed group

I would like to set auto-scaling for my GCE instances. I read the documentations and I understood that I can set a custom metric as the factor to allow google autoscaler to resize my cluster. Now, I would like to set the memory/percent_used as the…
0
votes
1 answer

How to use logger to log an error into stackdriver?

I have a VM micro instance running on google compute cloud and I want to log an error message to stackdriver. This page https://cloud.google.com/logging/docs/agent/installation shows this example logger "Some test message" which works great for…
0
votes
1 answer

google cloud logging api not correctly filtering

Trying to pull logs for a daily cron job that backs up app engine data from google.cloud.logging import Client, ASCENDING from google.oauth2.service_account import Credentials credentials =…
0
votes
1 answer

error loading Stackdriver logging client on AWS Lambda

I'm importing the Stackdriver logging python library on an AWS Lambda function, like so: import google.cloud.logging from google.cloud.logging.handlers import CloudLoggingHandler from google.cloud.logging.handlers.transports.sync import…
skunkwerk
  • 2,920
  • 2
  • 37
  • 55
0
votes
1 answer

Stackdriver logging not showing proper logs

I have been using Cloud ML and stackdriver logging service for a while. However, today there seems to be a problem and logs are not coming up as usual. Before when issuing a job logs such as the ones under would come up. info: Validating job…
Mark
  • 414
  • 2
  • 13
0
votes
1 answer

Loading statistics(Logs) of all BigQuery load jobs in my project to BigQuery table

After the end of Apache Beam (Google Cloud Dataflow 2.0) job, we get a readymade command at the end of logs bq show -j --format=prettyjson --project_id= 00005d2469488547749b5129ce3_0ca7fde2f9d59ad7182953e94de8aa83_00001-0 which can be…
0
votes
1 answer

StackDriver - Simple Log alerts for more than X lines matched per 1minute

Very simple scenario StackDriver logging alert scenario. Alert me if there are more than 100 404s log entries in the nginx log in a 1 minute period. I've setup the log filter and this works correctly, filtering 404 lines. And I can almost get the…
Mâtt Frëëman
  • 1,361
  • 9
  • 20
0
votes
1 answer

Logging using Stackdriver API on Kubernetes / Google Container Engine (GKE)

I have a go application that leverages Google Cloud Logging API. The relevant code is the same as this sample from their documentation: https://github.com/GoogleCloudPlatform/golang-samples/blob/master/logging/logging_quickstart/main.go After…
0
votes
1 answer

Stackdriver custom multiline logging, time format

I've been trying to set up a custom multiline log parser to get logs into Stackdriver with some readable fields. Currently it looks like this: type tail read_from_head true path /root/ansible.log pos_file…
snetch
  • 458
  • 4
  • 18
0
votes
0 answers

add image on metadata field on stackdriver logging

I have an app running on google-container-engine here is my deployment.yaml: apiVersion: extensions/v1beta1 kind: Deployment metadata: name: my-cool-app namespace: production spec: replicas: 1 strategy: type: RollingUpdate template: …
dina
  • 4,039
  • 6
  • 39
  • 67
0
votes
1 answer

(Alerting Policies) Set up custom messages

I'm using Google StackDriver to monitor a set of servers and websites, I have created Mail and SMS alerting policies, it is working well so far, but the mails and SMS contents aren't that easily readable for anyone that doesn't work with…
0
votes
1 answer

Manipulating Time Series data in Google-cloud library

I am trying to get data from a custom Stackdriver metric using the Google-Cloud Python library, but beyond returning it as a pandas dataframe I can't get the values I need. For example the query, which looks something like: query =…
0
votes
1 answer

How to remove devices from stackdriver policy notification list

My StackDriver Alerting Policy setup (for the Cloud Console mobile app) has two devices with the exact same name. Only one appears to actually deliver notifications to my phone, so I can never tell which one is the correct one to deliver it to my…
Mike Lambert
  • 1,976
  • 1
  • 17
  • 31
0
votes
0 answers

Custom counters from dataflow in the Stackdriver monitoring

How can I view the custom counters defined in my dataflow job to the stackdriver monitoring. As the google documents says the any custom counters defines in the dataflow will be reported as the custom metrics in the stackdriver. But I cant see any…
ganesh_patil
  • 356
  • 3
  • 18
0
votes
1 answer

Google cloud platform stackdriver log a file

I have a custom backup process, that at the end produces a log file. I would like to send the log to stackdriver, and for that I am doing: gcloud beta logging write log "!content!" pause Where content is a variable containing the entire file…
Amit
  • 5,924
  • 7
  • 46
  • 94