Stack Overflow
Stack Overflow

Questions tagged [google-cloud-logging]

Google Cloud Logging collects and stores logs from applications and services on the Google Cloud Platform

Introduction

Google Cloud Logging collects and stores logs from applications and services on the Google Cloud Platform:

  • View your logs with the Logs Viewer.
  • Export your logs to Google Cloud Storage, Google BigQuery, or Google Cloud Pub/Sub.
  • Integrate third-party logs from your virtual machine instances by installing the logging agent, google-fluentd.

Cloud Logging saves metadata with every log entry so that you can tell when the log entry was created, from what resource or instance it came, what its severity level is, and so forth. The log entry's original content, or payload, might be saved as a text string or as a structured object, depending on the log type.

Official documentation

622 questions
0
votes
1 answer

Log are shown as error when they are just info

When I'm looking at my container engine logs, I see a lot of warnings. After digging a bit further, I realized those errors are actually just logs from heapster. I believe this is due to the log starting by I0730 My kubernetes cluster is using…
mastilver
  • 665
  • 6
  • 18
0
votes
2 answers

Google Container Engine stdout Logs Not Showing Up

My stdout logs are not showing up in Google Logs Viewer, or when using kubectl logs . The cluster has Cloud Logging enabled and fluentd containers are running on each node. Example Python code: logger =…
Aaron Drenberg
  • 1,117
  • 2
  • 11
  • 29
0
votes
0 answers

Limit Disk usage in Docker+MongoDB

I am using the official mongo Docker image to start a MongoDB container where my boot disk is limited (e.g. 10G) I configured the docker to run with Google Cloud Logging driver and was hoping Google to store all the logs and save my local disk…
Andy
  • 1,231
  • 1
  • 15
  • 27
0
votes
1 answer

JSON Logs in Google Cloud Logging using Winston in nodeJS

I am running a nodeJS server on Ubuntu 14.04 in Google Compute Engine. I want to use google cloud logging for my application so I installed google fluentd logging agent as per https://cloud.google.com/logging/docs/agent/installation I used winston…
tacticurv
  • 498
  • 4
  • 18
0
votes
1 answer

Suitable Google Cloud data storage option for raw JSON events with auto-incrementing id

I'm looking for an appropriate google data/storage option to use as a location to stream raw, JSON events into. The events are generated by users in response to very large email broadcasts so throughput could be very low one moment and up to ~25,000…
samaspin
  • 2,342
  • 1
  • 26
  • 31
0
votes
1 answer

Google Cloud Logging API - Missing authentication(user) information from audit logs for certain log entries

Google Cloud Logging API currently provides audit logs for App Engine, BigQuery, and Cloud Dataflow. According to Google docs, authentication information field of an Audit Log entry contains email address of the user that performed the actual…
Ankit
  • 13
  • 2
0
votes
1 answer

Java Google AppEngine Managed VMs: What logs are obtainable through the Logging API?

I like that I can use the Logs API (described here: https://cloud.google.com/appengine/docs/java/logs/) to programatically access and display app & request logs as I see fit--it's great. Now that I'm using Managed VMs on AppEngine you can see on…
Robert
  • 1,220
  • 16
  • 19
0
votes
1 answer

Kernel logging to Cloud Logging for Container Engine nodes?

My container logs for Container Engine all show up nice and pretty and divided by application in Cloud Logging, but conspicuously absent are kernel messages. How can I log kernel messages from my bare-metal Container Engine node to Cloud Logging?
joshk0
  • 2,574
  • 2
  • 25
  • 36
0
votes
2 answers

Google Cloud Logging export to Big Query does not seem to work

I am using the the google cloud logging web ui to export google compute engine logs to a big query dataset. According to the docs, you can even create the big query dataset from this web ui (It simply asks to give the dataset a name). It also…
Prathap Sridharan
  • 1
  • 1
0
votes
1 answer

Search for text from a selected set of logs using Google Cloud Logging?

When using Kubernetes it's common to have multiple instances of a pod running. Each pod will create a unique log available in the "logs selector" dropdown (see screenshot). I'd like to search for text in only specific logs in the Google Cloud…
Johan
  • 37,479
  • 32
  • 149
  • 237
0
votes
1 answer

Google Logging API - What service name to use when writing entries from non-Google application?

I am trying to use Google Cloud Logging API to write log entries from a web application I'm developing (happens to be .net). To do this, I must use the logging.projects.logs.entries.write request. This request dictates that I provide a serviceName…
urig
  • 16,016
  • 26
  • 115
  • 184
0
votes
1 answer

Logging to Google Cloud Logging from log4net

I have an asp.net web application that emit logs via log4net. I need to get the log messages over to Google Cloud Logging. What is the best way to do this? Based on fluentd documentation and Google Cloud documentation, the best I can come up with…
urig
  • 16,016
  • 26
  • 115
  • 184
-1
votes
1 answer

Google charging for Dataflow Job logs generated by the dataflow

Google is charging for dataflow job logs generated by the pipeline itself and we are not generating any logs from the job and we are running dataflow jobs via composer using the python-apache beam. It doesn't make any sense as we are not generating…
Chethan R
  • 11
  • 4
-1
votes
1 answer

print list metric with list_metrics() from cloud logging api (generator Expression 0x3e9bfe2fb4c0>)

I want to log all the log-based metrics I have in my gcp project with a cloud function in python. I'm trying to run the following code sample: for metric in client.list_metrics(): # API call(s) #do_something_with(metric) print(metric) I…
Simon Breton
  • 2,638
  • 7
  • 50
  • 105
-1
votes
1 answer

"Request contains invalid agrument" when updating a log sink

I'm attempting to update an existing sink using the (Python) Google Stackdriver Logging API, and am getting an error that I can't track down. The API explorer for the method in question is here, to which I'm supplying…
cincodenada
  • 2,877
  • 25
  • 35
1 2 3
…
41
42