Stack Overflow
Stack Overflow

Questions tagged [google-cloud-logging]

Google Cloud Logging collects and stores logs from applications and services on the Google Cloud Platform

Introduction

Google Cloud Logging collects and stores logs from applications and services on the Google Cloud Platform:

  • View your logs with the Logs Viewer.
  • Export your logs to Google Cloud Storage, Google BigQuery, or Google Cloud Pub/Sub.
  • Integrate third-party logs from your virtual machine instances by installing the logging agent, google-fluentd.

Cloud Logging saves metadata with every log entry so that you can tell when the log entry was created, from what resource or instance it came, what its severity level is, and so forth. The log entry's original content, or payload, might be saved as a text string or as a structured object, depending on the log type.

Official documentation

622 questions
2
votes
1 answer

Google Cloud Logging: Search v1 Entries with V2 API?

I'm currently writing logs to Cloud logging via google-fluentd which is great. Now I want to filter and retrieve those entries. The google-fluentd agent writes v1 format entries using the v1 API. From what I gather the v1 API has no method to…
Robert Jordan
  • 187
  • 9
2
votes
1 answer

How to filter log messages above a certain response size in App Engine Log viewer?

Based on the LogViewer documenation I am hoping to be able to use httpRequest FIELDS in an expression to filter log messages. Within the Advanced Filter, I have tried to use httpRequest.responseSize > 10000 But has not worked. Any suggestion on…
user1055761
  • 1,071
  • 1
  • 12
  • 28
2
votes
1 answer

Filter by Google Container Engine namespaces in Cloud Logging

After creating a small, three node cluster with some pods on Google Container Engine I try to view pod logs in Cloud Logging. I can see the pod logs just fine, but I have no way of separating log entries from pods with the same name in different…
Tobias Lindholm
  • 35
  • 6
2
votes
1 answer

LogSeverity on aggregated logs in Google Container Engine

In a Google Container Engine cluster all of the standard out of the pods are aggregated and send to Google Cloud Logging. This works out fine except you don't have any control over the logging meta data like google.logging.v1.LogSeverity Is their…
alexvanboxel
  • 685
  • 6
  • 9
1
vote
0 answers

How to associate OpenTelemetry trace/span ID to Google Cloud Logs?

From the documentation: To associate a log entry with a trace by setting the trace field in the LogEntry object. The trace field must be set to a string with the following format: projects/PROJECT_ID/traces/TRACE_ID where PROJECT_ID is your…
Gajus
  • 69,002
  • 70
  • 275
  • 438
1
vote
1 answer

Google Cloud Working not working with Gunicorn

Up until now I've been using uvicorn directly to run a fastapi app running on Render which has google cloud logging enabled as such: def configure_logging(): # Reset root logger config logging.root.handlers = [] …
Evan Fossier
  • 49
  • 1
  • 5
1
vote
1 answer

Get details of All Class A operations in GCP Cloud Storage to Understand Cost

I am running a large data transfer between buckets using data transfer service for cloud storage. I want to find out exactly how many times I am invoking ClassA operations and ClassB operations to understand and analyse cost trends. Would like to…
SRJ
  • 2,092
  • 3
  • 17
  • 36
1
vote
0 answers

Custom attributes in Google Error Reporting shows up in logs but not on stackdriver

We are logging errors using GCPLoggingClient. Making sure that the format of the logged objects is ReportedErrorEvent so that they get marked as google errors and show up in stackdriver error reporting. This works and we can get errors logged to…
Aloof aloof
  • 17
  • 4
1
vote
1 answer

Should I implement logging in my NodeJS app when Google Cloud already provides Cloud Logging

So, this is my first question here and I'm pretty sure I'd break some guidelines even despite having read the tips on asking good questions. So I have a NodeJS code that I've just to deploy to production. I want to add logging for obvious reasons,…
Lex Nwimue P.
  • 9
  • 1
  • 4
1
vote
1 answer

Centralized monitoring solution in Google Cloud

Similar architecture monitoring we implemented in google cloud Context: We have a single organization, having different folders and each folder has a single project in Google cloud. We want to have a centralized monitoring solution in GCP. We…
Jagdish0886
  • 343
  • 1
  • 5
  • 20
1
vote
1 answer

Can disabling _default sink in GCP , will affect my other logs of resources?

I want to disable the _default sink of google cloud logging because of high cost, but wanted to be sure if this will affect my other logging policy that I am using for load balancer using big query. Is there any affect of disabling _default sink in…
Vishakha
  • 11
  • 1
1
vote
0 answers

How to write a custom multiline parser for Google Cloud Ops Agent

I am trying to configure google-cloud-ops-agent to collect log records from an application. Logs are one line or multiline. Example multiline log: [2023-02-08 10:32:23] production.ERROR: App\Jobs\Message::handle…
ursuleacv
  • 1,119
  • 14
  • 16
1
vote
1 answer

Cloud Profiler is not working for all Dataflow jobs

We're creating Dataflow job templates and launching new jobs using google-api-python-client library. Cloud Profiler is enabled for all jobs by default during Dataflow job template creation. python3 -m app.image_embeddings \ --job_name …
tokman
  • 71
  • 4
1
vote
1 answer

Firebase Realtime Database DATA_ACCESS audit logs logs are not visible in GCP Logging

I have a real time database and having multiple listeners on it. I would like to see a log entry in my audit logs when a read happens.(my listeners are reading out the database when some changes occur). Google Cloud Audit logs are the best candidate…
Robert
  • 127
  • 2
  • 11
1
vote
2 answers

In Google Cloud's Logs Explorer, how do you query for a key's existence in the jsonPayload dict?

In Google's Cloud Logging query language, is it possible to query for the existence of a particular key in the jsonPayload dict? E.g., suppose I know the jsonPayload will either be {'keyA':''} or {'keyB':'
BobMilton
  • 594
  • 5
  • 9
1 2 3
…
41 42