Questions tagged [google-cloud-pubsub]

For programming/API questions related to Google Cloud Pub/Sub, which provides asynchronous messaging and ingestion services for event-driven systems and streaming analytics on the Google Cloud Platform infrastructure.

The official documentation can be found here: https://cloud.google.com/pubsub/docs/overview

2920 questions
9
votes
1 answer

Google Cloud PubSub Message Delivered More than Once before reaching deadline acknowledgement time

Background: We configured cloud pubsub topic to interact within multiple app engine services, There we have configured push based subscribers. We have configured its acknowledgement deadline to 600 seconds Issue: We have observed pubsub has pushed…
Paresh Behede
  • 5,987
  • 1
  • 18
  • 13
9
votes
1 answer

Kubernetes dynamic Job scaling

I’m finally dipping my toes in the kubernetes pool and wanted to get some advice on the best way to approach a problem I have: Tech we are using: GCP GKE GCP Pub/Sub We need to do bursts of batch processing spread out across a fleet and have…
9
votes
1 answer

At what stage does Dataflow/Apache Beam ack a pub/sub message?

I have a dataflow streaming job with Pub/Sub subscription as an unbounded source. I want to know at what stage does dataflow acks the incoming pub/sub message. It appears to me that the message is lost if an exception is thrown during any stage of…
Kakaji
  • 1,421
  • 2
  • 15
  • 23
9
votes
2 answers

Google Cloud Platform pub/sub Publisher, how to supply credentials other than default application credentials

Using the com.google.cloud.google-cloud library (http://googlecloudplatform.github.io/google-cloud-java/0.21.1/index.html), I have the following code for the Google Cloud Platform pub/sub: TopicName topicName = TopicName.create("projectId...",…
RedShift
  • 287
  • 1
  • 6
  • 17
9
votes
1 answer

How to receive long running operation results via Google Cloud Pub/Sub API

When long running operations are kicked off in Google Cloud APIs, the service might return an object with an "Operations" shape. The status of the operation can then be polled through this object and the results obtained when complete. I'd like to…
9
votes
2 answers

Creating topic on pubsub emulator

I started to use the pubsub emulator to test my basic implementations and ran into an issue while trying to create a new topic. My emulator listens on localhost:8085 and if i create the topic via the api PUT…
9
votes
3 answers

Google Cloud Pub/Sub Retry Count

We are moving from an unstable messaging queue service to Google's Pub Sub in NodeJS. It seems to work well but we would like to include error handling. We would like to limit the number of retries for a particular message, say 10 times in our test…
9
votes
3 answers

Gmail push notification error (Only one user push notification client allowed per developer)

I tried to execute gmail api's watch on my two gmail accounts and it works fine. But when the other user tried to do so, it shows this error: HTTP error 400 : "Only one user push notification client allowed per developer (call /stop then try…
khulas15
  • 181
  • 4
9
votes
2 answers

Is there a way to configure the retention period for google cloud pub/sub?

Is there a way to specify the retention period for the messages in google cloud pub/sub? Let's say I have a subscriber started consuming messages, but the service crashed and is back online a day later after the bug is fixed. Can it continue from…
user1192699
  • 103
  • 1
  • 3
9
votes
2 answers

Google Cloud Pub/Sub Publishing from Browser - How does Auth work?

I have a requirement to use Google Cloud Pub/Sub API directly from Browser ( similar to GA script). I was wondering how can in handle Auth without requiring going through a back-end server. I want to invoke the Cloud Pub/Sub API directly from the…
Sathish Senathi
  • 215
  • 2
  • 8
8
votes
3 answers

Multiple google cloud project linking to API access in play console

We have multiple apps uploaded in a single developer account that are featuring in app subscription. All the apps uploaded on play console have corresponding google cloud project having pub sub setup. I am able to link only one google cloud project…
8
votes
1 answer

Go + Apache Beam GCP Dataflow: Could not find the sink for pubsub, Check that the sink library specifies alwayslink = 1

I am using the Go SDK with Apache Beam to build a simple Dataflow pipeline that will get data from a query and publish the data to pub/sub with the following code: package main import ( "context" "flag" …
8
votes
2 answers

Rate limit GCP Cloud Function triggers from pub/sub topic

I have a Cloud Function that is being triggered from a Pub/Sub topic. I want to rate limit my Cloud Function, so I set the max instances to 5. In my case, there will be a lot more produced messages than Cloud Functions (and I want to limit the…
8
votes
1 answer

Android Real Time developer notification for one time purchase is half working

Android's Real Time developer notification works when I use "Slow test card, approves after a few minutes". I'm getting two notifications on my server via pub/sub. One when the purchases has been made and with token and order withconsumptionState:0…
8
votes
1 answer

Creating google_logging_project_sink in Terraform doesn't push events to Pub/Sub

I want to create a Log Sink to listen to a specific message in Stack Driver and push the event to a Cloud Pub/Sub, which will trigger a Cloud Function. Here is a part of my Terraform template. resource "google_pubsub_topic" "dataflow_events" { …