Stack Overflow
Stack Overflow

Questions tagged [google-cloud-pubsub]

For programming/API questions related to Google Cloud Pub/Sub, which provides asynchronous messaging and ingestion services for event-driven systems and streaming analytics on the Google Cloud Platform infrastructure.

The official documentation can be found here: https://cloud.google.com/pubsub/docs/overview

2920 questions
1
vote
0 answers

Cloud pubsub pom.xml error

pom.xml entry: ` …
user2580738
  • 81
  • 3
  • 7
1
vote
0 answers

Using a pull subscription with a long running process

I have something like this in my main.py: while (True): pulled = subscription.pull(max_messages=1) # also tried with return_immediately=True for ack_id, data in pulled: subscription.acknowledge([ack_id]) run_task() # takes 15…
zoran119
  • 10,657
  • 12
  • 46
  • 88
1
vote
1 answer

Pub/Sub DEADLINE_EXCEEDED when Compute Engine external IP address set to None

I'm using the python example pub/sub code from within a CentOS based Google Compute Engine instance. https://cloud.google.com/pubsub/docs/quickstart-cli Everything works fine if the instance has the external IP address configuration set to…
Ahran Dunsmoor
  • 11
  • 1
1
vote
4 answers

Gcp PubSub not pushing message to REST Endpoint

I am facing an problem, Gcp PubSub not pushing message to my registered endpoint. Let me narrate in details the steps I have executed. Note, I am not using app engine I am deploying my simple spring boot app on PCF (Pivotal Cloud Foundry...PaaS)…
Indranil Bera
  • 11
  • 3
1
vote
1 answer

Google Pub/Sub retry policy ? how to deal with a poison pill?

In a Pub/Sub 'push' model the docs say this: If the push endpoint returns an error code, messages are retried for up to 7 days with an exponential backoff policy (capped at 10 seconds). Is there a way to decide what to do with the message after the…
1977
  • 2,580
  • 6
  • 26
  • 37
1
vote
1 answer

How retrieve metrics from pubsub outside Stackdriver

I want to know how retrieve metrics pubsub from an API. (I saw this topic Google PubSub - Counting messages in topic, but it's not the same problem). When I attempt to retrieve them from Logging API, but it returns a 404 error. It's not possible or…
Guillaume Dievart
  • 11
  • 2
1
vote
3 answers

Get real-time notifications from Gmail and Google calendar on slack with PubSub

I try to get real-time notifications on my slack channel from google calendar and gmail apis. I already created a Pub-Sub account and I want to add a push subscription on my topic with a slack incoming webhook url but when I try to add it, I got…
Saguaro
  • 233
  • 3
  • 12
1
vote
1 answer

saving google pub/sub messages in file or csv or mq

I know that in google cloud pub/sub, message will be lost after 7 days regardless of their acknowledgement state. Is there anyway we can send and store those messages in a file or csv or mq even after 7 days. My aim is whenever publisher publishes…
santosh.a
  • 503
  • 5
  • 20
1
vote
1 answer

Having trouble with sending high volume topics to Google cloud pubsub using fluentd plugin

The plugin works fine with low volume topics, but for the high volume its having trouble giving error: unexpected error error="The value for message_count is too large. You passed 1001 in the request, but the maximum value is 1000. I changed the…
FZF
  • 855
  • 4
  • 12
  • 29
1
vote
2 answers

How to know publish is successful in Google Pub Sub using .net library?

I am pushing some data to a topic in Google Pub Sub. Following code pushes a message to the topic: PublishResponse response = client.Publish(topic, messages); client is PublisherClient and message is a PubSubMessage. Now this response object…
Savaratkar
  • 1,974
  • 1
  • 24
  • 44
1
vote
0 answers

Go binding for Google pubsub gets stuck

Google Pubsub's Go binding gets stuck frequently, as explained below. We have been experiencing this problem since a few days ago. To isolate the cause, I wrote a very simple program, as follows, which calls merely Exists() and sees if it returns in…
linjus
  • 149
  • 9
1
vote
1 answer

Cloud Dataflow, PubSub & Bigquery (TableRowJsonCoder) Issues

I am using Cloud Dataflow, PubSub & Bigquery to read JSON Pubsub messages, convert the JSON into tables using TableRowJsonCoder and then write them to Bigquery. My issue is with consistency, the following code works sometimes. There are no errors…
Owen Monagan
  • 109
  • 8
1
vote
2 answers

GCloud pubsub emulator doesn't respect "PUBSUB_EMULATOR_HOST" environment variable

I tried running the pubsub emulator locally and send messages to it with existing services that I have running on pubsub. Messages weren't received, and all I get are auth errors in the logs. [pubsub] Jan 22, 2017 3:43:16 PM…
Saqib Rokadia
  • 629
  • 7
  • 16
1
vote
1 answer

Cross project push pub sub and firewall rules

I have a project, call it Project A. I have created a subscription to a Pub/Sub topic owned by Project B. This subscription is configured to deliver push notifications to my endpoint. I would like to create some firewall rules to restrict access to…
Max
  • 15,157
  • 17
  • 82
  • 127
1
vote
1 answer

How to Authenticate an External Publisher in Google Pub/Sub?

I am trying to obtain data from a web service (publisher). The web service lets me send the data (message) to any url through a webhook. My plan is to send it to a Google Pub/Sub topic. However, Google Pub/Sub is not recognizing this third-party…
XYseven
  • 475
  • 1
  • 4
  • 11
1 2 3
…
99 100