Stack Overflow
Stack Overflow

Questions tagged [google-cloud-pubsub]

For programming/API questions related to Google Cloud Pub/Sub, which provides asynchronous messaging and ingestion services for event-driven systems and streaming analytics on the Google Cloud Platform infrastructure.

The official documentation can be found here: https://cloud.google.com/pubsub/docs/overview

2920 questions
1
vote
2 answers

Cannot receive PubSub push message in appengine flexible environment

I created a POST endpoint in the appengine flexible environment (Java/Spring Boot). It is in the same Google project as the PubSub subscriptions. I checked and this POST endpoint is accessible from outside world. I can post data to this endpoint…
Kostyantyn Grinchenko
  • 11
  • 3
1
vote
1 answer

PubSub Java-API on AppEngine uses restricted SelectorProvider

Trying to use PubSub in my AppEngine I have added the following com.google.cloud google-cloud-pubsub 0.6.0 When I try to get my PubSub…
Robert Lill
  • 119
  • 1
  • 11
1
vote
0 answers

Google Cloud Pubsub message iterator.Next() times out instead of returning iterator.Done (Go client)

I'm trying to pull messages from a Pubsub subscription on an App Engine app. (The GAE app currently uses Go client library for GCP.) And after consuming all the queued messages, I am constantly hitting the following RPC error. rpc error: code = 13…
Mad Min
  • 11
  • 3
1
vote
1 answer

Forbidden: 403 User not authorized even though the user is logged in

I am getting 403 error on Mac trying to hit a URL that uses the Python client: Traceback (most recent call last): File "/Users/cchilders/.virtualenvs/myproject/lib/python2.7/site-packages/flask/app.py", line 1639, in full_dispatch_request rv =…
codyc4321
  • 9,014
  • 22
  • 92
  • 165
1
vote
2 answers

Google pubsub to Google cloud storage

Is it possible for a bucket in cloud storage to receive data/messages from pubSub? if yes then how?? Currently i am publishing messages to pubsub and i want to use pull delivery type (for that i have to provide endpoint URL for the bucket, which i…
khrystal
  • 110
  • 2
  • 11
1
vote
1 answer

Google Dataflow with PubSubIO source constantly available?

Assume we have some data coming in through a Google PubSub topic and its traffic pattern is spiky in nature, with potentially long quiet time before a burst of data coming in at fast rate for minutes. For processing that data, if we are going to…
M Song
  • 280
  • 2
  • 9
1
vote
1 answer

Should I create Push PubSub Subscription once or periodically?

I'm implementing a queue for ingesting data using PubSub Topics. My plan is to use Push subscriptions to get data processed instantaneously as it is published. When using a Pull Sub, I've seen a lot of code patterns trying to recreate a Pull…
Leonardo Naressi
  • 313
  • 4
  • 14
1
vote
1 answer

Request had invalid authentication credentials. on the compute engine vm

I have a default n1 instance on the GCloud with preinstalled java and latest google sdk. When I run code locally within appengine:devserver which connects to the real pubsub subscription, it works correct. If I do the same on the Instance I get an…
Thomas Anderson
  • 511
  • 1
  • 5
  • 14
1
vote
0 answers

After deployment of GAE Flexible Go project, pubsub will stop working for about 15-20 mins?

Our App Engine Go flexible projects, whenever we deploy successfully, we lose the ability to publish message to PubSub for about 15-20 mins. After 15-20 mins, it starts working again! We start to suspect, that this is a bug on the platform. I'm…
Alex
  • 75
  • 6
1
vote
1 answer

Google Cloud Monitoring: Add an alert if Publish succeeds and subscribe fails

I want to add an alert on Google Cloud Monitoring such that, for a given topic and a subscription, I want to know if a topic is being published then subscriptions are not being acknowledged at the same or similar rate for a given time frame. How do…
YCN
  • 667
  • 2
  • 9
  • 25
1
vote
1 answer

Implement a TaskQueue (like Celery) with ETA/Countdown

Many popular task queues (such as Google GAE TaskQueue, Celery) have the ETA/Countdown feature, which allows a task to be put into the queue after xxx seconds. I am working on a project that needs a task queue with the ETA feature. However, there…
Sen
  • 195
  • 1
  • 10
1
vote
1 answer

Transform data to pubsub events

I have a dataflow pipeline that collects user data like navigation, purchases, crud actions etc. I have this requirement to be able to identify patterns real time and then dispatch pubsub events that other services can listen to in order to provide…
chchrist
  • 18,854
  • 11
  • 48
  • 82
1
vote
0 answers

SSLException when using pubsub and cloud SQL

I am trying to set up Cloud SQL in my project and hence to make it work I installed custom SSL certificates. However, now I cannot connect to PubSub and get this error Caused by: javax.net.ssl.SSLHandshakeException:…
Amit
  • 3,952
  • 7
  • 46
  • 80
1
vote
1 answer

SocketTimeoutException when trying to run DataFlow job locally with PubSub input source

I'm trying to test my DataFlow job locally, but keep getting timeout errors on reading from PubSub topic. PCollection> input = pipeline.apply(PubsubIO.Read.topic(options.getPubSubTopic()).maxNumRecords(10)) I'm sure that topic…
Adrian Serafin
  • 7,665
  • 5
  • 46
  • 67
1
vote
1 answer

gloud-java. PERMISSION_DENIED: Google Cloud Pub/Sub API (Experimental)

I use gloud-java experimental library. After update today, error occurred. Run example from library local (This error is automatically appeared in the google cloud flexible engine, although deploy not produced for a week) public class PullTest…
vad babushkin
  • 56
  • 1
  • 7
1 2 3
…
99 100