Stack Overflow
Stack Overflow

Questions tagged [google-cloud-pubsub]

For programming/API questions related to Google Cloud Pub/Sub, which provides asynchronous messaging and ingestion services for event-driven systems and streaming analytics on the Google Cloud Platform infrastructure.

The official documentation can be found here: https://cloud.google.com/pubsub/docs/overview

2920 questions
1
vote
1 answer

Writing to BigQuery from Cloud Dataflow: Unable to create a side-input view from input

I'm trying to write a datastore flow that reads in a stream for pub sub and writes in into big query. When trying to run the tool I get the error " Unable to create a side-input view from input" with the stack trace: Exception in thread "main"…
Adam Brocklehurst
  • 503
  • 3
  • 10
1
vote
2 answers

pubsub Dynamic rate limiting

Can anyone give details on the Dynamic rate limiting implemented by the Pub/Sub system? I couldn't find any details on the gcloud docs or the faq pages. Here is my pubsub usage: I'm planning to use pubsub in our production. Right now, I have 1…
kadu
  • 11
  • 2
1
vote
1 answer

How to push from google pubsub to a servlet running on google app engine?

I am trying to configure google pubsub to push messages to a servlet running on google app engine. I am able to publish to the topic. I know that this is working because and I am able to retrieve via pull subscriptions using gcloud: gcloud alpha…
Alex Ryan
  • 3,719
  • 5
  • 25
  • 41
1
vote
1 answer

Monitoring the status of a google pub/sub submitted job

I am new to Google Compute/Google App Engine platform. I am currently migrating a python flask application using celery for async tasks to Google Compute/Google App Engine platform. However in the docs it's written I should use Google Pub/Sub…
Biswadip Paul
  • 33
  • 6
1
vote
1 answer

Google Pub/Sub: push to compute engine

In Google Pub/Sub, is it possible to use an HTTPS server running on a Compute Engine VM instance as an endpoint for a push subscription? I'm a bit stumped, as in the documentation it says the server must be reachable by a DNS name. Any advice…
Mullefa
  • 1,237
  • 1
  • 15
  • 27
1
vote
1 answer

Authenticating PubSub Push messages in AppEngine

Is there a way to know for sure that a message received by app engine is from the Google PubSub service? Currently the PubSub service gets a 302 on the URLs configured as "login: admin" in appengine app.yaml. So it keeps retrying. I would have…
Gubbi
  • 756
  • 1
  • 7
  • 18
1
vote
1 answer

Unable to create Pipeline with PubsubIO.Read, Set up of resource ... failed

My test pipeline is really simple. It attempts to read from a topic created via the console. public static void main(String[] args) throws IOException { Options options = PipelineOptionsFactory.fromArgs(args). …
Jeremy
  • 2,870
  • 3
  • 23
  • 31
1
vote
1 answer

Quota on outstanding pull requests

Earlier today I noticed the following error in my logs: 503 Too many outstanding pull requests for subscription '<...>'. Please reduce the number of simultaneous Pull() requests invoked for this subscription. (POST…
Gilles Jacobs
  • 53
  • 4
1
vote
1 answer

How to enable scopes at gmail console

I am working on sending notification from gmail to webserver through pub/sub, I have gone through documentation in that they have mentioned to enable the scopes https://cloud.google.com/pubsub/configure I am specifying the following scopes through…
testing account
  • 21
  • 1
1
vote
1 answer

How do I export my Dataflow worker logs to Cloud Pubsub?

I'd like to run some secondary processing on my worker logs from Cloud Dataflow. Is there an easy way to do that?
Sam McVeety
  • 3,194
  • 1
  • 15
  • 38
1
vote
1 answer

Accessing Google Cloud Pubsub over HTTP 2 using grpc and protobuf (generated client)

I am attempting to use the google cloud pubsub service by using the service definitions at https://github.com/google/googleapis/blob/master/google/pubsub/v1/pubsub.proto I am able to generate the client code and have the following code to get a…
Ankur Chauhan
  • 1,393
  • 2
  • 17
  • 37
1
vote
0 answers

Use google pubsub with actionscript/air client

I have to implement google pubsub service in flash air client, in order to receive push messages from google app engine. After a lot of google seach, I did not found any example or discussion about this. Does anyone has already done this? If not,…
Bernard Kinnaeve
  • 11
  • 2
1
vote
2 answers

Multiple Pull calls to same Subscription at same time

While getting the notifications from a particular topic using pull method, is it possible to make a pull call to same subscription through different servers at same time? If not, what if I call pull using various thread on same server at the same…
Krishna Khowal
  • 49
  • 8
1
vote
1 answer

How to get userId from access token for Gmail OAuth2.0

What I'm trying to do I'm trying to create a web app that would fetch emails from a user's Gmail. I understand that I would require authentication via Google OAuth 2.0. What I'm trying to do is setting a watch() request on an inbox. Then, when the…
ShivanKaul
  • 687
  • 1
  • 8
  • 21
1
vote
1 answer

How can I verify that all the messages sent to PubSub have been sent correctly?

I'm running a Dataflow streaming pipeline that reads from PubSub and writes to BigQuery. When I try to verify that all the messages have been written to BigQuery I realize that some messages are missing. How can I verify that all the messages sent…
bsmarcosj
  • 1,590
  • 1
  • 11
  • 21
1 2 3
…
99 100