Stack Overflow
Stack Overflow

Questions tagged [google-cloud-pubsub]

For programming/API questions related to Google Cloud Pub/Sub, which provides asynchronous messaging and ingestion services for event-driven systems and streaming analytics on the Google Cloud Platform infrastructure.

The official documentation can be found here: https://cloud.google.com/pubsub/docs/overview

2920 questions
1
vote
1 answer

Is it possible to add a pushEndpoint that has a port in it?

I'm trying to add a pushEndpoint to a subscription I'm trying to create in Google's PubSub (https://cloud.google.com/pubsub/) so I'm able to receive push updates from Gmail. The pushEndpoint I'm trying to add is an HTTPS-URL with a port (e.g.:…
jwanglof
  • 548
  • 1
  • 5
  • 20
1
vote
2 answers

gcloud pubsub on node.js - how to set IAM policy

Could someone walk me through setting an IAM policy in node.js using gcloud's pubsub? I've looked through this page: https://developers.google.com/gmail/api/guides/push And based on what I understood, I've saved this file as a .json: POST…
Sekoul
  • 1,361
  • 2
  • 14
  • 30
1
vote
1 answer

Google Pubsub API - 401 Error (The request does not have valid authentication credentials)

I am trying to connect to the Google Pubsub API with the API_KEY and I get 401 Error - Unauthorised. The command I am using is curl -i -H "Accept: application/json" -H "Content-Type: application/json" -H "Content-Length: 0" -X PUT…
user3451476
  • 297
  • 1
  • 4
  • 17
1
vote
1 answer

Google Cloud PubSub - can't seem to get topics

I'm using heroku to run a node.js app that uses gcloud to create a topic, and then subscribe to it. I'm using the following code, as taken from here: https://googlecloudplatform.github.io/gcloud-node/#/docs/v0.16.0/pubsub var gcloud =…
Sekoul
  • 1,361
  • 2
  • 14
  • 30
1
vote
0 answers

Not getting mail updates from cloud pub/sub topic watch

I have created topic on cloud pub/sub,then created subscription to it(Push into an endpoint url).Set watch on inbox mails of that topic.Watch set successfully still i am not getting any updates of new mails.How to get notify about mails?
Anu Pandit
  • 53
  • 1
  • 6
1
vote
2 answers

Master/Slave pattern on Google Cloud using Pub/Sub

We want to build a master slave pattern on Google Cloud. We planned to use Pub/Sub for that (similar to JMS pattern) letting each worker to grab a task from the queue and ack when done. But, it seems like a subscriber can't get messages sent before…
Guy Korland
  • 9,139
  • 14
  • 59
  • 106
1
vote
2 answers

Pubsub with Google App Engine

I'm trying to implement pubsub messaging with Google App Engine. I want to be able to store callbacks to other servers and then send them new data when it becomes available. I've had a good look around but can't seem to come up with anything apart…
chrisw
  • 273
  • 1
  • 4
  • 11
0
votes
1 answer

Does GCP pubsub Push subscription support custom attributes?

I have a GCP pubsub Push subscription. This subscription is pushing to a GCP Cloud run instance that receives the pubsub messages as HTTP requests. I am currently trying to add custom attributes to the publisher so that I can receive them in the…
Nick
  • 181
  • 2
  • 11
0
votes
0 answers

GCP Data Engineering certification Question

You are designing an Apache Beam pipeline to enrich data from Cloud Pub/Sub with static reference data from BigQuery. The reference data is small enough to fit in memory on a single worker. The pipeline should write enriched results to BigQuery for…
user546298
  • 41
  • 4
0
votes
1 answer

GCP PubSub Replay historical messages to specific Subscription

I have a GCP PubSub Topic and multiple consuming applications, with each app having its own subscription to it. The max retention on Topic is 31 days and messages are stored in a database. The use case is to allow specific consumer app to replay…
Rohit
  • 848
  • 3
  • 15
  • 31
0
votes
0 answers

Python unit test patch and mock?

I am trying to unit test my Workers class functions inside my workers.py module while testing file_download() which basically manipulates the message and makes another its own message and publish it to a google pubsub…
Shivam Kumar
  • 85
  • 1
  • 9
0
votes
1 answer

Expected latency with GCP Pub/sub synchronous pull subscription

My application is going to receive certain events from GCP Pub/sub and application is supposed to process these events using a cron job (mostly hourly). So, I am planning to use a synchronous pull subscription so that I can retrieve fixed no of…
Sumit Desai
  • 1,542
  • 9
  • 22
0
votes
0 answers

Pubsub to BigQuery Subscription : Schema revisions leads to null values in BigQuery

I am facing issues with pubsub schema evolution and when I add new fields then their values end up being null in BigQuery. My project structure is as follows. PubSub Schema { "namespace": "com.value.model", "name": "ValuePoint", "type" :…
SRJ
  • 2,092
  • 3
  • 17
  • 36
0
votes
1 answer

How can I receive firebase messages using python (or API)

I have a fleet of devices running python and need to be able to send messages to/from them each individually. I know that it is possible to send a message to an individual InstanceID token, but I can't figure out how to register a device to get an…
Daniel Watrous
  • 3,467
  • 2
  • 36
  • 48
0
votes
0 answers

Dataflow - process single input to multiple outputs using a ptransform

I read data from Pubsub and there are different types of data. I would provide runtime argument based on which it will have to create multiple outputs( using branching) but the idea is i would get multiple Pcollection after Ptransform but should i…
Anesh P
  • 3
  • 3
1 2 3
…
99
100