Stack Overflow
Stack Overflow

Questions tagged [google-cloud-pubsub]

For programming/API questions related to Google Cloud Pub/Sub, which provides asynchronous messaging and ingestion services for event-driven systems and streaming analytics on the Google Cloud Platform infrastructure.

The official documentation can be found here: https://cloud.google.com/pubsub/docs/overview

2920 questions
0
votes
1 answer

Does pubsub produce logs for each call to a push endpoint?

Is there anywhere that I can see a list of requests that pub/sub has made to a particular push endpoint? I don't need much info -- something like "this endpoint was called at this time" would be perfect. I have searched through stackdriver logs but…
Alex Flint
  • 6,040
  • 8
  • 41
  • 80
0
votes
1 answer

Is direct data ingestion from pub/sub to memorystore possible?

I was wondering if there's any possible option to move data directly from Pub/Sub to Memorystore, no mather Redis or Memcached. Is there any kind of subscription from Memorystore to Pub/Sub? I'm trying to move data directly from Pub/Sub to…
Carlos Torres
  • 3
  • 2
0
votes
1 answer

Using Spark Dataproc to write in Pub/Sub

I want to use Dataproc Spark to run 2 SQL files on BigQuery that are executed each minute, and then write the results into pub/sub. I am not sure if I can use these two technologies together. Does anyone that already have used Dataproc with Pub/Sub…
Lara
  • 21
  • 4
0
votes
1 answer

Persistence of Publishing

I'm using the google cloud PubSub Java client libaries and have a basic question about publishing guarantees. In the code below, if the publish returns successfully, i.e., the code gets to the // do other processing part, is the message guaranteed…
Dave McCullough
  • 43
  • 2
  • 5
0
votes
0 answers

Pubsub emulator publishing multiple messages instead of one

I have a weird issue happening on the publisher side and can't able to resolve it. Let me give a brief background of what I am doing. I have a service written in go, in order to do some operations this service is creating some K8 job which will spin…
Dogukan Evcil
  • 313
  • 4
  • 15
0
votes
1 answer

How do I fix a broken dag that requires python provider modules?

Some context: I have a GKE cluster running airflow 2.6.2. Python version 3.7 The direct error im getting is: Broken DAG: [/opt/airflow/dags/repo/airflow/dags/main.py] Traceback (most recent call last): File "", line…
JYang
  • 1
0
votes
0 answers

Using pub sub lite java client library with Firebase in android

When using firebase and pub sub lite client library together. I have lot of conflict of dependencies which I resolved by following configuration. implementation('com.google.cloud:google-cloud-pubsublite:1.12.12') { exclude group:…
Avinash kumawat
  • 475
  • 6
  • 18
0
votes
2 answers

Is it normal to have multiple users connected to one Pub Sub topic that contains user specific data?

I’m new to gcloud pub sub and I want to implement it so that I can communicate from server to a client self hosted node JS server without the user having to publicly expose a web server from their network. I want to send user specific data across…
Jack_b_321
  • 848
  • 8
  • 22
0
votes
0 answers

A sequenceNumber like attribute in pubsub

I acknowledge that on the receiver side, there is an attribute publish_time that can be used for sorting out the order of messages. However, unlike the sequenceNumber attribute in SQS, the publisher side returns a future object and I don't find any…
HanayoZz
  • 33
  • 5
0
votes
1 answer

GCP pub/sub, my pulled message is always empty

I have two Google Cloud functions, one that publishes and another that subscribes. This is the code public void publisXeroTeannt(XeroTenant xeroTenant) { Gson gson = new Gson(); String xeroTenantMessage =…
Pavanraotk
  • 1,097
  • 4
  • 15
  • 33
0
votes
1 answer

Can I specify an order key for GCP Bucket Storage Notifications to GCP PubSub?

I'm trying to process files that are dropped into GCP buckets in order, however, I can't seem to find a way to set an orderingKey on the StorageNotification. https://cloud.google.com/pubsub/docs/publisher#using-ordering-keys Looking at this page,…
Jty.tan
  • 808
  • 9
  • 25
0
votes
3 answers

Is push/pop really not available as a Cloud Service?

We are looking for a message queuing system that ensures the sequential processing of messages based on their row numbers. This seems like a foundational part of computing - but we seem unable to find it. Here's what we mean. PUSH/POP: Adding and…
Praxiteles
  • 5,802
  • 9
  • 47
  • 78
0
votes
1 answer

Google Cloud Pub/Sub Schemas - Too many protobuf messages in single schema

I'm defining a schema for a pub/sub topic. I have 7 proto files, and I'm able to combine them. When I did this, GCP outputted that there were too many protobuf messages in a single schema. I believe this is something to do with the 50Kb schema…
Joe Moore
  • 2,031
  • 2
  • 8
  • 29
0
votes
0 answers

Apache Flink: Google Cloud PubSub Connector: Unable to set attributes to the Pubsub Messages

Here I need to set some attributes to the Pubsub Messages before publishing them to the Google PubSub. For example: { "data": "Pubsub message data...", "attributes": { "attribute1": "value 1", "attribute2": "value 2", } } However, I…
Muaaz
  • 1
0
votes
0 answers

How to resolve null pointer exception while using pubsub MessageReceiver

I had java scheduler based implementation to read gcp pubsub msg but then I changed the same to use gcp pubsub MessageReceiver to listen and read msg asynchronously. // Class that implemented MessageReceiver contains code @Override public void…
stackUser
  • 545
  • 3
  • 9
  • 21
1 2 3
…
99
100