Stack Overflow
Stack Overflow

Questions tagged [google-cloud-pubsublite]

For programming/API questions related to Google Cloud Pub/Sub Lite, which provides asynchronous messaging and ingestion services for event-driven systems and streaming analytics on the Google Cloud Platform infrastructure at low cost of operation with pre-provisioned capacity.

29 questions
0
votes
1 answer

Retrieve PubSub Schema from external IP address with API Key

I have created a PubSub schema I have created an API key with no restrictions I wish to cURL/Get this schema from an address outside of GCP I tried the below request but it's denied as per below me@J-5CG2200NLY:~/go/$ curl…
user1843591
  • 1,074
  • 3
  • 17
  • 37
0
votes
1 answer

Having exception committing offset in pubsublite

The whole document doesn't give me clear example how to use the API to commit/list offsets Here is the code I tried to run CursorServiceClient csc = CursorServiceClient.create( …
Siyuan Hua
  • 1
0
votes
1 answer

Problems receving messages from pubsublite with spark streaming

I have a problem, I try to receive the messages from pubsublite in real time from a spark cluster on GCP, but they are grouped in blocks of one minute. My code: producer.py import random import time from proj_BOLSA import settings from…
user9548476
0
votes
1 answer

pyspark publish google-pubsublite

the code is from google doc. https://cloud.google.com/pubsub/lite/docs/write-messages-apache-spark I m trying to publish to a pubsulite topic from pyspark. . import os from pyspark.sql import…
Cosmin Chauciuc
  • 65
  • 5
0
votes
1 answer

Spark DataFrame to Google Cloud PubSub

I want to stream/ batch load data from a Spark DataFrame to the PubSub. I came across with some libraries like: Apache Bahir: Useful for Streaming data from PubSub only. https://bahir.apache.org/docs/spark/2.2.1/spark-streaming-pubsub/ PubSub Lite…
Vanshaj Bhatia
  • 77
  • 8
0
votes
1 answer

Pubsublite subscribe extremely slow for first message

I'm using GCP pubsublite, naive topic with one partition, a few messages. Python client lib. Doing the standard subscription, subscribe client, subscribe method with callback. Between the method is called and the first message is received, it takes…
zpz
  • 354
  • 1
  • 3
  • 16
0
votes
1 answer

PubsubMessage and MessageMetadata not found in pubsub lite receving message

i am following below documentation of PubSub lite and trying to recieving message which i have publish using below code. Getting error in callback function. https://cloud.google.com/pubsub/lite/docs/subscribing Publishing message #code for…
abhi
  • 41
  • 1
  • 7
0
votes
2 answers

Differentiate between spring cloud gcp pub sub and google cloud pub sub

If I want to send message to Google PubSub and consume message from it.Would you recommend using Spring cloud GCP library or just using Google Cloud Java API. Can anyone differentiate between these two or what are features spring cloud gcp provide…
aatish bansal
  • 11
  • 3
0
votes
1 answer

Pub Sub Lite topics with Peak Capacity Throughput option

We are using Pub Sub lite instances along with reservations, we want to deploy it via Terraform, on UI while creating a Pub Sub Lite we get an option to specify Peak Publish Throughput (MiB/s) and Peak Subscribe Throughput (MiB/s) which is not…
Sanjay M. P.
  • 919
  • 1
  • 16
  • 33
0
votes
1 answer

Pub/Sub Lite Delayed Consumer

I am implementing Kafka delayed topic consumption with consumer.pause(). Pub/Sub Kafka shim turns pause into a…
Gabriel
  • 1,679
  • 3
  • 16
  • 37
0
votes
0 answers

Q&A not coming in pub sub notification

The pub/sub notifications for Google Questions and Answers are not coming while the new reviews and google updates notifications are coming. Please let me know of any solutions
Antim Arora
  • 15
  • 1
  • 6
0
votes
1 answer

google cloud pubsublite client on a serverless service

First of all, I wanted to tag this post to google-cloud-pubsub-lite, but it's not created yet, my apologizes I'm trying to get introduced with pubsub lite. I think it can be used as a "cheap" way to get an event store in a GCP project. We usually…
Daní
  • 355
  • 1
  • 17
0
votes
1 answer

PubSubLite: Accessing PubSub Lite cross region

Is it possible for the publisher / subscriber to be in different region from the location of the Lite installation ? For example two use cases 1. The publisher is in a GKE app in Europe but the Lite and its subscribers are in US 2. The publisher…
user3792971
  • 11
  • 1
1
2