Stack Overflow
Stack Overflow

Questions tagged [google-cloud-bigtable]

Google Cloud Bigtable is a fast, fully managed, massively scalable NoSQL database service designed for applications requiring terabytes to petabytes of data. Cloud Bigtable doesn't require you to sacrifice speed, scale, or cost efficiency when your applications grow.

Google Cloud Bigtable is a fast, fully managed, massively scalable NoSQL database service designed for applications requiring terabytes to petabytes of data. Cloud Bigtable doesn't require you to sacrifice speed, scale, or cost efficiency when your applications grow.

Cloud Bigtable is exposed to applications through a supported extension to the Apache HBase 1.0 Java library.

628 questions
0
votes
2 answers

GCP Bigtable Python Client lost connection

I'm running into an issue with GCP Bigtable Python Client that it occasionally lost connection with Bigtable and causes a server error. The error message is attached below. This one happens when I was trying to write to Bigtable. I also observed…
xiu shi
  • 727
  • 8
  • 22
0
votes
1 answer

Hbase vs Google Bigtable: scan for large number of rows

I am trying to a Scan with a start and end row on Bigtable. The elements between the scan are around 100K. I want to get them in batches which I was able to do in HBase with using setCaching(500). In Bigtable, it seems setCaching is ignored and it…
Peter
  • 2,719
  • 4
  • 25
  • 55
0
votes
1 answer

RegexStringComparator BigTable Matching A Binary Number

In BigTable, when using the RegexStringComparator, is it possible to match a number in binary format. For example, suppose a Row Key has a number in it, but to save space and to have a predictable length, that number is stored as a 4 byte value…
Paul Mazzuca
  • 567
  • 1
  • 5
  • 19
0
votes
1 answer

Google Cloud BigTable Connection Issues

I am trying to create a simple connection to BigTable, however I think my dependencies are incorrect. As I understand it, if I have a standalone java application, the only thing I need to import is the bigtable-hbase-1.x as seen below, however, that…
Paul Mazzuca
  • 567
  • 1
  • 5
  • 19
0
votes
1 answer

Stuck in the error: "Not Started" when try to access BigTable through Dataflow Pipeline

My pipeline is very simple. Pipeline p = Pipeline.create(); p.apply("Read", (BigtableIO.read().withBigtableOptions(BIGTABLE_OPTIONS)).withKeyRange(keyRange).withTableId("myTable")); p.run().waitUntilFinish(); But when I run I…
Flávio Lúcio Pereira
  • 3
  • 1
0
votes
1 answer

Can we use Azkaban with Google Cloud Bigtable?

Can we use Azkaban with Google Cloud Bigtable, as we do with Apache HBase?
lakshay gaur
  • 39
  • 1
  • 9
0
votes
1 answer

Access audit logs in Google Bigtable

How can we access the audit logs in Bigtable (for instance, to know who dropped a table, or who altered some columns...) ? I've checked in "Stackdriver logging" where I can see all the Google Cloud components but BigTable. Or is it available with a…
Sourygna
  • 679
  • 4
  • 14
0
votes
1 answer

Read from Google PubSub and then read from Bigtable based on the PubSub message Topic

In Beam(Dataflow 2.0.0), I am reading a PubSub topic and then trying to fetch few rows from Bigtable based on the message from the topic. I couldn't find a way to scan the BigTable based on the pubsub messages through Beam documentation. I tried to…
Bala Murugan
  • 41
  • 1
  • 4
0
votes
1 answer

How to check if the provided cloud-bigtable project and instance IDs are valid?

val connection = BigtableConfiguration.connect(projectID, instanceID) val admin = connection.getAdmin Try { admin.tableExists(TableName.valueOf(tableName)) match { case true => connection.getTable(TableName.valueOf(tableName)) case false…
mmziyad
  • 298
  • 1
  • 4
  • 16
0
votes
2 answers

SBT Verify Error caused by multiple protobuf 2/3 dependencies in spite of shading

I am struggling with Verify Errors with this below sample project using Scio/Bigtable/HBase. The dependency tree requires protobuf version (2.5, 2.6.1, 3.0, 3.1) and seems to default to 3.2. I used the shading component of sbt-assembly, not sure I…
ogen
  • 802
  • 2
  • 7
  • 23
0
votes
1 answer

NotSerializableException trying to use JsonCredentials to query BigTable from Apache Beam

I'm trying to connect to Google BigTable using: BigtableOptions.Builder bigTableOptions = new BigtableOptions.Builder() .setProjectId(options.getProjectId()) .setInstanceId(options.getInstanceId()) …
sanj2sanj
  • 71
  • 6
0
votes
1 answer

Transform HBase Scan to RowFilter

I'm using scio from spotify for my Dataflow jobs. In last scio version, new bigtable java api is used (com.google.bigtable.v2) Now scio bigtable entry point required "RowFilter" to filter instead of Hbase "Scan". Is there a simple way to transform…
harscoet
  • 340
  • 1
  • 11
0
votes
1 answer

Bigtable Google Happybase Python KeyError when trying to do `counter_inc`

I'm not sure why but counter_inc method is not working, no emulator, pointing to a development real instance. Snippet: from google.cloud import bigtable from google.cloud import happybase client = bigtable.Client(project='robbie-ai',…
danius
  • 2,664
  • 27
  • 33
0
votes
1 answer

TimestampRangeFilter - all cells returned for row, or just matched cells?

Does the TimestampRangeFilter in Bigtable return all cells for returned rows, even if not all cells meet the filter criteria? Example: Say I have a row in Bigtable. I wrote a bunch of cells to the row 10 minutes ago. 5 minutes ago, I updated one…
user01380121
  • 527
  • 6
  • 18
0
votes
1 answer

bigtable bulk update based on dynamic filter

I'm looking for a way to scan huge Google BigTable with filter dynamically composed based on the events and make bulk update/delete on huge numbers of rows. At the moment, I'm trying to combine BigTable with java-based Dataflow (for intensive…
Pyit Phyo Aung
  • 11
  • 2
1 2 3
…
41 42