Questions tagged [tombstone]

For questions about how the tombstone feature of a data-store or database works, or about how to implement such functionality.

A tombstone is a marker or flag used to indicate that a record has been deleted, as a substitute for actually deleting the record and immediately reclaiming the space it used. SQLServer, Microsoft Synchronization Services and Cassandra use tombstones.

Using tombstones can improve execution speed, at the cost of increased storage space.

103 questions
1
vote
2 answers

Reduce cassandra tombstones

I have a table to store messages which are failed to process and I am retrying to process messages every 5 minutes through scheduler. When message gets processed successfully, respective row from table is deleted, so that same message should not get…
CKP
  • 13
  • 4
1
vote
1 answer

In Cassandra, why does a single value take precedence over quorum nodes empty response?

In Cassandra, tombstones are used in deletion since the writes are written to immutable files. I read that tombstones also solve the tough problem of deleting in distributed systems. This is where I am confused. What problems exist in deleting from…
Doraemon
  • 109
  • 1
  • 7
1
vote
1 answer

Kafka Connect tombstone message doesn't apply InsertField transformation

InsertField transformation isn't applied in tombstone message. I am using postgres 10.1 / debezium 1.2.1 version / kafka 2.4.1 version for example. configuration { ... "transforms": "InsertField", "transforms.InsertField.type":…
1
vote
1 answer

What is Number after symbol in Android Tombstone backtrace?

I was reading Tombstone in Android which have backtrace *** *** *** *** *** *** *** *** *** *** *** *** *** *** *** *** Build fingerprint: 'Android/aosp_angler/angler:7.1.1/NYC/enh12211018:eng/test-keys' Revision: '0' ABI: 'arm' pid: 17946, tid:…
RahulAN
  • 97
  • 1
  • 1
  • 7
1
vote
1 answer

spring cloud stream kafka - Functional approach: Consumer is never called when producing tombstone records

The issue is pretty much the same as https://github.com/spring-cloud/spring-cloud-stream-binder-kafka/issues/455 but for the Functional approach @Bean public Consumer> fooConsumer() { return message -> { …
1
vote
1 answer

Does Cassandra Insert JSON creates Tombstones?

I am using Cassandra's insert JSON feature to insert data into the table. In the JSON that I create, I do not include the null values. Meaning, ignore the fields that have null values in it. Does Cassandra create tombstones in such cases, if I am…
Bikas Katwal
  • 1,895
  • 1
  • 21
  • 42
1
vote
1 answer

Dealing with uncompactable/overlapping sstables in Cassandra

We have a new cluster running Cassandra 2.2.14, and have left compactions to "sort themselves out". This is in our UAT environment, so load is low. We run STCS. We are seeing forever growing tombstones. I understand that compactions will take care…
Flemo
  • 13
  • 2
1
vote
1 answer

how Compaction works in Apache Kafka

My input is 1:45$ and we are processing the message and next I am updating the 1:null. I do see still the 1:45$ in the topic along with the 1:null (I can see both the messages) I want output to be 1:null in the same topic. I have used this…
Ram Bha
  • 41
  • 3
1
vote
2 answers

Tombstones in hash tables

I am writing a class for a hash table. The hash table is an array of objects from a class I wrote, called HashVariable. The HashVariable has only two properties, a name, and a integer value. I know that if I delete an item from the table I will have…
mikael
  • 21
  • 1
  • 6
1
vote
1 answer

Updating cassandra list collection is creating tombstones

Cassandra version 3.11.3 I have a record with some set and list collections. Using the sets with adding/removing data seems to have no or very limited tombstone creation. Using a list column however seems to be creating a tombstone per query. I was…
Telavian
  • 3,752
  • 6
  • 36
  • 60
1
vote
1 answer

Major Compaction on ScyllaDB

Simple query:- I deleted data on Scylla with gc_grace_seconds 10 days. Scylla created tombstones and waiting for gc_grace_seconds expiration. Now, I have run major compaction on 2nd day after deletion(8 days still remaining for gc_grace_seconds…
LetsNoSQL
  • 1,478
  • 1
  • 11
  • 23
1
vote
1 answer

cassandra tombstones crossing threshold

In the logs I see tombstone warning threshold. Read 411 live rows and 1644 tombstone cells for query SELECT * FROM ks.tbl WHERE key = XYZ LIMIT 5000 (see tombstone_warn_threshold) This is Cassandra 3.11.3, I see there are 2 sstables for this table…
nmakb
  • 1,069
  • 1
  • 17
  • 35
1
vote
1 answer

Are tombstones an inssue in cassandra array?

I'm trying to investigate what are the performance impacts of using cassandra arrays. According to my experiments cassandra generates tombstones when inserting or not incremental updating of arrays (non frozen). However according to cqlsh trace…
Tomas Bartalos
  • 1,256
  • 12
  • 29
1
vote
1 answer

When are dropped SSTables compacted with SizeTieredCompaction in Cassandra?

With SizeTieredCompaction you may have a max of 32 SSTables per bucket and the coldest (like 33) gets dropped. When will they be picked up again? Are the compacted considered in a new bigger bucket again?
1
vote
1 answer

How are Cassandra Tombstones deleted in old SSTables?

If I have compaction enabled, like SizeTieredCompaction, my SSTables get compacted until a certain size level is reached. When I "delete" an old entry which is in an SSTable partition that is quite old and wont be compacted again in the near future,…