1

I have a problem to write data on aws keyspace with spark conector. This message below shows:

ERROR QueryExecutor: Failed to execute: com.datastax.spark.connector.writer.RichBoundStatementWrapper@681c47f5 com.datastax.oss.driver.api.core.servererrors.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency LOCAL_QUORUM (2 replica were required but only 0 acknowledged the write)

Spark version: 3.1 EMR: 6.3.1 Cassandra: 3.11.2

Autumn88
  • 351
  • 1
  • 11
Alan Miranda
  • 125
  • 1
  • 8

2 Answers2

2

When you get the WriteTimeout error with Amazon Keyspaces usually indicates when a write request fails due to insufficient capacity. To give more insight we recommend using the Cloud Watch Monitoring template that we’ve put on Github here: https://github.com/aws-samples/amazon-keyspaces-cloudwatch-cloudformation-templates . Its a Cloud Watch template that will help you to monitor your resources, The information from the Cloud watch metrics will help us to determine why you are getting this error so we can better help you.

Autumn88
  • 351
  • 1
  • 11
  • 1
    Amazon Keyspaces now supports the Spark Cassandra Connector https://aws.amazon.com/about-aws/whats-new/2022/04/amazon-keyspaces-read-write-data-apache-spark/ – MikeJPR Apr 22 '22 at 21:15
0

First please check the load on all nodes on the cluster means IO, CPU and memory statistics if all they are Ok.

As a workaround you can also consider to increase the below timeout parameters in cassandra.conf. write_request_timeout_in_ms & read_request_timeout_in_ms

Nimantha
  • 6,405
  • 6
  • 28
  • 69
gaurav garg
  • 11
  • 4