question

jaliase avatar image
jaliase asked Erick Ramirez edited

Frozen list not being Unset by the Spark connector

We have a column in a table with frozen<list<text>>. We are updating the value of the column in a spark job however if the list object is null in the output rdd, the spark connector sets the value to [] instead of unsettling it. We have a global configuration to unset when null.

spark-cassandra-connector
10 |1000

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

1 Answer

jaroslaw.grabowski_50515 avatar image
jaroslaw.grabowski_50515 answered

Please check the row via cqlsh. I suspect that the row has the value unset and "[]" that you see comes from Spark Cassandra Connector read (this is how SCC represents empty lists)).

Share
10 |1000

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.