When running Datastax Kafka Connector, I am getting a lot of errors that look like this:
Required field 'value.my_field' (mapped to column my_field) was missing from record (or may refer to an invalid function). Please remove it from the mapping. (com.datastax.oss.kafka.sink.CassandraSinkTask)
It looks like the solution is given in the official docs here: I just have to remove the field. Is it possible to make the field optional though, so that Kafka messages that do have that field can set that column to that C* record, and records that don't just set the C* column to null?
It seems like it should be possible but unsure about how I would go about doing that.
I do have hope though since at least when using Structs, it appears to be possible to allow for optional fields if the example shown here is correct.