I am practicing loading data with DSBulk from a CSV file.
I have a table defined as:
CREATE TABLE table_name ( col1 text, col2 set<text>, PRIMARY KEY (col1) );
When I load a pipe-delimited CSV that looks like this:
col1|col2 textValueWithSingleQuote|["collectionTextValueWithSingleQuote"]
The single quote in the text field is displayed correctly in the database, but the single quote in the set<text> field is displayed as two single quotes ''
I have tried escaping the single quote with \' and that is displayed as \'
I have tried escaping the single quote with two single quotes '' and that is displayed as four single quotes ''''
I am guessing it has something to do with how JSON Strings are parsed, but my knowledge of JSON is very limited.
Does anyone have any suggestions for how to work around this?
My initial thought is just to substitute a backtick ` for single quotes, but I would like to better understand what may be happening.
Thanks for any ideas or suggestions!
