Hi there,
I have a spark session that I use to connect to two different clusters by using:
spark.setCassandraConf("myremotecluster", myRemoteClusterConf)
Then later I do the following:
spark.read.cassandraFormat(cluster = "myremotecluster",
keyspace = "myremotekeyspace",
table = "myremotetable").load
What I would like to do is use this configuration to do the following:
// get the cluster config from the spark session somehow here //
// then use it
CassandraConnector(myRemoteClusterConf).withSessionDo { s => .... }
Is there an easy way to read this configuration back from the spark session? I can't seem to find one :-/
I can cache it somewhere myself but would be great to be able to grab it from the spark if possible.
Thanks,
James
