question

abratnap avatar image
abratnap asked Erick Ramirez edited

How do I connect to our DSE cluster from a Spark cluster?

I would like to know how can I connect datastax astra instance to the spark cluster. We have datatax running in IBM Cloud and I want to connect a local spark instance to it.

spark-cassandra-connector
10 |1000
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

1 Answer

Erick Ramirez avatar image
Erick Ramirez answered

Your question doesn't make sense to me. What do you mean by "Astra instance hosted in IBM Cloud"?

If you meant you have a DSE cluster and you want to connect to it from your own Spark cluster, then have a look at the Bring-your-own-Spark (BYOS) feature in DSE.

Note that DSE 6.8 ships with Apache Spark 2.4 so you'll only be able to connect to it if your Spark cluster is also version 2.4. Cheers!

Share
10 |1000
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.