Bringing together the Apache Cassandra experts from the community and DataStax.

Want to learn? Have a question? Want to share your expertise? You are in the right place!

Not sure where to begin? Getting Started

 

question

arunkolluri07_188529 avatar image
arunkolluri07_188529 asked arunkolluri07_188529 commented

What version of Spark is included in DSE 5.1?

Hi Team,

I am migrating my 18 node DSE 5.1 to open source.The current cluster has one DC with DSE Analytics and other 2 are just DSE .They are on DSE 5.1

I just wanted to know if below Open Source versions are the replacement versions that i need to install when i migrate.

  • Scala Version=2.11
  • Spark Version=_2.4.0
  • Connector Version=2.4.2
  • Cassandra Version=3.11
dse
10 |1000

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

1 Answer

Erick Ramirez avatar image
Erick Ramirez answered arunkolluri07_188529 commented

DSE 5.1 ships with Apache Spark 2.0 so you need to use components which match.

For details, see the Release Notes. Cheers!

1 comment Share
10 |1000

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

Thanks for the help.This was so useful.
0 Likes 0 ·