Bringing together the Apache Cassandra experts from the community and DataStax.

Want to learn? Have a question? Want to share your expertise? You are in the right place!

Not sure where to begin? Getting Started

 

question

kranthij29_188881 avatar image
kranthij29_188881 asked ·

Is it possible to just start Spark without starting full DSE on a node?

Hello All, How can we restart any service like and spark sql on one node in DSE cassandra like only spark restart without restarting full node.

dsespark
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

Erick Ramirez avatar image
Erick Ramirez answered ·

@kranthij29_188881 You won't be able to do it on a node in an existing DSE cluster because it's configured to run with DSE Cassandra + Analytics already. But you can create a new datacentre that runs DSE Analytics Solo -- a DSE DC with nodes which provide Spark analytics processing and DSEFS without the ability to store data. Cheers!

Share
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

Russell Spitzer avatar image
Russell Spitzer answered ·

SparkSql can be restarted but it depends what you are talking about. Applications like the Always On Sql Server can be restarted with their respective commands. For example


dse client-tool alwayson-sql restart


The actual application spark-sql is just a normal process which will be terminated when you exit the shell.


The resource management system for spark (Master and Worker) is managed by DSE and will automatically restart if it fails and there should usually be no reason for touching these processes.

Share
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.