question

kranthij29_188881 avatar image
kranthij29_188881 asked Russell Spitzer answered

Is it possible to just start Spark without starting full DSE on a node?

Hello All, How can we restart any service like and spark sql on one node in DSE cassandra like only spark restart without restarting full node.

dsespark
10 |1000

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

Erick Ramirez avatar image
Erick Ramirez answered

@kranthij29_188881 You won't be able to do it on a node in an existing DSE cluster because it's configured to run with DSE Cassandra + Analytics already. But you can create a new datacentre that runs DSE Analytics Solo -- a DSE DC with nodes which provide Spark analytics processing and DSEFS without the ability to store data. Cheers!

Share
10 |1000

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

Russell Spitzer avatar image
Russell Spitzer answered

SparkSql can be restarted but it depends what you are talking about. Applications like the Always On Sql Server can be restarted with their respective commands. For example


dse client-tool alwayson-sql restart


The actual application spark-sql is just a normal process which will be terminated when you exit the shell.


The resource management system for spark (Master and Worker) is managed by DSE and will automatically restart if it fails and there should usually be no reason for touching these processes.

Share
10 |1000

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.