Bringing together the Apache Cassandra experts from the community and DataStax.

Want to learn? Have a question? Want to share your expertise? You are in the right place!

Not sure where to begin? Getting Started

 

question

sourav11b avatar image
sourav11b asked Erick Ramirez edited

How do I configure and use workpools with DSE Analytics?

I want to enforce multi-tenancy in my spark cluster - my tenants would be allocated a certain amount of memory and CPU, and i want to make sure that when they submit their applications, they do not consume more than their quota.

I am also curious to know about the ownership of files and folders created in local file system/ NFS when a spark job is submitted in cluster mode?

dseanalytics
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

1 Answer

sourav11b avatar image
sourav11b answered

How do i configure and use workpools with DSE Analytics ?


workpool settings can be configured in dse.yaml. You can also control access access to workpools for DSE users by granting permissions as described in link.

Who owns the files created in local file-system / NFS when a spark job is submitted in cluster mode?


in cluster mode, the OS user, who executes the driver or the executor code, owns the files and folders being created by the spark code - it will be cassandra user or slots users as per your configuration.

You can watch a demo on these two topics in this video.


Share
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.