PLANNED MAINTENANCE

Hello, DataStax Community!

We want to make you aware of a few operational updates which will be carried out on the site. We are working hard to streamline the login process to integrate with other DataStax resources. As such, you will soon be prompted to update your password. Please note that your username will remain the same.

As we work to improve your user experience, please be aware that login to the DataStax Community will be unavailable for a few hours on:

  • Wednesday, July 15 16:00 PDT | 19:00 EDT | 20:00 BRT
  • Thursday, July 16 00:00 BST | 01:00 CEST | 04:30 IST | 07:00 CST | 09:00 AEST

For more info, check out the FAQ page. Thank you for being a valued member of our community.


question

aashish.aiesec_188335 avatar image
aashish.aiesec_188335 asked ·

How do I retrieve Cassandra table metrics using the Spark connector?

I have updated metrics.properties file as mentioned in this link. I do get read/write related metrics reported on my console but I wanted to know if it is possible to segregate these metrics by table name.


Right now, These metrics are reported at executor level and I want to include Cassandra table name as well so that it is per executor, per table.

sparkconnectormonitoring
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

1 Answer

Erick Ramirez avatar image
Erick Ramirez answered ·

I don't believe it is possible to retrieve metrics on a per-table basis using the connector. I will update my response once I find out more information.

I'm going to reach out to the team who maintain the connector to respond to your question. In the meantime, you might want to consider monitoring Cassandra directly using the Metric Collector for Apache Cassandra (MCAC) which we've recently open-sourced. It isn't a drop-in solution to your question but I thought you might be interested in it. Cheers!

Share
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.