Bringing together the Apache Cassandra experts from the community and DataStax.

Want to learn? Have a question? Want to share your expertise? You are in the right place!

Not sure where to begin? Getting Started

 

question

aashish.aiesec_188335 avatar image
aashish.aiesec_188335 asked ·

How do I retrieve Cassandra table metrics using the Spark connector?

I have updated metrics.properties file as mentioned in this link. I do get read/write related metrics reported on my console but I wanted to know if it is possible to segregate these metrics by table name.


Right now, These metrics are reported at executor level and I want to include Cassandra table name as well so that it is per executor, per table.

sparkconnectormonitoring
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

1 Answer

Erick Ramirez avatar image
Erick Ramirez answered ·

I don't believe it is possible to retrieve metrics on a per-table basis using the connector. I will update my response once I find out more information.

I'm going to reach out to the team who maintain the connector to respond to your question. In the meantime, you might want to consider monitoring Cassandra directly using the Metric Collector for Apache Cassandra (MCAC) which we've recently open-sourced. It isn't a drop-in solution to your question but I thought you might be interested in it. Cheers!

Share
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.