Bringing together the Apache Cassandra experts from the community and DataStax.

Want to learn? Have a question? Want to share your expertise? You are in the right place!

Not sure where to begin? Getting Started

 

question

ashish2350_120052 avatar image
ashish2350_120052 asked ·

How do I disable JMX Reporting in the Spark connector?

I'm trying to use the spark-cassandra-connector
But getting java.lang.ClassNotFoundException: com.codahale.metrics.JmxReporter
Any property I can set in Spark Context to disable JMX Reporting?
As we do for Cassandra Driver in Cluster class using withoutJmxReporting() method
spark-cassandra-connector
10 |1000 characters needed characters left characters exceeded
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

1 Answer

Russell Spitzer avatar image
Russell Spitzer answered ·

The only way to change the cluster builder is to implement a custom CassandraConnectionFactory but this shouldn't be neccessary. If the metrics reporter is not found it usually means all the dependencies for the Spark Cassandra Connector were not correctly placed on the classpath.


Usually this means that either the --packages command is not being used to pull the maven artifact. Using the packages command for spark-submit (or the corresponding spark conf option) would download the connector and all perquisite dependencies.

With DSE the dse-spark-dependencies maven package should be used.

Share
10 |1000 characters needed characters left characters exceeded
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.