I'm using DSE 6.7 and have a project that was originally written for running Spark using DSE Analytics nodes. However, now I want to try getting the same Spark submit job jar to run on a different Spark runtime (specifically, Databricks) instead.
Accordingly, I am trying to use the byos jar as described here. However, it seems like some of the classes in that jar are conflicting with the DSE java driver classes that we are using, and it seems to be causing some strange behaviour. Specifically, I noticed that both the java driver and byos are defining com.datastax.driver.dse.graph.GraphJsonUtils, though I'm sure there are others as well.
I could give more details about the specific error I'm running into, but before that just wanted to ask more generally if there is a standard procedure for using both BYOS jar and DSE Java Driver together. Or is it that if I'm using BYOS, I should just use the classes defined there and avoid also specifying the DSE java driver as a dependency?