When trying to query a table on Astra via pyspark, we are getting the below error:
An error occurred while calling o95.load. No SELECT permission on <table system.size_estimates>
We are trying to load the data into a dataframe from our pyspark code (below):
df = spark.read
.format("org.apache.spark.sql.cassandra")
.options(table='table', keyspace='keyspace')
.load()
Of course keyspace and table are replaced with their actual values. We are using an API R/W token which should have read access to ALL keyspaces and there is nowhere to alter these permissions, which is why I am at a loss for what to look at here.
