Bringing together the Apache Cassandra experts from the community and DataStax.

Want to learn? Have a question? Want to share your expertise? You are in the right place!

Not sure where to begin? Getting Started

 

question

pramod.dba31_92912 avatar image
pramod.dba31_92912 asked pramod.dba31_92912 commented

What could be causing log entries like "Logging.scala:54 - Removing RDD xxxxxx"?

We are seeing a lot of messages in our nodes, can I know what does this indicate and how can we avoid this.

INFO  [block-manager-slave-async-thread-pool-40] 2021-09-05 12:42:39,632  Logging.scala:54 - Removing RDD 152849
INFO  [block-manager-slave-async-thread-pool-37] 2021-09-05 12:42:49,631  Logging.scala:54 - Removing RDD 152850
INFO  [block-manager-slave-async-thread-pool-40] 2021-09-05 12:42:59,630  Logging.scala:54 - Removing RDD 152851
INFO  [block-manager-slave-async-thread-pool-38] 2021-09-05 12:43:09,629  Logging.scala:54 - Removing RDD 152852
INFO  [block-manager-slave-async-thread-pool-40] 2021-09-05 12:43:19,631  Logging.scala:54 - Removing RDD 152853

Scenario: Getting high disk space utilization alerts on our machines, possibly because of fast log rotation. And thus openfiles were being created, which we are clearing them manually all the time to free up disk space.

lsof /var/log | grep deleted
java       2852 cassandra  532w   REG  253,4 7135800134 1058794 /var/log/cassandra/system.log (deleted)
java       2852 cassandra  534w   REG  253,4 3457184075 1048691 /var/log/cassandra/debug.log (deleted)
java      14252 cassandra  443w   REG  253,4   20971617 3145816 /var/log/spark/master/master.log (deleted)
dse
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

1 Answer

Erick Ramirez avatar image
Erick Ramirez answered pramod.dba31_92912 commented

We would need a lot more information than you provided to be able to diagnose the problem.

Please log a ticket with DataStax Support so one of our engineers can assist you directly. Cheers!

1 comment Share
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.