We are seeing a lot of messages in our nodes, can I know what does this indicate and how can we avoid this.
INFO [block-manager-slave-async-thread-pool-40] 2021-09-05 12:42:39,632 Logging.scala:54 - Removing RDD 152849 INFO [block-manager-slave-async-thread-pool-37] 2021-09-05 12:42:49,631 Logging.scala:54 - Removing RDD 152850 INFO [block-manager-slave-async-thread-pool-40] 2021-09-05 12:42:59,630 Logging.scala:54 - Removing RDD 152851 INFO [block-manager-slave-async-thread-pool-38] 2021-09-05 12:43:09,629 Logging.scala:54 - Removing RDD 152852 INFO [block-manager-slave-async-thread-pool-40] 2021-09-05 12:43:19,631 Logging.scala:54 - Removing RDD 152853
Scenario: Getting high disk space utilization alerts on our machines, possibly because of fast log rotation. And thus openfiles were being created, which we are clearing them manually all the time to free up disk space.
lsof /var/log | grep deleted java 2852 cassandra 532w REG 253,4 7135800134 1058794 /var/log/cassandra/system.log (deleted) java 2852 cassandra 534w REG 253,4 3457184075 1048691 /var/log/cassandra/debug.log (deleted) java 14252 cassandra 443w REG 253,4 20971617 3145816 /var/log/spark/master/master.log (deleted)
