Bringing together the Apache Cassandra experts from the community and DataStax.

Want to learn? Have a question? Want to share your expertise? You are in the right place!

Not sure where to begin? Getting Started

 

question

suujana.naga16_165607 avatar image
suujana.naga16_165607 asked ·

Flush failed with "TimeoutException: Timeout while waiting for workers when flushing pool ks.tbl Index;"

In a cluster of 9 nodes , one node became unresponsive ( node1) where I am able to cqlsh into the node but in other nodes nodetool status output is showing down for node1.

So executed nodetool flush command just a troubleshooting step. For few mins node came up and again went down but got below error for flush command. What does this error mean?

java.util.concurrent.TimeoutException: Timeout while waiting for workers when flushing pool <keyspace>.<table_name> Index; current timeout is 300000 millis, consider increasing it, or reducing load on the node. Failure to flush may cause excessive growth of Cassandra commit log.


commitlog
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

1 Answer

Erick Ramirez avatar image
Erick Ramirez answered ·

The exception indicates that there's something wrong with the disk on the node. It's either overloaded and can't keep up with IO, the disk is full, or there are file permission issues preventing Cassandra from writing to disk.

You will need to review the logs on the node for clues. For the record, I'm not requesting you to send me the logs but I'm just providing you tips on how to troubleshoot the problem. Cheers!

Share
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.