Hi, getting timeouts for dsbulk unload...below is the error
This is the log from the operation:
Operation UNLOAD_20210415-150147-458640 failed: [/123.123.123.123:9042] Connection has been closed.
And this is in the operation.log
2021-04-15 11:04:17 ERROR Operation UNLOAD_20210415-090305-819663 failed: [/123.123.123.123:9042] Connection has been closed. com.datastax.driver.core.exceptions.TransportException: [/123.123.123.123:9042] Connection has been closed
Would it help to increase driver.socket.readTimeout to resolve this issue? or increase the executor.maxPerSecond = 2500 to say 5000 to make it run faster. Please advise on these parameters or if any other parameter should be changed to get by this error.
Here are the current parameters used -
nohup /apps/dsbulk-1.3.3/bin/dsbulk unload -h <<listOfIPs>> -maxErrors 1000 -u username -p password -f /apps/dsbulk-1.3.3/conf/unload_details.conf &
dsbulk {
connector.name = "json"
connector.json.url = "./opfile"
connector.json.fileNameFormat = "opfile-output-%0,6d.json"
connector.json.maxRecords = 10000
connector.json.generatorFeatures = { ESCAPE_NON_ASCII: true, QUOTE_FIELD_NAMES: true }
schema.keyspace = "keyspace"
schema.table = "tablename"
executor.maxPerSecond = 2500
executor.maxInFlight = 50
executor.continuousPaging.enabled = false
driver.query.fetchSize = 5000
driver.policy.maxRetries = 30
driver.socket.readTimeout = 120000
}
