Unable to start DSE, getting FSReadError: MismatchedInputException: No content to map due to end-of-input

Question

question

sridhar.addanki_188870 asked · May 01, 2020 at 04:23 AM

Unable to start DSE, getting FSReadError: MismatchedInputException: No content to map due to end-of-input

We are unable to start DSE. Unix server got rebooted with some hardware issue. When we try start dse with service dse start, its failing with below error.

INFO [main] 2020-04-30 20:50:21,954 DseDelegateSnitch.java:39 - Setting my workloads to [Analytics, Cassandra, Search]
DEBUG [main] 2020-04-30 20:50:21,955 YamlConfigurationLoader.java:98 - Loading settings from file:/etc/dse/cassandra/cassandra.yaml
INFO [main] 2020-04-30 20:50:21,961 YamlConfigurationLoader.java:77 - Configuration location: file:/etc/dse/cassandra/cassandra.yaml
DEBUG [main] 2020-04-30 20:50:21,963 GossipingPropertyFileSnitch.java:87 - Property file snitch compatibility mode is disabled. Set startup property cassandra.gpfs.enable_pfs_compatibility_mode=true to enable.
INFO [main] 2020-04-30 20:50:21,964 DseDelegateSnitch.java:41 - Initialized DseDelegateSnitch with workloads [Analytics, Cassandra, Search], delegating to org.apache.cassandra.locator.GossipingPropertyFileSnitch
DEBUG [main] 2020-04-30 20:50:21,973 YamlConfigurationLoader.java:98 - Loading settings from file:/etc/dse/cassandra/cassandra.yaml
INFO [main] 2020-04-30 20:50:21,977 YamlConfigurationLoader.java:77 - Configuration location: file:/etc/dse/cassandra/cassandra.yaml
ERROR [main] 2020-04-30 20:50:23,542 DseModule.java:126 - Unable to start server. Exiting...
org.apache.cassandra.io.FSReadError: com.fasterxml.jackson.databind.exc.MismatchedInputException: No content to map due to end-of-input
    at [Source: (BufferedInputStream); line: -1, column: 0]
    at com.datastax.bdp.db.nodes.Nodes.transactionalRead(Nodes.java:195)
    at com.datastax.bdp.db.nodes.Nodes.access$100(Nodes.java:76)
    at com.datastax.bdp.db.nodes.Nodes$Local.<init>(Nodes.java:477)
    at com.datastax.bdp.db.nodes.Nodes.<init>(Nodes.java:97)
    at com.datastax.bdp.db.nodes.Nodes$Instance.setup(Nodes.java:911)
    at org.apache.cassandra.config.DatabaseDescriptor.applyMetadata(DatabaseDescriptor.java:545)
    at org.apache.cassandra.config.DatabaseDescriptor.daemonInitialization(DatabaseDescriptor.java:226)
    at org.apache.cassandra.config.DatabaseDescriptor.daemonInitialization(DatabaseDescriptor.java:241)
    at com.datastax.bdp.DseCoreModule.<init>(DseCoreModule.java:84)
    at com.datastax.bdp.DseModule.getRequiredModules(DseModule.java:163)
    at com.datastax.bdp.server.AbstractDseModule.configure(AbstractDseModule.java:27)
    at com.datastax.bdp.DseModule.configure(DseModule.java:89)
    at com.google.inject.AbstractModule.configure(AbstractModule.java:62)
    at com.google.inject.spi.Elements$RecordingBinder.install(Elements.java:340)
    at com.google.inject.spi.Elements.getElements(Elements.java:110)
    at com.google.inject.internal.InjectorShell$Builder.build(InjectorShell.java:138)
    at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:104)
    at com.google.inject.Guice.createInjector(Guice.java:96)
    at com.google.inject.Guice.createInjector(Guice.java:73)
    at com.google.inject.Guice.createInjector(Guice.java:62)
    at com.datastax.bdp.ioc.DseInjector.get(DseInjector.java:36)
    at com.datastax.bdp.DseModule.main(DseModule.java:103)
Caused by: com.fasterxml.jackson.databind.exc.MismatchedInputException: No content to map due to end-of-input
    at [Source: (BufferedInputStream); line: -1, column: 0]
    at com.fasterxml.jackson.databind.exc.MismatchedInputException.from(MismatchedInputException.java:59)
    at com.fasterxml.jackson.databind.DeserializationContext.reportInputMismatch(DeserializationContext.java:1356)
    at com.fasterxml.jackson.databind.ObjectReader._initForReading(ObjectReader.java:358)
    at com.fasterxml.jackson.databind.ObjectReader._bindAndClose(ObjectReader.java:1596)
    at com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:1188)
    at com.datastax.bdp.db.nodes.Nodes.transactionalRead(Nodes.java:191)
    ... 21 common frames omitted

Can any one help us?

Thanks in Advance.

dse

10 |1000 characters needed characters left characters exceeded

Attachments: Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

Answer 1 · 2020-05-01T04:35:24Z

Erick Ramirez answered · May 01, 2020 at 04:35 AM

@sridhar.addanki_188870 We need a bit more info in order to diagnose the problem. Please edit your original question to include:

the full stack trace of the error message
4-5 lines of the log immediately before the error
version of DSE on the node

The stack trace you posted error indicates a problem reading a file so it's possible that you have a filesystem corruption. You will need to escalate the issue to your sysadmin team since they will need to investigate a possible disk corruption or failure. Cheers!

3 Share

10 |1000 characters needed characters left characters exceeded

Attachments: Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

sridhar.addanki_188870 · May 01, 2020 at 04:50 AM

Thanks Erick for the reply. We are working with Unix team regarding any disk issues.

Here is the stack trace.

[Pasted into original question]

0 ·

Erick Ramirez ♦♦ sridhar.addanki_188870 · May 01, 2020 at 04:57 AM

@sridhar.addanki_188870 I've converted your answer into a comment since it's not an answer. I also requested you to edit your question since it would've been too long to paste the log entries into a comment. Cheers!

1 ·

sridhar.addanki_188870 Erick Ramirez ♦♦ · May 02, 2020 at 03:51 AM

Thanks Erick.

Seems some issues is there at server level. Unix team checking the issue. We have removed that from cluster ring.

Thanks again for the help.

0 ·

question