Bringing together the Apache Cassandra experts from the community and DataStax.

Want to learn? Have a question? Want to share your expertise? You are in the right place!

Not sure where to begin? Getting Started

 

question

bb.addagada_90355 avatar image
bb.addagada_90355 asked ·

What could be the cause of "SolrException: Error on shard 10.x.x.x: java.lang.AssertionError" while reading data on a DSE 5.1.16 node?

We are using DSE Solr and observing below errors while reading data from solr.

Tried searching for below error couldn't find any solution. Could someone please help.

WARN [LocalMessageServer query worker - 46] 2020-04-09 14:53:20,511 ShardRequestProcessor.java:137 - Found exception for response message:
Flags: []
Id: 3915085
Type: 1:5
Version: 1
Body: org.apache.solr.response.SolrQueryResponse@4c528114
ERROR [Native-Transport-Requests-1] 2020-04-09 14:53:20,512 SolrException.java:187 - org.apache.solr.common.SolrException: Error on shard 10.x.x.x: java.lang.AssertionError
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
    at com.datastax.bdp.search.solr.handler.shard.modern.ModernShardHandler.waitForResponse(ModernShardHandler.java:237)
    at com.datastax.bdp.search.solr.handler.shard.modern.ModernShardHandler.takeCompletedOrError(ModernShardHandler.java:170)
    at org.apache.solr.handler.component.SearchHandler.processDistributed(SearchHandler.java:452)
    at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:296)
    at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:181)
    at org.apache.solr.core.SolrCore.execute(SolrCore.java:2189)
    at com.datastax.bdp.search.solr.cql.CqlSolrQueryExecutor.executeSolrQuery(CqlSolrQueryExecutor.java:426)
    at com.datastax.bdp.search.solr.cql.CqlSolrQueryExecutor.doExecute(CqlSolrQueryExecutor.java:177)
    at com.datastax.bdp.search.solr.cql.CqlSolrQueryExecutor.execute(CqlSolrQueryExecutor.java:117)
    at com.datastax.bdp.cassandra.cql3.SolrOperationFactory$SolrStatementExecution.execute(SolrOperationFactory.java:74)
    at com.datastax.bdp.cassandra.cql3.DseQueryHandler$Operation.executeWithTiming(DseQueryHandler.java:388)
    at com.datastax.bdp.cassandra.cql3.DseQueryHandler$Operation.executeAndMaybeWriteToAuditLog(DseQueryHandler.java:445)
    at com.datastax.bdp.cassandra.cql3.DseQueryHandler.process(DseQueryHandler.java:165)
    at com.datastax.bdp.cassandra.cql3.DseQueryHandler.process(DseQueryHandler.java:116)
    at org.apache.cassandra.transport.messages.QueryMessage.execute(QueryMessage.java:112)
    at org.apache.cassandra.transport.Message$Dispatcher.lambda$channelRead0$0(Message.java:579)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:162)
    at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:109)
    at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
    at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.common.SolrException: java.lang.AssertionError
    at com.datastax.bdp.search.solr.transport.protocols.query.ShardRequestContext.onResponse(ShardRequestContext.java:49)
    at com.datastax.bdp.search.solr.transport.protocols.query.ShardRequestContext.onResponse(ShardRequestContext.java:21)
    at com.datastax.bdp.node.transport.ClientServerConnection$MessageResponseHandler.channelRead(ClientServerConnection.java:444)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
    at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
    at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
    at io.netty.handler.codec.ByteToMessageCodec.channelRead(ByteToMessageCodec.java:103)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
    at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
    at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
    at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
    at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1302)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
    at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
    at io.netty.channel.local.LocalChannel.finishPeerRead0(LocalChannel.java:451)
    at io.netty.channel.local.LocalChannel.access$400(LocalChannel.java:49)
    at io.netty.channel.local.LocalChannel$5.run(LocalChannel.java:405)
    at io.netty.channel.local.LocalEventLoop.run(LocalEventLoop.java:33)
    at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
    ... 2 more
dsesearch
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

1 Answer

Erick Ramirez avatar image
Erick Ramirez answered ·

@bb.addagada_90355 The error you posted is very generic and does not give us clues as to its cause. You will need to check the logs on the Solr shard (DSE node) whose IP is indicated the error for more info.

It will be challenging troubleshooting your issue in a Q&A format so I recommend you log a ticket with DataStax Support and attach a Diagnostics Report from OpsCenter so one of our engineers can assist you. Cheers!

2 comments Share
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

Thanks for the response @Erick Ramirez. I had raised a ticket with the Datastax Support team last week and provided diagnostics from opsecenter , but didn't get an appropriate response from them. Will wait for there investigation.


Thanks

0 Likes 0 · ·

@bb.addagada_90355 I've checked your ticket. As I understand it, Ben Krug is waiting for your response. I'll let you respond directly on the Support ticket and you can continue to work there. Cheers!

0 Likes 0 · ·