question

Shannu avatar image
Shannu asked Erick Ramirez answered

Solr out of memory issue

Ours is a 3 node datacenter with search enabled(DSE). We are upgrading from 5.0 to 5.1.20 and populated the data using nodetool refresh metho. After creating the seach cores we are facing out of memory issues and nodes go down eventually, these are the warnings we are getting

WARN [http-bio-172.31.32.159-8983-exec-400] 2020-11-10 11:13:50,421 SolrRequestGuardrail.java:54 - The request on solr core KSec.buddy_fan_map has the following issues: parameter rows 1000000000 exceeds 20000, it may cause memory issue
WARN [Service Thread] 2020-11-10 11:13:54,529 GCInspector.java:262 - G1 Old Generation GC in 3541ms. G1 Old Gen: 13662350408 -> 1693479480; G1 Survivor Space: 58720256 -> 0;
WARN [http-bio-172.31.32.159-8983-exec-316] 2020-11-10 11:14:12,506 SolrRequestGuardrail.java:54 - The request on solr core KSec.user_connection has the following issues: parameter rows 100000 exceeds 20000, it may cause memory issue

Thanks in advance

search
10 |1000
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

1 Answer

Erick Ramirez avatar image
Erick Ramirez answered

There isn't enough information in your post to determine the actual problem and the cause.

The log entries you posted are warnings to let you know that the recommended maximum for Solr rows is 20,000 but the buddy_fan_map table has 1M (1000000000) rows and user_connection has 100K.

We will require a lot more details in order to diagnose the problem and a Q&A forum isn't the appropriate place for it. Please log a ticket with DataStax Support so one of our engineers can assist you directly. You will need to attach a Diagnostics Report from OpsCenter so they'll have most of the data they require for investigating the issue. Cheers!

Share
10 |1000
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.