forked from docs/doc-exports
Yang, Tong
3b1f73dece
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
84 lines
12 KiB
HTML
84 lines
12 KiB
HTML
<a name="ALM-43022"></a><a name="ALM-43022"></a>
|
|
|
|
<h1 class="topictitle1">ALM-43022 IndexServer2x Process GC Time Exceeds the Threshold</h1>
|
|
<div id="body1573719169454"><div class="section" id="ALM-43022__s7c9141d03d6b444d8290c30b631d0cf0"><h4 class="sectiontitle">Description</h4><p id="ALM-43022__a2ccf391541374d078f47ab2c7184204d">The system checks the GC time of the IndexServer2x process every 60 seconds. This alarm is generated when the detected GC time exceeds the threshold (12 seconds) for three consecutive times. To change the threshold, choose <strong id="ALM-43022__b1360755274415">O&M</strong> > <strong id="ALM-43022__b7541356154417">Alarm</strong> > <strong id="ALM-43022__b1596030104516">Thresholds</strong> > <span id="ALM-43022__text142051689517"><em id="ALM-43022__i1820517815119">Name of the desired cluster</em></span> > <strong id="ALM-43022__b089019363466">Spark2x</strong> > <strong id="ALM-43022__b1178914117464">GC Time</strong> > <strong id="ALM-43022__b16225171720478">Total GC time in milliseconds (IndexServer2x)</strong>. This alarm is cleared when the IndexServer2x GC time is shorter than or equal to the threshold.</p>
|
|
</div>
|
|
<div class="section" id="ALM-43022__s376651fb53d8499887f815231786b339"><h4 class="sectiontitle">Attribute</h4>
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="ALM-43022__t4159bb171b174e059da9bd760207c4d0" frame="border" border="1" rules="all"><thead align="left"><tr id="ALM-43022__r1e339099e2f645ff9056bd119fe381bf"><th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.2.2.1.4.1.1"><p id="ALM-43022__a38b80ab58f384df88ab015cc524b7cbb">Alarm ID</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.2.2.1.4.1.2"><p id="ALM-43022__a46c53a74faf84ecf9c9af27d6f61eaab">Severity</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.2.2.1.4.1.3"><p id="ALM-43022__a5fb5879d1a934dd39866e315bf6dfe8f">Auto Clear</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="ALM-43022__r237ab3a8c9504376a9db5fa7a97b148f"><td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.2.2.1.4.1.1 "><p id="ALM-43022__af28381aaf20e4c4a8f85098ec46a0303">43022</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.2.2.1.4.1.2 "><p id="ALM-43022__a6317fab9a9e34459b2a6e2e021edc2a2">Major</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.2.2.1.4.1.3 "><p id="ALM-43022__aa82affe10728446b8a39f58bf556fc8a">Yes</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="ALM-43022__s41639aabee044d8d960019194e2e6eb6"><h4 class="sectiontitle">Parameters</h4>
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="ALM-43022__t97c720d80e924869b586cf705bdbb204" frame="border" border="1" rules="all"><thead align="left"><tr id="ALM-43022__rae0af347daa24e06b98b0421fe713051"><th align="left" class="cellrowborder" valign="top" width="50%" id="mcps1.3.3.2.1.3.1.1"><p id="ALM-43022__a56eccbfb77e74aa68437112aac4782ef">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="50%" id="mcps1.3.3.2.1.3.1.2"><p id="ALM-43022__aa100738b88d94b3890e8fdde1ca6cf02">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="ALM-43022__row46363355123"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="ALM-43022__p17935380415">Source</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="ALM-43022__p187931338134115">Specifies the cluster for which the alarm is generated.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="ALM-43022__r84a8eeac06ca46ee937631f94bb0eb3c"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="ALM-43022__p41293795">ServiceName</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="ALM-43022__a3782d19bc5bb49a9b3b129fe8f6a7f37">Specifies the service for which the alarm is generated.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="ALM-43022__r6d450898cd1948969635904d31fc0ab5"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="ALM-43022__p23892775">RoleName</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="ALM-43022__abede771415c3492381db5c9910db0bff">Specifies the role for which the alarm is generated.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="ALM-43022__r1f75e56643624cf987aadc9f9569929f"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="ALM-43022__p14847206">HostName</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="ALM-43022__a318fdd3afdd84d8295b93803fe7dd9f4">Specifies the host for which the alarm is generated.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="ALM-43022__r4e888b217e0c4dda911e3e79da8fce66"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="ALM-43022__af9afacd827ec415e968655804e8e93e6">Trigger Condition</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="ALM-43022__aa568fb5712484a5ca4bbf32224da6b54">Specifies the threshold for triggering the alarm.</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="ALM-43022__s571b1640392345b59ad2a1ffba139704"><h4 class="sectiontitle">Impact on the System</h4><p id="ALM-43022__ac0fedb12054f4644838fdcc71d803e30">If the GC time exceeds the threshold, IndexServer2x may run in low performance or even unavailable.</p>
|
|
</div>
|
|
<div class="section" id="ALM-43022__s069a86c403ce485e94e72eba6af1c8d3"><h4 class="sectiontitle">Possible Causes</h4><p id="ALM-43022__a7f092a3ba42b4717a378c07de4265701">The heap memory of the IndexServer2x process is overused or the heap memory is inappropriately allocated. As a result, GC occurs frequently.</p>
|
|
</div>
|
|
<div class="section" id="ALM-43022__section18256634182118"><h4 class="sectiontitle">Procedure</h4><p class="tableheading" id="ALM-43022__ac5bd05682185447ab2af6e9e3334cfd0"><strong id="ALM-43022__b9541151174113">Check the GC time.</strong></p>
|
|
<ol id="ALM-43022__ol12288192316415"><li id="ALM-43022__li92879239417"><span>On FusionInsight Manager, choose <strong id="ALM-43022__b52611719174910">O&M</strong> > <strong id="ALM-43022__b1688165991316">Alarm</strong><strong id="ALM-43022__b27872374104950"> > Alarms</strong>. In the displayed alarm list, choose the alarm with ID <strong id="ALM-43022__b9262141910494">43022</strong>, and check the <strong id="ALM-43022__b1955573445015">RoleName</strong> in <strong id="ALM-43022__b052583712505">Location</strong> and confirm the IP address of <strong id="ALM-43022__b1241513413507">HostName</strong>.</span></li><li id="ALM-43022__li1128842317411"><span>On FusionInsight Manager, choose <strong id="ALM-43022__b775452895115">Cluster</strong> > <span id="ALM-43022__text928732324118"><em id="ALM-43022__i122871423114114">Name of the desired cluster</em></span> > <strong id="ALM-43022__b96931548165117">Services</strong> > <strong id="ALM-43022__b18280125295120">Spark2x</strong> > <strong id="ALM-43022__b16874578516">Instance</strong> and click the IndexServer2x for which the alarm is generated to go to the <strong id="ALM-43022__b659464922315">Dashboard</strong> page. Click the drop-down menu in the Chart area and choose <strong id="ALM-43022__b13995162825213">Customize</strong> > <strong id="ALM-43022__b17267152462416">GC Time</strong> > <strong id="ALM-43022__b131551139125213">Garbage Collection (GC) Time of IndexServer2x</strong> from the drop-down list box in the upper right corner and click <strong id="ALM-43022__b484195817525">OK</strong> to check whether the GC time is longer than the threshold (default value: 12 seconds).</span><p><ul class="subitemlist" id="ALM-43022__ul12288923154117"><li id="ALM-43022__li2288192354116">If the threshold is reached, go to <a href="#ALM-43022__li928810235414">3</a>.</li><li id="ALM-43022__li2028812231419">If the threshold is not reached, go to <a href="#ALM-43022__li728614235411">6</a>.</li></ul>
|
|
</p></li><li id="ALM-43022__li928810235414"><a name="ALM-43022__li928810235414"></a><a name="li928810235414"></a><span>On FusionInsight Manager, choose <strong id="ALM-43022__b634673512545">Cluster</strong> > <span id="ALM-43022__text5288423174113"><em id="ALM-43022__i1328872364119">Name of the desired cluster</em></span> > <strong id="ALM-43022__b2985653135420">Services</strong> > <strong id="ALM-43022__b18200180145518">Spark2x</strong> > <strong id="ALM-43022__b383211414556">Configurations</strong> > <strong id="ALM-43022__b288962114552">All Configurations</strong> > <strong id="ALM-43022__b17887150145512">IndexServer2x</strong> > <strong id="ALM-43022__b20906105417557">Default</strong>. The default value of the <strong id="ALM-43022__b139184145560">SPARK_DRIVER_MEMORY</strong> is 4 GB. You can change the value according to the following rules: Increase the value of the <strong id="ALM-43022__b8222184715118">SPARK_DRIVER_MEMORY</strong> parameter 1.5 times to its default value. If this alarm is still generated occasionally after the adjustment, increase the value by 0.5 times. Double the value if the alarm is reported frequently.</span></li><li id="ALM-43022__li656515289295"><span>Restart all IndexServer2x instances.</span></li><li id="ALM-43022__li2288192374116"><span>After 10 minutes, check whether the alarm is cleared.</span><p><ul class="subitemlist" id="ALM-43022__ul52881232411"><li id="ALM-43022__li1288623124112">If the alarm is cleared, no further action is required.</li><li id="ALM-43022__li152881823114113">If the alarm is not cleared, go to <a href="#ALM-43022__li728614235411">6</a>.</li></ul>
|
|
</p></li></ol>
|
|
<p id="ALM-43022__a93702ae7899b4a73b85d88e31d8fdf08"><strong id="ALM-43022__b84212934110">Collect fault information.</strong></p>
|
|
<ol start="6" id="ALM-43022__ol528672334116"><li id="ALM-43022__li728614235411"><a name="ALM-43022__li728614235411"></a><a name="li728614235411"></a><span>On FusionInsight Manager, choose <strong id="ALM-43022__b1854624844415">O&M</strong> > <strong id="ALM-43022__b1547144819446">Log</strong> > <strong id="ALM-43022__b115474485449">Download</strong>.</span></li><li id="ALM-43022__li02861923154112"><span>Expand the <strong id="ALM-43022__b1899192712389">Service</strong> drop-down list, and select <strong id="ALM-43022__b71306317335">Spark2x</strong> for the target cluster.</span></li><li id="ALM-43022__li228612364112"><span>Click <span><img id="ALM-43022__image3286112319416" src="en-us_image_0269417548.png"></span> in the upper right corner, and set <strong id="ALM-43022__b18831547123618">Start Date</strong> and <strong id="ALM-43022__b1483434743616">End Date</strong> for log collection to 10 minutes ahead of and after the alarm generation time respectively. Then, click <strong id="ALM-43022__b583564713611">Download</strong>.</span></li><li id="ALM-43022__li18286122318418"><span>Contact the <span id="ALM-43022__text4614151421417">O&M personnel</span> and provide the collected logs.</span></li></ol>
|
|
</div>
|
|
<div class="section" id="ALM-43022__section169311343318"><h4 class="sectiontitle">Alarm Clearing</h4><p id="ALM-43022__p754913417333">After the fault is rectified, the system automatically clears this alarm.</p>
|
|
</div>
|
|
<div class="section" id="ALM-43022__s117ba5042c8047e49828d78387997ff5"><h4 class="sectiontitle">Reference</h4><p id="ALM-43022__a87bdfd2b8c7c47c5a246020bd00fd45d">None</p>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1298.html">Alarm Reference (Applicable to MRS 3.x)</a></div>
|
|
</div>
|
|
</div>
|
|
|