forked from docs/doc-exports
Yang, Tong
3b1f73dece
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
86 lines
13 KiB
HTML
86 lines
13 KiB
HTML
<a name="ALM-43019"></a><a name="ALM-43019"></a>
|
|
|
|
<h1 class="topictitle1">ALM-43019 Heap Memory Usage of the IndexServer2x Process Exceeds the Threshold</h1>
|
|
<div id="body1573716530594"><div class="section" id="ALM-43019__s003d1a897bb74496accc109e130a2b79"><h4 class="sectiontitle">Description</h4><p id="ALM-43019__a1a0df0c1cfac438bb577f3e50b9c4a38">The system checks the IndexServer2x process status every 30 seconds. The alarm is generated when the heap memory usage of a IndexServer2x process exceeds the threshold (95% of the maximum memory).</p>
|
|
</div>
|
|
<div class="section" id="ALM-43019__s32061f2ab1e44d538c70b77f588c95cd"><h4 class="sectiontitle">Attribute</h4>
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="ALM-43019__t62b2bf48fdb841b8b702dde8b4644920" frame="border" border="1" rules="all"><thead align="left"><tr id="ALM-43019__r653f637d7ab844f1b2b15f5002adddc1"><th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.2.2.1.4.1.1"><p id="ALM-43019__a6e2b2640000e4f428add13b685a783aa">Alarm ID</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.2.2.1.4.1.2"><p id="ALM-43019__a7af8d14c415f4b68b43115fb4f53f3ef">Severity</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.2.2.1.4.1.3"><p id="ALM-43019__a02d843fe6f624e84964ca5d1578740af">Auto Clear</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="ALM-43019__rbbe1f519640347c5aa24f4905dc8ef50"><td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.2.2.1.4.1.1 "><p id="ALM-43019__a212dce1b184242249ca42d3e8cfbf84e">43019</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.2.2.1.4.1.2 "><p id="ALM-43019__af105557b1f4f47de89fbeccd88f9941a">Major</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.2.2.1.4.1.3 "><p id="ALM-43019__a38e9a2fe39b6403aaaf4b4fb0e29f3e5">Yes</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="ALM-43019__s741e8ec04d9446768c01e82bd6e711e2"><h4 class="sectiontitle">Parameters</h4>
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="ALM-43019__t9f47f89d18d243fab2094565e98d83e3" frame="border" border="1" rules="all"><thead align="left"><tr id="ALM-43019__ra75bbb84f5d74453be996544228d00d2"><th align="left" class="cellrowborder" valign="top" width="50%" id="mcps1.3.3.2.1.3.1.1"><p id="ALM-43019__ab21543f0c58a41a8913512dcfbf72944">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="50%" id="mcps1.3.3.2.1.3.1.2"><p id="ALM-43019__abeda253959cb4662a594521d2dc72255">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="ALM-43019__row92491653161219"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="ALM-43019__p17935380415">Source</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="ALM-43019__p187931338134115">Specifies the cluster for which the alarm is generated.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="ALM-43019__r22ce027ef3024074aeff2607500388ab"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="ALM-43019__p41293795">ServiceName</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="ALM-43019__a035311a753c9400d8922b2eabd67b99f">Specifies the service for which the alarm is generated.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="ALM-43019__r25691c41a60c400e8f4cd09ecf91837b"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="ALM-43019__p23892775">RoleName</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="ALM-43019__aefbdd0e3041747fb803e48abb240998a">Specifies the role for which the alarm is generated.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="ALM-43019__r3d53a6e9138a48ffbb3f6d327452b5d3"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="ALM-43019__p14847206">HostName</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="ALM-43019__aa95e2e07ac7f454582df5a0e86a74e55">Specifies the host for which the alarm is generated.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="ALM-43019__rde525935a2834a8895ddacf674450ba5"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="ALM-43019__a1f2fbce6a30747a5b50b4f4805460bd7">Trigger Condition</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="ALM-43019__afb1ebb849d8540c2b1dee2196613eb15">Specifies the threshold for triggering the alarm.</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="ALM-43019__sb3a2d017129345d888713064e79025cd"><h4 class="sectiontitle">Impact on the System</h4><p id="ALM-43019__ad579930607cf452393078e30befa0b43">If the available IndexServer2x process heap memory is insufficient, a memory overflow occurs and the service breaks down.</p>
|
|
</div>
|
|
<div class="section" id="ALM-43019__sa5adbf6484b2466281b8b667bdc68717"><h4 class="sectiontitle">Possible Causes</h4><p id="ALM-43019__ae5ccdb97f4b345fd942e330012bd8001">The heap memory of the IndexServer2x process is overused or the heap memory is inappropriately allocated.</p>
|
|
</div>
|
|
<div class="section" id="ALM-43019__section1876421013309"><h4 class="sectiontitle">Procedure</h4><p class="tableheading" id="ALM-43019__a3a4094eb11004e8b919c1d2d0f5442e7"><strong id="ALM-43019__b569612374158">Check the heap memory usage.</strong></p>
|
|
<ol id="ALM-43019__ol52118526561"><li id="ALM-43019__li121552185617"><span>On FusionInsight Manager, choose <strong id="ALM-43019__b156391231192211">O&M</strong> > <strong id="ALM-43019__b1688165991316">Alarm</strong><strong id="ALM-43019__b27872374104950"> > Alarms</strong>. In the displayed alarm list, choose the alarm for which the ID is <strong id="ALM-43019__b464093115223">43019</strong>, and check the <strong id="ALM-43019__b1955573445015">RoleName</strong> in <strong id="ALM-43019__b052583712505">Location</strong> and confirm the IP address of <strong id="ALM-43019__b1241513413507">HostName</strong>.</span></li><li id="ALM-43019__li20212521563"><span>On FusionInsight Manager, choose <strong id="ALM-43019__b567965844515">Cluster</strong> > <span id="ALM-43019__text18330192912598"><em id="ALM-43019__i2252142013472">Name of the desired cluster</em></span> > <strong id="ALM-43019__b1955542914463">Service</strong><strong id="ALM-43019__b132562116115">s</strong> > <strong id="ALM-43019__b151323364467">Spark2x</strong> > <strong id="ALM-43019__b1633541184619">Instance</strong>. Click the IndexServer2x that reported the alarm to go to the <strong id="ALM-43019__b659464922315">Dashboard</strong> page. Click the drop-down list in the upper right corner of the chart area, and choose <strong id="ALM-43019__b51261654114813">Customize</strong> > <strong id="ALM-43019__b1782241111313">Memory</strong> > <strong id="ALM-43019__b20208171194913">IndexServer2x Memory Usage Statistics</strong> > <strong id="ALM-43019__b1084642115500">OK</strong>. Check whether the heap memory used by the IndexServer2x process reaches the maximum heap memory threshold (95% by default).</span><p><ul class="subitemlist" id="ALM-43019__ul4763640145211"><li id="ALM-43019__li6763104013523">If the threshold is reached, go to <a href="#ALM-43019__li1769491023514">3</a>.</li><li id="ALM-43019__li14763194017520">If the threshold is not reached, go to <a href="#ALM-43019__li1543255925610">7</a>.</li></ul>
|
|
</p></li><li id="ALM-43019__li1769491023514"><a name="ALM-43019__li1769491023514"></a><a name="li1769491023514"></a><span>On FusionInsight Manager, choose <strong id="ALM-43019__b10291336175419">Cluster</strong> > <span id="ALM-43019__text1729233611545"><em id="ALM-43019__i52921636185419">Name of the desired cluster</em></span> > <strong id="ALM-43019__b6292436185418">Services</strong> > <strong id="ALM-43019__b42921936195416">Spark2x</strong> > <strong id="ALM-43019__b829253619548">Instance</strong>. Click the IndexServer2x that reported the alarm to go to the <strong id="ALM-43019__b1186579192415">Dashboard</strong> page. Click the drop-down list in the upper right corner of the chart area, and choose <strong id="ALM-43019__b192933369549">Customize</strong> > <strong id="ALM-43019__b477019232159">Memory</strong> > <strong id="ALM-43019__b202939367548">Statistics for the heap memory of the IndexServer2x Process</strong> > <strong id="ALM-43019__b32931136125413">OK</strong>. Based on the alarm generation time, check the values of the used heap memory of the IndexServer2x process in the corresponding period and obtain the maximum value.</span></li><li id="ALM-43019__li921352115614"><span>On FusionInsight Manager, choose <strong id="ALM-43019__b142841918195814">Cluster</strong> > <span id="ALM-43019__text426163543914"><em id="ALM-43019__i1326235163910">Name of the desired cluster</em></span> > <strong id="ALM-43019__b1211754175815">Services</strong> > <strong id="ALM-43019__b18291135810582">Spark2x</strong> > <strong id="ALM-43019__b176608665918">Configurations</strong> > <strong id="ALM-43019__b19736171975917">All Configuration</strong> > <strong id="ALM-43019__b5569194012593">IndexServer2x</strong>> <strong id="ALM-43019__b1962784425911">Tuning</strong>. The default value of the <strong id="ALM-43019__b698013542593">SPARK_DRIVER_MEMORY</strong> parameter is 4 GB. You can change the value based on the ratio of the maximum heap memory used by the IndexServer2x process to the threshold specified by <strong id="ALM-43019__b14941257194">IndexServer2x Heap Memory Usage Statistics (IndexServer2x)</strong> in the alarm period. If the alarm persists after the parameter value is changed, increase the value by 0.5 times. If the alarm is generated frequently, double the rate.</span><p><div class="note" id="ALM-43019__note167581556194510"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="ALM-43019__p121092931415">On FusionInsight Manager, you can choose <strong id="ALM-43019__b1583318524017">O&M</strong> > <strong id="ALM-43019__b1650619184019">Alarm</strong> > <strong id="ALM-43019__b1166716167402">Thresholds</strong> > <em id="ALM-43019__i152810252400">Name of the desired cluster</em> > <strong id="ALM-43019__b1779812914401">Spark2x</strong> > <strong id="ALM-43019__b4253143320400">Memory</strong> > <strong id="ALM-43019__b17870114118">IndexServer2x Heap Memory Usage Statistics (IndexServer2x)</strong> to view the threshold.</p>
|
|
</div></div>
|
|
</p></li><li id="ALM-43019__li656515289295"><span>Restart all IndexServer2x instances.</span></li><li id="ALM-43019__li14211352155620"><span>After 10 minutes, check whether the alarm is cleared.</span><p><ul class="subitemlist" id="ALM-43019__ul1676564015210"><li id="ALM-43019__li4766540185217">If the alarm is cleared, no further action is required.</li><li id="ALM-43019__li376664016528">If the alarm is not cleared, go to <a href="#ALM-43019__li1543255925610">7</a>.</li></ul>
|
|
</p></li></ol>
|
|
<p id="ALM-43019__aad603008e60c4983b1730402781accab"><strong id="ALM-43019__b19474188182110">Collect fault information.</strong></p>
|
|
<ol start="7" id="ALM-43019__ol7433115915614"><li id="ALM-43019__li1543255925610"><a name="ALM-43019__li1543255925610"></a><a name="li1543255925610"></a><span>On FusionInsight Manager, choose <strong id="ALM-43019__b1854624844415">O&M</strong> > <strong id="ALM-43019__b1547144819446">Log</strong> > <strong id="ALM-43019__b115474485449">Download</strong>.</span></li><li id="ALM-43019__li104321259195610"><span>Expand the <strong id="ALM-43019__b1899192712389">Service</strong> drop-down list, and select <strong id="ALM-43019__b71306317335">Spark2x</strong> for the target cluster.</span></li><li id="ALM-43019__li043316593563"><span>Click <span><img id="ALM-43019__image1743315945613" src="en-us_image_0269417545.png"></span> in the upper right corner, and set <strong id="ALM-43019__b18831547123618">Start Date</strong> and <strong id="ALM-43019__b1483434743616">End Date</strong> for log collection to 10 minutes ahead of and after the alarm generation time respectively. Then, click <strong id="ALM-43019__b583564713611">Download</strong>.</span></li><li id="ALM-43019__li204339590561"><span>Contact the <span id="ALM-43019__text4614151421417">O&M personnel</span> and provide the collected logs.</span></li></ol>
|
|
</div>
|
|
<div class="section" id="ALM-43019__section169311343318"><h4 class="sectiontitle">Alarm Clearing</h4><p id="ALM-43019__p754913417333">After the fault is rectified, the system automatically clears this alarm.</p>
|
|
</div>
|
|
<div class="section" id="ALM-43019__s90cd5279899a47bab7f1ded21334fa68"><h4 class="sectiontitle">Reference</h4><p id="ALM-43019__a1b0d8c37c99f45ee9e1c69ffd3a7a9f8">None</p>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1298.html">Alarm Reference (Applicable to MRS 3.x)</a></div>
|
|
</div>
|
|
</div>
|
|
|