forked from docs/doc-exports
Yang, Tong
3b1f73dece
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
85 lines
10 KiB
HTML
85 lines
10 KiB
HTML
<a name="alm_14006"></a><a name="alm_14006"></a>
|
|
|
|
<h1 class="topictitle1">ALM-14006 Number of HDFS Files Exceeds the Threshold</h1>
|
|
<div id="body8662426"><div class="section" id="alm_14006__en-us_topic_0191813952_section38788755"><h4 class="sectiontitle">Description</h4><p id="alm_14006__en-us_topic_0191813952_p28290863">The system periodically checks the number of HDFS files every 30 seconds and compares the number of HDFS files with the threshold. This alarm is generated when the system detects that the number of HDFS files exceeds the threshold.</p>
|
|
<p id="alm_14006__en-us_topic_0191813952_p9858548">This alarm is cleared when the number of HDFS files is less than or equal to the threshold.</p>
|
|
</div>
|
|
<div class="section" id="alm_14006__en-us_topic_0191813952_section13554483"><h4 class="sectiontitle">Attribute</h4>
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="alm_14006__en-us_topic_0191813952_table60344938" frame="border" border="1" rules="all"><thead align="left"><tr id="alm_14006__en-us_topic_0191813952_row59011071"><th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.2.2.1.4.1.1"><p id="alm_14006__en-us_topic_0191813952_p15167431">Alarm ID</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.2.2.1.4.1.2"><p id="alm_14006__en-us_topic_0191813952_p20602375">Alarm Severity</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="33.33333333333333%" id="mcps1.3.2.2.1.4.1.3"><p id="alm_14006__en-us_topic_0191813952_p58179688">Auto Clear</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="alm_14006__en-us_topic_0191813952_row14934289"><td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.2.2.1.4.1.1 "><p id="alm_14006__en-us_topic_0191813952_p1717931">14006</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.2.2.1.4.1.2 "><p id="alm_14006__en-us_topic_0191813952_p4934750">Major</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.33333333333333%" headers="mcps1.3.2.2.1.4.1.3 "><p id="alm_14006__en-us_topic_0191813952_p64170449">Yes</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="alm_14006__en-us_topic_0191813952_section54881489"><h4 class="sectiontitle">Parameters</h4>
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="alm_14006__en-us_topic_0191813952_table30423852" frame="border" border="1" rules="all"><thead align="left"><tr id="alm_14006__en-us_topic_0191813952_row60888739"><th align="left" class="cellrowborder" valign="top" width="50%" id="mcps1.3.3.2.1.3.1.1"><p id="alm_14006__en-us_topic_0191813952_p33040847">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="50%" id="mcps1.3.3.2.1.3.1.2"><p id="alm_14006__en-us_topic_0191813952_p59062984">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="alm_14006__en-us_topic_0191813952_row19372405"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="alm_14006__en-us_topic_0191813952_p25660991">ServiceName</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="alm_14006__en-us_topic_0191813952_p65274381">Specifies the service for which the alarm is generated.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="alm_14006__en-us_topic_0191813952_row50598521"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="alm_14006__en-us_topic_0191813952_p4839561">RoleName</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="alm_14006__en-us_topic_0191813952_p56460178">Specifies the role for which the alarm is generated.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="alm_14006__en-us_topic_0191813952_row38379555"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="alm_14006__en-us_topic_0191813952_p21736211">HostName</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="alm_14006__en-us_topic_0191813952_p15802639">Specifies the host for which the alarm is generated.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="alm_14006__en-us_topic_0191813952_row8006030"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="alm_14006__en-us_topic_0191813952_p44508680">NSName</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="alm_14006__en-us_topic_0191813952_p48433347">Specifies the NameService service for which the alarm is generated.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="alm_14006__en-us_topic_0191813952_row33246944"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.1 "><p id="alm_14006__en-us_topic_0191813952_p8647967">Trigger condition</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.1.3.1.2 "><p id="alm_14006__en-us_topic_0191813952_p29396722">Generates an alarm when the actual indicator value exceeds the specified threshold.</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="alm_14006__en-us_topic_0191813952_section24171358"><h4 class="sectiontitle">Impact on the System</h4><p id="alm_14006__en-us_topic_0191813952_p32324290">Disk storage space is insufficient, which may result in data import failure. The performance of the HDFS system is affected.</p>
|
|
</div>
|
|
<div class="section" id="alm_14006__en-us_topic_0191813952_section16215635"><h4 class="sectiontitle">Possible Causes</h4><p id="alm_14006__en-us_topic_0191813952_p1021814">The number of HDFS files exceeds the threshold.</p>
|
|
</div>
|
|
<div class="section" id="alm_14006__en-us_topic_0191813952_section11722994"><h4 class="sectiontitle">Procedure</h4><ol id="alm_14006__en-us_topic_0191813952_ol46684102154710"><li class="tableheading" id="alm_14006__en-us_topic_0191813952_li62410660154710"><span>Check whether unnecessary files exist in the system.</span><p><ol type="a" id="alm_14006__en-us_topic_0191813952_ol6705199"><li id="alm_14006__en-us_topic_0191813952_li36508524">Use the client on the cluster node and run the <strong id="alm_14006__b1554323113619">hdfs dfs -ls</strong> <em id="alm_14006__i554653133611">file or directory path</em> command to check whether the file or directory can be deleted.<ul class="subitemlist" id="alm_14006__en-us_topic_0191813952_ul39604502"><li id="alm_14006__en-us_topic_0191813952_li20896204">If yes, go to <a href="#alm_14006__en-us_topic_0191813952_alm-14006_mmccppss_step4">1.b</a>.</li><li id="alm_14006__en-us_topic_0191813952_li14870940">If no, go to <a href="#alm_14006__en-us_topic_0191813952_yt16">2.a</a>.</li></ul>
|
|
</li><li id="alm_14006__en-us_topic_0191813952_alm-14006_mmccppss_step4"><a name="alm_14006__en-us_topic_0191813952_alm-14006_mmccppss_step4"></a><a name="en-us_topic_0191813952_alm-14006_mmccppss_step4"></a>Run the <strong id="alm_14006__b1629133143613">hdfs dfs -rm -r</strong> <em id="alm_14006__i46291531163619">file or directory path</em> command. Delete unnecessary files, wait 5 minutes, and check whether the alarm is cleared.<ul class="subitemlist" id="alm_14006__en-us_topic_0191813952_ul61795582"><li id="alm_14006__en-us_topic_0191813952_li19289328">If yes, no further action is required.</li><li id="alm_14006__en-us_topic_0191813952_li39386231">If no, go to <a href="#alm_14006__en-us_topic_0191813952_yt16">2.a</a>.</li></ul>
|
|
</li></ol>
|
|
</p></li><li class="tableheading" id="alm_14006__en-us_topic_0191813952_li48207971154724"><span>Check the number of files in the system.</span><p><ol type="a" id="alm_14006__en-us_topic_0191813952_ol46328937154616"><li id="alm_14006__en-us_topic_0191813952_yt16"><a name="alm_14006__en-us_topic_0191813952_yt16"></a><a name="en-us_topic_0191813952_yt16"></a>On MRS Manager, choose <strong id="alm_14006__b1417712501366">System</strong> > <strong id="alm_14006__b017765063615">Threshold Configuration</strong>.</li><li id="alm_14006__en-us_topic_0191813952_li43938279">In the navigation tree on the left, choose <strong id="alm_14006__b7242152153619">Services</strong> > <strong id="alm_14006__b9243145223620">HDFS</strong> > <strong id="alm_14006__b424315214369">HDFS File</strong> > <strong id="alm_14006__b192431452193614">Total Number of Files</strong>.</li><li id="alm_14006__en-us_topic_0191813952_li59900193">In the right pane, modify the threshold in the rule based on the number of current HDFS files.<p class="litext" id="alm_14006__en-us_topic_0191813952_p2230829"><a name="alm_14006__en-us_topic_0191813952_li59900193"></a><a name="en-us_topic_0191813952_li59900193"></a>To check the number of HDFS files, choose <strong id="alm_14006__b1451115910365">Services</strong> > <strong id="alm_14006__b13560591365">HDFS</strong>, click <strong id="alm_14006__b135618599368">Customize</strong> in the <strong id="alm_14006__b756759103612">Real-Time Statistics</strong> area on the right, and select the <strong id="alm_14006__b1957165933616">HDFS File</strong> monitoring item.</p>
|
|
</li><li id="alm_14006__en-us_topic_0191813952_sss999">Wait 5 minutes and check whether the alarm is cleared.<ul class="subitemlist" id="alm_14006__en-us_topic_0191813952_ul13072760"><li id="alm_14006__en-us_topic_0191813952_li50545980">If yes, no further action is required.</li><li id="alm_14006__en-us_topic_0191813952_li52260639">If no, go to <a href="#alm_14006__en-us_topic_0191813952_li572522141314">3</a>.</li></ul>
|
|
</li></ol>
|
|
</p></li><li id="alm_14006__en-us_topic_0191813952_li572522141314"><a name="alm_14006__en-us_topic_0191813952_li572522141314"></a><a name="en-us_topic_0191813952_li572522141314"></a><span>Collect fault information.</span><p><ol type="a" id="alm_14006__en-us_topic_0191813952_en-us_topic_0191813935_ol6089206913036"><li id="alm_14006__en-us_topic_0191813952_en-us_topic_0191813935_li4478836213036">On MRS Manager, choose <span class="menucascade" id="alm_14006__menucascade19189196375"><b><span class="uicontrol" id="alm_14006__uicontrol49171119193710">System</span></b> > <b><span class="uicontrol" id="alm_14006__uicontrol091861923717">Export Log</span></b></span>.</li><li id="alm_14006__li18574327401">Contact technical support engineers for help. For details, see <a href="https://docs.otc.t-systems.com/en-us/public/learnmore.html" target="_blank" rel="noopener noreferrer">technical support</a>.</li></ol>
|
|
</p></li></ol>
|
|
</div>
|
|
<div class="section" id="alm_14006__en-us_topic_0191813952_section38398082"><h4 class="sectiontitle">Reference</h4><p id="alm_14006__en-us_topic_0191813952_p54402144">None</p>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_0241.html">Alarm Reference (Applicable to Versions Earlier Than MRS 3.x)</a></div>
|
|
</div>
|
|
</div>
|
|
|