Yang, Tong 6182f91ba8 MRS component operation guide_normal 2.0.38.SP20 version
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2022-12-09 14:55:21 +00:00

20 lines
2.0 KiB
HTML

<a name="mrs_01_2079"></a><a name="mrs_01_2079"></a>
<h1 class="topictitle1">Why the Job Fails with HDFS_DELEGATION_TOKEN Expired Exception?</h1>
<div id="body1596167575146"><div class="section" id="mrs_01_2079__sb09c19490efc4c6b863b581150627847"><h4 class="sectiontitle">Question</h4><p id="mrs_01_2079__aa5516832f06b4638aef6b35214a8d791">Why is the HDFS_DELEGATION_TOKEN expired exception reported when a job fails in security mode?</p>
</div>
<div class="section" id="mrs_01_2079__s20e9c62912e54d86b11f4a2ff2190380"><h4 class="sectiontitle">Answer</h4><p id="mrs_01_2079__a173c4a4b91bf4169ad6f7ea8aa3586bc">HDFS_DELEGATION_TOKEN expires because the token is not updated or it is accessed after max. lifetime.</p>
<p id="mrs_01_2079__a834de3088de445f9879f9ea0960dbfc1">Ensure the following parameter value of max. lifetime of the token is greater than the job running time.</p>
<p id="mrs_01_2079__a2234aeda440341ecaa30d3e4f30ed63c"><span class="parmname" id="mrs_01_2079__pafbec81e23c84edc94d16d83e436091c"><b>dfs.namenode.delegation.token.max-lifetime</b></span>=<span class="parmvalue" id="mrs_01_2079__p45d3bb646452470d980e664e9ec30f33"><b>604800000</b></span> (1 week by default)</p>
<p id="mrs_01_2079__p181181238201018">Go to the <strong id="mrs_01_2079__b15996132119392">All Configurations</strong> page of HDFS by referring to <a href="mrs_01_2125.html">Modifying Cluster Service Configuration Parameters</a> and search for this parameter in the search box.</p>
<div class="note" id="mrs_01_2079__n368106accd4d4b16b9df9dbf16bd4244"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="mrs_01_2079__a0ea4ceae6e1d46a9937288c856f667ad">You are advised to set this parameter to a value that is multiple times of the number of hours within the max. lifecycle of the token.</p>
</div></div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_2077.html">Common Issues About Yarn</a></div>
</div>
</div>