forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
139 lines
14 KiB
HTML
139 lines
14 KiB
HTML
<a name="mrs_01_2071"></a><a name="mrs_01_2071"></a>
|
|
|
|
<h1 class="topictitle1">Log Overview</h1>
|
|
<div id="body1594690433055"><div class="section" id="mrs_01_2071__s4cfaa897839d43d5bfdc2cb9bb7c0928"><h4 class="sectiontitle">Log Description</h4><p id="mrs_01_2071__en-us_topic_0046736734_p42341959"><strong id="mrs_01_2071__b1172224355111947">Log path</strong>: The default save path of Tez logs is <strong id="mrs_01_2071__b228347147111947">/var/log/Bigdata/tez/</strong><em id="mrs_01_2071__i379982028111947">role name</em>.</p>
|
|
<p id="mrs_01_2071__p17253131184">TezUI: <strong id="mrs_01_2071__b335520661111947">/var/log/Bigdata/tez/tezui</strong> (run logs) and <strong id="mrs_01_2071__b1887119180111947">/var/log/Bigdata/audit/tez/tezui</strong> (audit logs)</p>
|
|
<p id="mrs_01_2071__en-us_topic_0046736734_p47145967"><strong id="mrs_01_2071__b831120314111947">Log archive rule</strong>: The automatic compression and archiving function of Tez is enabled. By default, when the size of a log file exceeds 20 MB (which is adjustable), the log file is automatically compressed. The naming rule of the compressed log file is as follows: <<em id="mrs_01_2071__i447613517111947">Original log file name</em>>-<<em id="mrs_01_2071__i422830713111947">yyyy-mm-dd_hh-mm-ss</em>>.[<em id="mrs_01_2071__i584325854111947">ID</em>].<strong id="mrs_01_2071__b1547614477111947">log.zip</strong> A maximum of 20 latest compressed files are retained. The number of compressed files and compression threshold can be configured. </p>
|
|
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_2071__en-us_topic_0046736734_table60726989" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Tez log list</caption><thead align="left"><tr id="mrs_01_2071__en-us_topic_0046736734_row27003373"><th align="left" class="cellrowborder" valign="top" width="28.572857285728574%" id="mcps1.3.1.5.2.4.1.1"><p id="mrs_01_2071__en-us_topic_0046736734_p39789633">Log Type</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="35.713571357135706%" id="mcps1.3.1.5.2.4.1.2"><p id="mrs_01_2071__en-us_topic_0046736734_p1734841">Name</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="35.713571357135706%" id="mcps1.3.1.5.2.4.1.3"><p id="mrs_01_2071__en-us_topic_0046736734_p6304446">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_2071__en-us_topic_0046736734_row40898103"><td class="cellrowborder" rowspan="8" valign="top" width="28.572857285728574%" headers="mcps1.3.1.5.2.4.1.1 "><p id="mrs_01_2071__en-us_topic_0046736734_p24412045">Run log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="35.713571357135706%" headers="mcps1.3.1.5.2.4.1.2 "><p id="mrs_01_2071__en-us_topic_0046736734_p31218599">tezui.out</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="35.713571357135706%" headers="mcps1.3.1.5.2.4.1.3 "><p id="mrs_01_2071__en-us_topic_0046736734_p45678573">Log file that records TezUI running environment information</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2071__en-us_topic_0046736734_row8453981"><td class="cellrowborder" valign="top" headers="mcps1.3.1.5.2.4.1.1 "><p id="mrs_01_2071__en-us_topic_0046736734_p13683857">tezui.log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.1.5.2.4.1.2 "><p id="mrs_01_2071__en-us_topic_0046736734_p34650662">Run log of the TezUI process</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2071__en-us_topic_0046736734_row43420508"><td class="cellrowborder" valign="top" headers="mcps1.3.1.5.2.4.1.1 "><p id="mrs_01_2071__en-us_topic_0046736734_p27400293">tezui-omm-<<em id="mrs_01_2071__i088691510106">Date</em>>-gc.log.<<em id="mrs_01_2071__i147121813108">No.</em>></p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.1.5.2.4.1.2 "><p id="mrs_01_2071__en-us_topic_0046736734_p4831266">GC log of the TezUI process</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2071__en-us_topic_0046736734_row15189541"><td class="cellrowborder" valign="top" headers="mcps1.3.1.5.2.4.1.1 "><p id="mrs_01_2071__en-us_topic_0046736734_p22393284">prestartDetail.log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.1.5.2.4.1.2 "><p id="mrs_01_2071__en-us_topic_0046736734_p1916704">Work logs generated before the TezUI is started</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2071__en-us_topic_0046736734_row17250336"><td class="cellrowborder" valign="top" headers="mcps1.3.1.5.2.4.1.1 "><p id="mrs_01_2071__en-us_topic_0046736734_p55099937">check-serviceDetail.log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.1.5.2.4.1.2 "><p id="mrs_01_2071__en-us_topic_0046736734_p33909907">Log file that records whether the TezUI service starts successfully</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2071__row997161163513"><td class="cellrowborder" valign="top" headers="mcps1.3.1.5.2.4.1.1 "><p id="mrs_01_2071__p1997181115353">postinstallDetail.log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.1.5.2.4.1.2 "><p id="mrs_01_2071__p997101163514">Work logs after the TezUI is installed</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2071__en-us_topic_0046736734_row36267164"><td class="cellrowborder" valign="top" headers="mcps1.3.1.5.2.4.1.1 "><p id="mrs_01_2071__en-us_topic_0046736734_p51959135">startDetail.log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.1.5.2.4.1.2 "><p id="mrs_01_2071__en-us_topic_0046736734_p47940444">Startup log of the TezUI process</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2071__en-us_topic_0046736734_row28810815"><td class="cellrowborder" valign="top" headers="mcps1.3.1.5.2.4.1.1 "><p id="mrs_01_2071__en-us_topic_0046736734_p51974659">stopDetail.log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.1.5.2.4.1.2 "><p id="mrs_01_2071__en-us_topic_0046736734_p49197844">Stop log of the TezUI process</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2071__en-us_topic_0046736734_row18983738"><td class="cellrowborder" valign="top" width="28.572857285728574%" headers="mcps1.3.1.5.2.4.1.1 "><p id="mrs_01_2071__en-us_topic_0046736734_p61287837">Audit log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="35.713571357135706%" headers="mcps1.3.1.5.2.4.1.2 "><p id="mrs_01_2071__en-us_topic_0046736734_p65367744">tezui-audit.log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="35.713571357135706%" headers="mcps1.3.1.5.2.4.1.3 "><p id="mrs_01_2071__en-us_topic_0046736734_p60295883">TezUI audit log</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="mrs_01_2071__section1769013409218"><h4 class="sectiontitle">Log Level</h4><p id="mrs_01_2071__en-us_topic_0046736734_p9424991"><a href="#mrs_01_2071__t91045e1a946a46b4bac39028af62f3ad">Table 2</a> describes the log levels supported by TezUI.</p>
|
|
<p id="mrs_01_2071__en-us_topic_0046736734_p25226782">Levels of run logs are ERROR, WARN, INFO, and DEBUG from the highest to the lowest priority. Run logs of equal or higher levels are recorded. The higher the specified log level, the fewer the logs recorded.</p>
|
|
|
|
<div class="tablenoborder"><a name="mrs_01_2071__t91045e1a946a46b4bac39028af62f3ad"></a><a name="t91045e1a946a46b4bac39028af62f3ad"></a><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_2071__t91045e1a946a46b4bac39028af62f3ad" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Log levels</caption><thead align="left"><tr id="mrs_01_2071__en-us_topic_0046736734_row58374663"><th align="left" class="cellrowborder" valign="top" width="39.190000000000005%" id="mcps1.3.2.4.2.3.1.1"><p id="mrs_01_2071__en-us_topic_0046736734_p52951174">Level</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="60.809999999999995%" id="mcps1.3.2.4.2.3.1.2"><p id="mrs_01_2071__en-us_topic_0046736734_p13809081">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_2071__en-us_topic_0046736734_row8735540"><td class="cellrowborder" valign="top" width="39.190000000000005%" headers="mcps1.3.2.4.2.3.1.1 "><p id="mrs_01_2071__en-us_topic_0046736734_p36490171">ERROR</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="60.809999999999995%" headers="mcps1.3.2.4.2.3.1.2 "><p id="mrs_01_2071__en-us_topic_0046736734_p2913837">Logs of this level record error information about system running.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2071__en-us_topic_0046736734_row26224539"><td class="cellrowborder" valign="top" width="39.190000000000005%" headers="mcps1.3.2.4.2.3.1.1 "><p id="mrs_01_2071__en-us_topic_0046736734_p43812891">WARN</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="60.809999999999995%" headers="mcps1.3.2.4.2.3.1.2 "><p id="mrs_01_2071__en-us_topic_0046736734_p59183292">Exception information about the current event processing</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2071__en-us_topic_0046736734_row62887584"><td class="cellrowborder" valign="top" width="39.190000000000005%" headers="mcps1.3.2.4.2.3.1.1 "><p id="mrs_01_2071__en-us_topic_0046736734_p60729557">INFO</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="60.809999999999995%" headers="mcps1.3.2.4.2.3.1.2 "><p id="mrs_01_2071__en-us_topic_0046736734_p20147070">Logs of this level record normal running status information about the system and events.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2071__en-us_topic_0046736734_row47105906"><td class="cellrowborder" valign="top" width="39.190000000000005%" headers="mcps1.3.2.4.2.3.1.1 "><p id="mrs_01_2071__en-us_topic_0046736734_p57482021">DEBUG</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="60.809999999999995%" headers="mcps1.3.2.4.2.3.1.2 "><p id="mrs_01_2071__en-us_topic_0046736734_p25532096">Logs of this level record the system information and system debugging information.</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
<p id="mrs_01_2071__en-us_topic_0046736734_p28462276">To modify log levels, perform the following operations:</p>
|
|
<ol id="mrs_01_2071__ol17706776185419"><li id="mrs_01_2071__li42132031185419"><span>Log in to Manager.</span></li><li id="mrs_01_2071__li43643961185419"><span>Choose <strong id="mrs_01_2071__b2280218141110">Cluster </strong>> <strong id="mrs_01_2071__b17767019101110">Service </strong>> <strong id="mrs_01_2071__b18946121111113">Tez </strong>> <strong id="mrs_01_2071__b25281627131119">Configuration</strong>.</span></li><li id="mrs_01_2071__li57251336185419"><span>Select <strong id="mrs_01_2071__b455677052111947">All Configurations</strong>.</span></li><li id="mrs_01_2071__li45499980185419"><span>In the navigation pane, choose <strong id="mrs_01_2071__b1344933321119">TezUI </strong>> <strong id="mrs_01_2071__b1452812356118">Log</strong>.</span></li><li id="mrs_01_2071__li6846638185419"><span>Select a desired log level.</span></li><li id="mrs_01_2071__li61619743185419"><span>Click <strong id="mrs_01_2071__b129681940171111">Save</strong>. In the dialog box that is displayed, click <strong id="mrs_01_2071__b19337114501119">OK </strong>to save the configuration.</span></li><li id="mrs_01_2071__li11331034203312"><span>Click <strong id="mrs_01_2071__b1798015221111">Instance</strong>, select the <strong id="mrs_01_2071__b1998014522114">TezUI</strong> role, choose <strong id="mrs_01_2071__b598075216115">More</strong> > <strong id="mrs_01_2071__b1698114521113">Restart Instance</strong>, enter the user password, and click <strong id="mrs_01_2071__b29811352191119">OK</strong> in the dialog box that is displayed.</span></li><li id="mrs_01_2071__li6799181595419"><span>Wait until the instance is restarted for the configuration to take effect.</span></li></ol>
|
|
</div>
|
|
<div class="section" id="mrs_01_2071__se5e516e522b84306a70d53ec87072c63"><h4 class="sectiontitle">Log Format</h4><p id="mrs_01_2071__en-us_topic_0046736734_p46940727">The following table lists the Tez log formats.</p>
|
|
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_2071__en-us_topic_0046736734_table19813363" frame="border" border="1" rules="all"><caption><b>Table 3 </b>Log formats</caption><thead align="left"><tr id="mrs_01_2071__en-us_topic_0046736734_row61370790"><th align="left" class="cellrowborder" valign="top" width="24.490000000000002%" id="mcps1.3.3.3.2.4.1.1"><p id="mrs_01_2071__en-us_topic_0046736734_p4978063">Log Type</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="35.76%" id="mcps1.3.3.3.2.4.1.2"><p id="mrs_01_2071__en-us_topic_0046736734_p569920">Format</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="39.75%" id="mcps1.3.3.3.2.4.1.3"><p id="mrs_01_2071__en-us_topic_0046736734_p46163554">Example</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_2071__en-us_topic_0046736734_row48260380"><td class="cellrowborder" valign="top" width="24.490000000000002%" headers="mcps1.3.3.3.2.4.1.1 "><p id="mrs_01_2071__en-us_topic_0046736734_p16776727">Run log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="35.76%" headers="mcps1.3.3.3.2.4.1.2 "><p id="mrs_01_2071__en-us_topic_0046736734_p16737659"><yyyy-MM-dd HH:mm:ss,SSS>|<LogLevel>|<Thread that generates the log>|<Message in the log>|<Location of the log event></p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="39.75%" headers="mcps1.3.3.3.2.4.1.3 "><p id="mrs_01_2071__en-us_topic_0046736734_p13573102">2020-07-31 11:44:21,378 | INFO | TezUI-health-check | Start health check | com.XXX.tez.HealthCheck.run(HealthCheck.java:30)</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_2071__en-us_topic_0046736734_row55049062"><td class="cellrowborder" valign="top" width="24.490000000000002%" headers="mcps1.3.3.3.2.4.1.1 "><p id="mrs_01_2071__en-us_topic_0046736734_p29789046">Audit logs</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="35.76%" headers="mcps1.3.3.3.2.4.1.2 "><p id="mrs_01_2071__p474462551615"><yyyy-MM-dd HH:mm:ss,SSS>|<LogLevel>|<Thread that generates the log>|<User Name><User IP><Time><Operation><Resource><Result><Detail >|< Location of the log event ></p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="39.75%" headers="mcps1.3.3.3.2.4.1.3 "><p id="mrs_01_2071__p1372234391619">2018-12-24 12:16:25,319 | INFO | HiveServer2-Handler-Pool: Thread-185 | UserName=hive UserIP=10.153.2.204 Time=2018/12/24 12:16:25 Operation=CloseSession Result=SUCCESS Detail= | org.apache.hive.service.cli.thrift.ThriftCLIService.logAuditEvent(ThriftCLIService.java:434)</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_2067.html">Using Tez</a></div>
|
|
</div>
|
|
</div>
|
|
|