forked from docs/doc-exports
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: chenxiaoxiong <chenxiaoxiong@huawei.com> Co-committed-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
219 lines
32 KiB
HTML
219 lines
32 KiB
HTML
<a name="dataartsstudio_01_0593"></a><a name="dataartsstudio_01_0593"></a>
|
|
|
|
<h1 class="topictitle1">Regular Expressions for Separating Semi-structured Text</h1>
|
|
<div id="body32001227"><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p1530884195614">During table/file migration, CDM uses delimiters to separate fields in CSV files. However, delimiters cannot be used in complex semi-structured data because the field values also contain delimiters. In this case, the regular expression can be used to separate the fields.</p>
|
|
<p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p26103007135344">The regular expression is configured in <strong id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_b137173112471">Source Job Configuration</strong>. The migration source must be an object storage or file system, and <span class="parmname" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_parmname07293154719"><b>File Format</b></span> must be <span class="parmvalue" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_parmvalue572631134713"><b>CSV</b></span>.</p>
|
|
<div class="fignone" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_fig15629134511"><span class="figcap"><b>Figure 1 </b>Setting regular expression parameters</span><br><span><img id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_image69781716194614" src="en-us_image_0000002234080632.png" title="Click to enlarge" class="imgResize"></span></div>
|
|
<p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p1838965818467"></p>
|
|
<div class="p" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p35214072134931">During the migration of CSV files, CDM can use regular expressions to separate fields and write parsed results to the migration destination. For details about the syntax of the regular expression, refer to the related documents. This section describes the regular expressions of the following log files:<ul id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_ul22818463135836"><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li17963451135836"><a href="#dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section3640870614023">Log4J Log</a></li><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li62251927135858"><a href="#dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section3778456914559">Log4J Audit Log</a></li><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li4116907135910"><a href="#dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section20618611495">Tomcat Log</a></li><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li25291538135943"><a href="#dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section1163361141018">Django Log</a></li><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li64939702135953"><a href="#dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section61918911141058">Apache Server Log</a></li></ul>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section3640870614023"><a name="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section3640870614023"></a><a name="en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section3640870614023"></a><h4 class="sectiontitle">Log4J Log</h4><ul id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_ul1092115384217"><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li169211338322">Log sample:<pre class="screen" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_screen3035687714219">2018-01-11 08:50:59,001 INFO [org.apache.sqoop.core.SqoopConfiguration.configureClassLoader(SqoopConfiguration.java:251)] Adding jars to current classloader from property: org.apache.sqoop.classpath.extra</pre>
|
|
</li><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li92856579405">Regular expression:<pre class="codeblock" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_codeblock816370144210">^(\d.*\d) (\w*) \[(.*)\] (\w.*).*</pre>
|
|
</li><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li1771612579210">Parsing result:
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_table6481183435420" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Log4J log parsing result</caption><thead align="left"><tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row548263414542"><th align="left" class="cellrowborder" valign="top" width="10%" id="mcps1.3.6.2.3.1.2.3.1.1"><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p1648233418548">Column Number</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="90%" id="mcps1.3.6.2.3.1.2.3.1.2"><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p14482183495413">Example Value</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row1482334175416"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.6.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p1948273485418">1</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.6.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p13482173485413">2018-01-11 08:50:59,001</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row14482183465416"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.6.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p148210342545">2</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.6.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p1148263435417">INFO</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row84821348549"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.6.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p1948213349546">3</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.6.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p74823348545">org.apache.sqoop.core.SqoopConfiguration.configureClassLoader(SqoopConfiguration.java:251)</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row2482103495416"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.6.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p248293418549">4</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.6.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p154830344547">Adding jars to current classloader from property: org.apache.sqoop.classpath.extra</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</li></ul>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section3778456914559"><a name="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section3778456914559"></a><a name="en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section3778456914559"></a><h4 class="sectiontitle">Log4J Audit Log</h4><ul id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_ul20813174216319"><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li14813242833">Log sample:<pre class="screen" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_screen18131427317">2018-01-11 08:51:06,156 INFO [org.apache.sqoop.audit.FileAuditLogger.logAuditEvent(FileAuditLogger.java:61)] user=sqoop.anonymous.user ip=189.xxx.xxx.75 op=show obj=version objId=x</pre>
|
|
</li><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li878832118429">Regular expression:<pre class="codeblock" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_codeblock9710114894210">^(\d.*\d) (\w*) \[(.*)\] user=(\w.*) ip=(\w.*) op=(\w.*) obj=(\w.*) objId=(.*).*</pre>
|
|
</li><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li11451155617317">Parsing result:
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_table1745193814598" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Log4J audit log parsing result</caption><thead align="left"><tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row24511338165913"><th align="left" class="cellrowborder" valign="top" width="10%" id="mcps1.3.7.2.3.1.2.3.1.1"><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p2451103885916">Column Number</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="90%" id="mcps1.3.7.2.3.1.2.3.1.2"><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p2045263825920">Example Value</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row34521238165912"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.7.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p7452153810596">1</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.7.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p11761927107">2018-01-11 08:51:06,156</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row6452163812598"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.7.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p1645203817598">2</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.7.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p18452103855920">INFO</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row6452153815915"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.7.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p84527388595">3</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.7.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p144527386597">org.apache.sqoop.audit.FileAuditLogger.logAuditEvent(FileAuditLogger.java:61)</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row1545233812593"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.7.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p34527381593">4</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.7.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p945273815915">sqoop.anonymous.user</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row646917336114"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.7.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p164709331317">5</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.7.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p7470633314">189.xxx.xxx.75</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row363413331515"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.7.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p563403317111">6</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.7.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p763412331219">show</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row9701504111"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.7.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p67011501317">7</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.7.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p97012501114">version</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row192531350715"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.7.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p14254550514">8</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.7.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p125416508112">x</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</li></ul>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section20618611495"><a name="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section20618611495"></a><a name="en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section20618611495"></a><h4 class="sectiontitle">Tomcat Log</h4><ul id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_ul192181119916"><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li5218811594">Log sample:<pre class="screen" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_screen2991056514946">11-Jan-2018 09:00:06.907 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Name: Linux</pre>
|
|
</li></ul>
|
|
<ul id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_ul0625041295"><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li15368547174310">Regular expression:<pre class="codeblock" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_codeblock2259175114411">^(\d.*\d) (\w*) \[(.*)\] ([\w\.]*) (\w.*).*</pre>
|
|
</li><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li196813220911">Parsing result:
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_table176213364620" frame="border" border="1" rules="all"><caption><b>Table 3 </b>Tomcat log parsing result</caption><thead align="left"><tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row762133613610"><th align="left" class="cellrowborder" valign="top" width="10%" id="mcps1.3.8.3.2.1.2.3.1.1"><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p18621336467">Column Number</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="90%" id="mcps1.3.8.3.2.1.2.3.1.2"><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p362736967">Example Value</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row5621836066"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.8.3.2.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p4633362617">1</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.8.3.2.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p984169972">11-Jan-2018 09:00:06.907</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row1063163618613"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.8.3.2.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p96318361613">2</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.8.3.2.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p206343619614">INFO</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row126363618619"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.8.3.2.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p1363123613619">3</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.8.3.2.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p64524232074">main</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row12633362620"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.8.3.2.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p15638361967">4</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.8.3.2.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p7929205014719">org.apache.catalina.startup.VersionLoggerListener.log</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row1963103610617"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.8.3.2.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p1363113619619">5</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.8.3.2.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p18366142819811">OS Name:Linux</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</li></ul>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section1163361141018"><a name="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section1163361141018"></a><a name="en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section1163361141018"></a><h4 class="sectiontitle">Django Log</h4><ul id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_ul112120158121"><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li142121615131211">Log sample:<pre class="screen" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_screen29073110141046">[08/Jan/2018 20:59:07 ] settings INFO Welcome to Hue 3.9.0</pre>
|
|
</li><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li3197013144419">Regular expression:<pre class="codeblock" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_codeblock11605129154416">^\[(.*)\] (\w*) (\w*) (.*).*</pre>
|
|
</li><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li16492124111218">Parsing result:
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_table317482613914" frame="border" border="1" rules="all"><caption><b>Table 4 </b>Django log parsing result</caption><thead align="left"><tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row117482610919"><th align="left" class="cellrowborder" valign="top" width="10%" id="mcps1.3.9.2.3.1.2.3.1.1"><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p71741261696">Column Number</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="90%" id="mcps1.3.9.2.3.1.2.3.1.2"><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p101742026793">Example Value</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row151741826395"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.9.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p617414261897">1</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.9.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p4370114514920">08/Jan/2018 20:59:07</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row1517419261591"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.9.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p5174226796">2</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.9.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p115323561197">settings</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row201754262911"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.9.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p13175426491">3</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.9.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p12811601011">INFO</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row19175426599"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.9.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p3175132614916">4</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.9.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p5275101711107">Welcome to Hue 3.9.0</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</li></ul>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section61918911141058"><a name="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section61918911141058"></a><a name="en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_section61918911141058"></a><h4 class="sectiontitle">Apache Server Log</h4><ul id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_ul1376157191414"><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li1476114714141">Log sample:<pre class="screen" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_screen55972025141130">[Mon Jan 08 20:43:51.854334 2018] [mpm_event:notice] [pid 36465:tid 140557517657856] AH00489: Apache/2.4.12 (Unix) OpenSSL/1.0.1t configured -- resuming normal operations</pre>
|
|
</li><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li14371138134412">Regular expression:<pre class="codeblock" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_codeblock179021053124420">^\[(.*)\] \[(.*)\] \[(.*)\] (.*).*</pre>
|
|
</li><li id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_li1166311419143">Parsing result:
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_table9441114111116" frame="border" border="1" rules="all"><caption><b>Table 5 </b>Apache server log parsing result</caption><thead align="left"><tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row84425417113"><th align="left" class="cellrowborder" valign="top" width="10%" id="mcps1.3.10.2.3.1.2.3.1.1"><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p14442649118">Column Number</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="90%" id="mcps1.3.10.2.3.1.2.3.1.2"><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p14442349112">Example Value</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row7442147119"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.10.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p184421344113">1</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.10.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p358932181112">Mon Jan 08 20:43:51.854334 2018</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row16442646119"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.10.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p94421841113">2</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.10.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p127972044101119">mpm_event:notice</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row444214419118"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.10.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p1344215413112">3</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.10.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p1678925911114">pid 36465:tid 140557517657856</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_row1244316419113"><td class="cellrowborder" valign="top" width="10%" headers="mcps1.3.10.2.3.1.2.3.1.1 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p174436419118">4</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="90%" headers="mcps1.3.10.2.3.1.2.3.1.2 "><p id="dataartsstudio_01_0593__en-us_topic_0000001197659215_en-us_topic_0000001197658803_en-us_topic_0108275466_p16231827191213">AH00489: Apache/2.4.12 (Unix) OpenSSL/1.0.1t configured -- resuming normal operations</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</li></ul>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0110.html">Key Operation Guide</a></div>
|
|
</div>
|
|
</div>
|
|
|
|
|
|
<script language="JavaScript">
|
|
<!--
|
|
initImageViewer('.imgResize');
|
|
var msg_imageMax = "view original image";
|
|
var msg_imageClose = "close";
|
|
//--></script> |