forked from docs/doc-exports
chenxiaoxiong
f9e2808b7c
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: chenxiaoxiong <chenxiaoxiong@huawei.com> Co-committed-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
186 lines
23 KiB
HTML
186 lines
23 KiB
HTML
<a name="dataartsstudio_01_0186"></a><a name="dataartsstudio_01_0186"></a>
|
||
|
||
<h1 class="topictitle1">To MRS Hudi</h1>
|
||
<div id="body8662426"><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p21313215367">If the destination link of a job is an <a href="dataartsstudio_01_0184.html">MRS Hudi link</a>, configure the destination job parameters based on <a href="#dataartsstudio_01_0186__en-us_topic_0000001298741086_table13961848191611">Table 1</a>.</p>
|
||
|
||
<div class="tablenoborder"><a name="dataartsstudio_01_0186__en-us_topic_0000001298741086_table13961848191611"></a><a name="en-us_topic_0000001298741086_table13961848191611"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0186__en-us_topic_0000001298741086_table13961848191611" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row9546184413415"><th align="left" class="cellrowborder" valign="top" width="11.261126112611262%" id="mcps1.3.2.2.5.1.1"><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p95593455014">Type</p>
|
||
</th>
|
||
<th align="left" class="cellrowborder" valign="top" width="17.01170117011701%" id="mcps1.3.2.2.5.1.2"><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_en-us_topic_0133467990_p1626397215165">Parameter</p>
|
||
</th>
|
||
<th align="left" class="cellrowborder" valign="top" width="49.45494549454945%" id="mcps1.3.2.2.5.1.3"><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_en-us_topic_0133467990_p4231334915165">Description</p>
|
||
</th>
|
||
<th align="left" class="cellrowborder" valign="top" width="22.272227222722275%" id="mcps1.3.2.2.5.1.4"><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_en-us_topic_0133467990_p482921015165">Example Value</p>
|
||
</th>
|
||
</tr>
|
||
</thead>
|
||
<tbody><tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row414054918161"><td class="cellrowborder" rowspan="9" valign="top" width="11.261126112611262%" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p144141640101710">Basic parameters</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" width="17.01170117011701%" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p1914004911163">Destination Link Name</p>
|
||
<p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p1514012497161"></p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" width="49.45494549454945%" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p8140144917165">MRS Hudi link</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" width="22.272227222722275%" headers="mcps1.3.2.2.5.1.4 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p1314014916166">hudi_to_cdm</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row161400499168"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p2140164991615">Database Name</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p1114094912167">Database name. Click the icon next to the text box. The dialog box for selecting the database is displayed.</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p1314014941619">dbadmin</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row3140174921610"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p9140184918169">Table Name</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p1914020492164">Click the icon next to the text box. The dialog box for selecting the table is displayed.</p>
|
||
<p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p514004919161">This parameter can be configured as a macro variable of date and time and a path name can contain multiple macro variables. You can use macro variables of date and time in a scheduled job to synchronize incremental data periodically. For details, see <a href="dataartsstudio_01_0114.html">Using Macro Variables of Date and Time</a>.</p>
|
||
<div class="note" id="dataartsstudio_01_0186__en-us_topic_0000001298741086_note45791757134910"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_en-us_topic_0108275319_p52974484409">If you have configured a macro variable of date and time and schedule a CDM job through <span id="dataartsstudio_01_0186__en-us_topic_0000001298741086_en-us_topic_0108275319_text9997118203">DataArts Studio DataArts Factory</span>, the system replaces the macro variable of date and time with (<em id="dataartsstudio_01_0186__en-us_topic_0000001298741086_en-us_topic_0108275319_i799871152012">Planned start time of the data development job</em> – <em id="dataartsstudio_01_0186__en-us_topic_0000001298741086_en-us_topic_0108275319_i0998101192020">Offset</em>) rather than (<em id="dataartsstudio_01_0186__en-us_topic_0000001298741086_en-us_topic_0108275319_i299821132018">Actual start time of the CDM job</em> – <em id="dataartsstudio_01_0186__en-us_topic_0000001298741086_en-us_topic_0108275319_i129981917200">Offset</em>).</p>
|
||
</div></div>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p1914014941612">cdm</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row71408498160"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p11140114961618">Auto Table Creation</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p2014014921616">Whether to automatically create Hudi tables</p>
|
||
<ul id="dataartsstudio_01_0186__en-us_topic_0000001298741086_ul859118371813"><li id="dataartsstudio_01_0186__en-us_topic_0000001298741086_li19591537186"><strong id="dataartsstudio_01_0186__en-us_topic_0000001298741086_b9703343277232">Non-auto creation</strong>: CDM will not automatically create a table.</li><li id="dataartsstudio_01_0186__en-us_topic_0000001298741086_li95911033188"><strong id="dataartsstudio_01_0186__en-us_topic_0000001298741086_b2674844097232">Auto creation</strong>: If the destination database does not contain the table specified by <span class="parmname" id="dataartsstudio_01_0186__en-us_topic_0000001298741086_parmname723181087232"><b>Table Name</b></span>, CDM will automatically create the table. If the table specified by <span class="parmname" id="dataartsstudio_01_0186__en-us_topic_0000001298741086_parmname20042786657232"><b>Table Name</b></span> already exists, no table is created and data is written to the existing table.</li></ul>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p114074913167">Non-auto creation</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row2140549181619"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p7140749191610">Clear Data Before Import</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p9140204971619">Whether the data in the destination table is cleared before data import. The options are as follows:</p>
|
||
<ul id="dataartsstudio_01_0186__en-us_topic_0000001298741086_ul1714074961614"><li id="dataartsstudio_01_0186__en-us_topic_0000001298741086_li10141164961614"><strong id="dataartsstudio_01_0186__en-us_topic_0000001298741086_b9493323287232">Yes</strong>: The data is cleared.</li><li id="dataartsstudio_01_0186__en-us_topic_0000001298741086_li13141204911615"><strong id="dataartsstudio_01_0186__en-us_topic_0000001298741086_b19380087547232">No</strong>: The data is not cleared. Instead, it will be added to the existing table.</li></ul>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p2141349191610">No</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row188308484349"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p172928213516">Full Data Mode to Write Hoodie</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p159273019116">Hoodie write mode. The default value is <strong id="dataartsstudio_01_0186__en-us_topic_0000001298741086_b7102672120">Yes</strong>, indicating the full mode. Value <strong id="dataartsstudio_01_0186__en-us_topic_0000001298741086_b28401822201213">No</strong> indicates the microbatch mode.</p>
|
||
<ul id="dataartsstudio_01_0186__en-us_topic_0000001298741086_ul1989016453371"><li id="dataartsstudio_01_0186__en-us_topic_0000001298741086_li188906452374">In full mode, data is asynchronously written to Hoodie by fragments, which is suitable for writing all data at a time.</li><li id="dataartsstudio_01_0186__en-us_topic_0000001298741086_li178913450372">In microbatch mode, data is asynchronously written to Hoodie in batches. This mode is suitable if there are strict SLA requirements on the import time, a small number of resources are required, or the MOR table storage types are compressed online.</li></ul>
|
||
<div class="note" id="dataartsstudio_01_0186__en-us_topic_0000001298741086_note224794116113"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p1383134823415">This mode cannot be changed during a retry upon failure.</p>
|
||
</div></div>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p38315484349">Yes</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row94097117511"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p7633172259">Batch Size</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p1641011258">This parameter is available when <strong id="dataartsstudio_01_0186__en-us_topic_0000001298741086_b173581141192117">Full Data Mode to Write Hoodie</strong> is set to <strong id="dataartsstudio_01_0186__en-us_topic_0000001298741086_b194861746152110">No</strong>.</p>
|
||
<p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p1993195579">It specifies the number of data rows written to Hoodie in a single batch. The default value is <strong id="dataartsstudio_01_0186__en-us_topic_0000001298741086_b8244203552317">100000</strong>.</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p34104119516">100000</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row195334335359"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p1370213346351">Use the import time field</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p16533193310355">A field marked as the import time field. If a table is automatically created, this field is automatically added to the table creation statement. When data is written to Hudi, the value of this field is replaced by the current time. If the table is not automatically created, select the existing import time field.</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p11533143315351">Yes</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row104677297399"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p116561730113915">Data import time field name</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p997133164016">This parameter is available when <strong id="dataartsstudio_01_0186__en-us_topic_0000001298741086_b678102742815">Use the import time field</strong> is set to <strong id="dataartsstudio_01_0186__en-us_topic_0000001298741086_b151231338172810">Yes</strong>.</p>
|
||
<p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p289414309319">It specifies the time when data is written to Hudi.</p>
|
||
<div class="note" id="dataartsstudio_01_0186__en-us_topic_0000001298741086_note2120111151413"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0186__en-us_topic_0000001298741086_ul174514161153"><li id="dataartsstudio_01_0186__en-us_topic_0000001298741086_li175738919231">If the destination table already has an import time field, you can directly use the existing timestamp field.</li><li id="dataartsstudio_01_0186__en-us_topic_0000001298741086_li11451181661516">In the automatic table creation scenario, this field is concatenated to the table creation statement and it is a timestamp. The field name cannot be the same as that of any source field (including custom fields).</li></ul>
|
||
</div></div>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p1236552124720">cdc_last_update_date</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row214119492166"><td class="cellrowborder" rowspan="11" valign="top" width="11.261126112611262%" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p6977214161812">Hudi table creation parameters</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" width="17.01170117011701%" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p2014119494163">Location</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" width="49.45494549454945%" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p18141104991613">OBS or HDFS path where database table files are stored</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" width="22.272227222722275%" headers="mcps1.3.2.2.5.1.4 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p18141249181614">-</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row71412049161612"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p111414493166">Hudi Table Type</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p12141149111616">Storage type of the Hudi table</p>
|
||
<ul id="dataartsstudio_01_0186__en-us_topic_0000001298741086_ul5141749101611"><li id="dataartsstudio_01_0186__en-us_topic_0000001298741086_li1814154910162"><strong id="dataartsstudio_01_0186__en-us_topic_0000001298741086_b6739201010341">MOR</strong>: Data is written to a log file in avro format and then merged into a Parquet file when being read.</li><li id="dataartsstudio_01_0186__en-us_topic_0000001298741086_li181411049171611"><strong id="dataartsstudio_01_0186__en-us_topic_0000001298741086_b14277446113410">COW</strong>: Data is directly written to a Parquet file.</li></ul>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p121418490160">MOR</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row16141104917167"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p1814113498166">Hudi table primary key</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p01417496161">Primary keys for creating a Hudi table. Use commas (,) to separate multiple keys.</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p2014115497162">-</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row1914116493163"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p01418499160">Hudi Table Key Generator Class</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p714164917165">Primary key generation type, which implements <strong id="dataartsstudio_01_0186__en-us_topic_0000001298741086_b1485212477363">org.apache.hudi.keygen.KeyGenerator</strong> to extract key values from input records.</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p10141449201614">-</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row1614118497162"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p13141949111610">Hudi table pre-combine key</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p1014194961620">If two records have the same primary key, the record with a larger <strong id="dataartsstudio_01_0186__en-us_topic_0000001298741086_b07655317378">precombine</strong> value is retained.</p>
|
||
<div class="note" id="dataartsstudio_01_0186__en-us_topic_0000001298741086_note164391410293"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p106430147295">If no time field is available, you can set a field that is the same as the primary key. When a primary key conflict occurs, the latest record is retained.</p>
|
||
</div></div>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p131422493169">ts</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row3142174916168"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p191421749171612">Hudi Table Partition Fields</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p314224901619">Partition fields for creating a Hudi table. Use commas (,) to separate multiple fields.</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p514244912161">-</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row1514274931611"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p171428491168">Hudi table compression policy (whether to enable write compression)</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p0142749161620">Policy for compressing data online. This parameter takes effect only for MOR tables.</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p13142114951618">Yes</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row814212496169"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p7142134913169">Hudi Table Clean Policy (Reserved Submissions)</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p191422049171613">Number of submissions reserved during clearance</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p12142124911166">1</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row614234912161"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p51428496167">Hudi Table Archiving Policy (Minimum Retention Submissions)</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p1814214493161">Minimum number of submissions retained during archiving</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p514264914164">1</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row514274919164"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p1814220496164">Hudi Table Archiving Policy (Maximum Number of Retained Submissions)</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p1714244915164">Maximum number of submissions retained during archiving</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p314216492165">100</p>
|
||
</td>
|
||
</tr>
|
||
<tr id="dataartsstudio_01_0186__en-us_topic_0000001298741086_row12142549141611"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.1 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p181421949141614">Hudi table options</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.2 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p10142849131612">Custom parameters for creating a Hudi table. The parameters take effect in options, for example, <strong id="dataartsstudio_01_0186__en-us_topic_0000001298741086_b75675915453">primary key</strong>, <strong id="dataartsstudio_01_0186__en-us_topic_0000001298741086_b17688139456">combineKey</strong>, or <strong id="dataartsstudio_01_0186__en-us_topic_0000001298741086_b143481818454">index</strong>.</p>
|
||
</td>
|
||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.5.1.3 "><p id="dataartsstudio_01_0186__en-us_topic_0000001298741086_p31421495161">-</p>
|
||
</td>
|
||
</tr>
|
||
</tbody>
|
||
</table>
|
||
</div>
|
||
</div>
|
||
<div>
|
||
<div class="familylinks">
|
||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0061.html">Configuring CDM Destination Job Parameters</a></div>
|
||
</div>
|
||
</div>
|
||
|