yexinru/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
Files
a41a4e0331fbc0beff63bb28fa59228cc9a751df
doc-exports/docs/dataartsstudio/umn/dataartsstudio_01_0456.html
chenxiaoxiong f9e2808b7c DataArts UMN 20250810 version 
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Co-authored-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
Co-committed-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
2025-09-02 10:44:13 +00:00

252 lines
34 KiB
HTML
Raw Blame History

<a name="dataartsstudio_01_0456"></a><a name="dataartsstudio_01_0456"></a>
<h1 class="topictitle1">MRS Spark Python</h1>
<div id="body8662426"><div class="section" id="dataartsstudio_01_0456__en-us_topic_0177038589_section44280035173841"><h4 class="sectiontitle">Functions</h4><p id="dataartsstudio_01_0456__en-us_topic_0177038589_p2324626615819">The <span id="dataartsstudio_01_0456__en-us_topic_0177038589_text103222500433">MRS Spark Python</span> node is used to execute a predefined Spark Python job on MRS.</p>
<p id="dataartsstudio_01_0456__p877423984914">For details about how to use the <span id="dataartsstudio_01_0456__text12391522114918">MRS Spark Python</span> operator, see <a href="dataartsstudio_01_0525.html">Developing an MRS Spark Python Job</a>.</p>
</div>
<div class="section" id="dataartsstudio_01_0456__en-us_topic_0177038589_section1791764173933"><h4 class="sectiontitle">Parameters</h4><p id="dataartsstudio_01_0456__en-us_topic_0177038589_p49252448103256"><a href="#dataartsstudio_01_0456__en-us_topic_0177038589_table3764823994826">Table 1</a>, <a href="#dataartsstudio_01_0456__en-us_topic_0177038589_table7463135744918">Table 2</a>, and <a href="#dataartsstudio_01_0456__en-us_topic_0114569494_table987664914213">Table 3</a> describe the parameters of the <span id="dataartsstudio_01_0456__en-us_topic_0177038589_text681972154517">MRS Spark Python</span><span id="dataartsstudio_01_0456__en-us_topic_0177038589_text47744836161657">node</span> node.</p>
<div class="tablenoborder"><a name="dataartsstudio_01_0456__en-us_topic_0177038589_table3764823994826"></a><a name="en-us_topic_0177038589_table3764823994826"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0456__en-us_topic_0177038589_table3764823994826" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters of <span id="dataartsstudio_01_0456__en-us_topic_0177038589_text7218185917">MRS Spark Python</span> nodes</caption><thead align="left"><tr id="dataartsstudio_01_0456__en-us_topic_0177038589_row3170822394826"><th align="left" class="cellrowborder" valign="top" width="21.86%" id="mcps1.3.2.3.2.4.1.1"><p id="dataartsstudio_01_0456__en-us_topic_0177038589_p2984581994826">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="10.15%" id="mcps1.3.2.3.2.4.1.2"><p id="dataartsstudio_01_0456__en-us_topic_0177038589_p159227094826">Mandatory</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="67.99%" id="mcps1.3.2.3.2.4.1.3"><p id="dataartsstudio_01_0456__en-us_topic_0177038589_p6186505494826">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0456__en-us_topic_0177038589_row1991457694826"><td class="cellrowborder" valign="top" width="21.86%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0177038589_p246794194826">Node Name</p>
</td>
<td class="cellrowborder" valign="top" width="10.15%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0177038589_p6568554794826">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="67.99%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_0456__en-us_topic_0101095437_p1892909794826">Name of a <span id="dataartsstudio_01_0456__en-us_topic_0099822521_text44323307153939">node</span>. The name must contain 1 to 128 characters, including only letters, numbers, underscores (_), hyphens (-), slashes (/), less-than signs (&lt;), and greater-than signs (&gt;).</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__row14899113341315"><td class="cellrowborder" valign="top" width="21.86%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0456__p1989943311137">Job Name</p>
</td>
<td class="cellrowborder" valign="top" width="10.15%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_0456__p48995335138">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="67.99%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_0456__p137331636181513">MRS job name. It can contain a maximum of 64 characters. Only letters, digits, hyphens (-), and underscores (_) are allowed.</p>
<p id="dataartsstudio_01_0456__p1992286368">The system can automatically enter a job name in <em id="dataartsstudio_01_0456__en-us_topic_0181380727_i18982132012228">Job name_Node name</em> format.</p>
<div class="note" id="dataartsstudio_01_0456__note18734143641514"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0456__en-us_topic_0181380727_p4169117193320">The job name cannot contain Chinese characters or more than 64 characters. If the job name does not meet requirements, the MRS job will fail to be submitted.</p>
</div></div>
</td>
</tr>
<tr id="dataartsstudio_01_0456__row14321112101417"><td class="cellrowborder" valign="top" width="21.86%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0456__p13432161291417">Script Type</p>
</td>
<td class="cellrowborder" valign="top" width="10.15%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_0456__p13432201214148">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="67.99%" headers="mcps1.3.2.3.2.4.1.3 "><ul id="dataartsstudio_01_0456__ul1214613543149"><li id="dataartsstudio_01_0456__li01461554181414">Offline</li><li id="dataartsstudio_01_0456__li195406214157">Online</li></ul>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0177038589_row3614415394826"><td class="cellrowborder" valign="top" width="21.86%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0177038589_p4199531294826">MRS Cluster Name</p>
</td>
<td class="cellrowborder" valign="top" width="10.15%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0177038589_p4617707494826">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="67.99%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_0456__en-us_topic_0177038589_p17967492105259">Select an MRS cluster that supports Spark Python. Only a specific version of MRS supports Spark Python. Test the cluster first to ensure that it supports Spark Python.</p>
<div class="p" id="dataartsstudio_01_0456__en-us_topic_0177038589_p27489702105259">To create an MRS cluster, use either of the following methods:<ul id="dataartsstudio_01_0456__en-us_topic_0101095234_en-us_topic_0099822521_ul46080727105259"><li id="dataartsstudio_01_0456__en-us_topic_0101095234_en-us_topic_0099822521_li12073360105259">Click <span><img id="dataartsstudio_01_0456__en-us_topic_0101095234_image898618712510" src="en-us_image_0000002234245684.png"></span>. On the <span class="wintitle" id="dataartsstudio_01_0456__en-us_topic_0101095234_wintitle3126196153112"><b>Clusters</b></span> page, create an MRS cluster.</li><li id="dataartsstudio_01_0456__en-us_topic_0101095234_en-us_topic_0099822521_li24857298105259">Go to the MRS console to create an MRS cluster.</li></ul>
</div>
<p id="dataartsstudio_01_0456__p17413192942811">For details about how to create a cluster, see section "Buying a Custom Cluster" in <em id="dataartsstudio_01_0456__i135253673913">MapReduce Service (MRS) Usage Guide</em>.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__row32091220181518"><td class="cellrowborder" valign="top" width="21.86%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0456__p723317251632">MRS Resource Queue</p>
</td>
<td class="cellrowborder" valign="top" width="10.15%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_0456__p122332025839">No</p>
</td>
<td class="cellrowborder" valign="top" width="67.99%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_0456__p18226122519414">Select a created MRS resource queue.</p>
<p id="dataartsstudio_01_0456__p1536015140328">This parameter is mandatory if <a href="dataartsstudio_01_04501.html#dataartsstudio_01_04501__section146531751579">Whether MRS Resource Queue Is Mandatory</a> is set to <strong id="dataartsstudio_01_0456__en-us_topic_0181380725_b49381423121215">Yes</strong>.</p>
<div class="note" id="dataartsstudio_01_0456__note11911151517520"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0456__p1391117155519">Select a queue you configured in the queue permissions of DataArts Security. If you set multiple resource queues for this node, the resource queue you select here has the highest priority.</p>
</div></div>
</td>
</tr>
<tr id="dataartsstudio_01_0456__row174788426257"><td class="cellrowborder" valign="top" width="21.86%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0456__p3479204262511">SQL Script</p>
</td>
<td class="cellrowborder" valign="top" width="10.15%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_0456__p3479442132515">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="67.99%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_0456__p55113203616">This parameter is available only when <strong id="dataartsstudio_01_0456__b41551340163915">Script Type</strong> is set to <strong id="dataartsstudio_01_0456__b21598537392">Online</strong>.</p>
<p id="dataartsstudio_01_0456__p116975752618">Select a Spark Python script.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__row49271050112615"><td class="cellrowborder" valign="top" width="21.86%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0456__p892795032619">Script Parameter</p>
</td>
<td class="cellrowborder" valign="top" width="10.15%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_0456__p4927175012617">No</p>
</td>
<td class="cellrowborder" valign="top" width="67.99%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_0456__p11814111273614">This parameter is available only when <strong id="dataartsstudio_01_0456__b8499755104020">Script Type</strong> is set to <strong id="dataartsstudio_01_0456__b1849935544014">Online</strong>.</p>
<p id="dataartsstudio_01_0456__p9927150122611">If the associated Spark Python script uses a parameter, the parameter name is displayed. Set the parameter value in the text box next to the parameter name.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__row953131919278"><td class="cellrowborder" valign="top" width="21.86%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0456__p4534194271">Program Parameter</p>
</td>
<td class="cellrowborder" valign="top" width="10.15%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_0456__p35461915272">No</p>
</td>
<td class="cellrowborder" valign="top" width="67.99%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_0456__p108941443334">This parameter is available only when <strong id="dataartsstudio_01_0456__b2599656163918">Script Type</strong> is set to <strong id="dataartsstudio_01_0456__b7599956133910">Online</strong>.</p>
<p id="dataartsstudio_01_0456__en-us_topic_0101095437_p33849599443">Configure optimization parameters such as threads, memory, and vCPUs for the job to optimize resource usage and improve job execution performance.</p>
<div class="note" id="dataartsstudio_01_0456__en-us_topic_0101095437_note2073561518462"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0456__en-us_topic_0101095437_p1226422124616">This parameter is mandatory if the cluster version is MRS 1.8.7 or later than MRS 2.0.1.</p>
</div></div>
<p id="dataartsstudio_01_0456__p13962032134816">For details about the parameters of MRS Spark jobs, see <strong id="dataartsstudio_01_0456__b181971619133917">Managing an Existing Cluster</strong> &gt; <strong id="dataartsstudio_01_0456__b15198419123917">Job Management</strong> &gt; <strong id="dataartsstudio_01_0456__b3198131911399">Running a Spark Job</strong> in <em id="dataartsstudio_01_0456__i219831973912">MapReduce Service (MRS) User Guide</em><em id="dataartsstudio_01_0456__i181990193398"></em>.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0177038589_row1949012674611"><td class="cellrowborder" valign="top" width="21.86%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0177038589_p154913613464">Parameter</p>
</td>
<td class="cellrowborder" valign="top" width="10.15%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0177038589_p1749110664620">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="67.99%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_0456__p595672813305">This parameter is available only when <strong id="dataartsstudio_01_0456__b2875171614423">Script Type</strong> is set to <strong id="dataartsstudio_01_0456__b13876716194210">Offline</strong>.</p>
<p id="dataartsstudio_01_0456__en-us_topic_0177038589_p649136154615">Enter parameters. Press <strong id="dataartsstudio_01_0456__b87811039134310">Enter</strong> between parameters.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__row1914551710166"><td class="cellrowborder" valign="top" width="21.86%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0456__p7146917111612">Execution Program Parameter</p>
</td>
<td class="cellrowborder" valign="top" width="10.15%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_0456__p13146417121616">No</p>
</td>
<td class="cellrowborder" valign="top" width="67.99%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_0456__p1697151152911">Enter parameters of the MRS execution program.</p>
<p id="dataartsstudio_01_0456__p32891244174">Use spaces to separate parameters. To prevent parameters from being saved as plaintext, add an at sign (@) before parameters.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0177038589_row10153101910469"><td class="cellrowborder" valign="top" width="21.86%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0177038589_p101533199468">Attribute</p>
</td>
<td class="cellrowborder" valign="top" width="10.15%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0177038589_p10153519154612">No</p>
</td>
<td class="cellrowborder" valign="top" width="67.99%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_0456__en-us_topic_0177038589_p91531719134620">Enter parameters in the key=value format. Use <strong id="dataartsstudio_01_0456__en-us_topic_0177038589_b115737518203">Enter</strong> to separate multiple parameters.</p>
</td>
</tr>
</tbody>
</table>
</div>
<div class="tablenoborder"><a name="dataartsstudio_01_0456__en-us_topic_0177038589_table7463135744918"></a><a name="en-us_topic_0177038589_table7463135744918"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0456__en-us_topic_0177038589_table7463135744918" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Advanced parameters</caption><thead align="left"><tr id="dataartsstudio_01_0456__en-us_topic_0099822521_row9846111555118"><th align="left" class="cellrowborder" valign="top" width="28.07%" id="mcps1.3.2.4.2.4.1.1"><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p2846515195115">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="15.659999999999998%" id="mcps1.3.2.4.2.4.1.2"><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p108461215185110">Mandatory</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="56.269999999999996%" id="mcps1.3.2.4.2.4.1.3"><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p1484719153511">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0456__en-us_topic_0099822521_row18847141515512"><td class="cellrowborder" valign="top" width="28.07%" headers="mcps1.3.2.4.2.4.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p2847181535113">Max. Node Execution Duration</p>
</td>
<td class="cellrowborder" valign="top" width="15.659999999999998%" headers="mcps1.3.2.4.2.4.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p15847171511512">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="56.269999999999996%" headers="mcps1.3.2.4.2.4.1.3 "><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p1884761565119">Execution timeout interval for the <span id="dataartsstudio_01_0456__en-us_topic_0099822521_text1344611820218">node</span>. If retry is configured and the execution is not complete within the timeout interval, the <span id="dataartsstudio_01_0456__en-us_topic_0099822521_text8447488212">node</span> will be executed again.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0099822521_row19847181555112"><td class="cellrowborder" valign="top" width="28.07%" headers="mcps1.3.2.4.2.4.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p12847815125117">Retry upon Failure</p>
</td>
<td class="cellrowborder" valign="top" width="15.659999999999998%" headers="mcps1.3.2.4.2.4.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p8847161516511">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="56.269999999999996%" headers="mcps1.3.2.4.2.4.1.3 "><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p684761514516">Whether to re-execute a <span id="dataartsstudio_01_0456__en-us_topic_0099822521_text68471415185118">node</span> if it fails to be executed. Possible values:</p>
<ul id="dataartsstudio_01_0456__en-us_topic_0099822521_ul18479151514"><li id="dataartsstudio_01_0456__en-us_topic_0099822521_li148481915205115"><strong id="dataartsstudio_01_0456__en-us_topic_0099822521_b692668954">Yes</strong>: The <span id="dataartsstudio_01_0456__en-us_topic_0099822521_text184861512517">node</span> will be re-executed, and the following parameters must be configured:<ul id="dataartsstudio_01_0456__en-us_topic_0099822521_ul284811151511"><li id="dataartsstudio_01_0456__en-us_topic_0099822521_li1927319416429"><strong id="dataartsstudio_01_0456__en-us_topic_0099822521_b11288652181717">Retry upon Timeout</strong></li><li id="dataartsstudio_01_0456__en-us_topic_0099822521_li1584811515119"><strong id="dataartsstudio_01_0456__en-us_topic_0099822521_b1150205942">Maximum Retries</strong></li><li id="dataartsstudio_01_0456__en-us_topic_0099822521_li1184841512511"><strong id="dataartsstudio_01_0456__en-us_topic_0099822521_b910983280">Retry Interval (seconds)</strong></li></ul>
</li><li id="dataartsstudio_01_0456__en-us_topic_0099822521_li1884851535115"><strong id="dataartsstudio_01_0456__en-us_topic_0099822521_b8133175784614">No</strong>: The <span id="dataartsstudio_01_0456__en-us_topic_0099822521_text5848215145116">node</span> will not be re-executed. This is the default setting.<div class="note" id="dataartsstudio_01_0456__en-us_topic_0099822521_note112261354122511"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p1722635418254">If retry is configured for a job node and the timeout duration is configured, the system allows you to retry a node when the node execution times out.</p>
<p id="dataartsstudio_01_0456__en-us_topic_0099822521_p1690217201682">If a node is not re-executed when it fails upon timeout, you can go to the <strong id="dataartsstudio_01_0456__en-us_topic_0099822521_b14924182735216">Default Configuration</strong> page to modify this policy.</p>
<p id="dataartsstudio_01_0456__en-us_topic_0099822521_p979555414426"><strong id="dataartsstudio_01_0456__en-us_topic_0099822521_b11436145811174">Retry upon Timeout</strong> is displayed only when <strong id="dataartsstudio_01_0456__en-us_topic_0099822521_b64361558201713">Retry upon Failure</strong> is set to <strong id="dataartsstudio_01_0456__en-us_topic_0099822521_b34366589176">Yes</strong>.</p>
</div></div>
</li></ul>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0099822521_row148481015115110"><td class="cellrowborder" valign="top" width="28.07%" headers="mcps1.3.2.4.2.4.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p168481315165110">Policy for Handling Subsequent Nodes If the Current Node Fails</p>
</td>
<td class="cellrowborder" valign="top" width="15.659999999999998%" headers="mcps1.3.2.4.2.4.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p7848181515114">Yes</p>
</td>
<td class="cellrowborder" valign="top" width="56.269999999999996%" headers="mcps1.3.2.4.2.4.1.3 "><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p1848915165110">Operation that will be performed if the <span id="dataartsstudio_01_0456__en-us_topic_0099822521_text184871517513">node</span> fails to be executed. Possible values:</p>
<ul id="dataartsstudio_01_0456__en-us_topic_0099822521_ul684811155518"><li id="dataartsstudio_01_0456__en-us_topic_0099822521_en-us_topic_0099822521_li867222192212"><strong id="dataartsstudio_01_0456__en-us_topic_0099822521_en-us_topic_0099822521_b63511334183">Suspend execution plans of the subsequent nodes</strong>: stops running subsequent nodes. The job instance status is <strong id="dataartsstudio_01_0456__en-us_topic_0099822521_en-us_topic_0099822521_b635117371819">Failed</strong>.</li><li id="dataartsstudio_01_0456__en-us_topic_0099822521_en-us_topic_0099822521_li2533844102858"><strong id="dataartsstudio_01_0456__en-us_topic_0099822521_en-us_topic_0099822521_b31833716587">End the current job execution plan</strong>: stops running the current job. The job instance status is <strong id="dataartsstudio_01_0456__en-us_topic_0099822521_en-us_topic_0099822521_b1521193765820">Failed</strong>.</li><li id="dataartsstudio_01_0456__en-us_topic_0099822521_en-us_topic_0099822521_li22804597102858"><strong id="dataartsstudio_01_0456__en-us_topic_0099822521_en-us_topic_0099822521_b72771223151916">Go to the next node</strong>: ignores the execution failure of the current node. The job instance status is <strong id="dataartsstudio_01_0456__en-us_topic_0099822521_en-us_topic_0099822521_b1727710236199">Failure ignored</strong>.</li><li id="dataartsstudio_01_0456__en-us_topic_0099822521_en-us_topic_0099822521_li1657745411173"><strong id="dataartsstudio_01_0456__en-us_topic_0099822521_en-us_topic_0099822521_b99581526191817">Suspend the current job execution plan</strong>: If the current job instance is in abnormal state, the subsequent nodes of this node and the subsequent job instances that depend on the current job are in waiting state.</li></ul>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0099822521_row443311414209"><td class="cellrowborder" valign="top" width="28.07%" headers="mcps1.3.2.4.2.4.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p6433154115208">Enable Dry Run</p>
</td>
<td class="cellrowborder" valign="top" width="15.659999999999998%" headers="mcps1.3.2.4.2.4.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p134343417207">No</p>
</td>
<td class="cellrowborder" valign="top" width="56.269999999999996%" headers="mcps1.3.2.4.2.4.1.3 "><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p9477175317207">If you select this option, the node will not be executed, and a success message will be returned.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0099822521_row127470182515"><td class="cellrowborder" valign="top" width="28.07%" headers="mcps1.3.2.4.2.4.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p1027414042510">Task Groups</p>
</td>
<td class="cellrowborder" valign="top" width="15.659999999999998%" headers="mcps1.3.2.4.2.4.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p1827419013254">No</p>
</td>
<td class="cellrowborder" valign="top" width="56.269999999999996%" headers="mcps1.3.2.4.2.4.1.3 "><p id="dataartsstudio_01_0456__en-us_topic_0099822521_p4881175711254">Select a task group. If you select a task group, you can control the maximum number of concurrent nodes in the task group in a fine-grained manner in scenarios where a job contains multiple nodes, a data patching task is ongoing, or a job is rerunning.</p>
</td>
</tr>
</tbody>
</table>
</div>
<div class="tablenoborder"><a name="dataartsstudio_01_0456__en-us_topic_0114569494_table987664914213"></a><a name="en-us_topic_0114569494_table987664914213"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0456__en-us_topic_0114569494_table987664914213" frame="border" border="1" rules="all"><caption><b>Table 3 </b>Lineage</caption><thead align="left"><tr id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_row645819861410"><th align="left" class="cellrowborder" valign="top" width="24.88%" id="mcps1.3.2.5.2.3.1.1"><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p10458988144">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="75.12%" id="mcps1.3.2.5.2.3.1.2"><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p15458168131416">Description</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_row1845888161417"><td class="cellrowborder" colspan="2" valign="top" headers="mcps1.3.2.5.2.3.1.1 mcps1.3.2.5.2.3.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p18915103311157"><strong id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_b84235270610534">Input</strong></p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_row3459178131420"><td class="cellrowborder" valign="top" width="24.88%" headers="mcps1.3.2.5.2.3.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p187842189163">Add</p>
</td>
<td class="cellrowborder" valign="top" width="75.12%" headers="mcps1.3.2.5.2.3.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p18780151816168">Click <span class="uicontrol" id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_uicontrol10540132714159"><b>Add</b></span>. In the <span class="parmname" id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_parmname618004413147"><b>Type</b></span> drop-down list, select the type to be created. The value can be <strong id="dataartsstudio_01_0456__en-us_topic_0181380515_b1428175313178">DWS</strong>, <strong id="dataartsstudio_01_0456__en-us_topic_0181380515_b16281153191719">OBS</strong>, <strong id="dataartsstudio_01_0456__en-us_topic_0181380515_b8285537176">CSS</strong>, <strong id="dataartsstudio_01_0456__en-us_topic_0181380515_b4291953171713">HIVE</strong>, <strong id="dataartsstudio_01_0456__en-us_topic_0181380515_b152955318176">DLI</strong>, or <strong id="dataartsstudio_01_0456__en-us_topic_0181380515_b20291153191720">CUSTOM</strong>.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_row199741336132219"><td class="cellrowborder" valign="top" width="24.88%" headers="mcps1.3.2.5.2.3.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p1749815291215">OK</p>
</td>
<td class="cellrowborder" valign="top" width="75.12%" headers="mcps1.3.2.5.2.3.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p849611210129">Click <span class="uicontrol" id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_uicontrol933415249182"><b>OK</b></span> to save the parameter settings.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_row18429125472217"><td class="cellrowborder" valign="top" width="24.88%" headers="mcps1.3.2.5.2.3.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p54958220127">Cancel</p>
</td>
<td class="cellrowborder" valign="top" width="75.12%" headers="mcps1.3.2.5.2.3.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p249314216120">Click <span class="uicontrol" id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_uicontrol622928195712"><b>Cancel</b></span> to cancel the parameter settings.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_row893175852218"><td class="cellrowborder" valign="top" width="24.88%" headers="mcps1.3.2.5.2.3.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p7490112151211">Modify</p>
</td>
<td class="cellrowborder" valign="top" width="75.12%" headers="mcps1.3.2.5.2.3.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p5489152101216">Click <span><img id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_image17798910112517" src="en-us_image_0000002269198773.png"></span> to modify the parameter settings. After the modification, save the settings.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_row193125810225"><td class="cellrowborder" valign="top" width="24.88%" headers="mcps1.3.2.5.2.3.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p84888215126">Delete</p>
</td>
<td class="cellrowborder" valign="top" width="75.12%" headers="mcps1.3.2.5.2.3.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p9486721124">Click <span><img id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_image3622107287" src="en-us_image_0000002269198765.png"></span> to delete the parameter settings.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_row4275174312218"><td class="cellrowborder" valign="top" width="24.88%" headers="mcps1.3.2.5.2.3.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p19276543122219">View Details</p>
</td>
<td class="cellrowborder" valign="top" width="75.12%" headers="mcps1.3.2.5.2.3.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p132769436229">Click <span><img id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_image293616596236" src="en-us_image_0000002234079480.png"></span> to view details about the table created based on the input lineage.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_row293114586229"><td class="cellrowborder" colspan="2" valign="top" headers="mcps1.3.2.5.2.3.1.1 mcps1.3.2.5.2.3.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p1538144016336"><strong id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_b842352706105213">Output</strong></p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_row5430165412220"><td class="cellrowborder" valign="top" width="24.88%" headers="mcps1.3.2.5.2.3.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p93819401331">Add</p>
</td>
<td class="cellrowborder" valign="top" width="75.12%" headers="mcps1.3.2.5.2.3.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p103824018333">Click <span class="uicontrol" id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_uicontrol0610144565819"><b>Add</b></span>. In the <span class="parmname" id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_parmname1261113455588"><b>Type</b></span> drop-down list, select the type to be created. The value can be <strong id="dataartsstudio_01_0456__en-us_topic_0181380515_b17565442161816">DWS</strong>, <strong id="dataartsstudio_01_0456__en-us_topic_0181380515_b7565104221818">OBS</strong>, <strong id="dataartsstudio_01_0456__en-us_topic_0181380515_b165661642161810">CSS</strong>, <strong id="dataartsstudio_01_0456__en-us_topic_0181380515_b15676426181">HIVE</strong>, <strong id="dataartsstudio_01_0456__en-us_topic_0181380515_b1456734211820">DLI</strong>, or <strong id="dataartsstudio_01_0456__en-us_topic_0181380515_b14568342161813">CUSTOM</strong>.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_row8430175416224"><td class="cellrowborder" valign="top" width="24.88%" headers="mcps1.3.2.5.2.3.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p1401840133315">OK</p>
</td>
<td class="cellrowborder" valign="top" width="75.12%" headers="mcps1.3.2.5.2.3.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p84014033318">Click <span class="uicontrol" id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_uicontrol1526514115119"><b>OK</b></span> to save the parameter settings.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_row33901521246"><td class="cellrowborder" valign="top" width="24.88%" headers="mcps1.3.2.5.2.3.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p74094020337">Cancel</p>
</td>
<td class="cellrowborder" valign="top" width="75.12%" headers="mcps1.3.2.5.2.3.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p1940184016333">Click <span class="uicontrol" id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_uicontrol1483816469110"><b>Cancel</b></span> to cancel the parameter settings.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_row1919619151644"><td class="cellrowborder" valign="top" width="24.88%" headers="mcps1.3.2.5.2.3.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p144013406339">Modify</p>
</td>
<td class="cellrowborder" valign="top" width="75.12%" headers="mcps1.3.2.5.2.3.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p11401040133312">Click <span><img id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_image1640124083311" src="en-us_image_0000002269118737.png"></span> to modify the parameter settings. After the modification, save the settings.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_row1891511181842"><td class="cellrowborder" valign="top" width="24.88%" headers="mcps1.3.2.5.2.3.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p9401340173318">Delete</p>
</td>
<td class="cellrowborder" valign="top" width="75.12%" headers="mcps1.3.2.5.2.3.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p17404746103416">Click <span><img id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_image14409406336" src="en-us_image_0000002269198821.png"></span> to delete the parameter settings.</p>
</td>
</tr>
<tr id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_row166741601271"><td class="cellrowborder" valign="top" width="24.88%" headers="mcps1.3.2.5.2.3.1.1 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p176123142711">View Details</p>
</td>
<td class="cellrowborder" valign="top" width="75.12%" headers="mcps1.3.2.5.2.3.1.2 "><p id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_p14771737274">Click <span><img id="dataartsstudio_01_0456__en-us_topic_0181380515_en-us_topic_0101095232_image197793102717" src="en-us_image_0000002269118733.png"></span> to view details about the table created based on the output lineage.</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0441.html">Node Reference</a></div>
</div>
</div>
View Git Blame Copy Permalink