yexinru/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
Files
a41a4e0331fbc0beff63bb28fa59228cc9a751df
doc-exports/docs/dataartsstudio/umn/dataartsstudio_01_04501.html
chenxiaoxiong f9e2808b7c DataArts UMN 20250810 version 
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Co-authored-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
Co-committed-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
2025-09-02 10:44:13 +00:00

397 lines
90 KiB
HTML
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

<a name="dataartsstudio_01_04501"></a><a name="dataartsstudio_01_04501"></a>
<h1 class="topictitle1">Configuring a Default Item</h1>
<div id="body0000001175218135"><p id="dataartsstudio_01_04501__en-us_topic_0175328117_p1033132923012">This section describes how to configure a default item. You can perform the operations in this section only if you have the permissions of <strong id="dataartsstudio_01_04501__b861633711718"><span id="dataartsstudio_01_04501__text10615153751710">DARTS</span></strong> <strong id="dataartsstudio_01_04501__b2616337201713">Administrator</strong> or <strong id="dataartsstudio_01_04501__b13616183716176">Tenant Administrator</strong>.</p>
<div class="section" id="dataartsstudio_01_04501__section1029718195210"><h4 class="sectiontitle">Scenario</h4><p id="dataartsstudio_01_04501__p145803617521">If a parameter is invoked by multiple jobs, you can use this parameter as the default configuration item. In this way, you do not need to set this parameter for each job.</p>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_04501__table1391281184114" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Configuration items</caption><thead align="left"><tr id="dataartsstudio_01_04501__row179127113415"><th align="left" class="cellrowborder" valign="top" width="27.03270327032703%" id="mcps1.3.2.3.2.4.1.1"><p id="dataartsstudio_01_04501__p8912191114114">Configuration Item</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="23.162316231623162%" id="mcps1.3.2.3.2.4.1.2"><p id="dataartsstudio_01_04501__p391341119411">Affected Module</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="49.80498049804981%" id="mcps1.3.2.3.2.4.1.3"><p id="dataartsstudio_01_04501__p19913191104117">Main Usage</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_04501__row12913311104114"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p6913161124113"><a href="#dataartsstudio_01_04501__section758614222215">Periodic Scheduling</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p89138117417">Job scheduling</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><ul id="dataartsstudio_01_04501__ul11166145175712"><li id="dataartsstudio_01_04501__li171661151165719">Default action on the <strong id="dataartsstudio_01_04501__b81510361874">current job</strong> when the job it depends on fails</li></ul>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row19913151164110"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p89134116416"><a href="#dataartsstudio_01_04501__section1105620164415">Multi-IF Policy</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p13913111184112">Job scheduling</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p2913191114120">Policy for executing nodes with multiple IF conditions</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row1091312114413"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p49135113416"><a href="#dataartsstudio_01_04501__section140018355442">Hard and Soft Lock Policy</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p119131011204115">Script/Job development</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p19131711194115">Policy for grabbing the lock of a job or script</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row191311119415"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p32591120122"><a href="#dataartsstudio_01_04501__section310213518565">Script Variable Definition</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p3808174114217">Script development</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p17913191111414">Format definition of script variables. Two formats are available: ${} and ${dlf.}.</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row391331112412"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p29172062036"><a href="#dataartsstudio_01_04501__section1970845152011">Data Export Policy</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p819715251930">Script/Job development</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p14913211114112">Policy for downloading or dumping the SQL execution result</p>
<ul id="dataartsstudio_01_04501__ul75711201945"><li id="dataartsstudio_01_04501__li057320649">All users</li><li id="dataartsstudio_01_04501__li155742013414">No user</li><li id="dataartsstudio_01_04501__li1957820742">Only workspace administrator</li></ul>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row39136119418"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p941419295417"><a href="#dataartsstudio_01_04501__section67661828112219">Disable Auto Node Name Change</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p791321194111">Job Development</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p1191311113415">When a node in a DataArts Studio job is associated with a script or a job of another service, the node name does not change accordingly.</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row2091361112416"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p35510311354"><a href="#dataartsstudio_01_04501__section12475339019">Use Simple Variable Set</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p159141511134119">Job development</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p1791461117419">A simple variable set provides a series of custom variables that automatically replace parameters during job scheduling.</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row891411154117"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p916620571266"><a href="#dataartsstudio_01_04501__section201662581464">Notification Policy for Jobs in Failure Ignored Status</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p7914181112412">O&amp;M and scheduling</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p1791415111411">Notification type for jobs whose status is failure ignored</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row169141811174111"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p10521425122216"><a href="#dataartsstudio_01_04501__section687113915618">Retry Node upon Timeout</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p9914131116412">Job execution</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p16262175118225">Whether a node will be re-executed if it fails upon timeout</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row291481164115"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p16671121815243"><a href="#dataartsstudio_01_04501__section14959925164217">Exclude Waiting Time from Instance Timeout Duration</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p291451118415">Job execution</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p891421113417">If you select <strong id="dataartsstudio_01_04501__b20622171522210">Yes</strong>, the waiting time before an instance starts running is excluded from the instance timeout duration.</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row79142011184118"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p1148316016251"><a href="#dataartsstudio_01_04501__section105211772476">Rules for Splitting MRS JAR Package Parameters</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p129141811104119">Job development</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p5914131134111">Rules for splitting string parameters (parameters enclosed by "") in the JAR packages of MRS MapReduce and MRS Spark operators</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row4914201110410"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p697111302615"><a href="#dataartsstudio_01_04501__section2986254123414">Synchronization of Job Version by Waiting Instance</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p159151911164110">O&amp;M and scheduling</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p11915151110416">Whether a waiting instance synchronizes the latest job version when it runs</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row15915131111419"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p18828472271"><a href="#dataartsstudio_01_04501__section1545212478426">Execution Mode for Hive SQL and Spark SQL Statements</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p2941177102816">Script/Job development</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><ul id="dataartsstudio_01_04501__ul158116141218"><li id="dataartsstudio_01_04501__li1181216142114"><strong id="dataartsstudio_01_04501__b1770859122510">In OBS</strong>: The OBS path is returned to MRS.</li><li id="dataartsstudio_01_04501__li48122147113"><strong id="dataartsstudio_01_04501__b11902182482519">In the request message body</strong>: The script content is returned to MRS.</li></ul>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row1691541119412"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p1760972553011"><a href="#dataartsstudio_01_04501__section146531751579">Whether MRS Resource Queue Is Mandatory</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p1915161116415">Job development</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p16915911114117">If you select <strong id="dataartsstudio_01_04501__b17215132817268">Yes</strong>, parameter <strong id="dataartsstudio_01_04501__b1010120435267">MRS Resource Queue</strong> is mandatory.</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row39154113418"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p1964313273313"><a href="#dataartsstudio_01_04501__section1149418391843">PatchData Job Priority</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p091631164117">O&amp;M – PatchData</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p18916151119416">Priority of a PatchData job. If system resources are insufficient, computing resources are preferentially allocated to jobs with higher priorities. A larger value indicates a higher priority. Priorities can be set only for DLI SQL operators.</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row8916111104118"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p17636127453"><a href="#dataartsstudio_01_04501__section10606125173916">Historical Job Instance Cancellation Policy</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p39168114418">O&amp;M and scheduling</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p591613110411">Days to wait before job instances are canceled. If the wait time of a job instance exceeds the value of this parameter, the instance will be canceled. The minimum value is 2, that is, a job instance can be canceled only after two days. The default value is <strong id="dataartsstudio_01_04501__b18843105220299">60</strong> days.</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row10916161116414"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p111361330124619"><a href="#dataartsstudio_01_04501__section166989301817">Historical Job Instance Alarm Policy</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p1591651184113">O&amp;M and scheduling</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p1916311134118">Days in which alarms can be reported for job instances.</p>
<p id="dataartsstudio_01_04501__p19711924114718">The default value is <strong id="dataartsstudio_01_04501__b5806123311309">7</strong>, that is, alarms can be reported for the job instances created within the last seven days, but not for those created before that.</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row10916101154114"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p47728336308"><a href="#dataartsstudio_01_04501__section1048217439191">Default Retry Policy upon Job Operator Failure</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p1091618111415">O&amp;M and scheduling</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p15916111144113">Default policy for retrying a failed job operator</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row99161311164116"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p11374151613315"><a href="#dataartsstudio_01_04501__section132101959182118">Generate Alarm Upon Job Retry Failure</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p791614113419">O&amp;M and scheduling</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p637417259339">If you select <strong id="dataartsstudio_01_04501__b8578140153219">All jobs</strong>, <strong id="dataartsstudio_01_04501__b1557910405321">Real-time jobs</strong>, or <strong id="dataartsstudio_01_04501__b857924023213">Batch jobs</strong>, an alarm is generated each time a job fails to be retried.</p>
<p id="dataartsstudio_01_04501__p12374725173310">If you select <strong id="dataartsstudio_01_04501__b1283174633210">Disable</strong>, an alarm is generated only when the maximum number of retries has been reached for the job.</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row091631124115"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p19759165715333"><a href="#dataartsstudio_01_04501__section5197124710613">Automatic Script Name Transfer During Job Execution</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p71937122357">Job development (job execution)</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p18917211134112">If this function is enabled, set mapreduce.job.name=Script name of the Hive SQL script is automatically transferred to MRS during job execution in the current workspace.</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row230374810535"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p43031248185317"><a href="#dataartsstudio_01_04501__section45021415123915">Job Dependency Rule</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p12303648175316">Job scheduling</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p1830344815538">Jobs can be depended on by jobs in other workspaces (requires the permission to query the job list in the workspace). All default roles in the workspace have this permission. Custom roles must have the job query permission in DataArts Factory.</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row14917121115417"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p128801331143514"><a href="#dataartsstudio_01_04501__section7536359192017">Script Execution History</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p3782226193610">Script/Job development</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p7306646143517">Which script execution results are displayed</p>
<ul id="dataartsstudio_01_04501__ul148064406211"><li id="dataartsstudio_01_04501__li48068400216"><strong id="dataartsstudio_01_04501__b629013225379">Myself</strong>: The script execution history for only myself is displayed.</li><li id="dataartsstudio_01_04501__li10806240827"><strong id="dataartsstudio_01_04501__b193841935133717">All users</strong>: The script execution history for all users is displayed.</li></ul>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row13917111164113"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p17327142163610"><a href="#dataartsstudio_01_04501__section83901219181110">Identity for Job Tests</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p199171711174114">Job development (job test)</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p12418103114376">Identity for testing jobs.</p>
<ul id="dataartsstudio_01_04501__ul163381455183715"><li id="dataartsstudio_01_04501__li833975523714"><strong id="dataartsstudio_01_04501__b85241621173814">Public agency or IAM account</strong>: A public agency or IAM account is used to execute jobs.</li><li id="dataartsstudio_01_04501__li16339755123713"><strong id="dataartsstudio_01_04501__b1232642453818">Personal account</strong>: The user who clicks <strong id="dataartsstudio_01_04501__b1632615246382">Test</strong> is used to execute jobs.</li></ul>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row1291716115413"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p1611219488361"><a href="#dataartsstudio_01_04501__section977293342312">SparkSqlJob/Script Default Template Configuration</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p179171811194119">Spark SQL script/job development</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p3917141112411">Whether any parameters can be set for Spark SQL jobs and scripts</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row091711111415"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p1962155313364"><a href="#dataartsstudio_01_04501__section20499113582315">HiveSqlJob/Script Default Template Configuration</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p16917121117412">Spark SQL script/job development</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p1091721144114">Whether any parameters can be set for Hive SQL jobs and scripts</p>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row19917131118414"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p1816795913365"><a href="#dataartsstudio_01_04501__section375164516215">Job/Script Change Management</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p199171411104116">Job/Script import and export</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p12681927154013">Whether to enable job/script change management for the workspace</p>
<ul id="dataartsstudio_01_04501__ul186501456114014"><li id="dataartsstudio_01_04501__li7650156114019"><strong id="dataartsstudio_01_04501__b198991164451">Yes</strong>: Events are recorded for job and script changes. All the changed jobs and scripts can be incrementally exported and imported by time.</li><li id="dataartsstudio_01_04501__li16509568407"><strong id="dataartsstudio_01_04501__b1048114204458">No</strong>: No events are recorded for job and script changes. Only selected jobs and scripts can be exported and imported.</li></ul>
</td>
</tr>
<tr id="dataartsstudio_01_04501__row193731814172120"><td class="cellrowborder" valign="top" width="27.03270327032703%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_04501__p1441011515211"><a href="#dataartsstudio_01_04501__section108941170226">Log Open Mode</a></p>
</td>
<td class="cellrowborder" valign="top" width="23.162316231623162%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_04501__p1437316141218">Viewing logs</p>
</td>
<td class="cellrowborder" valign="top" width="49.80498049804981%" headers="mcps1.3.2.3.2.4.1.3 "><p id="dataartsstudio_01_04501__p103736148218">Whether to open logs on a new tab or in a pop-up window</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div class="section" id="dataartsstudio_01_04501__section758614222215"><a name="dataartsstudio_01_04501__section758614222215"></a><a name="section758614222215"></a><h4 class="sectiontitle">Configuring Periodic Scheduling</h4><ul id="dataartsstudio_01_04501__ul57961315474"><li id="dataartsstudio_01_04501__li57969151377">To configure the default action on the <strong id="dataartsstudio_01_04501__b3784141262815">current job</strong> when the job it depends on fails, perform the following operations:<ol id="dataartsstudio_01_04501__ol1373716362718"><li id="dataartsstudio_01_04501__li451212492718">In the left navigation pane on the DataArts Factory console, choose <strong id="dataartsstudio_01_04501__b1343191762712">Configuration</strong> &gt; <strong id="dataartsstudio_01_04501__b14314176279">Configure</strong>.</li><li id="dataartsstudio_01_04501__li651264918714">Choose <strong id="dataartsstudio_01_04501__b194411723102719">Default Configuration</strong>.<div class="note" id="dataartsstudio_01_04501__note1851234912711"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_04501__p15512549573">Three options are available. The default value is <strong id="dataartsstudio_01_04501__b720914255271">Terminate</strong>.</p>
<ul id="dataartsstudio_01_04501__ul12512134913712"><li id="dataartsstudio_01_04501__li16512164914712"><strong id="dataartsstudio_01_04501__b01571819162814">Suspend</strong>: The current job is suspended.</li><li id="dataartsstudio_01_04501__li151211494712"><strong id="dataartsstudio_01_04501__b5173171313487">Continue</strong>: The current job continues to be executed.</li><li id="dataartsstudio_01_04501__li13512349079"><strong id="dataartsstudio_01_04501__b2125907778101945">Cancel</strong>: The current job is canceled.</li></ul>
</div></div>
</li><li id="dataartsstudio_01_04501__li351213491074">Click <strong id="dataartsstudio_01_04501__b1750291512499">Save</strong> to save the settings. This parameter takes effect only for new jobs.</li></ol>
</li></ul>
</div>
<div class="section" id="dataartsstudio_01_04501__section1105620164415"><a name="dataartsstudio_01_04501__section1105620164415"></a><a name="section1105620164415"></a><h4 class="sectiontitle">Configuring the Multi-IF Policy</h4><p id="dataartsstudio_01_04501__p1567605313">To configure the policy for executing nodes with multiple IF conditions, perform the following operations:</p>
<ol id="dataartsstudio_01_04501__ol1210582010442"><li id="dataartsstudio_01_04501__li1910572017448"><span>In the navigation pane, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade4951131954411"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol8950101974413">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol11951141910443">Specifications</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li14105142019443"><span>Choose <strong id="dataartsstudio_01_04501__b071772413382">Default Configuration</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note4105720114415"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_04501__p1610692011446">The following two options are available:</p>
<ul id="dataartsstudio_01_04501__ul1106122014417"><li id="dataartsstudio_01_04501__li2010614203441"><strong id="dataartsstudio_01_04501__b9878155372218">OR</strong>: Nodes are executed if an IF condition is met.</li><li id="dataartsstudio_01_04501__li3106420184416"><strong id="dataartsstudio_01_04501__b64221543132313">AND</strong>: Nodes are executed if all IF conditions are met.</li></ul>
<p id="dataartsstudio_01_04501__p854113551218">For details, see <a href="dataartsstudio_01_0583.html#dataartsstudio_01_0583__section1626375417376">Configuring the Policy for Executing a Node with Multiple IF Statements</a>.</p>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li101061120194411"><span>Click <strong id="dataartsstudio_01_04501__b723596919">Save</strong> to save the settings.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section140018355442"><a name="dataartsstudio_01_04501__section140018355442"></a><a name="section140018355442"></a><h4 class="sectiontitle">Configuring the Hard and Soft Lock Policy</h4><p id="dataartsstudio_01_04501__p13447867510">The policy determines how you can grab the lock of a job or script. If you use a soft lock, you can grab the lock of a job or script regardless of whether you have the lock. If you use a hard lock, you can only unlock or grab the lock of a job or script for which you have the lock. Operations such as publish, execution, and scheduling are not restricted by locks.</p>
<p id="dataartsstudio_01_04501__p331712319494">You can configure the hard/soft policy based on your needs.</p>
<ol id="dataartsstudio_01_04501__ol1540018354445"><li id="dataartsstudio_01_04501__li114011135104415"><span>In the navigation pane, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade1502622402"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol1608391996">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol502303408">Specifications</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li1240117354441"><span>Choose <strong id="dataartsstudio_01_04501__b18863131183813">Default Configuration</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note16401153510448"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_04501__p16401135184414">The default policy is <strong id="dataartsstudio_01_04501__b31463520404">Soft Lock</strong>.</p>
<ul id="dataartsstudio_01_04501__ul54011735174417"><li id="dataartsstudio_01_04501__li13401735154412"><strong id="dataartsstudio_01_04501__b186392596404">Soft lock</strong>: You can lock or unlock jobs or scripts, regardless of whether they are locked by others.</li><li id="dataartsstudio_01_04501__li1640123513449"><strong id="dataartsstudio_01_04501__b7449724131712">Hard Lock</strong>: You can lock jobs or scripts only after they have been unlocked by other users. The space administrator and the <span id="dataartsstudio_01_04501__text444914249176">DARTS</span> Administrator user can lock and unlock jobs or scripts without any limitations.</li></ul>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li24012352440"><span>Click <strong id="dataartsstudio_01_04501__b688819412">Save</strong> to save the settings.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section310213518565"><a name="dataartsstudio_01_04501__section310213518565"></a><a name="section310213518565"></a><h4 class="sectiontitle">Configuring Script Variables</h4><p id="dataartsstudio_01_04501__p1163575314566">Variables of an SQL script can be in ${} or ${dlf.} format. You can configure either type as needed. The configured variable format applies to SQL scripts, SQL statements in jobs, single-node jobs, and environment variables.</p>
<ol id="dataartsstudio_01_04501__ol8505171712582"><li id="dataartsstudio_01_04501__li1250661715810"><span>In the navigation pane, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade19185048296"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol171843410297">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol7184124142911">Configure</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li157774795814"><span>Click <strong id="dataartsstudio_01_04501__b710211481313">Default Configuration</strong> and set <strong id="dataartsstudio_01_04501__b205775614324">Script Variable Definition</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note85061417105815"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_04501__p450691719581">The default variable format is <strong id="dataartsstudio_01_04501__b08731234329">${}</strong>.</p>
<ul id="dataartsstudio_01_04501__ul11506717185810"><li id="dataartsstudio_01_04501__li5506617195813"><strong id="dataartsstudio_01_04501__b1783435323315">${}</strong>: Identify the definition of the ${} format in the script and parse the field as the variable name. For example, variable name <em id="dataartsstudio_01_04501__i16519194916356">xxx</em> is identified from <strong id="dataartsstudio_01_04501__b69365573359">${</strong><em id="dataartsstudio_01_04501__i147201959143518">xxx</em><strong id="dataartsstudio_01_04501__b64242183613">}</strong>.</li><li id="dataartsstudio_01_04501__li146266151546"><strong id="dataartsstudio_01_04501__b1401751153315">${dlf.}</strong>: Identify the definition of the ${dlf.} format in the script and parse the <strong id="dataartsstudio_01_04501__b13466191811342">dlf.</strong> field as the variable name. Other ${} format definitions are not recognized as variables. For example, variable name <strong id="dataartsstudio_01_04501__b36191915203516">dlf.</strong><em id="dataartsstudio_01_04501__i16961817133515">xxx</em> is identified from <strong id="dataartsstudio_01_04501__b10603163719354">${dlf.</strong><em id="dataartsstudio_01_04501__i944063913512">xxx</em><strong id="dataartsstudio_01_04501__b15624163316354">}</strong>.</li></ul>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li75061017145818"><span>Click <strong id="dataartsstudio_01_04501__b1173885283816">Save</strong> to save the settings.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section1970845152011"><a name="dataartsstudio_01_04501__section1970845152011"></a><a name="section1970845152011"></a><h4 class="sectiontitle">Configuring a Data Export Policy</h4><p id="dataartsstudio_01_04501__p1716975192116">By default, all users can download and dump the execution results of SQL scripts. If you do not want all users to have this permission, perform the following steps to configure a data export policy:</p>
<ol id="dataartsstudio_01_04501__ol4363643133112"><li id="dataartsstudio_01_04501__li1236414311318"><span>In the navigation pane, choose <strong id="dataartsstudio_01_04501__b5180557135712">Configuration</strong> &gt; <strong id="dataartsstudio_01_04501__b143315319587">Configure</strong>.</span></li><li id="dataartsstudio_01_04501__li1536514333117"><span>Choose <strong id="dataartsstudio_01_04501__b19216101219529">Default Configuration</strong> and set <strong id="dataartsstudio_01_04501__b540418473327">Data Export Policy</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note33653439312"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_04501__p193651943173114">The default data export policy is <strong id="dataartsstudio_01_04501__b1587184611586">All User Can</strong>.</p>
<ul id="dataartsstudio_01_04501__ul171621621133415"><li id="dataartsstudio_01_04501__li31623219342"><strong id="dataartsstudio_01_04501__b672785211478">All User Can</strong>: All users can download and dump SQL execution results.</li><li id="dataartsstudio_01_04501__li11162521183416"><strong id="dataartsstudio_01_04501__b14887210104811">All User Cannot</strong>: No user can download or dump SQL execution results.</li><li id="dataartsstudio_01_04501__li41621921113417"><strong id="dataartsstudio_01_04501__b109569247482">Only Workspace Manager Can</strong>: Only workspace administrators can download and dump SQL execution results.</li></ul>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li1836694393111"><span>Click <strong id="dataartsstudio_01_04501__b758864610129">Save</strong>.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section67661828112219"><a name="dataartsstudio_01_04501__section67661828112219"></a><a name="section67661828112219"></a><h4 class="sectiontitle">Disabling Auto Node Name Change</h4><p id="dataartsstudio_01_04501__p785218347221">On the <strong id="dataartsstudio_01_04501__b3972173435914">Develop Job</strong> page, when you select a script for a node or associate a node with the function of another cloud service, the node name will be automatically changed to the script name or function name. You can disable this function.</p>
<ol id="dataartsstudio_01_04501__ol192321345151219"><li id="dataartsstudio_01_04501__li623212456129"><span>In the navigation pane, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade656183816612"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol185543815610">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol95614381060">Specifications</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li92321345171213"><span>Choose <strong id="dataartsstudio_01_04501__b94011057263">Default Configuration</strong>. Find <strong id="dataartsstudio_01_04501__b38011056476">Disable Auto Node Name Change</strong> and select job nodes.</span><p><div class="note" id="dataartsstudio_01_04501__note15232845171212"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_04501__ul12325456123"><li id="dataartsstudio_01_04501__li12916608204">You can disable automatic name change for the following nodes: CDM Job, DLI SQL, DWS SQL, MRS Spark SQL, MRS Hive SQL, MRS Presto SQL, MRS HetuEngine, MRS ClickHouse, MRS Impala SQL, Shell, RDS SQL, Subjob, For Each, Doris SQL, or Python.</li><li id="dataartsstudio_01_04501__li5982657122616">No job nodes are selected by default.</li><li id="dataartsstudio_01_04501__li1950811141379">Names of the selected nodes will not be automatically changed when a script is selected or a function is associated with them.</li></ul>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li20233174591215"><span>Click <strong id="dataartsstudio_01_04501__b2703190115210">Save</strong>.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section12475339019"><a name="dataartsstudio_01_04501__section12475339019"></a><a name="section12475339019"></a><h4 class="sectiontitle">Use Simple Variable Set</h4><p id="dataartsstudio_01_04501__p0901174515116">The simple variable set provides a series of customized variables to dynamically replace parameters during task scheduling.</p>
<ol id="dataartsstudio_01_04501__ol79012451114"><li id="dataartsstudio_01_04501__li99012451112"><span>In the navigation pane on the <strong id="dataartsstudio_01_04501__b63471033710">Data Development</strong> page, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade133472016376"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol15347180193710">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol634716013379">Configure</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li885185319218"><span>Choose <strong id="dataartsstudio_01_04501__b2064141911452">Default Configuration</strong> and set <strong id="dataartsstudio_01_04501__b1487964715450">Use Simple Variable Set</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note69821229431"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_04501__ul738402721412"><li id="dataartsstudio_01_04501__li1738402710148"><strong id="dataartsstudio_01_04501__b421151304618">Yes</strong>: Simple variable sets are supported. A series of customized variables provided by the simple variable set. Customized parameters are automatically replaced with specific values based on the service date, plan time, and parameter value format of task scheduling. In this way, parameters can be dynamically replaced during task scheduling.</li><li id="dataartsstudio_01_04501__li138422719142"><strong id="dataartsstudio_01_04501__b17831151710467">No</strong>: Simple variable sets are not supported.</li></ul>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li1590154510114"><span>Click <strong id="dataartsstudio_01_04501__b140971715370">Save</strong> to save the settings.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section201662581464"><a name="dataartsstudio_01_04501__section201662581464"></a><a name="section201662581464"></a><h4 class="sectiontitle">Notification Policy for Jobs in Failure Ignored Status</h4><p id="dataartsstudio_01_04501__p181771108710">To configure the notification type for jobs whose status is failure ignored, perform the following steps:</p>
<ol id="dataartsstudio_01_04501__ol91771301970"><li id="dataartsstudio_01_04501__li1917740277"><span>In the navigation pane on the <strong id="dataartsstudio_01_04501__b1723545712101">Data Development</strong> page, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade717475794517"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol111731057184510">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol417325714452">Configure</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li693019712132"><span>Choose <strong id="dataartsstudio_01_04501__b16591306130">Default Configuration</strong> and set <strong id="dataartsstudio_01_04501__b3732102012130">Notification Policy for Jobs in Failure Ignored Status</strong>.</span></li><li id="dataartsstudio_01_04501__li1341613615279"><span>Select a notification type for jobs whose status is failure ignored.</span><p><div class="note" id="dataartsstudio_01_04501__note1517712019715"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_04501__ul41776017711"><li id="dataartsstudio_01_04501__li10177400712">Jobs whose status is failure ignored are those whose <strong id="dataartsstudio_01_04501__b1750913146205">Policy for Handling Subsequent Nodes If the Current Node Fails</strong> is set to <strong id="dataartsstudio_01_04501__b15592163262015">Go to the next node</strong>. By default, such jobs are deemed successful by the system.</li><li id="dataartsstudio_01_04501__li8333022121414">You can configure either of the following notification types for such jobs:<p id="dataartsstudio_01_04501__p689872312141"><a name="dataartsstudio_01_04501__li8333022121414"></a><a name="li8333022121414"></a><strong id="dataartsstudio_01_04501__b499111592256">Abnormal</strong></p>
<p id="dataartsstudio_01_04501__p58989234142"><strong id="dataartsstudio_01_04501__b13828151532615">Successful</strong> (default)</p>
</li></ul>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li81771106720"><span>Click <strong id="dataartsstudio_01_04501__b195897614468">Save</strong>.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section687113915618"><a name="dataartsstudio_01_04501__section687113915618"></a><a name="section687113915618"></a><h4 class="sectiontitle">Setting Retry Node upon Timeout</h4><p id="dataartsstudio_01_04501__p387129155612">You can set this parameter to specify whether a node will be re-executed if it fails upon timeout.</p>
<ol id="dataartsstudio_01_04501__ol108716918569"><li id="dataartsstudio_01_04501__li1187249115612"><span>In the navigation pane on the <strong id="dataartsstudio_01_04501__b133931537330">Data Development</strong> page, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade1939405316330"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol6393185363312">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol12394553163312">Configure</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li14872596569"><span>Choose <strong id="dataartsstudio_01_04501__b4515025163512">Default Configuration</strong>.</span></li><li id="dataartsstudio_01_04501__li168724925617"><span>Set <strong id="dataartsstudio_01_04501__b182459233617">Retry Node upon Timeout</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note5872139195613"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_04501__ul3872991567"><li id="dataartsstudio_01_04501__li1387219955617"><strong id="dataartsstudio_01_04501__b7285435153618">No</strong>: A <span id="dataartsstudio_01_04501__text1328324161254">node</span> will not be re-executed if it fails upon timeout.</li><li id="dataartsstudio_01_04501__li18729995615"><strong id="dataartsstudio_01_04501__b92261528133717">Yes</strong>: A <span id="dataartsstudio_01_04501__text9226192812372">node</span> will be re-executed if it fails upon timeout.</li></ul>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li28735945618"><span>Click <strong id="dataartsstudio_01_04501__b1487616116381">Save</strong> to save the settings.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section14959925164217"><a name="dataartsstudio_01_04501__section14959925164217"></a><a name="section14959925164217"></a><h4 class="sectiontitle">Exclude Waiting Time from Instance Timeout Duration</h4><p id="dataartsstudio_01_04501__p193900167437">You can specify whether to exclude waiting time from instance timeout duration.</p>
<ol id="dataartsstudio_01_04501__ol11390121654313"><li id="dataartsstudio_01_04501__li839071614437"><span>In the navigation pane, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade687687359"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol1330047144">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol300996876">Specifications</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li5390161694319"><span>Choose <strong id="dataartsstudio_01_04501__b111685489334">Default Configuration</strong> and set <strong id="dataartsstudio_01_04501__b33671570348">Exclude Waiting Time from Instance Timeout Duration</strong>.</span></li><li id="dataartsstudio_01_04501__li1839071613438"><span>Select <strong id="dataartsstudio_01_04501__b27971136103418">Yes</strong> or <strong id="dataartsstudio_01_04501__b95171340133412">No</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note7390111618436"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_04501__p11390181694312"><strong id="dataartsstudio_01_04501__b229195143420">Yes</strong>: The waiting time before an instance starts running is excluded from the instance timeout duration.</p>
<p id="dataartsstudio_01_04501__p5390416154318"><strong id="dataartsstudio_01_04501__b252320599342">No</strong>: The waiting time before an instance starts running is included in the instance timeout duration.</p>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li1539031664317"><span>Click <strong id="dataartsstudio_01_04501__b1187731686">Save</strong> to save the settings.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section105211772476"><a name="dataartsstudio_01_04501__section105211772476"></a><a name="section105211772476"></a><h4 class="sectiontitle">Rules for Splitting MRS JAR Package Parameters</h4><p id="dataartsstudio_01_04501__p124578464473">You can set the rule for splitting the string parameters (enclosed by "") in the JAR package parameters of MRS MapReduce and MRS Spark operators.</p>
<ol id="dataartsstudio_01_04501__ol3457546144717"><li id="dataartsstudio_01_04501__li164581046144716"><span>In the navigation pane, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade1551718102"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol1645237744">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol1106344371">Specifications</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li145810468477"><span>Choose <strong id="dataartsstudio_01_04501__b145951849153812">Default Configuration</strong> and set <strong id="dataartsstudio_01_04501__b37325853918">Rules for Splitting MRS JAR Package Parameters</strong>.</span></li><li id="dataartsstudio_01_04501__li144581546104711"><span>Select a rule.</span><p><div class="note" id="dataartsstudio_01_04501__note12458104618472"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_04501__p15821182665012"><strong id="dataartsstudio_01_04501__b79156566390">Split String Arguments by Space</strong>: For example, <strong id="dataartsstudio_01_04501__b1776018499502">"select * from table"</strong> is split into four parameters by space: <strong id="dataartsstudio_01_04501__b84777285403">select</strong>, <strong id="dataartsstudio_01_04501__b49581630104019">*</strong>, <strong id="dataartsstudio_01_04501__b122717343405">from</strong>, and <strong id="dataartsstudio_01_04501__b157817371409">table</strong>.</p>
<p id="dataartsstudio_01_04501__p14113142812508"><strong id="dataartsstudio_01_04501__b4821454194014">Do not split string arguments</strong>: For example, <strong id="dataartsstudio_01_04501__b1936951616512">"select * from table"</strong> is regarded as one parameter and is not split.</p>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li1045811468477"><span>Click <strong id="dataartsstudio_01_04501__b28374327">Save</strong> to save the settings.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section2986254123414"><a name="dataartsstudio_01_04501__section2986254123414"></a><a name="section2986254123414"></a><h4 class="sectiontitle">Synchronization of Job Version by Waiting Instance</h4><p id="dataartsstudio_01_04501__p216642612388">You can specify whether a waiting instance can synchronize the latest job version.</p>
<ol id="dataartsstudio_01_04501__ol17714192513392"><li id="dataartsstudio_01_04501__li613153053916"><span>In the navigation pane, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade196160253"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol115031492">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol1334805728">Specifications</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li513143003916"><span>Choose <strong id="dataartsstudio_01_04501__b1417511576458">Default Configuration</strong> and set <strong id="dataartsstudio_01_04501__b181751257204512">Synchronization of Job Version by Waiting Instance</strong>.</span></li><li id="dataartsstudio_01_04501__li41393013391"><span>Select <strong id="dataartsstudio_01_04501__b106551125104618">Yes</strong> or <strong id="dataartsstudio_01_04501__b13110722104610">No</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note17605144118404"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_04501__p410235015404"><strong id="dataartsstudio_01_04501__b1155235144614">Yes</strong>: The waiting instance uses the latest job version.</p>
<p id="dataartsstudio_01_04501__p31021150114011"><strong id="dataartsstudio_01_04501__b66931431475">No</strong>: The waiting instance still uses the existing job version.</p>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li178173314013"><span>Click <strong id="dataartsstudio_01_04501__b1245102401">Save</strong> to save the settings.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section1545212478426"><a name="dataartsstudio_01_04501__section1545212478426"></a><a name="section1545212478426"></a><h4 class="sectiontitle">Execution Mode for Hive SQL and Spark SQL Statements</h4><p id="dataartsstudio_01_04501__p559113875219">When Hive SQL and Spark SQL statements are executed, <span id="dataartsstudio_01_04501__text8313154018447">DataArts Studio</span> can place SQL statements in OBS or in the request body.</p>
<ol id="dataartsstudio_01_04501__ol223025035717"><li id="dataartsstudio_01_04501__li123055025718"><span>In the navigation pane, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade1081425819154"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol4813155817159">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol11813125810153">Configure</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li122314505574"><span>Choose <strong id="dataartsstudio_01_04501__b71764314416">Default Configuration</strong>.</span></li><li id="dataartsstudio_01_04501__li112311750165715"><span>Set <strong id="dataartsstudio_01_04501__b295665974712">Execution Mode for Hive SQL and Spark SQL Statements</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note0231850145718"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_04501__p5231145012577"><strong id="dataartsstudio_01_04501__b17640143510482">In OBS</strong>: Hive SQL and Spark SQL statements are put in OBS, and the OBS is returned to MRS.</p>
<p id="dataartsstudio_01_04501__p12311350195711"><strong id="dataartsstudio_01_04501__b220591665015">In the request message body</strong>: Hive SQL and Spark SQL statements are put in the request message body, and the script content is returned to MRS.</p>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li1323112506576"><span>Click <strong id="dataartsstudio_01_04501__b20603131519164">Save</strong> to save the settings.</span><p><div class="note" id="dataartsstudio_01_04501__note75719451112"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_04501__p7581445131114">This configuration supports Hive SQL and Spark SQL scripts, and pipeline and single-task jobs.</p>
</div></div>
</p></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section146531751579"><a name="dataartsstudio_01_04501__section146531751579"></a><a name="section146531751579"></a><h4 class="sectiontitle">Whether MRS Resource Queue Is Mandatory</h4><p id="dataartsstudio_01_04501__p10699145316613">You can set whether the <strong id="dataartsstudio_01_04501__b9701444143812">MRS resource queue</strong> is mandatory for configuring an MRS-related job.</p>
<div class="note" id="dataartsstudio_01_04501__note1243214115317"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><div class="p" id="dataartsstudio_01_04501__p16699195311614">This function is available for the following scenarios:<ul id="dataartsstudio_01_04501__ul1928015414504"><li id="dataartsstudio_01_04501__li16280241115017">Pipeline job operators: MRS Spark SQL, MRS Flink Job, MRS Hive SQL, MRS Spark Python, and MRS Spark</li><li id="dataartsstudio_01_04501__li181211212185117">Real-time processing jobs: Flink Jar and Flink SQL</li><li id="dataartsstudio_01_04501__li19781850165111">Batch processing single-task jobs: Spark SQL and Hive SQL</li><li id="dataartsstudio_01_04501__li3601224175419">Job import (including the job types listed above)</li></ul>
</div>
</div></div>
<ol id="dataartsstudio_01_04501__ol46999536618"><li id="dataartsstudio_01_04501__li167004531465"><span>In the left navigation pane on the DataArts Factory console, choose <strong id="dataartsstudio_01_04501__b59894783219">Configuration</strong> &gt; <strong id="dataartsstudio_01_04501__b498918783215">Configure</strong>.</span></li><li id="dataartsstudio_01_04501__li11700453563"><span>Choose <strong id="dataartsstudio_01_04501__b10451012173213">Default Configuration</strong>.</span></li><li id="dataartsstudio_01_04501__li187003535612"><span>Set <strong id="dataartsstudio_01_04501__b16902134620325">Whether MRS Resource Queue Is Mandatory</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note10692143819550"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_04501__p13809826175614"><strong id="dataartsstudio_01_04501__b197941954123214">Yes</strong>: The <strong id="dataartsstudio_01_04501__b966794153311">MRS Resource Queue</strong> parameter is mandatory.</p>
<p id="dataartsstudio_01_04501__p164274303564"><strong id="dataartsstudio_01_04501__b1871614673311">No</strong>: The <strong id="dataartsstudio_01_04501__b67175633312">MRS Resource Queue</strong> parameter is not mandatory.</p>
<div class="p" id="dataartsstudio_01_04501__p26406515592">As shown in the following figure, there are no red asterisks (*) before <strong id="dataartsstudio_01_04501__b105645441334">MRS Resource Queue</strong>, indicating that this parameter is not mandatory.<div class="fignone" id="dataartsstudio_01_04501__fig9796198145920"><span class="figcap"><b>Figure 1 </b>Setting MRS Resource Queue</span><br><span><img id="dataartsstudio_01_04501__image380464119264" src="en-us_image_0000002269124893.png"></span></div>
</div>
<p id="dataartsstudio_01_04501__p9983175113273"></p>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li1898412227554"><span>Click <strong id="dataartsstudio_01_04501__b3570205316342">Save</strong>.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section1149418391843"><a name="dataartsstudio_01_04501__section1149418391843"></a><a name="section1149418391843"></a><h4 class="sectiontitle">Setting PatchData Priority</h4><p id="dataartsstudio_01_04501__p044215101519">You can set the priority of a PatchData job. When system resources are insufficient, computing resources are preferentially allocated to jobs with higher priorities. A larger number indicates a higher priority. Currently, only the priorities of DLI SQL operators can be set.</p>
<ol id="dataartsstudio_01_04501__ol5442121015514"><li id="dataartsstudio_01_04501__li1544291012518"><span>In the left navigation pane on the DataArts Factory console, choose <strong id="dataartsstudio_01_04501__b1926215401351">Configuration</strong> &gt; <strong id="dataartsstudio_01_04501__b19151148123513">Configure</strong>.</span></li><li id="dataartsstudio_01_04501__li18442161016519"><span>Choose <strong id="dataartsstudio_01_04501__b12406112317175">Default Configuration</strong> and set <strong id="dataartsstudio_01_04501__b1240620233170">PatchData Job Priority</strong>.</span></li><li id="dataartsstudio_01_04501__li24423102519"><span>Set the patch data priority policy.</span></li><li id="dataartsstudio_01_04501__li19443141018516"><span>Click <strong id="dataartsstudio_01_04501__b2780133917403">Save</strong> to save the settings.</span><p><div class="note" id="dataartsstudio_01_04501__note240113108166"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_04501__p20549653101816">The mapping between the <strong id="dataartsstudio_01_04501__b142981453181515">PatchData Job Priority</strong> and <strong id="dataartsstudio_01_04501__b74441805151">spark.sql.dli.job.priority</strong> of DLI is as follows:</p>
<p id="dataartsstudio_01_04501__p12589112618189">If <strong id="dataartsstudio_01_04501__b11112175931513">PatchData Job Priority</strong> is set to <strong id="dataartsstudio_01_04501__b57632010191611">1</strong>, <strong id="dataartsstudio_01_04501__b19163174141613">spark.sql.dli.job.priority</strong> of DLI is <strong id="dataartsstudio_01_04501__b495519495169">1</strong>.</p>
<p id="dataartsstudio_01_04501__p15872629101810">If <strong id="dataartsstudio_01_04501__b981112961714">PatchData Job Priority</strong> is set to <strong id="dataartsstudio_01_04501__b582152913171">2</strong>, <strong id="dataartsstudio_01_04501__b1182122961720">spark.sql.dli.job.priority</strong> of DLI is <strong id="dataartsstudio_01_04501__b5821529161714">3</strong>.</p>
<p id="dataartsstudio_01_04501__p2367143414180">If <strong id="dataartsstudio_01_04501__b16305184041717">PatchData Job Priority</strong> is set to <strong id="dataartsstudio_01_04501__b14305184017173">3</strong>, <strong id="dataartsstudio_01_04501__b13305144014179">spark.sql.dli.job.priority</strong> of DLI is <strong id="dataartsstudio_01_04501__b14306134017174">5</strong>.</p>
<p id="dataartsstudio_01_04501__p17864836131814">If <strong id="dataartsstudio_01_04501__b152159613188">PatchData Job Priority</strong> is set to <strong id="dataartsstudio_01_04501__b22169691820">4</strong>, <strong id="dataartsstudio_01_04501__b202160614183">spark.sql.dli.job.priority</strong> of DLI is <strong id="dataartsstudio_01_04501__b5216146131820">8</strong>.</p>
<p id="dataartsstudio_01_04501__p940215101161">If <strong id="dataartsstudio_01_04501__b139787364181">PatchData Job Priority</strong> is set to <strong id="dataartsstudio_01_04501__b189781736111813">5</strong>, <strong id="dataartsstudio_01_04501__b7978236191814">spark.sql.dli.job.priority</strong> of DLI is <strong id="dataartsstudio_01_04501__b7979173613188">10</strong>.</p>
</div></div>
</p></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section10606125173916"><a name="dataartsstudio_01_04501__section10606125173916"></a><a name="section10606125173916"></a><h4 class="sectiontitle">Historical Job Instance Cancellation Policy</h4><p id="dataartsstudio_01_04501__p41759109402">You can set the number of retention days for waiting job instances. If the waiting time of a job instance exceeds the configured retention days, the job instance is canceled. The minimum number of retention days is 2, that is, a job instance which is not executed can be canceled after at least two days. The default number of retention days is 60.</p>
<ol id="dataartsstudio_01_04501__ol1340616591735"><li id="dataartsstudio_01_04501__li194061559132"><span>In the left navigation pane on the DataArts Factory console, choose <strong id="dataartsstudio_01_04501__b128391647123510">Configuration</strong> &gt; <strong id="dataartsstudio_01_04501__b18839154713357">Configure</strong>.</span></li><li id="dataartsstudio_01_04501__li10406859939"><span>Choose <strong id="dataartsstudio_01_04501__b1851316616368">Default Configuration</strong>.</span></li><li id="dataartsstudio_01_04501__li1540617591931"><span>Set the number of retention days for waiting job instances.</span></li><li id="dataartsstudio_01_04501__li17255859186"><span>Click <strong id="dataartsstudio_01_04501__b5984201810516">Save</strong> to save the settings.</span></li></ol>
<p id="dataartsstudio_01_04501__p124615539815">Send Alarm Upon Instance Cancellation If you select <strong id="dataartsstudio_01_04501__b8615819029">Yes</strong> for this parameter and configure a cancellation notification for a job, an alarm notification will be sent when a historical job instance is canceled upon timeout. If you select <strong id="dataartsstudio_01_04501__b1141828423">No</strong>, no alarm notification will be sent.</p>
<ol id="dataartsstudio_01_04501__ol823111237111"><li id="dataartsstudio_01_04501__li18231182361112"><span>In the left navigation pane on the DataArts Factory console, choose <strong id="dataartsstudio_01_04501__b208618394211">Configuration</strong> &gt; <strong id="dataartsstudio_01_04501__b38621539729">Configure</strong>.</span></li><li id="dataartsstudio_01_04501__li5231192361119"><span>Choose <strong id="dataartsstudio_01_04501__b72851446624">Default Configuration</strong>.</span></li><li id="dataartsstudio_01_04501__li102328238119"><span>Set <strong id="dataartsstudio_01_04501__b069411317310">Send Alarm Upon Instance Cancellation</strong>.</span></li><li id="dataartsstudio_01_04501__li3232162361119"><span>Click <strong id="dataartsstudio_01_04501__b7840125835">Save</strong> to save the settings.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section166989301817"><a name="dataartsstudio_01_04501__section166989301817"></a><a name="section166989301817"></a><h4 class="sectiontitle">Historical Job Instance Alarm Policy</h4><p id="dataartsstudio_01_04501__p95721392111">You can set the number of days during which alarms can be generated for monitored job instances. The default value is seven days. Alarms cannot be sent for job instances beyond the seven-day period.</p>
<p id="dataartsstudio_01_04501__p131201835111511">For example, if you set the value of this parameter to <strong id="dataartsstudio_01_04501__b1733152217452">2</strong>, alarms can be generated for the job instances of yesterday and today, but cannot be generated for the job instances of the day before yesterday and of an earlier time even if the triggering conditions are met.</p>
<ol id="dataartsstudio_01_04501__ol1672113615116"><li id="dataartsstudio_01_04501__li1572136111113"><span>In the navigation pane, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade11877112164418"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol148771721124419">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol108776212446">Configure</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li5721146101116"><span>Choose <strong id="dataartsstudio_01_04501__b1154293710489">Default Configuration</strong> and locate <strong id="dataartsstudio_01_04501__b847613430493">Historical Job Instance Alarm Policy</strong>.</span></li><li id="dataartsstudio_01_04501__li07219691111"><span>Set the number of days during which alarms can be generated for monitored job instances.</span><p><div class="note" id="dataartsstudio_01_04501__note188151316116"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_04501__p168161618114">The default value is <strong id="dataartsstudio_01_04501__b89964510171">7</strong>. Set a value from 1 to 270.</p>
<p id="dataartsstudio_01_04501__p4202016141018">After you set this parameter, alarms are generated only for the job instances which are created after this parameter is set and not for historical instances.</p>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li5722196131119"><span>Click <strong id="dataartsstudio_01_04501__b108116365218">Save</strong> to save the settings.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section1048217439191"><a name="dataartsstudio_01_04501__section1048217439191"></a><a name="section1048217439191"></a><h4 class="sectiontitle">Default Retry Policy upon Job Operator Failure</h4><p id="dataartsstudio_01_04501__p152641410142010">This policy takes effect only for new job operators in the current workspace. The default policy for the operators in historical jobs is not affected. The default value is <strong id="dataartsstudio_01_04501__b895212393320">No</strong>.</p>
<ol id="dataartsstudio_01_04501__ol14264161062015"><li id="dataartsstudio_01_04501__li8264131019207"><span>In the left navigation pane on the DataArts Factory console, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade631134223210"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol9311144293217">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol831114211324">Configure</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li122643102206"><span>Choose <strong id="dataartsstudio_01_04501__b1477815673313">Default Configuration</strong>.</span></li><li id="dataartsstudio_01_04501__li3265410122016"><span>Set <strong id="dataartsstudio_01_04501__b1547493163317">Default Retry Policy upon Job Operator Failure</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note1370515314302"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_04501__p107068532305">If this parameter is set to <strong id="dataartsstudio_01_04501__b58504916347">Yes</strong>, new job operators can be retried once, and the retry interval is 120 seconds by default.</p>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li326551042014"><span>Click <strong id="dataartsstudio_01_04501__b43331249122419">Save</strong> to save the settings.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section132101959182118"><a name="dataartsstudio_01_04501__section132101959182118"></a><a name="section132101959182118"></a><h4 class="sectiontitle">Generate Alarm Upon Job Retry Failure</h4><p id="dataartsstudio_01_04501__p6929158122213">If you enable this function, an alarm is generated each time a job fails to be retried.</p>
<ol id="dataartsstudio_01_04501__ol17347182917225"><li id="dataartsstudio_01_04501__li1334722915228"><span>In the left navigation pane on the DataArts Factory console, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade65381606399"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol853650163918">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol95372013397">Configure</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li17347329182214"><span>Choose <strong id="dataartsstudio_01_04501__b139891214143920">Default Configuration</strong>.</span></li><li id="dataartsstudio_01_04501__li03479295221"><span>Set <strong id="dataartsstudio_01_04501__b141841250163619">Generate Alarm Upon Job Retry Failure</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note33481029172213"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_04501__ul065613252519"><li id="dataartsstudio_01_04501__li411583625119">If you select <strong id="dataartsstudio_01_04501__b95584323712">All jobs</strong>, <strong id="dataartsstudio_01_04501__b152674793718">Real-time jobs</strong>, or <strong id="dataartsstudio_01_04501__b149951310379">Batch jobs</strong>, an alarm is generated each time a job fails to be retried.</li><li id="dataartsstudio_01_04501__li011553617513">If you select <strong id="dataartsstudio_01_04501__b642722303720">Disable</strong>, an alarm is generated only when the maximum number of retries has been reached for the job.</li></ul>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li234811296225"><span>Click <strong id="dataartsstudio_01_04501__b1573142110297">Save</strong> to save the settings.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section5197124710613"><a name="dataartsstudio_01_04501__section5197124710613"></a><a name="section5197124710613"></a><h4 class="sectiontitle">Automatic Script Name Transfer During Job Execution</h4><p id="dataartsstudio_01_04501__p346113414713">If this function is enabled, <strong id="dataartsstudio_01_04501__b13203147144919">set mapreduce.job.name="<em id="dataartsstudio_01_04501__i189701151144917">Script name</em>"</strong> of the Hive SQL script is automatically transferred to MRS during job execution in the current workspace.</p>
<div class="note" id="dataartsstudio_01_04501__note43010461985"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_04501__p143034616810">This function takes effect only if the preceding parameter value has not been set for the script. If the parameter value has been set for the script, the value set is preferentially read and transferred to MRS. This function is unavailable for MRS clusters in security mode. To enable this function for such clusters, set them to non-security mode.</p>
</div></div>
<ol id="dataartsstudio_01_04501__ol810291110716"><li id="dataartsstudio_01_04501__li101021911878"><span>In the navigation pane, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade800773331"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol638533066">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol901026921">Specifications</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li81029111973"><span>Choose <strong id="dataartsstudio_01_04501__b10226411165411">Default Configuration</strong>.</span></li><li id="dataartsstudio_01_04501__li1710313117711"><span>Set <strong id="dataartsstudio_01_04501__b17558192518559">Automatic Script Name Transfer During Job Execution</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note1710351115710"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_04501__ul610331114717"><li id="dataartsstudio_01_04501__li1103811674"><strong id="dataartsstudio_01_04501__b8922333155513">Yes</strong>: The system automatically transfers the Hive SQL script name to MRS during job execution.</li><li id="dataartsstudio_01_04501__li5103911279">No: The system does not automatically transfer the Hive SQL script name to MRS during job execution.</li></ul>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li710316111372"><span>Click <strong id="dataartsstudio_01_04501__b1606866816">Save</strong> to save the settings.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section45021415123915"><a name="dataartsstudio_01_04501__section45021415123915"></a><a name="section45021415123915"></a><h4 class="sectiontitle">Job Dependency Rule</h4><p id="dataartsstudio_01_04501__p11479621103910">Jobs can be depended on by jobs in other workspaces (requires the permission to query the job list in the workspace). All default roles in the workspace have this permission. Custom roles must have the job query permission in DataArts Factory.</p>
<ol id="dataartsstudio_01_04501__ol99370178414"><li id="dataartsstudio_01_04501__li193881711414"><span>In the left navigation pane on the DataArts Factory console, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade1441610617533"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol104154695311">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol3416660537">Configure</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li179381517114113"><span>Choose <strong id="dataartsstudio_01_04501__b691123065312">Default Configuration</strong>.</span></li><li id="dataartsstudio_01_04501__li3938171710419"><span>Configure <strong id="dataartsstudio_01_04501__b1043155315539">Job Dependency Rule</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note179389178416"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_04501__ul10938171744112"><li id="dataartsstudio_01_04501__li1938201710413"><strong id="dataartsstudio_01_04501__b4684122814548">Jobs cannot be depended on by jobs in other workspaces</strong>: Jobs in this workspace cannot be depended on by jobs in other workspaces.</li><li id="dataartsstudio_01_04501__li15938217164112"><strong id="dataartsstudio_01_04501__b10646111165520">Jobs can be depended on by jobs in other workspaces</strong>: Jobs in this workspace can be depended on by jobs in other workspaces, without requiring the permissions of this workspace.</li><li id="dataartsstudio_01_04501__li13482114494214"><strong id="dataartsstudio_01_04501__b127153421844">Jobs can be depended on by jobs in other workspaces (requires the permission to query the job list in the workspace)</strong>: Jobs in this workspace can be depended on by jobs in other workspaces, requiring the permissions of this workspace. If you do not have the permissions, the system displays a message indicating that you do not have the permission to obtain the job list in workspace <em id="dataartsstudio_01_04501__i9250379592">xxx</em> when you configure job dependencies across workspaces.</li></ul>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li109381017204110"><span>Click <strong id="dataartsstudio_01_04501__b1183621141">Save</strong> to save the settings.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section7536359192017"><a name="dataartsstudio_01_04501__section7536359192017"></a><a name="section7536359192017"></a><h4 class="sectiontitle">Script Execution History</h4><p id="dataartsstudio_01_04501__p3233123102414">You can set this parameter to control the permissions to view the script execution history.</p>
<ol id="dataartsstudio_01_04501__ol111282449213"><li id="dataartsstudio_01_04501__li1212817449213"><span>In the left navigation pane on the DataArts Factory console, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade19622163819020"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol1462112386019">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol1462115389013">Configure</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li1812944410215"><span>Choose <strong id="dataartsstudio_01_04501__b1849134017010">Default Configuration</strong>.</span></li><li id="dataartsstudio_01_04501__li4129124414216"><span>Set <strong id="dataartsstudio_01_04501__b6320087112">Script Execution History</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note18129204462110"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_04501__ul7129244122110"><li id="dataartsstudio_01_04501__li14129194413212"><strong id="dataartsstudio_01_04501__b121516231815">Myself</strong>: The script execution history for only myself is displayed.</li><li id="dataartsstudio_01_04501__li16129944142120"><strong id="dataartsstudio_01_04501__b167770318118">All users</strong>: The script execution history for all users is displayed.</li></ul>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li612904472116"><span>Click <strong id="dataartsstudio_01_04501__b121847221414">Save</strong> to save the settings.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section83901219181110"><a name="dataartsstudio_01_04501__section83901219181110"></a><a name="section83901219181110"></a><h4 class="sectiontitle">Identity for Job Tests</h4><p id="dataartsstudio_01_04501__p494553611112">After configuring this parameter, you can specify the identity used to test jobs.</p>
<ol id="dataartsstudio_01_04501__ol1094523641111"><li id="dataartsstudio_01_04501__li494573671113"><span>In the left navigation pane on the DataArts Factory console, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade676015851020"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol107592817104">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol17602087109">Configure</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li294610364115"><span>Choose <strong id="dataartsstudio_01_04501__b1016062381012">Default Configuration</strong>.</span></li><li id="dataartsstudio_01_04501__li994613615114"><span>Set <strong id="dataartsstudio_01_04501__b3432139131014">Identity for Job Tests</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note4946836101112"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_04501__ul1194616363119"><li id="dataartsstudio_01_04501__li2072535151311"><strong id="dataartsstudio_01_04501__b155141348131011">Public agency or IAM account</strong>: A public agency or IAM account is used to execute jobs.</li><li id="dataartsstudio_01_04501__li63984543139"><strong id="dataartsstudio_01_04501__b187212214371">Personal account</strong>: The user who clicks <strong id="dataartsstudio_01_04501__b1272172119376">Test</strong> is used to execute jobs.<p id="dataartsstudio_01_04501__p7682541172214">If no workspace agency or IAM account is available, a personal account is used for job tests.</p>
<p id="dataartsstudio_01_04501__p22682045101316">If you are using a federated account, you must set this parameter to <strong id="dataartsstudio_01_04501__b11781274123">Public agency or IAM account</strong>.</p>
</li></ul>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li1694683615115"><span>Click <strong id="dataartsstudio_01_04501__b49741011191212">Save</strong> to save the settings.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section977293342312"><a name="dataartsstudio_01_04501__section977293342312"></a><a name="section977293342312"></a><h4 class="sectiontitle">SparkSqlJob/Script Default Template Configuration</h4><p id="dataartsstudio_01_04501__p157721333152312">You can set this parameter to determine whether any parameters can be set to overwrite the default parameters of the template.</p>
<p id="dataartsstudio_01_04501__p172015115508">In the MRS API connection mode, default parameters can be configured for Spark SQL scripts. For proxy connections, this function is not supported.</p>
<ol id="dataartsstudio_01_04501__ol117722336237"><li id="dataartsstudio_01_04501__li117728339237"><span>In the navigation pane, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade1328227041"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol1658283868">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol544398297">Specifications</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li0773113318238"><span>Choose <strong id="dataartsstudio_01_04501__b151179215519">Default Configuration</strong>.</span></li><li id="dataartsstudio_01_04501__li1577303372312"><span>Set <strong id="dataartsstudio_01_04501__b15800255512">SparkSqlJob/Script Default Template Configuration</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note1477343313237"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_04501__ul9773183332318"><li id="dataartsstudio_01_04501__li17773153382311"><strong id="dataartsstudio_01_04501__b32701718145116">Yes</strong>: You can set any parameters for jobs and scripts.</li><li id="dataartsstudio_01_04501__li14655115218429"><strong id="dataartsstudio_01_04501__b196661214143519">No</strong>: You must select a template for jobs and scripts. If you select <strong id="dataartsstudio_01_04501__b61771820982">No</strong>, select a default parameter template that has been configured. For details about how to configure a template, see <a href="dataartsstudio_01_1282.html">Configuring a Template</a>.<p id="dataartsstudio_01_04501__p1425585413429">Then go to the <strong id="dataartsstudio_01_04501__b173848489109">basic information page of the Spark SQL job or Spark SQL script page and click</strong> <span><img id="dataartsstudio_01_04501__image12835544335" src="en-us_image_0000002269204977.png"></span> <strong id="dataartsstudio_01_04501__b1038464891015">in the upper right corner</strong> to view the configured default program parameters. The preset default parameters are unavailable and cannot be modified.</p>
<p id="dataartsstudio_01_04501__p171566334438">You can also customize program parameters, which can replace the template parameters during the execution of Spark SQL jobs or scripts.</p>
</li></ul>
</div></div>
</p></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section20499113582315"><a name="dataartsstudio_01_04501__section20499113582315"></a><a name="section20499113582315"></a><h4 class="sectiontitle">HiveSqlJob/Script Default Template Configuration</h4><p id="dataartsstudio_01_04501__p11499143516231">You can set this parameter to determine whether parameters can be set to overwrite the default parameters of the template.</p>
<p id="dataartsstudio_01_04501__p2259449194615">In the MRS API connection mode, default parameters can be configured for Hive SQL scripts. For proxy connections, this function is not supported.</p>
<ol id="dataartsstudio_01_04501__ol95001335142314"><li id="dataartsstudio_01_04501__li1250033552312"><span>In the navigation pane, choose <span class="menucascade" id="dataartsstudio_01_04501__menucascade1706992575"><b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol993388023">Configuration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_04501__uicontrol81762055">Specifications</span></b></span>.</span></li><li id="dataartsstudio_01_04501__li55001635172316"><span>Choose <strong id="dataartsstudio_01_04501__b859553311615">Default Configuration</strong>.</span></li><li id="dataartsstudio_01_04501__li1550011355231"><span>Set <strong id="dataartsstudio_01_04501__b1621765215313">HiveSqlJob/Script Default Template Configuration</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note75001359234"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_04501__ul12500235112311"><li id="dataartsstudio_01_04501__li45001535192314"><strong id="dataartsstudio_01_04501__b024818875413">Yes</strong>: You can set any parameters for jobs and scripts.</li><li id="dataartsstudio_01_04501__li9325310452"><strong id="dataartsstudio_01_04501__b1136117350577">No</strong>: You must select a template for jobs and scripts. If you select <strong id="dataartsstudio_01_04501__b3403162061711">No</strong>, select a default parameter template that has been configured. For details about how to configure a template, see <a href="dataartsstudio_01_1282.html">Configuring a Template</a>.<p id="dataartsstudio_01_04501__p69551633104513">Then go to the <strong id="dataartsstudio_01_04501__b34113243175">basic information page of the Hive SQL job or Hive SQL script page and click</strong> <span><img id="dataartsstudio_01_04501__image942112412174" src="en-us_image_0000002234245540.png"></span> <strong id="dataartsstudio_01_04501__b1842524171720">in the upper right corner</strong> to view the configured default program parameters. The preset default parameters are unavailable and cannot be modified.</p>
<p id="dataartsstudio_01_04501__p155621249184518">You can also customize program parameters, which can replace the template parameters during the execution of Hive SQL jobs or scripts.</p>
</li></ul>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li135001935142317"><span>Click <strong id="dataartsstudio_01_04501__b1140725753">Save</strong> to save the settings.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section375164516215"><a name="dataartsstudio_01_04501__section375164516215"></a><a name="section375164516215"></a><h4 class="sectiontitle">Job/Script Change Management</h4><p id="dataartsstudio_01_04501__p55431184312">If you enable this function, you can export job/script changes (addition, modification, and deletion) in a workspace to a .zip file, and import the file to another workspace.</p>
<ol id="dataartsstudio_01_04501__ol1154311816314"><li id="dataartsstudio_01_04501__li1554378736"><span>In the left navigation pane on the DataArts Factory console, choose <strong id="dataartsstudio_01_04501__b1848151314370">Configuration</strong> &gt; <strong id="dataartsstudio_01_04501__b16481813133714">Configure</strong>.</span></li><li id="dataartsstudio_01_04501__li1454313813319"><span>Click <strong id="dataartsstudio_01_04501__b19196922153714">Default Configuration</strong>. </span></li><li id="dataartsstudio_01_04501__li205435814312"><span>Set <strong id="dataartsstudio_01_04501__b1983451153815">Job/Script Change Management</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note0543985318"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_04501__ul954478332"><li id="dataartsstudio_01_04501__li0544148237"><strong id="dataartsstudio_01_04501__b99855214411">Yes</strong>: Events are recorded for job and script changes. All the changed jobs and scripts can be incrementally exported and imported by time.</li><li id="dataartsstudio_01_04501__li172691161245"><strong id="dataartsstudio_01_04501__b750313315418">No</strong>: No events are recorded for job and script changes. Only selected jobs and scripts can be exported and imported.</li></ul>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li84411247518"><span>Click <strong id="dataartsstudio_01_04501__b18856933154113">Save</strong> to save the settings.</span><p><div class="note" id="dataartsstudio_01_04501__note102813192124"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_04501__p1628118194122">You can export and import jobs and scripts in the workspace only if you have set <strong id="dataartsstudio_01_04501__b18588102014421">Job/Script Change Management</strong> to <strong id="dataartsstudio_01_04501__b3921162510422">Yes</strong>.</p>
</div></div>
</p></li></ol>
</div>
<div class="section" id="dataartsstudio_01_04501__section108941170226"><a name="dataartsstudio_01_04501__section108941170226"></a><a name="section108941170226"></a><h4 class="sectiontitle">Log Open Mode</h4><p id="dataartsstudio_01_04501__p7279184620281">You can configure whether to open logs on a new tab or in a pop-up window.</p>
<ol id="dataartsstudio_01_04501__ol2800165111233"><li id="dataartsstudio_01_04501__li158011251122316"><span>In the left navigation pane on the DataArts Factory console, choose <strong id="dataartsstudio_01_04501__b79308919">Configuration</strong> &gt; <strong id="dataartsstudio_01_04501__b564302350">Configure</strong>.</span></li><li id="dataartsstudio_01_04501__li1680155113235"><span>Choose <strong id="dataartsstudio_01_04501__b19653171113456">Default Configuration</strong> and locate <strong id="dataartsstudio_01_04501__b996814216454">Log Open Mode</strong>.</span></li><li id="dataartsstudio_01_04501__li1916133832418"><span>Select <strong id="dataartsstudio_01_04501__b208372399455">New tab</strong> or <strong id="dataartsstudio_01_04501__b15311205518455">Pop-up</strong>.</span><p><div class="note" id="dataartsstudio_01_04501__note67262462255"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_04501__ul92831122182619"><li id="dataartsstudio_01_04501__li1283172215265"><strong id="dataartsstudio_01_04501__b483981710488">New tab</strong>: Logs are opened on a new page.</li><li id="dataartsstudio_01_04501__li17283162272611"><strong id="dataartsstudio_01_04501__b14465183104811">Pop-up</strong>: Logs are opened in a pop-up window on the current page.</li></ul>
</div></div>
</p></li><li id="dataartsstudio_01_04501__li1129603716253"><span>Click <strong id="dataartsstudio_01_04501__b29348720356">Save</strong> to save the settings.</span></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0510.html">Configuring Resources</a></div>
</div>
</div>
View Git Blame Copy Permalink