forked from docs/doc-exports
chenxiaoxiong
f9e2808b7c
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: chenxiaoxiong <chenxiaoxiong@huawei.com> Co-committed-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
273 lines
57 KiB
HTML
273 lines
57 KiB
HTML
<a name="dataartsstudio_01_0508"></a><a name="dataartsstudio_01_0508"></a>
|
|
|
|
<h1 class="topictitle1">Monitoring a Batch Job</h1>
|
|
<div id="body8662426"><p id="dataartsstudio_01_0508__p12469182910401">In the batch processing mode, data is processed periodically in batches based on the job-level scheduling plan, which is used in scenarios with low real-time requirements. This type of job is a pipeline that consists of one or more nodes and is scheduled as a whole. It cannot run for an unlimited period of time, that is, it must end after running for a certain period of time.</p>
|
|
<p id="dataartsstudio_01_0508__en-us_topic_0159097444_p911913324486">You can choose <strong id="dataartsstudio_01_0508__b14469195919506">Monitor Job</strong> and click the <strong id="dataartsstudio_01_0508__b046913598503">Batch Job Monitoring</strong> tab to view the scheduling status, scheduling period, and start time of a batch job, and perform the operations listed in <a href="#dataartsstudio_01_0508__en-us_topic_0159098544_table958254318576">Table 1</a>.</p>
|
|
<div class="fignone" id="dataartsstudio_01_0508__fig177281136183518"><span class="figcap"><b>Figure 1 </b>Monitoring batch jobs</span><br><span><img id="dataartsstudio_01_0508__image6214173914541" src="en-us_image_0000002234080616.png" title="Click to enlarge" class="imgResize"></span></div>
|
|
<p id="dataartsstudio_01_0508__p17599154613519"></p>
|
|
|
|
<div class="tablenoborder"><a name="dataartsstudio_01_0508__en-us_topic_0159098544_table958254318576"></a><a name="en-us_topic_0159098544_table958254318576"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0508__en-us_topic_0159098544_table958254318576" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Operations supported by batch job monitoring</caption><thead align="left"><tr id="dataartsstudio_01_0508__en-us_topic_0159098544_row1558284313572"><th align="left" class="cellrowborder" valign="top" width="28.28%" id="mcps1.3.5.2.3.1.1"><p id="dataartsstudio_01_0508__en-us_topic_0159098544_p75823437579">Operation</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="71.72%" id="mcps1.3.5.2.3.1.2"><p id="dataartsstudio_01_0508__en-us_topic_0159098544_p45821843165710">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dataartsstudio_01_0508__row679218403524"><td class="cellrowborder" valign="top" width="28.28%" headers="mcps1.3.5.2.3.1.1 "><p id="dataartsstudio_01_0508__p99401747492">Filtering jobs by <strong id="dataartsstudio_01_0508__b649672425815">Job Name</strong>, <strong id="dataartsstudio_01_0508__b1249613245587">Owner</strong>, <strong id="dataartsstudio_01_0508__b154971424175817">CDM Job</strong>, <strong id="dataartsstudio_01_0508__b849742485810">Scheduling Identity</strong>, or <strong id="dataartsstudio_01_0508__b5497132435814">Node Type</strong></p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.72%" headers="mcps1.3.5.2.3.1.2 "><p id="dataartsstudio_01_0508__p1379374013521">N/A</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__en-us_topic_0159098544_row35827433577"><td class="cellrowborder" valign="top" width="28.28%" headers="mcps1.3.5.2.3.1.1 "><p id="dataartsstudio_01_0508__en-us_topic_0159098544_p17582114312576">Filtering jobs by whether notifications have been configured, scheduling status, job tag, or next plan time</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.72%" headers="mcps1.3.5.2.3.1.2 "><p id="dataartsstudio_01_0508__en-us_topic_0159098544_p7582104311578">You can filter jobs for which no notification has been configured by notification type (such as exception or failure) so that you can set alarm notifications in batches.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__row26614215186"><td class="cellrowborder" valign="top" width="28.28%" headers="mcps1.3.5.2.3.1.1 "><p id="dataartsstudio_01_0508__p921819363613">Performing operations on jobs in a batch</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.72%" headers="mcps1.3.5.2.3.1.2 "><p id="dataartsstudio_01_0508__p8218236561">Select multiple jobs and perform operations on them.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__row11419103816393"><td class="cellrowborder" valign="top" width="28.28%" headers="mcps1.3.5.2.3.1.1 "><p id="dataartsstudio_01_0508__p148091120673">Viewing job instance status</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.72%" headers="mcps1.3.5.2.3.1.2 "><p id="dataartsstudio_01_0508__li1545642516529p0">Click <span><img id="dataartsstudio_01_0508__image7951320104918" src="en-us_image_0000002269119817.png"></span> in front of the <span id="dataartsstudio_01_0508__text18951132094913">job</span> name. The <span class="wintitle" id="dataartsstudio_01_0508__wintitle6952132084917"><b>Last Instance</b></span> information is displayed. You can view information about the last instance of the <span id="dataartsstudio_01_0508__text14952122012496">job</span>.</p>
|
|
<p id="dataartsstudio_01_0508__p25231622026">In the <strong id="dataartsstudio_01_0508__b86261728182">Operation</strong> column of the last instance, you can view the run logs of the instance and rerun the instance.</p>
|
|
<div class="note" id="dataartsstudio_01_0508__note196297531739"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0508__ul191718421684"><li id="dataartsstudio_01_0508__li317164219811">The rerun job may run at the same time as a normally scheduled job. Check whether the job supports concurrent running. If the number or names of nodes in the job change, the rerunning starts from the first node. If you rerun a job instance in successful state, the rerunning starts from the first node.</li><li id="dataartsstudio_01_0508__li131794218814">When rerunning a job instance, you need to set <strong id="dataartsstudio_01_0508__b182449165716">Parameters to Use</strong> and <strong id="dataartsstudio_01_0508__b1294185635612">Ignore OBS Listening</strong>.<p id="dataartsstudio_01_0508__p116111566113">You can set <strong id="dataartsstudio_01_0508__b104081141144018">Parameters to Use</strong> to <strong id="dataartsstudio_01_0508__b1498851914413">Parameters of the original job</strong> or <strong id="dataartsstudio_01_0508__b3292131514412">Parameters of the latest job</strong>.</p>
|
|
<p id="dataartsstudio_01_0508__p46420342133"><strong id="dataartsstudio_01_0508__b33616368416">Ignore OBS Listening</strong> is set to <strong id="dataartsstudio_01_0508__b4982164354114">Yes</strong> by default.</p>
|
|
</li><li id="dataartsstudio_01_0508__li141713425811">In enterprise mode, developers cannot rerun job instances.</li></ul>
|
|
</div></div>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__row1694122981615"><td class="cellrowborder" valign="top" width="28.28%" headers="mcps1.3.5.2.3.1.1 "><p id="dataartsstudio_01_0508__p15694132941611">Viewing node information of the job</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.72%" headers="mcps1.3.5.2.3.1.2 "><p id="dataartsstudio_01_0508__p14616131185811">Click a job name. On the displayed page, click the job node and view its associated jobs/scripts and monitoring information.</p>
|
|
<p id="dataartsstudio_01_0508__p1869482919168">Click a job name. On the displayed page, view the job instance. For details, see <a href="#dataartsstudio_01_0508__section193191612165510">Batch Job Monitoring: Job Instances</a>.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__en-us_topic_0159098544_row10582843155716"><td class="cellrowborder" valign="top" width="28.28%" headers="mcps1.3.5.2.3.1.1 "><p id="dataartsstudio_01_0508__p158261225126">Job scheduling operations</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.72%" headers="mcps1.3.5.2.3.1.2 "><p id="dataartsstudio_01_0508__en-us_topic_0159098544_p1754215301448">You can run, pause, recover, stop, and configure scheduling. For details, see <a href="#dataartsstudio_01_0508__en-us_topic_0159100548_section1617819411343">Batch Job Monitoring: Scheduling a Job</a>.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__en-us_topic_0159098544_row158214433574"><td class="cellrowborder" valign="top" width="28.28%" headers="mcps1.3.5.2.3.1.1 "><p id="dataartsstudio_01_0508__en-us_topic_0159098544_p1558284315711">Configuring notifications</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.72%" headers="mcps1.3.5.2.3.1.2 "><p id="dataartsstudio_01_0508__en-us_topic_0159098544_p14582164311577">In the <span class="parmname" id="dataartsstudio_01_0508__parmname176230448588"><b>Operation</b></span> column of a <span id="dataartsstudio_01_0508__text12623104485810">job</span>, choose <span class="menucascade" id="dataartsstudio_01_0508__menucascade1662411445583"><b><span class="uicontrol" id="dataartsstudio_01_0508__uicontrol156233446583">More</span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0508__uicontrol1062384411581">Configuration Notification</span></b></span>. In the displayed dialog box, configure notification parameters. <a href="dataartsstudio_01_0514.html#dataartsstudio_01_0514__en-us_topic_0114591806_table63861718143217">Table 1</a> describes the notification parameters.</p>
|
|
<p id="dataartsstudio_01_0508__p2158104716255">You can also click <strong id="dataartsstudio_01_0508__b1841048155815">Configure Notification</strong> to configure notifications for jobs based on <a href="dataartsstudio_01_0514.html#dataartsstudio_01_0514__en-us_topic_0114591806_table63861718143217">Table 1</a>.</p>
|
|
<p id="dataartsstudio_01_0508__p31121747618">For how to modify existing notification configuration, see <a href="dataartsstudio_01_0414.html">Notification Management</a>. If you switch to the <strong id="dataartsstudio_01_0508__b6406529175910">Manage Notification</strong> page from a job, only the configurations of the job are displayed.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__en-us_topic_0159098544_row15821434571"><td class="cellrowborder" valign="top" width="28.28%" headers="mcps1.3.5.2.3.1.1 "><p id="dataartsstudio_01_0508__en-us_topic_0159098544_p15582104355717">Monitoring instances</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.72%" headers="mcps1.3.5.2.3.1.2 "><p id="dataartsstudio_01_0508__p11670756151319">In the <span class="parmname" id="dataartsstudio_01_0508__parmname7833525354320"><b>Operation</b></span> column of a <span id="dataartsstudio_01_0508__en-us_topic_0159100548_text317352503211">job</span>, choose <span class="menucascade" id="dataartsstudio_01_0508__menucascade2621984824320"><b><span class="uicontrol" id="dataartsstudio_01_0508__uicontrol1676753024320">More</span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0508__uicontrol8784911234320">Monitor Instance</span></b></span> to view the running records of all instances of the job.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__row67491277118"><td class="cellrowborder" valign="top" width="28.28%" headers="mcps1.3.5.2.3.1.1 "><p id="dataartsstudio_01_0508__p137492074110">Configuring scheduling information</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.72%" headers="mcps1.3.5.2.3.1.2 "><p id="dataartsstudio_01_0508__p1974991718113">In the <span class="parmname" id="dataartsstudio_01_0508__parmname274901711116"><b>Operation</b></span> column of a <span id="dataartsstudio_01_0508__text1974941715114">job</span>, click <strong id="dataartsstudio_01_0508__b725518664311">More</strong> and select <strong id="dataartsstudio_01_0508__b37451437164312">Scheduling Setup</strong>. On the displayed job development page, you can view and configure the job scheduling information.</p>
|
|
<div class="note" id="dataartsstudio_01_0508__note673703561516"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0508__p10739135111518">You cannot configure scheduling information for a running job.</p>
|
|
</div></div>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__row10989143521416"><td class="cellrowborder" valign="top" width="28.28%" headers="mcps1.3.5.2.3.1.1 "><p id="dataartsstudio_01_0508__p1990153571418">PatchData</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.72%" headers="mcps1.3.5.2.3.1.2 "><p id="dataartsstudio_01_0508__p1499013515140">In the <span class="parmname" id="dataartsstudio_01_0508__parmname126491454142619"><b>Operation</b></span> column of a <span id="dataartsstudio_01_0508__text76508548262">job</span>, choose <span class="menucascade" id="dataartsstudio_01_0508__menucascade1065035492616"><b><span class="uicontrol" id="dataartsstudio_01_0508__uicontrol6650125415266">More</span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0508__uicontrol1665065442616">PatchData</span></b></span>. For details, see <a href="#dataartsstudio_01_0508__en-us_topic_0159100548_section1819004120344">Batch Job Monitoring: PatchData</a>.</p>
|
|
<p id="dataartsstudio_01_0508__p10945029102214">This function is available only for jobs that are scheduled periodically.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__row17262173810149"><td class="cellrowborder" valign="top" width="28.28%" headers="mcps1.3.5.2.3.1.1 "><p id="dataartsstudio_01_0508__p126218382143">Adding a job tag</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.72%" headers="mcps1.3.5.2.3.1.2 "><p id="dataartsstudio_01_0508__p114115917220">In the <span class="parmname" id="dataartsstudio_01_0508__parmname1133084411303"><b>Operation</b></span> column of a job, choose <span class="menucascade" id="dataartsstudio_01_0508__menucascade123318443309"><b><span class="uicontrol" id="dataartsstudio_01_0508__uicontrol203311448309">More</span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0508__uicontrol433154413308">Add Job Tag</span></b></span>. For details, see <a href="#dataartsstudio_01_0508__en-us_topic_0159100548_section12186114111347">Batch Job Monitoring: Adding a Job Tag</a>.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__row159085301514"><td class="cellrowborder" valign="top" width="28.28%" headers="mcps1.3.5.2.3.1.1 "><p id="dataartsstudio_01_0508__p69089361511">Viewing a job dependency graph</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.72%" headers="mcps1.3.5.2.3.1.2 "><p id="dataartsstudio_01_0508__p20908163151519">In the <span class="parmname" id="dataartsstudio_01_0508__parmname225912373459"><b>Operation</b></span> column of a job, click <strong id="dataartsstudio_01_0508__b203381724154614">More</strong> and select <strong id="dataartsstudio_01_0508__b11435630174619">View Job Dependency Graph</strong>. For details, see <a href="#dataartsstudio_01_0508__section1913992715419">Batch Job Monitoring: Viewing a Job Dependency Graph</a>.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__row10229142414392"><td class="cellrowborder" valign="top" width="28.28%" headers="mcps1.3.5.2.3.1.1 "><p id="dataartsstudio_01_0508__p2384198275">Exporting all data</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.72%" headers="mcps1.3.5.2.3.1.2 "><p id="dataartsstudio_01_0508__p1351810123316">Click <strong id="dataartsstudio_01_0508__b1026464514509">Export All Data</strong>. In the displayed <strong id="dataartsstudio_01_0508__b326474565016">Export All Data</strong> dialog box, click <strong id="dataartsstudio_01_0508__b42641945135015">OK</strong>. After the export is complete, go to the <strong id="dataartsstudio_01_0508__b16884142016110">Download Center</strong> page to view the exported data.</p>
|
|
<p id="dataartsstudio_01_0508__p43847922710">If the default storage path is not configured, you can set a storage path and select <strong id="dataartsstudio_01_0508__b57091955141213">Set as default OBS path</strong> in the <strong id="dataartsstudio_01_0508__b1728113671216">Export to OBS</strong> dialog box.</p>
|
|
<p id="dataartsstudio_01_0508__p135069415383">A maximum of 30 MB data can be exported. If there are more than 30 MB data, the data will be automatically truncated.</p>
|
|
<p id="dataartsstudio_01_0508__p156801491310">The exported job instances map job nodes. You cannot export data by selecting job names. Instead, you can select the data to be exported by setting filter criteria.</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
<p id="dataartsstudio_01_0508__p18130164744116">Click a job name. On the displayed page, view the job parameters, properties, and instances.</p>
|
|
<p id="dataartsstudio_01_0508__p11371101944217">Click a node of a job to view the node properties, script content, and node monitoring information.</p>
|
|
<p id="dataartsstudio_01_0508__p726882354718">In addition, you can view the current job version and job scheduling status, schedule, stop, or pause a job, configure patch data, notification, or update frequency for a job.</p>
|
|
<div class="section" id="dataartsstudio_01_0508__section193191612165510"><a name="dataartsstudio_01_0508__section193191612165510"></a><a name="section193191612165510"></a><h4 class="sectiontitle">Batch Job Monitoring: Job Instances</h4><ol id="dataartsstudio_01_0508__ol4408195215550"><li id="dataartsstudio_01_0508__li2848154165110">Log in to the <span id="dataartsstudio_01_0508__en-us_topic_0000001987511677_en-us_topic_0000001127311125_text5574448155719">DataArts Studio</span> console by following the instructions in <a href="dataartsstudio_01_0001.html">Accessing the DataArts Studio Instance Console</a>.</li><li id="dataartsstudio_01_0508__li1816416301479">On the <span id="dataartsstudio_01_0508__en-us_topic_0181092879_text185611381448">DataArts Studio</span> console, locate a workspace and click <strong id="dataartsstudio_01_0508__en-us_topic_0181092879_b65382814249">DataArts Factory</strong>.</li><li id="dataartsstudio_01_0508__li1017751135611">In the left navigation pane of DataArts Factory, choose <span class="menucascade" id="dataartsstudio_01_0508__menucascade1660610441864"><b><span class="uicontrol" id="dataartsstudio_01_0508__uicontrol1160424413619"><span id="dataartsstudio_01_0508__text196048441369">Monitoring</span></span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0508__uicontrol1260518449612"><span id="dataartsstudio_01_0508__text16605944865">Job Monitoring</span></span></b></span>.</li><li id="dataartsstudio_01_0508__li1417751110562">Click the <span class="wintitle" id="dataartsstudio_01_0508__wintitle6690144616717"><b>Batch Job Monitoring</b></span> tab.</li><li id="dataartsstudio_01_0508__li177921630125610">Click a job name. On the displayed page, click the <strong id="dataartsstudio_01_0508__b54789257119">Job Instances</strong> tab to view job instances. You can perform the following operations:<ul id="dataartsstudio_01_0508__ul2052723212519"><li id="dataartsstudio_01_0508__li96825162711">Select <strong id="dataartsstudio_01_0508__b13817711101215">Show Instances to Be Generated</strong> and set the time range to filter job instances that are expected to be generated in the future.<div class="note" id="dataartsstudio_01_0508__note1954116581"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0508__p146862181104">A maximum of 100 instances expected to be generated can be displayed.</p>
|
|
</div></div>
|
|
</li><li id="dataartsstudio_01_0508__li9912131416113">Freeze or unfreeze job instances that are expected to be generated in the future. You can click <strong id="dataartsstudio_01_0508__b2314112105612">Freeze</strong> or <strong id="dataartsstudio_01_0508__b854972565">Unfreeze</strong> above the job instance list, or click <strong id="dataartsstudio_01_0508__b1433913325617">More</strong> in the <strong id="dataartsstudio_01_0508__b62881339195612">Operation</strong> column and select <strong id="dataartsstudio_01_0508__b1187215464564">Freeze</strong> or <strong id="dataartsstudio_01_0508__b12165350155618">Unfreeze</strong>.<div class="note" id="dataartsstudio_01_0508__note74723512313"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0508__p171701839183117"><strong id="dataartsstudio_01_0508__b16529191610571">Freeze</strong>: You can only freeze job instances that have not been generated or are in waiting state.</p>
|
|
<p id="dataartsstudio_01_0508__p7288162716453">You cannot freeze jobs instances that have been frozen.</p>
|
|
<p id="dataartsstudio_01_0508__p19170163993118">When a job is frozen, it is considered to be failed and its downstream jobs will be suspended, executed, or canceled based on the failure policy configured for the job.</p>
|
|
<p id="dataartsstudio_01_0508__p14741175815214">When job instances that have not been generated are frozen, you can view them on the <strong id="dataartsstudio_01_0508__b14969436912">Batch Job Monitoring</strong> page or filter them by status on the <strong id="dataartsstudio_01_0508__b199066961018">Monitor Instance</strong> page.</p>
|
|
<p id="dataartsstudio_01_0508__p1317063933115"><strong id="dataartsstudio_01_0508__b18543141751020">Unfreeze</strong>: You can unfreeze a job instance that has not been scheduled and has been frozen.</p>
|
|
</div></div>
|
|
</li><li id="dataartsstudio_01_0508__li14329101511334">Perform other operations on job instances, such as stopping, rerunning, and retrying job instances, continuing running job instances, making job instances succeed, viewing waiting job instances, and viewing job configuration. When viewing waiting job instances, you can click <strong id="dataartsstudio_01_0508__b16407153920315">Remove Dependency</strong> in the <strong id="dataartsstudio_01_0508__b106601449036">Operation</strong> column to remove dependency on an upstream instance.</li><li id="dataartsstudio_01_0508__li102161240114414">If jobs need manual confirmation before they are executed, they are in waiting confirmation state on the <strong id="dataartsstudio_01_0508__b91602185234">Batch Jobs</strong> page. When you click <strong id="dataartsstudio_01_0508__b162683498254">Execute</strong>, the jobs are in waiting execution state.</li></ul>
|
|
</li></ol>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0508__en-us_topic_0159100548_section1617819411343"><a name="dataartsstudio_01_0508__en-us_topic_0159100548_section1617819411343"></a><a name="en-us_topic_0159100548_section1617819411343"></a><h4 class="sectiontitle">Batch Job Monitoring: Scheduling a Job</h4><p id="dataartsstudio_01_0508__en-us_topic_0159100548_p0687302133">After developing a job, you can manage job scheduling tasks on the <strong id="dataartsstudio_01_0508__en-us_topic_0159100548_b10735122293613">Monitor Job</strong> page. Specific operations include to run, pause, restore, or stop scheduling.</p>
|
|
<div class="fignone" id="dataartsstudio_01_0508__en-us_topic_0159100548_fig13746183214580"><span class="figcap"><b>Figure 2 </b>Scheduling a job</span><br><span><img class="imgResize" id="dataartsstudio_01_0508__en-us_topic_0159100548_image1649165919215" src="en-us_image_0000002234240444.png" title="Click to enlarge"></span></div>
|
|
<ol id="dataartsstudio_01_0508__ol18400193994818"><li id="dataartsstudio_01_0508__li204151541574">Log in to the <span id="dataartsstudio_01_0508__en-us_topic_0000001987511677_en-us_topic_0000001127311125_text5574448155719_1">DataArts Studio</span> console by following the instructions in <a href="dataartsstudio_01_0001.html">Accessing the DataArts Studio Instance Console</a>.</li><li id="dataartsstudio_01_0508__li134107280371">On the <span id="dataartsstudio_01_0508__en-us_topic_0181092879_text185611381448_1">DataArts Studio</span> console, locate a workspace and click <strong id="dataartsstudio_01_0508__en-us_topic_0181092879_b65382814249_1">DataArts Factory</strong>.</li><li id="dataartsstudio_01_0508__li16400163913484">In the left navigation pane of DataArts Factory, choose <span class="menucascade" id="dataartsstudio_01_0508__en-us_topic_0159100548_menucascade13508951284"><b><span class="uicontrol" id="dataartsstudio_01_0508__en-us_topic_0159100548_uicontrol13508115686"><span id="dataartsstudio_01_0508__en-us_topic_0159100548_text1750819517811">Monitoring</span></span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0508__en-us_topic_0159100548_uicontrol125081256813"><span id="dataartsstudio_01_0508__en-us_topic_0159100548_text65081258811">Job Monitoring</span></span></b></span>.</li><li id="dataartsstudio_01_0508__li1540010395487">Click the <span class="wintitle" id="dataartsstudio_01_0508__en-us_topic_0159100548_wintitle315504819452"><b>Batch Job Monitoring</b></span> tab.<div class="note" id="dataartsstudio_01_0508__note13553102713203"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0508__p2554527112020">You can filter batch processing jobs by scheduling type or scheduling frequency.</p>
|
|
</div></div>
|
|
</li><li id="dataartsstudio_01_0508__li24003390489">In the <span class="parmname" id="dataartsstudio_01_0508__parmname1265304931218"><b>Operation</b></span> column of the job, click <span class="uicontrol" id="dataartsstudio_01_0508__uicontrol365318499121"><b>Execute</b></span>, <span class="uicontrol" id="dataartsstudio_01_0508__uicontrol136545496120"><b>Pause</b></span>, <span class="uicontrol" id="dataartsstudio_01_0508__uicontrol1765454971219"><b>Restore</b></span>, or <span class="uicontrol" id="dataartsstudio_01_0508__uicontrol156551249171217"><b>Stop Scheduling</b></span>.</li></ol>
|
|
<p id="dataartsstudio_01_0508__p6572113724">If a dependent job has been configured for a batch job, you can select either <strong id="dataartsstudio_01_0508__b139691242152017">Start Current Job Only</strong> or <strong id="dataartsstudio_01_0508__b1352497218">Start Current and Depended Jobs</strong> when submitting the batch job. For details about how to configure dependent jobs, see <a href="dataartsstudio_01_0470.html#dataartsstudio_01_0470__en-us_topic_0099797007_section1590152794714">Setting Up Scheduling for a Job Using the Batch Processing Mode</a>.</p>
|
|
<div class="note" id="dataartsstudio_01_0508__note93721879222"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0508__p537211782217">If the job is on the baseline task link, the system automatically displays a dialog box indicating that the baseline is associated when the scheduling is paused or stopped.</p>
|
|
<p id="dataartsstudio_01_0508__p3105174622412">If the job is on the baseline task link or is depended on by other jobs, the system automatically displays a dialog box when the scheduling is paused or stopped.</p>
|
|
</div></div>
|
|
<div class="p" id="dataartsstudio_01_0508__p18511545205"><div class="fignone" id="dataartsstudio_01_0508__fig198076281528"><span class="figcap"><b>Figure 3 </b>Starting a job</span><br><span><img id="dataartsstudio_01_0508__image2807132815216" src="en-us_image_0000002234240472.png" title="Click to enlarge" class="imgResize"></span></div>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0508__en-us_topic_0159100548_section1819004120344"><a name="dataartsstudio_01_0508__en-us_topic_0159100548_section1819004120344"></a><a name="en-us_topic_0159100548_section1819004120344"></a><h4 class="sectiontitle">Batch Job Monitoring: PatchData</h4><p id="dataartsstudio_01_0508__en-us_topic_0159100548_p1791217566590">A job executes a scheduling task to generate a series of instances in a certain period of time. This series of instances are called PatchData. PatchData can be used to fix the job instances that have data errors in the historical records or to build job records for debugging programs.</p>
|
|
<p id="dataartsstudio_01_0508__en-us_topic_0159100548_p2152413529">Only the periodically scheduled jobs support PatchData. For details about the execution records of PatchData, see <a href="dataartsstudio_01_0512.html">Monitoring PatchData</a>.</p>
|
|
<div class="note" id="dataartsstudio_01_0508__en-us_topic_0159100548_note1892471718191"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0508__en-us_topic_0159100548_p159243176199">Do not modify the job configuration when PatchData is being performed. Otherwise, job instances generated during PatchData will be affected.</p>
|
|
</div></div>
|
|
<ol id="dataartsstudio_01_0508__ol5857145535119"><li id="dataartsstudio_01_0508__li18813059195710">Log in to the <span id="dataartsstudio_01_0508__en-us_topic_0000001987511677_en-us_topic_0000001127311125_text5574448155719_2">DataArts Studio</span> console by following the instructions in <a href="dataartsstudio_01_0001.html">Accessing the DataArts Studio Instance Console</a>.</li><li id="dataartsstudio_01_0508__li15870427925">On the <span id="dataartsstudio_01_0508__en-us_topic_0181092879_text185611381448_2">DataArts Studio</span> console, locate a workspace and click <strong id="dataartsstudio_01_0508__en-us_topic_0181092879_b65382814249_2">DataArts Factory</strong>.</li><li id="dataartsstudio_01_0508__li1485712555513">In the left navigation pane of DataArts Factory, choose <span class="menucascade" id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_menucascade13508951284"><b><span class="uicontrol" id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_uicontrol13508115686"><span id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_text1750819517811">Monitoring</span></span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_uicontrol125081256813"><span id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_text65081258811">Job Monitoring</span></span></b></span>.</li><li id="dataartsstudio_01_0508__li108571555185119">Click the <span class="wintitle" id="dataartsstudio_01_0508__en-us_topic_0159100548_wintitle276611488818"><b>Batch Job Monitoring</b></span> tab.</li><li id="dataartsstudio_01_0508__li6857205513519">In the <strong id="dataartsstudio_01_0508__en-us_topic_0159100548_b19832134415277">Operation</strong> column of the job, choose <span class="menucascade" id="dataartsstudio_01_0508__en-us_topic_0159100548_menucascade16277125755116"><b><span class="uicontrol" id="dataartsstudio_01_0508__uicontrol1127755715511">More</span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0508__uicontrol77157435211">Configure PatchData</span></b></span>.</li><li id="dataartsstudio_01_0508__li17857655155116">Configure PatchData parameters based on <a href="#dataartsstudio_01_0508__en-us_topic_0159100548_table15019455411">Table 2</a>.<div class="fignone" id="dataartsstudio_01_0508__fig79021485219"><span class="figcap"><b>Figure 4 </b>PatchData parameters</span><br><span><img id="dataartsstudio_01_0508__image049173114317" src="en-us_image_0000002269119825.png" title="Click to enlarge" class="imgResize"></span></div>
|
|
<p id="dataartsstudio_01_0508__p52710374248"></p>
|
|
|
|
<div class="tablenoborder"><a name="dataartsstudio_01_0508__en-us_topic_0159100548_table15019455411"></a><a name="en-us_topic_0159100548_table15019455411"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0508__en-us_topic_0159100548_table15019455411" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Parameters</caption><thead align="left"><tr id="dataartsstudio_01_0508__en-us_topic_0159100548_row9507465414"><th align="left" class="cellrowborder" valign="top" width="35.17%" id="mcps1.3.11.5.6.4.2.3.1.1"><p id="dataartsstudio_01_0508__en-us_topic_0159100548_p15034125412">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="64.83%" id="mcps1.3.11.5.6.4.2.3.1.2"><p id="dataartsstudio_01_0508__en-us_topic_0159100548_p20507419547">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dataartsstudio_01_0508__en-us_topic_0159100548_row1350845549"><td class="cellrowborder" valign="top" width="35.17%" headers="mcps1.3.11.5.6.4.2.3.1.1 "><p id="dataartsstudio_01_0508__en-us_topic_0159100548_p1850543547">PatchData Name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="64.83%" headers="mcps1.3.11.5.6.4.2.3.1.2 "><p id="dataartsstudio_01_0508__en-us_topic_0159100548_p105010414544">Name of the automatically generated PatchData task. The value can be modified.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__en-us_topic_0159100548_row165015410541"><td class="cellrowborder" valign="top" width="35.17%" headers="mcps1.3.11.5.6.4.2.3.1.1 "><p id="dataartsstudio_01_0508__en-us_topic_0159100548_p115014495413">Job Name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="64.83%" headers="mcps1.3.11.5.6.4.2.3.1.2 "><p id="dataartsstudio_01_0508__en-us_topic_0159100548_p95054195411">Name of the job that requires PatchData.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__row193404345576"><td class="cellrowborder" valign="top" width="35.17%" headers="mcps1.3.11.5.6.4.2.3.1.1 "><p id="dataartsstudio_01_0508__p634011345576">Scheduling Time Type</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="64.83%" headers="mcps1.3.11.5.6.4.2.3.1.2 "><ul id="dataartsstudio_01_0508__ul88014514571"><li id="dataartsstudio_01_0508__li2081445205711">Consecutive date range<p id="dataartsstudio_01_0508__p14800555185819"><a name="dataartsstudio_01_0508__li2081445205711"></a><a name="li2081445205711"></a>The PatchData time is a continuous date range.</p>
|
|
</li><li id="dataartsstudio_01_0508__li269165725718">Discrete date ranges<p id="dataartsstudio_01_0508__p1424994665919"><a name="dataartsstudio_01_0508__li269165725718"></a><a name="li269165725718"></a>The PatchData time consists of discrete date ranges.</p>
|
|
</li></ul>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__en-us_topic_0159100548_row450174175418"><td class="cellrowborder" valign="top" width="35.17%" headers="mcps1.3.11.5.6.4.2.3.1.1 "><p id="dataartsstudio_01_0508__en-us_topic_0159100548_p1750549542">Date</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="64.83%" headers="mcps1.3.11.5.6.4.2.3.1.2 "><p id="dataartsstudio_01_0508__p879184017118"><strong id="dataartsstudio_01_0508__b1725216124214">If Scheduling Time Type is set to Consecutive date range:</strong></p>
|
|
<p id="dataartsstudio_01_0508__en-us_topic_0159100548_p85015418545">Period of time when PatchData is required. If the date is later than the current time, the current time is displayed by default.</p>
|
|
<div class="note" id="dataartsstudio_01_0508__note32182319191"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0508__p18219143114191">PatchData can be configured for a job multiple times. However, avoid configuring PatchData multiple times on the same date to prevent data duplication or disorder.</p>
|
|
</div></div>
|
|
<p id="dataartsstudio_01_0508__p1249965316267">If you select <strong id="dataartsstudio_01_0508__b1743817225178">Patch data in reverse order of date</strong>, the patch data of each day is in positive sequence.</p>
|
|
<div class="note" id="dataartsstudio_01_0508__note7644153963118"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0508__ul3954125253719"><li id="dataartsstudio_01_0508__li7954195218373">This function is applicable when the data of each day is not coupled with each other.</li><li id="dataartsstudio_01_0508__li16954052153718">The PatchData job will ignore the dependencies between the job instances created before this date.</li></ul>
|
|
</div></div>
|
|
<p id="dataartsstudio_01_0508__p615516231329"><strong id="dataartsstudio_01_0508__b7981195874017">If Scheduling Time Type is set to Discrete date ranges:</strong></p>
|
|
<p id="dataartsstudio_01_0508__p149347271673">You also need to set the following PatchData parameters:</p>
|
|
<p id="dataartsstudio_01_0508__p124421282816">You can click <strong id="dataartsstudio_01_0508__b188942098469">Add Date Range</strong> to add multiple discrete date ranges for PatchData. You must set at least one date range.</p>
|
|
<p id="dataartsstudio_01_0508__p12451111113914">You can click <strong id="dataartsstudio_01_0508__b10635144517481">Delete</strong> to delete discrete date ranges.</p>
|
|
<div class="note" id="dataartsstudio_01_0508__note13032311433"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0508__p112311271521">DataArts Studio does not support concurrent running of PatchData instances and periodic job instances of underlying services (such as CDM and DLI). To prevent PatchData instances from affecting periodic job instances and avoid exceptions, ensure that they do not run at the same time.</p>
|
|
</div></div>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__row1965185315584"><td class="cellrowborder" valign="top" width="35.17%" headers="mcps1.3.11.5.6.4.2.3.1.1 "><p id="dataartsstudio_01_0508__p565119534582">Run PatchData Tasks Periodically</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="64.83%" headers="mcps1.3.11.5.6.4.2.3.1.2 "><ul id="dataartsstudio_01_0508__ul1559165055914"><li id="dataartsstudio_01_0508__li159195005913"><strong id="dataartsstudio_01_0508__b490805710295">Yes</strong>: PatchData jobs will be executed based on the configured period.<p id="dataartsstudio_01_0508__p96891813559"><strong id="dataartsstudio_01_0508__b1467411033510">The first value</strong> indicates a specific value.</p>
|
|
<p id="dataartsstudio_01_0508__p4240202016414"><strong id="dataartsstudio_01_0508__b1325293411187">The second value</strong> indicates that data is patched based on a specified period, for example, hours, days, weeks, or months.</p>
|
|
<div class="note" id="dataartsstudio_01_0508__note9763352121315"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0508__p476325231313">If you set a period, PatchData tasks will be scheduled based on that period. If the job is scheduled every few minutes, hours, or days, PatchData tasks will be scheduled based on the period you set. For example, if you want to patch data from 00:00 on Jan 1, 2023 to 00:00 on Feb 1, 2023 for an hourly job that starts at 01:00 every day, and set the PatchData period to two days, PatchData tasks will be scheduled at 00:00 on Jan 1, 2023, 00:00 on Jan 3, 2023, 00:00 on Jan 5, 2023, and so on. If the PatchData task scheduling period is in months and the first scheduling date falls on the last day of a month, PatchData tasks will be scheduled on the last day of each month.</p>
|
|
</div></div>
|
|
</li><li id="dataartsstudio_01_0508__li11595508596"><strong id="dataartsstudio_01_0508__b111571422173610">No</strong>: PatchData jobs will not be executed periodically. Instead, the system executes PatchData jobs based on the existing rule.</li></ul>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__row299512518020"><td class="cellrowborder" valign="top" width="35.17%" headers="mcps1.3.11.5.6.4.2.3.1.1 "><p id="dataartsstudio_01_0508__p7995175120013">Cycle</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="64.83%" headers="mcps1.3.11.5.6.4.2.3.1.2 "><p id="dataartsstudio_01_0508__p19995135111018">This parameter is required when <strong id="dataartsstudio_01_0508__b103274348558">Scheduling Time Type</strong> is set to <strong id="dataartsstudio_01_0508__b156011539115516">Discrete date ranges</strong>.</p>
|
|
<p id="dataartsstudio_01_0508__p1120614227518">It specifies the PatchData cycle.</p>
|
|
<p id="dataartsstudio_01_0508__p12514182219316">You can click <strong id="dataartsstudio_01_0508__b74181548961">Viewing Scheduling Details</strong> to view the execution time of the task instances in the current time segment.</p>
|
|
<div class="note" id="dataartsstudio_01_0508__note72700101518"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0508__p10270119152">This parameter is required only when a job is scheduled by hour or minute and <strong id="dataartsstudio_01_0508__b20526191916123">Scheduling Time Type</strong> is set to <strong id="dataartsstudio_01_0508__b1215202751214">Discrete date ranges</strong>.</p>
|
|
</div></div>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__en-us_topic_0159100548_row6501415546"><td class="cellrowborder" valign="top" width="35.17%" headers="mcps1.3.11.5.6.4.2.3.1.1 "><p id="dataartsstudio_01_0508__en-us_topic_0159100548_p3501448544">Parallel Instances</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="64.83%" headers="mcps1.3.11.5.6.4.2.3.1.2 "><p id="dataartsstudio_01_0508__en-us_topic_0159100548_p17509415413">Number of instances to be executed at the same time. A maximum of five instances can be executed at the same time.</p>
|
|
<p id="dataartsstudio_01_0508__p12578421132016">If you select <strong id="dataartsstudio_01_0508__b494022112197">Yes</strong> for <strong id="dataartsstudio_01_0508__b094072113193">Patch Data by Day</strong>, <strong id="dataartsstudio_01_0508__b39406214192">Parallel Instances</strong> means the number of concurrent job instances on the same day.</p>
|
|
<p id="dataartsstudio_01_0508__p1651812318227">If you select <strong id="dataartsstudio_01_0508__b169559436198">No</strong> for <strong id="dataartsstudio_01_0508__b199561443131917">Patch Data by Day</strong>, <strong id="dataartsstudio_01_0508__b119561943191916">Parallel Instances</strong> means the number of concurrent job instances in the scheduling cycle.</p>
|
|
<div class="note" id="dataartsstudio_01_0508__note14889164191915"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0508__p1188910417190">Set this parameter based on the site requirements. For example, if a CDM job instance is used, data cannot be supplemented at the same time. The value of this parameter can only be set to <strong id="dataartsstudio_01_0508__b167842233116">1</strong>.</p>
|
|
</div></div>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__en-us_topic_0159100548_row4501543540"><td class="cellrowborder" valign="top" width="35.17%" headers="mcps1.3.11.5.6.4.2.3.1.1 "><p id="dataartsstudio_01_0508__en-us_topic_0159100548_p1250841547">Upstream or Downstream Job</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="64.83%" headers="mcps1.3.11.5.6.4.2.3.1.2 "><p id="dataartsstudio_01_0508__p1655273601318">Select the upstream and downstream jobs (jobs that depend on the current job) that require PatchData.</p>
|
|
<p id="dataartsstudio_01_0508__en-us_topic_0159100548_p7504425413">The job dependency graph is displayed. For details about the operations on the job dependency graph, see <a href="#dataartsstudio_01_0508__section1913992715419">Batch Job Monitoring: Viewing a Job Dependency Graph</a>.</p>
|
|
<div class="note" id="dataartsstudio_01_0508__note752161414376"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0508__p135215144377">If you set <strong id="dataartsstudio_01_0508__b022519241196">Run PatchData Tasks Periodically</strong> to <strong id="dataartsstudio_01_0508__b15122143231918">Yes</strong>, you can only select an upstream or downstream job with the same scheduling period as the job.</p>
|
|
</div></div>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__row19532014457"><td class="cellrowborder" valign="top" width="35.17%" headers="mcps1.3.11.5.6.4.2.3.1.1 "><p id="dataartsstudio_01_0508__p3517201456">Patch Data by Day</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="64.83%" headers="mcps1.3.11.5.6.4.2.3.1.2 "><p id="dataartsstudio_01_0508__p121210336464">If you select <strong id="dataartsstudio_01_0508__b20644125917202">Yes</strong>, PatchData instances on the same day can be executed concurrently for a job, but those on different days cannot be executed concurrently. For example, a job instance scheduled at 5:00 and one scheduled at 6:00 can be executed concurrently, but a job instance scheduled on 1st of a month and one scheduled on 2nd of the month cannot be executed concurrently.</p>
|
|
<p id="dataartsstudio_01_0508__p05251729164610"><strong id="dataartsstudio_01_0508__b1477118507224">Yes</strong>: Data is patched by day.</p>
|
|
<p id="dataartsstudio_01_0508__p189976418466"><strong id="dataartsstudio_01_0508__b1756416512235">No</strong>: Data is not patched by day.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__row79911556717"><td class="cellrowborder" valign="top" width="35.17%" headers="mcps1.3.11.5.6.4.2.3.1.1 "><p id="dataartsstudio_01_0508__p5992556719">Stop Upon Failure</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="64.83%" headers="mcps1.3.11.5.6.4.2.3.1.2 "><p id="dataartsstudio_01_0508__p39944566115">This parameter is mandatory if <strong id="dataartsstudio_01_0508__b13625163616018">Patch Data by Day</strong> is set to <strong id="dataartsstudio_01_0508__b75151431012">Yes</strong>.</p>
|
|
<p id="dataartsstudio_01_0508__p1814311431233"><strong id="dataartsstudio_01_0508__b412518501603">Yes</strong>: If a daily PatchData task fails, subsequent PatchData tasks stop immediately.</p>
|
|
<p id="dataartsstudio_01_0508__p414419431634"><strong id="dataartsstudio_01_0508__b122018439113">No</strong>: If a daily PatchData task fails, subsequent PatchData tasks continue.</p>
|
|
<div class="note" id="dataartsstudio_01_0508__note1952613416913"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0508__p15272341793">If data is patched by day and a PatchData task fails on a day, no PatchData task will be executed on the next day. This function is supported only by daily PatchData tasks, and not by hourly PatchData tasks.</p>
|
|
</div></div>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__row21101029163"><td class="cellrowborder" valign="top" width="35.17%" headers="mcps1.3.11.5.6.4.2.3.1.1 "><p id="dataartsstudio_01_0508__p121116217168">Priority</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="64.83%" headers="mcps1.3.11.5.6.4.2.3.1.2 "><p id="dataartsstudio_01_0508__p011252141613">Select a PatchData priority. You can set the priority of a workspace-level PatchData job in <a href="dataartsstudio_01_04501.html#dataartsstudio_01_04501__section1149418391843">Default Configuration</a>.</p>
|
|
<div class="note" id="dataartsstudio_01_0508__note1164101362011"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0508__p116411317200">The priority of PatchData is higher than that of PatchData in the workspace.</p>
|
|
<p id="dataartsstudio_01_0508__p114317481161">Currently, only the priorities of DLI SQL operators can be set.</p>
|
|
</div></div>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__row1270123710528"><td class="cellrowborder" valign="top" width="35.17%" headers="mcps1.3.11.5.6.4.2.3.1.1 "><p id="dataartsstudio_01_0508__p27012377527">Ignore OBS Listening</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="64.83%" headers="mcps1.3.11.5.6.4.2.3.1.2 "><ul id="dataartsstudio_01_0508__ul012434195315"><li id="dataartsstudio_01_0508__li81241455312"><strong id="dataartsstudio_01_0508__b997477416">Yes</strong>: OBS listening is ignored in PatchData scenarios.</li><li id="dataartsstudio_01_0508__li10820435155420"><strong id="dataartsstudio_01_0508__b76578361349">No</strong>: The system listens to the OBS path in PatchData scenarios.</li></ul>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0508__row28668307915"><td class="cellrowborder" valign="top" width="35.17%" headers="mcps1.3.11.5.6.4.2.3.1.1 "><p id="dataartsstudio_01_0508__p1866730599">Set Running Period</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="64.83%" headers="mcps1.3.11.5.6.4.2.3.1.2 "><p id="dataartsstudio_01_0508__p171241223121012">Whether a running period can be set for the PatchData task.</p>
|
|
<ul id="dataartsstudio_01_0508__ul1079615571391"><li id="dataartsstudio_01_0508__li0796457894">Yes<p id="dataartsstudio_01_0508__p1315516013112"><a name="dataartsstudio_01_0508__li0796457894"></a><a name="li0796457894"></a>You can set the time period for running the PatchData task every day.</p>
|
|
</li><li id="dataartsstudio_01_0508__li15796557994">No</li></ul>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</li><li id="dataartsstudio_01_0508__li985816550518">Click <span class="uicontrol" id="dataartsstudio_01_0508__en-us_topic_0159100548_uicontrol5540125715462"><b>OK</b></span>. The system starts to perform PatchData and the <span class="wintitle" id="dataartsstudio_01_0508__en-us_topic_0159100548_wintitle1295114131213"><b>PatchData Monitoring</b></span> page is displayed.</li></ol>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0508__en-us_topic_0159100548_section12186114111347"><a name="dataartsstudio_01_0508__en-us_topic_0159100548_section12186114111347"></a><a name="en-us_topic_0159100548_section12186114111347"></a><h4 class="sectiontitle">Batch Job Monitoring: Adding a Job Tag</h4><p id="dataartsstudio_01_0508__en-us_topic_0159100548_p4453121512598">Tags can be added to jobs to facilitate job instance filtering.</p>
|
|
<ol id="dataartsstudio_01_0508__ol2020433765110"><li id="dataartsstudio_01_0508__li9364171012584">Log in to the <span id="dataartsstudio_01_0508__en-us_topic_0000001987511677_en-us_topic_0000001127311125_text5574448155719_3">DataArts Studio</span> console by following the instructions in <a href="dataartsstudio_01_0001.html">Accessing the DataArts Studio Instance Console</a>.</li><li id="dataartsstudio_01_0508__li66651132923">On the <span id="dataartsstudio_01_0508__en-us_topic_0181092879_text185611381448_3">DataArts Studio</span> console, locate a workspace and click <strong id="dataartsstudio_01_0508__en-us_topic_0181092879_b65382814249_3">DataArts Factory</strong>.</li><li id="dataartsstudio_01_0508__li1599617397510">In the left navigation pane of DataArts Factory, choose <span class="menucascade" id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_menucascade13508951284_1"><b><span class="uicontrol" id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_uicontrol13508115686_1"><span id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_text1750819517811_1">Monitoring</span></span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_uicontrol125081256813_1"><span id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_text65081258811_1">Job Monitoring</span></span></b></span>.</li><li id="dataartsstudio_01_0508__li72041237185111">Click the <span class="wintitle" id="dataartsstudio_01_0508__wintitle16106132111913"><b>Batch Job Monitoring</b></span> tab.</li><li id="dataartsstudio_01_0508__li84032015154618">In the <strong id="dataartsstudio_01_0508__b1553221320191">Operation</strong> column of a job, choose <span class="menucascade" id="dataartsstudio_01_0508__menucascade840371504619"><b><span class="uicontrol" id="dataartsstudio_01_0508__uicontrol1040361534613">More</span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0508__uicontrol640381584611">Add Job Tag</span></b></span>.</li><li id="dataartsstudio_01_0508__li2031724374716">In the <strong id="dataartsstudio_01_0508__b2501956191914">Add Job Tag</strong> dialog box displayed, set the job tag parameters.<div class="fignone" id="dataartsstudio_01_0508__fig631794394712"><span class="figcap"><b>Figure 5 </b>Parameters for adding a job tag</span><br><span><img id="dataartsstudio_01_0508__image12483141615487" src="en-us_image_0000002234240480.png" title="Click to enlarge" class="imgResize"></span></div>
|
|
</li><li id="dataartsstudio_01_0508__li6166932114919">Click <strong id="dataartsstudio_01_0508__b1237732542010">OK</strong>.</li></ol>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0508__section1913992715419"><a name="dataartsstudio_01_0508__section1913992715419"></a><a name="section1913992715419"></a><h4 class="sectiontitle">Batch Job Monitoring: Viewing a Job Dependency Graph</h4><p id="dataartsstudio_01_0508__p7139102718540">In the job dependency graph, you can view the dependencies between jobs.</p>
|
|
<ol id="dataartsstudio_01_0508__ol3139122785410"><li id="dataartsstudio_01_0508__li967814153588">Log in to the <span id="dataartsstudio_01_0508__en-us_topic_0000001987511677_en-us_topic_0000001127311125_text5574448155719_4">DataArts Studio</span> console by following the instructions in <a href="dataartsstudio_01_0001.html">Accessing the DataArts Studio Instance Console</a>.</li><li id="dataartsstudio_01_0508__li158321636126">On the <span id="dataartsstudio_01_0508__en-us_topic_0181092879_text185611381448_4">DataArts Studio</span> console, locate a workspace and click <strong id="dataartsstudio_01_0508__en-us_topic_0181092879_b65382814249_4">DataArts Factory</strong>.</li><li id="dataartsstudio_01_0508__li1139727165412">In the left navigation pane of DataArts Factory, choose <span class="menucascade" id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_menucascade13508951284_2"><b><span class="uicontrol" id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_uicontrol13508115686_2"><span id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_text1750819517811_2">Monitoring</span></span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_uicontrol125081256813_2"><span id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_text65081258811_2">Job Monitoring</span></span></b></span>.</li><li id="dataartsstudio_01_0508__li1146817514228">Click the <span class="wintitle" id="dataartsstudio_01_0508__wintitle97131620132111"><b>Batch Job Monitoring</b></span> tab.</li><li id="dataartsstudio_01_0508__li2046815111228">In the <span class="parmname" id="dataartsstudio_01_0508__parmname175228436507"><b>Operation</b></span> column of a job, choose <span class="menucascade" id="dataartsstudio_01_0508__menucascade14305657105010"><b><span class="uicontrol" id="dataartsstudio_01_0508__uicontrol18305175745012">More</span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0508__uicontrol8305557145016">View Job Dependency Graph</span></b></span>.</li><li id="dataartsstudio_01_0508__li1271055142913">On the displayed <strong id="dataartsstudio_01_0508__b139971744133019">Job Dependency</strong> page, perform any of the following operations:<ul id="dataartsstudio_01_0508__en-us_topic_0000001086717757_ul95750281404"><li id="dataartsstudio_01_0508__en-us_topic_0000001086717757_li82047227510">In the upper right corner, select <strong id="dataartsstudio_01_0508__b2275848203019">Display complete dependency graphs</strong>, <strong id="dataartsstudio_01_0508__b13275184813308">Display the current job and its upstream and downstream jobs</strong>, or <strong id="dataartsstudio_01_0508__b1427554813308">Display the current job and its directly connected jobs</strong>.</li><li id="dataartsstudio_01_0508__en-us_topic_0000001086717757_li8316133271211">In the search box in the upper right corner, you can enter the name of a node to search for the node. The node found will be highlighted.</li><li id="dataartsstudio_01_0508__en-us_topic_0000001086717757_li710413427475">Click <strong id="dataartsstudio_01_0508__b3477539304">Download</strong> to download the job dependency file.</li><li id="dataartsstudio_01_0508__en-us_topic_0000001086717757_li1957515282001">Scroll your mouse wheel to zoom in or zoom out the dependency graph.</li><li id="dataartsstudio_01_0508__en-us_topic_0000001086717757_li1320783313612">Drag the blank area to view the complete relationship graph.</li><li id="dataartsstudio_01_0508__en-us_topic_0000001086717757_li11315062915">When the cursor is hovered on a job node, the node is marked green, its upstream job is marked blue, and its downstream job is marked orange.<div class="fignone" id="dataartsstudio_01_0508__en-us_topic_0000001086717757_fig14265092912"><span class="figcap"><b>Figure 6 </b>Marking upstream and downstream job nodes of a node</span><br><span><img id="dataartsstudio_01_0508__en-us_topic_0000001086717757_image1818916155401" src="en-us_image_0000002269119869.png" title="Click to enlarge" class="imgResize"></span></div>
|
|
</li><li id="dataartsstudio_01_0508__en-us_topic_0000001086717757_li1484808175310">Right-click a job node to view the job, copy the job name, and collapse upstream or downstream jobs.<div class="fignone" id="dataartsstudio_01_0508__en-us_topic_0000001086717757_fig3579142418300"><span class="figcap"><b>Figure 7 </b>Job node operations</span><br><span><img id="dataartsstudio_01_0508__en-us_topic_0000001086717757_image1837153617417" src="en-us_image_0000002234080640.png" title="Click to enlarge" class="imgResize"></span></div>
|
|
<p id="dataartsstudio_01_0508__p18759182418127"></p>
|
|
</li></ul>
|
|
</li></ol>
|
|
<p id="dataartsstudio_01_0508__p195041311244">You can also view the node monitoring information of a job on the job details page.</p>
|
|
<ol id="dataartsstudio_01_0508__ol251917318246"><li id="dataartsstudio_01_0508__li1718216289584">Log in to the <span id="dataartsstudio_01_0508__en-us_topic_0000001987511677_en-us_topic_0000001127311125_text5574448155719_5">DataArts Studio</span> console by following the instructions in <a href="dataartsstudio_01_0001.html">Accessing the DataArts Studio Instance Console</a>.</li><li id="dataartsstudio_01_0508__li1942818421424">On the <span id="dataartsstudio_01_0508__en-us_topic_0181092879_text185611381448_5">DataArts Studio</span> console, locate a workspace and click <strong id="dataartsstudio_01_0508__en-us_topic_0181092879_b65382814249_5">DataArts Factory</strong>.</li><li id="dataartsstudio_01_0508__li104403218416">In the left navigation pane of DataArts Factory, choose <span class="menucascade" id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_menucascade13508951284_3"><b><span class="uicontrol" id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_uicontrol13508115686_3"><span id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_text1750819517811_3">Monitoring</span></span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_uicontrol125081256813_3"><span id="dataartsstudio_01_0508__en-us_topic_0181289902_en-us_topic_0159100548_text65081258811_3">Job Monitoring</span></span></b></span>.</li><li id="dataartsstudio_01_0508__li10519193162415">Click the <span class="wintitle" id="dataartsstudio_01_0508__wintitle12243710112211"><b>Batch Job Monitoring</b></span> tab.</li><li id="dataartsstudio_01_0508__li195191431192416">Click a job name and then a node to view monitoring information of the node.<p id="dataartsstudio_01_0508__p13519631182414"><a name="dataartsstudio_01_0508__li195191431192416"></a><a name="li195191431192416"></a>Click <strong id="dataartsstudio_01_0508__b1263713372211">Edit</strong> to access the job development page.</p>
|
|
</li></ol>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0413.html">Monitoring a Job</a></div>
|
|
</div>
|
|
</div>
|
|
|
|
|
|
<script language="JavaScript">
|
|
<!--
|
|
initImageViewer('.imgResize');
|
|
var msg_imageMax = "view original image";
|
|
var msg_imageClose = "close";
|
|
//--></script> |