forked from docs/doc-exports
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: chenxiaoxiong <chenxiaoxiong@huawei.com> Co-committed-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
25 lines
7.1 KiB
HTML
25 lines
7.1 KiB
HTML
<a name="dataartsstudio_01_0432"></a><a name="dataartsstudio_01_0432"></a>
|
|
|
|
<h1 class="topictitle1">Job Development Process</h1>
|
|
<div id="body8662426"><div class="p" id="dataartsstudio_01_0432__p1733021917477">The job development function provides the following capabilities:<ul id="dataartsstudio_01_0432__ul75311824164717"><li id="dataartsstudio_01_0432__li14871343135715">Provides a graphical designer that allows you to quickly build a data processing workflow by drag-and-drop.</li><li id="dataartsstudio_01_0432__li1148714437576">Presets multiple job types, such as data integration, computing and analysis, data monitoring, and resource management, and completes complex data analysis and processing based on dependencies between jobs.</li><li id="dataartsstudio_01_0432__li20266164519489">Supports various scheduling modes.</li><li id="dataartsstudio_01_0432__li1448714433576">Supports job import and export.</li><li id="dataartsstudio_01_0432__li1382233665114">Monitors job status and sends job result notifications.</li><li id="dataartsstudio_01_0432__li683585821213">Provides editing locks for collaborative development.</li><li id="dataartsstudio_01_0432__li16559525214">Supports job version management and generation of saved and submitted versions.<div class="note" id="dataartsstudio_01_0432__note784492520269"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0432__en-us_topic_0181092878_p138232027102615">If you save a script multiple times within a minute, only one version is recorded. If the intermediate data is important, you can click <strong id="dataartsstudio_01_0432__en-us_topic_0181092878_b6615131505410">Save new version</strong> to save and add a version.</p>
|
|
</div></div>
|
|
</li><li id="dataartsstudio_01_0432__li6213184219223">Allows you to right-click a job to quickly copy the job name and to quickly close an opened job tab page.</li><li id="dataartsstudio_01_0432__li1887619191811">Provides a link in the execution results of single-task MRS Spark SQL and MRS Hive SQL jobs that use a connection of the MRS API type. Through this link, you can switch to MRS Yarn to view execution logs.</li><li id="dataartsstudio_01_0432__li1966810665317">Allows you to switch to the task release page by clicking <strong id="dataartsstudio_01_0432__b1483102316235">Release</strong> when developing a job in enterprise mode.</li><li id="dataartsstudio_01_0432__li18376144922813">Allows you to filter submitted, unsubmitted, scheduled, and unscheduled jobs. Unsubmitted jobs are marked in red, and unscheduled jobs are marked in yellow.</li><li id="dataartsstudio_01_0432__li1417718262123">Allows you to configure the SQL editor style for single-task jobs. Click <strong id="dataartsstudio_01_0432__b1562995361818">Style Configuration</strong> to configure the editor, icon display, annotation templates, and shortcut keys that can be used in the SQL script editor.</li><li id="dataartsstudio_01_0432__li11449114916">Allows you to view single-task SQL query results in a table or list. You can click <strong id="dataartsstudio_01_0432__b35231815171912">Style Configuration</strong> and set <strong id="dataartsstudio_01_0432__b2524171581913">SQL Query Result Display Mode</strong> on the <strong id="dataartsstudio_01_0432__b145241215131913">Configure Editor</strong> tab page.</li><li id="dataartsstudio_01_0432__li137041413105216">You can filter out the latest jobs by owner or update time.</li><li id="dataartsstudio_01_0432__li1868821813401">Fine-grained permission control is available for job development. You can configure permission control policies for the job directories in DataArts Factory.</li><li id="dataartsstudio_01_0432__li9648152210374">You can click <strong id="dataartsstudio_01_0432__b141601542516">Baseline Link</strong> to view the baseline link to which a job belongs. If a job is not associated with any baseline, <strong id="dataartsstudio_01_0432__b177837162619">Baseline Link</strong> is unavailable.</li></ul>
|
|
</div>
|
|
<div class="p" id="dataartsstudio_01_0432__en-us_topic_0155308177_p11212143991410">Before developing a job, you can learn about the basic job development process.<div class="fignone" id="dataartsstudio_01_0432__fig751515296455"><span class="figcap"><b>Figure 1 </b>Job development process</span><br><span><img class="imgResize" id="dataartsstudio_01_0432__image7515122918451" src="en-us_image_0000002234237740.png" title="Click to enlarge"></span></div>
|
|
</div>
|
|
<ol id="dataartsstudio_01_0432__ol28625151589"><li id="dataartsstudio_01_0432__li87675301915">Create a job: Currently, two job types are available: batch and real-time, which are used for batch data processing and real-time connection data processing, respectively. Batch jobs support pipeline and single-node modes. For details, see <a href="dataartsstudio_01_0434.html">Creating a Job</a>.</li><li id="dataartsstudio_01_0432__li8210141120130">Develop the job: Develop the created job. You can orchestrate and configure nodes. For details, see <a href="dataartsstudio_01_0435.html">Developing a Pipeline Job</a>.</li><li id="dataartsstudio_01_0432__li16464192618220">Schedule the job: Configure job scheduling tasks. For details, see <a href="dataartsstudio_01_0470.html">Setting Up Scheduling for a Job</a>.<ul id="dataartsstudio_01_0432__ul188562379228"><li id="dataartsstudio_01_0432__li6856113713227">If the processing mode of a job is batch processing, configure scheduling types for jobs. Three scheduling types are supported: run once, run periodically, and event-based. For details, see <a href="dataartsstudio_01_0470.html#dataartsstudio_01_0470__en-us_topic_0099797007_section1590152794714">Setting Up Scheduling for a Job Using the Batch Processing Mode</a>.</li><li id="dataartsstudio_01_0432__li887220416222">If the processing mode of a job is real-time processing, configure scheduling types for nodes. Three scheduling types are supported: run once, run periodically, and event-based. For details, see <a href="dataartsstudio_01_0470.html#dataartsstudio_01_0470__en-us_topic_0099797007_section644754422910">Setting Up Scheduling for Nodes of a Job Using the Real-Time Processing Mode</a>.</li></ul>
|
|
</li><li id="dataartsstudio_01_0432__li186211510587">Submit a version and unlock the script: After performing this step, the job can be scheduled and modified by other developers. For details, see <a href="dataartsstudio_01_0902.html">Submitting a Version</a>.</li><li id="dataartsstudio_01_0432__li52761415194616">(Optional) Manage the job: After the job development is complete, you can manage the job as required. For details, see <a href="dataartsstudio_01_0408.html">(Optional) Managing Jobs</a>.</li><li id="dataartsstudio_01_0432__li5442155053411">Release the job. This step is required in enterprise mode. For details, see <a href="dataartsstudio_01_1903.html">Releasing a Job Task</a>.</li></ol>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0431.html">Job Development</a></div>
|
|
</div>
|
|
</div>
|
|
|
|
|
|
<script language="JavaScript">
|
|
<!--
|
|
initImageViewer('.imgResize');
|
|
var msg_imageMax = "view original image";
|
|
var msg_imageClose = "close";
|
|
//--></script> |