yexinru/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
Files
0b3a43371a4bcc99577594de0a685249d676a567
doc-exports/docs/dataartsstudio/umn/dataartsstudio_01_0089.html
chenxiaoxiong f9e2808b7c DataArts UMN 20250810 version 
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Co-authored-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
Co-committed-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
2025-09-02 10:44:13 +00:00

49 lines
26 KiB
HTML
Raw Blame History

<a name="dataartsstudio_01_0089"></a><a name="dataartsstudio_01_0089"></a>
<h1 class="topictitle1">Migrating Data from OBS to DLI</h1>
<div id="body8662426"><div class="section" id="dataartsstudio_01_0089__en-us_topic_0108275364_section21020958143223"><h4 class="sectiontitle">Scenario</h4><p id="dataartsstudio_01_0089__en-us_topic_0108275364_p4504939393411">DLI is a fully hosted big data query service. This section describes how to use CDM to migrate data from OBS to DLI. The procedure includes four steps:</p>
<ol id="dataartsstudio_01_0089__en-us_topic_0108275364_ol0281507308"><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li5281303305"><a href="#dataartsstudio_01_0089__en-us_topic_0108275364_section817245122914">Creating a CDM Cluster</a></li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li93261904476"><a href="#dataartsstudio_01_0089__en-us_topic_0108275364_section42195618294">Creating a DLI Link</a></li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li1268558114713"><a href="#dataartsstudio_01_0089__en-us_topic_0108275364_section12969166122916">Creating an OBS Link</a></li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li845221714470"><a href="#dataartsstudio_01_0089__en-us_topic_0108275364_section1508747294234">Creating a Migration Job</a></li></ol>
</div>
<div class="section" id="dataartsstudio_01_0089__en-us_topic_0108275364_section5787168294234"><h4 class="sectiontitle">Prerequisites</h4><ul id="dataartsstudio_01_0089__en-us_topic_0108275364_ul155523073416"><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li145521904343">You have enabled OBS and DLI and have the permissions to read data from OBS.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li131005433414">You have created resource queues, databases, and tables on DLI.</li></ul>
</div>
<div class="section" id="dataartsstudio_01_0089__en-us_topic_0108275364_section817245122914"><a name="dataartsstudio_01_0089__en-us_topic_0108275364_section817245122914"></a><a name="en-us_topic_0108275364_section817245122914"></a><h4 class="sectiontitle">Creating a CDM Cluster</h4><p id="dataartsstudio_01_0089__en-us_topic_0108275364_p342142211225">Create a CDM cluster.</p>
<p id="dataartsstudio_01_0089__en-us_topic_0108275364_p19946119193911">In this scenario, if the CDM cluster is used only to migrate data from OBS to DLI and does not need to migrate data of other data sources, there is no special requirements on the VPC, subnet, and security group of the CDM cluster. You can specify them based on your needs. CDM accesses DLI and OBS through the intranet. The flavor of the CDM cluster is selected based on the amount of data to be migrated. Generally, cdm.medium meets the requirements for most migration scenarios.</p>
</div>
<div class="section" id="dataartsstudio_01_0089__en-us_topic_0108275364_section42195618294"><a name="dataartsstudio_01_0089__en-us_topic_0108275364_section42195618294"></a><a name="en-us_topic_0108275364_section42195618294"></a><h4 class="sectiontitle">Creating a DLI Link</h4><ol id="dataartsstudio_01_0089__en-us_topic_0108275364_ol1912110109465"><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li135396271350"><span>Click <span class="uicontrol" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275298_uicontrol19806194174318"><b>Job Management</b></span> in the <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275298_b2806249435">Operation</strong> column of the CDM cluster. On the displayed page, click the <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275298_b480613424310">Links</strong> tab and then <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275298_b10806184174313">Create Link</strong>. The <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275298_b16807154184319">Select Connector</strong> page is displayed.</span></li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li23421555144710"><span>Select <span class="uicontrol" id="dataartsstudio_01_0089__en-us_topic_0108275364_uicontrol1570810213547"><b>Data Lake Insight</b></span>, click <span class="uicontrol" id="dataartsstudio_01_0089__en-us_topic_0108275364_uicontrol1472302118541"><b>Next</b></span>, and configure the DLI link parameters. See <a href="#dataartsstudio_01_0089__en-us_topic_0108275364_fig193421755164718">Figure 1</a>.</span><p><ul id="dataartsstudio_01_0089__en-us_topic_0108275364_ul18342195564712"><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li934235584711"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_b1538114511549">Name</strong>: Enter a custom link name, for example, <span class="parmvalue" id="dataartsstudio_01_0089__en-us_topic_0108275364_parmvalue1256911415556"><b>dlilink</b></span>.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li6342055124717"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_b1156935218543">AK</strong> and <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_b16569652175418">SK</strong>: Enter the AK and SK used for accessing the DLI database.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li173421655154715"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_b0610141201918">Project ID</strong>: Enter the project ID of the region to which DLI belongs.</li></ul>
<div class="fignone" id="dataartsstudio_01_0089__en-us_topic_0108275364_fig193421755164718"><a name="dataartsstudio_01_0089__en-us_topic_0108275364_fig193421755164718"></a><a name="en-us_topic_0108275364_fig193421755164718"></a><span class="figcap"><b>Figure 1 </b>Creating a DLI link</span><br><span><img id="dataartsstudio_01_0089__en-us_topic_0108275364_image183420555471" src="en-us_image_0000002269197053.png"></span></div>
</p></li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li3624144134812"><span>Click <span class="uicontrol" id="dataartsstudio_01_0089__en-us_topic_0108275364_uicontrol1660061134"><b>Save</b></span>. The <span class="uicontrol" id="dataartsstudio_01_0089__en-us_topic_0108275364_uicontrol19600516315"><b>Link Management</b></span> page is displayed.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_0089__en-us_topic_0108275364_section12969166122916"><a name="dataartsstudio_01_0089__en-us_topic_0108275364_section12969166122916"></a><a name="en-us_topic_0108275364_section12969166122916"></a><h4 class="sectiontitle">Creating an OBS Link</h4><ol id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_ol726314523353"><li id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_li13979142135415"><span>Click <span class="uicontrol" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_uicontrol127563324020"><b>Job Management</b></span> in the <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_b1980633144013">Operation</strong> column of the CDM cluster. On the displayed page, click the <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_b1280233174012">Links</strong> tab and then <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_b19811033164015">Create Link</strong>. The <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_b281133315405">Select Connector</strong> page is displayed.</span><p><div class="fignone" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_fig159791021145416"><span class="figcap"><b>Figure 2 </b>Selecting a connector type</span><br><span><img id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275477_image53893842012" src="en-us_image_0000002234235252.png" title="Click to enlarge" class="imgResize"></span></div>
</p></li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_li38011752411"><span>Select <span class="parmvalue" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_parmvalue27182373401"><b>Object Storage Service (OBS)</b></span> and click <span class="uicontrol" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_uicontrol1271919377404"><b>Next</b></span> to configure parameters for the OBS link.</span><p><ul id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_ul1524835213519"><li id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_li82482528356"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_b87206318369">Name</strong>: Enter a custom link name, for example, <span class="uicontrol" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_uicontrol3720231113614"><b>obslink</b></span>.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_li9248852163516"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_b842352706113916">OBS Server</strong> and <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_b842352706113940">Port</strong>: Enter the actual OBS address information.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_li0248552153517"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_b84235270615565">AK</strong> and <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_b84235270615568">SK</strong>: Enter the AK and SK used for logging in to OBS.<div class="p" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_p13152215453">To obtain an access key, perform the following steps:<ol type="a" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_en-us_topic_0183643042_ol535183018588"><li id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535103025819">Log in to the management console, move the cursor to the username in the upper right corner, and select <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_b1586023610364">My Credentials</strong> from the drop-down list.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_en-us_topic_0183643042_li173533018584">On the <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_b149721128172418">My Credentials</strong> page, choose <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_b15803656132414">Access Keys</strong>, and click <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_b2452152020258">Create Access Key</strong>. See <a href="#dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615">Figure 3</a>.<div class="fignone" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"><a name="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><a name="en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><span class="figcap"><b>Figure 3 </b>Clicking Create Access Key</span><br><span><img id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_image20389043111611" src="en-us_image_0000002269194761.png" title="Click to enlarge" class="imgResize"></span></div>
</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535530185815">Click <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_b8340319122819">OK</strong> and save the access key file as prompted. The access key file will be saved to your browser's configured download location. Open the <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_b1940852512813">credentials.csv</strong> file to view <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_b191574128718">Access Key Id</strong> and <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_b175769149718">Secret Access Key</strong>.<div class="note" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_note4554158201"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_ul25541081906"><li id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_li175541819018">Only two access keys can be added for each user.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_li3554138305">To ensure access key security, the access key is automatically downloaded only when it is generated for the first time and cannot be obtained from the management console later. Keep them properly.</li></ul>
</div></div>
</li></ol>
</div>
</li></ul>
</p></li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_en-us_topic_0108275445_li8248125203520"><span>Click <span class="uicontrol" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_uicontrol1176911318388"><b>Save</b></span>. The <span class="uicontrol" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0123434187_uicontrol3769031133812"><b>Link Management</b></span> page is displayed.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_0089__en-us_topic_0108275364_section1508747294234"><a name="dataartsstudio_01_0089__en-us_topic_0108275364_section1508747294234"></a><a name="en-us_topic_0108275364_section1508747294234"></a><h4 class="sectiontitle">Creating a Migration Job</h4><ol id="dataartsstudio_01_0089__en-us_topic_0108275364_ol4836259095851"><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li6209919410469"><span>Choose <span class="menucascade" id="dataartsstudio_01_0089__en-us_topic_0108275364_menucascade173043715259"><b><span class="uicontrol" id="dataartsstudio_01_0089__en-us_topic_0108275364_uicontrol6730153772515">Table/File Migration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_0089__en-us_topic_0108275364_uicontrol57301371258">Create Job</span></b></span> to create a job for migrating data from OBS to DLI. See <a href="#dataartsstudio_01_0089__en-us_topic_0108275364_fig134515616469">Figure 4</a>.</span><p><div class="fignone" id="dataartsstudio_01_0089__en-us_topic_0108275364_fig134515616469"><a name="dataartsstudio_01_0089__en-us_topic_0108275364_fig134515616469"></a><a name="en-us_topic_0108275364_fig134515616469"></a><span class="figcap"><b>Figure 4 </b>Creating a job for migrating data from OBS to DLI</span><br><span><img id="dataartsstudio_01_0089__en-us_topic_0108275364_image598992012544" src="en-us_image_0000002234077772.png" title="Click to enlarge" class="imgResize"></span></div>
<ul id="dataartsstudio_01_0089__en-us_topic_0108275364_ul54261246111141"><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li14031455165315"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_b162871227334">Job Name</strong>: Enter a custom job name.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li20539370518"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_b5818133218310">Source Link Name</strong>: Select the <span class="parmvalue" id="dataartsstudio_01_0089__en-us_topic_0108275364_parmvalue1481814324317"><b>obslink</b></span> link created in <a href="#dataartsstudio_01_0089__en-us_topic_0108275364_section12969166122916">Creating an OBS Link</a>.<ul id="dataartsstudio_01_0089__en-us_topic_0108275364_ul946034013517"><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li552213424518"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_b842352706105336">Bucket Name</strong>: Select the bucket from which the data is to be migrated.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li624832145213"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_b84235270610544">Source Directory/File</strong>: Set this parameter to the path of the data to be migrated.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li1654163719527"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_b88191538415">File Format</strong>: Select <span class="parmvalue" id="dataartsstudio_01_0089__en-us_topic_0108275364_parmvalue1599112244411"><b>CSV</b></span> or <span class="parmvalue" id="dataartsstudio_01_0089__en-us_topic_0108275364_parmvalue154609306415"><b>JSON</b></span> for transferring files to a data table.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li54123274111239">Retain the default values of the optional parameters in <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_b245653918536">Show Advanced Attributes</strong>.</li></ul>
</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li1082375355219"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_b22265401245">Destination Link Name</strong>: Select the <span class="parmvalue" id="dataartsstudio_01_0089__en-us_topic_0108275364_parmvalue513319486410"><b>dlilink</b></span> link created in <a href="#dataartsstudio_01_0089__en-us_topic_0108275364_section42195618294">Creating a DLI Link</a>.<ul id="dataartsstudio_01_0089__en-us_topic_0108275364_ul1615155605210"><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li178938201651"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_b14519112217356">Resource Queue</strong>: Enter the resource queue to which the destination table belongs.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li8495257105212"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_b5631103493712">Database Name</strong>: Enter the name of the database to which data is to be written.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li45011599413"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_b4771114513714">Table Name</strong>: Enter the name of the table to which data is to be written. CDM cannot automatically create tables on DLI. The table must be created on DLI in advance, and the field types and formats of the table must be consistent with those of the data to be migrated.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li16267563111423"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_b440019321864">Clear Before Importing Data</strong>: Choose whether to clear data in the destination table before data import. In this example, retain the default value.</li></ul>
</li></ul>
</p></li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li59151048111210"><span>Click <span class="uicontrol" id="dataartsstudio_01_0089__en-us_topic_0108275364_uicontrol35891551610"><b>Next</b></span>. The <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_b175895551562">Map Field</strong> page is displayed. CDM automatically matches the source and destination fields.</span><p><ul id="dataartsstudio_01_0089__en-us_topic_0108275364_ul2086033675113"><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li286063610513">If the field mapping is incorrect, you can drag the fields to adjust the mapping.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li557993195213">CDM supports field conversion during the migration. </li></ul>
</p></li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li47753211373"><span>Click <span class="uicontrol" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_uicontrol6471103355516"><b>Next</b></span> and set task parameters. Generally, retain the default values of all parameters.</span><p><div class="p" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_p574914560220">In this step, you can configure the following optional functions:<ul id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_ul65067533203334"><li id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_li37800576203334"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_b95381451163716">Retry If Failed</strong>: Determine whether to automatically retry the job if it fails. Retain the default value <span class="parmvalue" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_parmvalue137031560212"><b>Never</b></span>.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_li158210387356"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_b117553917428">Group</strong>: Select the group to which the job belongs. The default group is <span class="parmvalue" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_parmvalue1229163714324"><b>DEFAULT</b></span>. On the <span class="wintitle" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_wintitle161211277446"><b>Job Management</b></span> page, jobs can be displayed, started, or exported by group.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_li33236331203339"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_b447277982112428">Schedule Execution</strong>: Determine whether to automatically execute the job at a scheduled time. Retain the default value <span class="parmvalue" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_parmvalue12389152254610"><b>No</b></span> in this example.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_li65386286258"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_b0990135545110">Concurrent Extractors</strong>: Enter the number of concurrent extractors. An appropriate value improves migration efficiency. Retain the default value <span class="parmvalue" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_parmvalue1939217251214"><b>1</b></span>.</li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_li1396265172616"><strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_b115901914176">Write Dirty Data</strong>: Specify this parameter if data that fails to be processed or filtered out during job execution needs to be written to OBS for future viewing. Before writing dirty data, create an OBS link on the CDM console. Retain the default value <span class="parmvalue" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_parmvalue1890595274511"><b>No</b></span> so that dirty data is not recorded.</li></ul>
<div class="fignone" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_fig81141229205912"><span class="figcap"><b>Figure 5 </b>Configuring the task</span><br><span><img id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275315_image1793431113212" src="en-us_image_0000002269114701.png" title="Click to enlarge" class="imgResize"></span></div>
</div>
</p></li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li1577510223710"><span>Click <span class="uicontrol" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275326_uicontrol1362446142110"><b>Save and Run</b></span>. The <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275326_b867281052113">Job Management</strong> page is displayed, on which you can view the job execution progress and result.</span></li><li id="dataartsstudio_01_0089__en-us_topic_0108275364_li1189115352456"><span>After the job is successfully executed, in the <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275326_b78588166211">Operation</strong> column of the job, click <span class="uicontrol" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275326_uicontrol6858616102110"><b>Historical Record</b></span> to view the job's historical execution records and read/write statistics.</span><p><p id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275326_p1891735144518">On the <strong id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275326_b1470242882110">Historical Record</strong> page, click <span class="uicontrol" id="dataartsstudio_01_0089__en-us_topic_0108275364_en-us_topic_0108275326_uicontrol147021628182113"><b>Log</b></span> to view the job logs.</p>
</p></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0086.html">Tutorials</a></div>
</div>
</div>
<script language="JavaScript">
<!--
initImageViewer('.imgResize');
var msg_imageMax = "view original image";
var msg_imageClose = "close";
//--></script>
View Git Blame Copy Permalink