forked from docs/doc-exports
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: chenxiaoxiong <chenxiaoxiong@huawei.com> Co-committed-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
53 lines
28 KiB
HTML
53 lines
28 KiB
HTML
<a name="dataartsstudio_01_0103"></a><a name="dataartsstudio_01_0103"></a>
|
|
|
|
<h1 class="topictitle1">Migrating Data from MRS HDFS to OBS</h1>
|
|
<div id="body8662426"><div class="section" id="dataartsstudio_01_0103__en-us_topic_0284710797_section2353196237"><h4 class="sectiontitle">Scenario</h4><p id="dataartsstudio_01_0103__en-us_topic_0284710797_p19986314333">CDM supports file-to-file data migration. This section describes how to migrate data from MRS HDFS to OBS. The process is as follows:</p>
|
|
<ol id="dataartsstudio_01_0103__en-us_topic_0284710797_ol13108111115338"><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li9108211133318"><a href="#dataartsstudio_01_0103__en-us_topic_0284710797_section1596917553011">Creating a CDM Cluster and Binding an EIP to the Cluster</a></li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li2032341312336"><a href="#dataartsstudio_01_0103__en-us_topic_0284710797_section136013511582">Creating an MRS HDFS Link</a></li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li369571593319"><a href="#dataartsstudio_01_0103__en-us_topic_0284710797_section5774720191611">Creating an OBS Link</a></li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li2990161717336"><a href="#dataartsstudio_01_0103__en-us_topic_0284710797_section119151411712">Creating a Migration Job</a></li></ol>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0103__en-us_topic_0284710797_section563405015518"><h4 class="sectiontitle">Prerequisites</h4><ul id="dataartsstudio_01_0103__en-us_topic_0284710797_ul45436471068"><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li1458495263814">You have obtained the domain name, port number, AK, and SK for accessing OBS.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li2723271211445">You have created an MRS cluster.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li63901224135311">Your EIP quota is sufficient.</li></ul>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0103__en-us_topic_0284710797_section1596917553011"><a name="dataartsstudio_01_0103__en-us_topic_0284710797_section1596917553011"></a><a name="en-us_topic_0284710797_section1596917553011"></a><h4 class="sectiontitle">Creating a CDM Cluster and Binding an EIP to the Cluster</h4><ol id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0111325168_ol686765753513"><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li89807384515"><span id="dataartsstudio_01_0103__en-us_topic_0284710797_p342142211225">Create a CDM cluster.</span><p><p id="dataartsstudio_01_0103__en-us_topic_0284710797_p71409403512">The key configurations are as follows:</p>
|
|
<ul id="dataartsstudio_01_0103__en-us_topic_0284710797_ul15746738161720"><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li207467382175">The flavor of the CDM cluster is selected based on the amount of data to be migrated. Generally, cdm.medium meets the requirements for most migration scenarios.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li1774643817175">The VPC, subnet, and security group of the CDM cluster must be the same as those of the MRS cluster.</li></ul>
|
|
</p></li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0111325168_li1844914916273"><span>After the CDM cluster is created, on the <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b41981620155616">Cluster Management</strong> page, click <span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_uicontrol1819862016561"><b>Bind EIP</b></span> in the <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b1619822055611">Operation</strong> column to bind an EIP to the cluster. The CDM cluster uses the EIP to access MRS HDFS.</span><p><div class="note" id="dataartsstudio_01_0103__en-us_topic_0284710797_note24642513383"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0108275471_p1693084519332">If SSL encryption is configured for the access channel of a local data source, CDM cannot connect to the data source using the EIP.</p>
|
|
</div></div>
|
|
</p></li></ol>
|
|
<p id="dataartsstudio_01_0103__en-us_topic_0284710797_p14756183114584"></p>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0103__en-us_topic_0284710797_section136013511582"><a name="dataartsstudio_01_0103__en-us_topic_0284710797_section136013511582"></a><a name="en-us_topic_0284710797_section136013511582"></a><h4 class="sectiontitle">Creating an MRS HDFS Link</h4><ol id="dataartsstudio_01_0103__en-us_topic_0284710797_ol10523154914588"><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0111325168_li16641390115738"><span>On the <span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_uicontrol3694181165013"><b>Cluster Management</b></span> page, locate a cluster and click <span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_uicontrol176954111506"><b>Job Management</b></span> in the <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b11695161155018">Operation</strong> column. On the displayed page, click the <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b569511120506">Links</strong> tab and then <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b5695131112508">Create Link</strong>.</span><p><div class="fignone" id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0111325168_fig15373426133913"><span class="figcap"><b>Figure 1 </b>Selecting a connector type</span><br><span><img id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0108275477_image53893842012" src="en-us_image_0000002234235252.png" title="Click to enlarge" class="imgResize"></span></div>
|
|
</p></li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li45233495585"><span>Select <span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_uicontrol13790261625"><b>MRS HDFS</b></span> and click <span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_uicontrol18413261126"><b>Next</b></span> to configure parameters for the MRS HDFS link.</span><p><ul id="dataartsstudio_01_0103__en-us_topic_0284710797_ul395772416911"><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li1395719241594"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b17726037195719">Name</strong>: Enter a custom link name, for example, <span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_uicontrol1473163725714"><b>mrs_hdfs_link</b></span>.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li195976411108"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b11816228227">Manager IP</strong>: IP address of MRS Manager. Click <span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_uicontrol1586744965713"><b>Select</b></span> next to the <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b118681491579">Manager IP</strong> text box to select a created MRS cluster. CDM automatically fills in the authentication information.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li12964164591215"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b2081520441428">Username</strong>: If <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b81867694721752">Authentication Method</strong> is set to <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b23811247121752">KERBEROS</strong>, set the username and password for logging in to MRS Manager.<p id="dataartsstudio_01_0103__en-us_topic_0284710797_p1771411578131">If you need to create a snapshot when exporting a directory from HDFS, the user configured here must have the administrator permission on HDFS.</p>
|
|
</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li29891413171413"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b16471222319">Password</strong>: password for logging in to MRS Manager</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li6473141431517"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b118883231534">Authentication Method</strong>: authentication method for accessing MRS</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li99841721154518"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b1472095014318">Run Mode</strong>: Select the running mode of the HDFS link.</li></ul>
|
|
</p></li></ol>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0103__en-us_topic_0284710797_section5774720191611"><a name="dataartsstudio_01_0103__en-us_topic_0284710797_section5774720191611"></a><a name="en-us_topic_0284710797_section5774720191611"></a><h4 class="sectiontitle">Creating an OBS Link</h4><ol id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_ol726314523353"><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_li13979142135415"><span>Click <span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_uicontrol127563324020"><b>Job Management</b></span> in the <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_b1980633144013">Operation</strong> column of the CDM cluster. On the displayed page, click the <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_b1280233174012">Links</strong> tab and then <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_b19811033164015">Create Link</strong>. The <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_b281133315405">Select Connector</strong> page is displayed.</span><p><div class="fignone" id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_fig159791021145416"><span class="figcap"><b>Figure 2 </b>Selecting a connector type</span><br><span><img id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275477_image53893842012" src="en-us_image_0000002234235252.png" title="Click to enlarge" class="imgResize"></span></div>
|
|
</p></li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_li38011752411"><span>Select <span class="parmvalue" id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_parmvalue27182373401"><b>Object Storage Service (OBS)</b></span> and click <span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_uicontrol1271919377404"><b>Next</b></span> to configure parameters for the OBS link.</span><p><ul id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_ul1524835213519"><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_li82482528356"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_b87206318369">Name</strong>: Enter a custom link name, for example, <span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_uicontrol3720231113614"><b>obslink</b></span>.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_li9248852163516"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_b842352706113916">OBS Server</strong> and <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_b842352706113940">Port</strong>: Enter the actual OBS address information.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_li0248552153517"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_b84235270615565">AK</strong> and <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_b84235270615568">SK</strong>: Enter the AK and SK used for logging in to OBS.<div class="p" id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_p13152215453">To obtain an access key, perform the following steps:<ol type="a" id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_en-us_topic_0183643042_ol535183018588"><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535103025819">Log in to the management console, move the cursor to the username in the upper right corner, and select <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_b1586023610364">My Credentials</strong> from the drop-down list.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_en-us_topic_0183643042_li173533018584">On the <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_b149721128172418">My Credentials</strong> page, choose <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_b15803656132414">Access Keys</strong>, and click <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_b2452152020258">Create Access Key</strong>. See <a href="#dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615">Figure 3</a>.<div class="fignone" id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"><a name="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><a name="en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><span class="figcap"><b>Figure 3 </b>Clicking Create Access Key</span><br><span><img id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_image20389043111611" src="en-us_image_0000002269194761.png" title="Click to enlarge" class="imgResize"></span></div>
|
|
</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535530185815">Click <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_b8340319122819">OK</strong> and save the access key file as prompted. The access key file will be saved to your browser's configured download location. Open the <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_b1940852512813">credentials.csv</strong> file to view <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_b191574128718">Access Key Id</strong> and <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_b175769149718">Secret Access Key</strong>.<div class="note" id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_note4554158201"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_ul25541081906"><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_li175541819018">Only two access keys can be added for each user.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_en-us_topic_0000001129241845_li3554138305">To ensure access key security, the access key is automatically downloaded only when it is generated for the first time and cannot be obtained from the management console later. Keep them properly.</li></ul>
|
|
</div></div>
|
|
</li></ol>
|
|
</div>
|
|
</li></ul>
|
|
</p></li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_en-us_topic_0108275445_li8248125203520"><span>Click <span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_uicontrol1176911318388"><b>Save</b></span>. The <span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_uicontrol3769031133812"><b>Link Management</b></span> page is displayed.</span></li></ol>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0103__en-us_topic_0284710797_section119151411712"><a name="dataartsstudio_01_0103__en-us_topic_0284710797_section119151411712"></a><a name="en-us_topic_0284710797_section119151411712"></a><h4 class="sectiontitle">Creating a Migration Job</h4><ol id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_ol139311427141216"><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_li12211241111211"><span>Choose <span class="menucascade" id="dataartsstudio_01_0103__en-us_topic_0284710797_menucascade7382281349"><b><span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_uicontrol20381118744">Table/File Migration</span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_uicontrol53819812414">Create Job</span></b></span> to create a job for exporting data from the MRS HDFS database to OBS.</span><p><div class="fignone" id="dataartsstudio_01_0103__en-us_topic_0284710797_fig15203103412568"><span class="figcap"><b>Figure 4 </b>Creating a job for migrating data from MRS HDFS to OBS</span><br><span><img id="dataartsstudio_01_0103__en-us_topic_0284710797_image15203133405619" src="en-us_image_0000002269200297.jpg" title="Click to enlarge" class="imgResize"></span></div>
|
|
<ul id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_ul11211104191217"><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_li1221164117123"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b179131045844">Job Name</strong>: Enter a unique name.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li16261428162612"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b1367612470415">Source Job Configuration</strong><ul id="dataartsstudio_01_0103__en-us_topic_0284710797_ul2626528132612"><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li17626028172611"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b58437451253">Source Link Name</strong>: Select the <span class="parmvalue" id="dataartsstudio_01_0103__en-us_topic_0284710797_parmvalue1462612288262"><b>hdfs_llink</b></span> created in <a href="#dataartsstudio_01_0103__en-us_topic_0284710797_section136013511582">Creating an MRS HDFS Link</a>.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li21599492011"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b1592401080">Source Directory/File</strong>: Enter the directory or file path of the data to be migrated.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li1142310112114"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b169544561182">File Format</strong>: Select the file format used for data transmission. Select <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b1838816011104">Binary</strong>. If files are transferred without being parsed, the file format does not have to be <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b197631031141119">Binary</strong>. This applies to file copy.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li156270280265">Retain the default values of other optional parameters.</li></ul>
|
|
</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_li16211144119127"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b54269811219">Destination Job Configuration</strong><ul id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_ul32111741141219"><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_li42111641101218"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b14366121316129">Destination Link Name</strong>: Select the <span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_uicontrol172282414129"><b>obs_link</b></span> created in <a href="#dataartsstudio_01_0103__en-us_topic_0284710797_section5774720191611">Creating an OBS Link</a>.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_li2228134117121"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b20660153418120">Bucket Name</strong>: Select the bucket from which the data will be migrated.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_li1021672441114"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b17708113631213">Write Directory</strong>: Enter the directory to which data is to be written on the OBS server.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_li22262311623"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b13192134521216">File Format</strong>: Select <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b121921545131216">Binary</strong>.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_li62282414121">Retain the default values of the optional parameters in <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b639616913544">Show Advanced Attributes</strong>.</li></ul>
|
|
</li></ul>
|
|
</p></li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_li59151048111210"><span>Click <span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_uicontrol09611716133"><b>Next</b></span>. The <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b159714712131">Map Field</strong> page is displayed. CDM automatically matches the source and destination fields.</span><p><ul id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0108275437_ul2086033675113"><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0108275437_li286063610513">If the field mapping is incorrect, you can drag the fields to adjust the mapping.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0108275437_li557993195213">The expressions in CDM support field conversion of common character strings, dates, and values. </li></ul>
|
|
</p></li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_li47753211373"><span>Click <span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_uicontrol888415389142"><b>Next</b></span> and set task parameters. Generally, retain the default values of all parameters.</span><p><div class="p" id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0183642955_en-us_topic_0108275315_p574914560220">In this step, you can configure the following optional functions:<ul id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0183642955_en-us_topic_0108275315_ul65067533203334"><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0183642955_en-us_topic_0108275315_li37800576203334"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b196894210143">Retry Upon Failure</strong>: If the job fails to be executed, you can determine whether to automatically retry. Retain the default value <span class="parmvalue" id="dataartsstudio_01_0103__en-us_topic_0284710797_parmvalue169681742181416"><b>Never</b></span>.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0183642955_en-us_topic_0108275315_li158210387356"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b15657944191410">Group</strong>: Select the group to which the job belongs. The default group is <span class="parmvalue" id="dataartsstudio_01_0103__en-us_topic_0284710797_parmvalue265814442143"><b>DEFAULT</b></span>. On the <span class="wintitle" id="dataartsstudio_01_0103__en-us_topic_0284710797_wintitle2558134661414"><b>Job Management</b></span> page, jobs can be displayed, started, or exported by group.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0183642955_en-us_topic_0108275315_li33236331203339"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b8948151011542">Schedule Execution</strong>: Enable it if you need to configure scheduled jobs. Retain the default value <span class="parmvalue" id="dataartsstudio_01_0103__en-us_topic_0284710797_parmvalue148661050171415"><b>No</b></span>.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0183642955_en-us_topic_0108275315_li65386286258"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b9861175214143">Concurrent Extractors</strong>: Enter the number of extractors to be concurrently executed. CDM supports concurrent extraction of multiple files. Increasing the value of this parameter can improve migration efficiency.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0183642955_en-us_topic_0108275315_li1396265172616"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b181217314159">Write Dirty Data</strong>: Select <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b16951836111513">No</strong>. The file-to-file migration is binary, and no dirty data will be generated.</li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0183642955_en-us_topic_0108275315_li26341820112614"><strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b857684591610">Delete Job After Completion</strong>: Retain the default value <span class="parmvalue" id="dataartsstudio_01_0103__en-us_topic_0284710797_parmvalue1957794516162"><b>Do not delete</b></span>. You can also set this parameter to <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_b35341047191617">Delete</strong> to prevent an accumulation of too many migration jobs.</li></ul>
|
|
</div>
|
|
</p></li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_li1577510223710"><span>Click <span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0108275326_uicontrol1362446142110"><b>Save and Run</b></span>. The <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0108275326_b867281052113">Job Management</strong> page is displayed, on which you can view the job execution progress and result.</span></li><li id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0123434187_li1189115352456"><span>After the job is successfully executed, in the <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0108275326_b78588166211">Operation</strong> column of the job, click <span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0108275326_uicontrol6858616102110"><b>Historical Record</b></span> to view the job's historical execution records and read/write statistics.</span><p><p id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0108275326_p1891735144518">On the <strong id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0108275326_b1470242882110">Historical Record</strong> page, click <span class="uicontrol" id="dataartsstudio_01_0103__en-us_topic_0284710797_en-us_topic_0108275326_uicontrol147021628182113"><b>Log</b></span> to view the job logs.</p>
|
|
</p></li></ol>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0086.html">Tutorials</a></div>
|
|
</div>
|
|
</div>
|
|
|
|
|
|
<script language="JavaScript">
|
|
<!--
|
|
initImageViewer('.imgResize');
|
|
var msg_imageMax = "view original image";
|
|
var msg_imageClose = "close";
|
|
//--></script> |