forked from docs/doc-exports
DataArts UMN 20241028 version
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: chenxiaoxiong <chenxiaoxiong@huawei.com> Co-committed-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
This commit is contained in:
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
20
docs/dataartsstudio/umn/dataartsstudio_01_0001.html
Normal file
20
docs/dataartsstudio/umn/dataartsstudio_01_0001.html
Normal file
@ -0,0 +1,20 @@
|
||||
<a name="dataartsstudio_01_0001"></a><a name="dataartsstudio_01_0001"></a>
|
||||
|
||||
<h1 class="topictitle1">Accessing the <span id="text2083152211518">DataArts Studio</span> Instance Console</h1>
|
||||
<div id="body0000001853601317"><div class="section" id="dataartsstudio_01_0001__section133514245719"><h4 class="sectiontitle">Prerequisites</h4><p id="dataartsstudio_01_0001__p16738144416585">A <span id="dataartsstudio_01_0001__text736833275210">DataArts Studio</span> instance has been obtained. For details, see <a href="dataartsstudio_01_0115.html">Creating a DataArts Studio Basic Package</a>.</p>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0001__section185393313315"><h4 class="sectiontitle">Procedure</h4><ol id="dataartsstudio_01_0001__ol165206015246"><li id="dataartsstudio_01_0001__en-us_topic_0181028490_li586523263418"><span>Log in to the <span id="dataartsstudio_01_0001__text1122912916583">cloud</span> console. Choose <span id="dataartsstudio_01_0001__text1771592614358">DataArts Studio</span> from the service list in the upper left corner to access the <span id="dataartsstudio_01_0001__text1421955017286">DataArts Studio</span> instance console.</span><p><ul id="dataartsstudio_01_0001__ul32482719575"><li id="dataartsstudio_01_0001__li3244279575">If there are multiple <span id="dataartsstudio_01_0001__text626003945410">DataArts Studio</span> instances in the current region, the instance list is displayed by default. Locate an instance and click <strong id="dataartsstudio_01_0001__b15891858174611">Access</strong> to access the <span id="dataartsstudio_01_0001__text166763199566">DataArts Studio</span> console.<p id="dataartsstudio_01_0001__p1584233632220"></p>
|
||||
<p id="dataartsstudio_01_0001__p79261641112316"></p>
|
||||
</li><li id="dataartsstudio_01_0001__li182432755712">If there is only one <span id="dataartsstudio_01_0001__text787861295711">DataArts Studio</span> instance in the current region, the <span id="dataartsstudio_01_0001__text1560072112575">DataArts Studio</span> console homepage is displayed by default.<p id="dataartsstudio_01_0001__p278692623011"></p>
|
||||
<p id="dataartsstudio_01_0001__p313020184610"></p>
|
||||
<p id="dataartsstudio_01_0001__p4872201532719"></p>
|
||||
</li></ul>
|
||||
</p></li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_12_0002.html">Preparations</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
@ -1,9 +1,9 @@
|
||||
<a name="dataartsstudio_01_0003"></a><a name="dataartsstudio_01_0003"></a>
|
||||
|
||||
<h1 class="topictitle1">Preparations</h1>
|
||||
<div id="body8662426"><p id="dataartsstudio_01_0003__en-us_topic_0197575849_p9356115916393">To use <span id="dataartsstudio_01_0003__text14567613773">DataArts Studio</span>, <span id="dataartsstudio_01_0003__text162431854104718">create</span> a <span id="dataartsstudio_01_0003__text4243354134712">a cloud platform account</span>, <span id="dataartsstudio_01_0003__text20243454184711">create</span> a <span id="dataartsstudio_01_0003__text142445549472">DataArts Studio</span> instance, and authorize a user to use <span id="dataartsstudio_01_0003__text4732134194813">DataArts Studio</span>.</p>
|
||||
<p id="dataartsstudio_01_0003__en-us_topic_0197575849_p0579429102216">For details about the preparations and operations, see later sections.</p>
|
||||
<div class="fignone" id="dataartsstudio_01_0003__fig143423102457"><span class="figcap"><b>Figure 1 </b><span id="dataartsstudio_01_0003__text6142101435818">DataArts Studio</span> preparation process</span><br><span><img id="dataartsstudio_01_0003__image635310133914" src="en-us_image_0000001322408448.png"></span></div>
|
||||
<div id="body8662426"><p id="dataartsstudio_01_0003__p19331838114818">Before using <span id="dataartsstudio_01_0003__text14567613773">DataArts Studio</span>, you need to <span id="dataartsstudio_01_0003__text18331103854810">create</span> a <span id="dataartsstudio_01_0003__text1331538114813">a cloud platform account</span>, <span id="dataartsstudio_01_0003__text13331143824812">create</span> a <span id="dataartsstudio_01_0003__text18331143812480">DataArts Studio</span> instance, access the DataArts Studio instance console, manage workspaces, and authorize users to use <span id="dataartsstudio_01_0003__text16819177115812">DataArts Studio</span>.</p>
|
||||
<p id="dataartsstudio_01_0003__en-us_topic_0197575849_p0579429102216">The following figure shows the preparations and operations, which will be described in detail in later sections.</p>
|
||||
<div class="fignone" id="dataartsstudio_01_0003__fig7123194914174"><span class="figcap"><b>Figure 1 </b>Preparations for using <span id="dataartsstudio_01_0003__text112324991718">DataArts Studio</span></span><br><span><img id="dataartsstudio_01_0003__image12982120271" src="en-us_image_0000002270844674.png"></span></div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
|
||||
@ -1,21 +1,33 @@
|
||||
<a name="dataartsstudio_01_0004"></a><a name="dataartsstudio_01_0004"></a>
|
||||
|
||||
<h1 class="topictitle1">Creating an IAM User and Assigning <span id="text13250174381611">DataArts Studio</span> Permissions</h1>
|
||||
<div id="body8662426"><div class="p" id="dataartsstudio_01_0004__en-us_topic_0223009156_p988518487488">Identity and Access Management (IAM) can be used for fine-grained permissions management on your <span id="dataartsstudio_01_0004__text189401823191311">DataArts Studio</span> resources. With IAM, you can:<ul id="dataartsstudio_01_0004__ul20307133063417"><li id="dataartsstudio_01_0004__en-us_topic_0223009156_li588684820486">Create IAM users for employees based on your enterprise's organizational structure. Each IAM user will have their own security credentials for accessing <span id="dataartsstudio_01_0004__text2090111011530">DataArts Studio</span> resources.</li><li id="dataartsstudio_01_0004__en-us_topic_0223009156_li38863484487">Assign users only the permissions required to perform a task.</li><li id="dataartsstudio_01_0004__en-us_topic_0223009156_li17886174824816">Entrust a <span id="dataartsstudio_01_0004__text458111419359">a cloud platform account</span> or cloud service to perform efficient O&M on your <span id="dataartsstudio_01_0004__text66291413531">DataArts Studio</span> resources.</li></ul>
|
||||
<div id="body8662426"><div class="p" id="dataartsstudio_01_0004__en-us_topic_0223009156_p988518487488">Identity and Access Management (IAM) can be used for fine-grained permissions management on your <span id="dataartsstudio_01_0004__text189401823191311">DataArts Studio</span> resources. With IAM, you can:<ul id="dataartsstudio_01_0004__ul20307133063417"><li id="dataartsstudio_01_0004__en-us_topic_0223009156_li588684820486">Create IAM users for employees based on your enterprise's organizational structure. Each IAM user will have their own security credentials for accessing <span id="dataartsstudio_01_0004__text2090111011530">DataArts Studio</span> resources.</li><li id="dataartsstudio_01_0004__en-us_topic_0223009156_li38863484487">Assign users only the permissions required to perform a task.</li><li id="dataartsstudio_01_0004__en-us_topic_0223009156_li17886174824816">Entrust a <span id="dataartsstudio_01_0004__text685775312213">a cloud platform account</span> or cloud service to perform efficient O&M on your <span id="dataartsstudio_01_0004__text885745314210">DataArts Studio</span> resources.</li></ul>
|
||||
</div>
|
||||
<p id="dataartsstudio_01_0004__en-us_topic_0223009156_p7886148114812">If you do not require individual IAM users for permissions management, skip this section.</p>
|
||||
<div class="section" id="dataartsstudio_01_0004__en-us_topic_0223009156_section149106163317"><h4 class="sectiontitle">Background</h4><ul id="dataartsstudio_01_0004__en-us_topic_0223009156_ul4345266339"><li id="dataartsstudio_01_0004__en-us_topic_0223009156_li19891163562811">Before assigning permissions to a user group, familiarize yourself with the <span id="dataartsstudio_01_0004__text99095165312">DataArts Studio</span> workspace role permissions that can be added to the user group and select permissions based on actual requirements. </li></ul>
|
||||
<div class="section" id="dataartsstudio_01_0004__en-us_topic_0223009156_section149106163317"><h4 class="sectiontitle">Background</h4><ul id="dataartsstudio_01_0004__en-us_topic_0223009156_ul4345266339"><li id="dataartsstudio_01_0004__en-us_topic_0223009156_li19891163562811">Before assigning permissions to a user group, you need to understand the <span id="dataartsstudio_01_0004__text256471362515">DataArts Studio</span> permission system and select permissions as needed. </li></ul>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0004__en-us_topic_0223009156_section9135134520119"><h4 class="sectiontitle">Procedure</h4><ol id="dataartsstudio_01_0004__en-us_topic_0223009156_ol11830932152014"><li id="dataartsstudio_01_0004__en-us_topic_0223009156_li1983016328204"><a name="dataartsstudio_01_0004__en-us_topic_0223009156_li1983016328204"></a><a name="en-us_topic_0223009156_li1983016328204"></a>Create a user group and assign permissions to it. Log in to the IAM console using a <span id="dataartsstudio_01_0004__text16645549163611">a cloud platform account</span>, create a user group, and grant permissions of a common user (for example, <span class="parmname" id="dataartsstudio_01_0004__parmname126501549203610"><b>DAYU User</b></span>) to the group.<p id="dataartsstudio_01_0004__en-us_topic_0223009156_p108313320205">For details, see "User Groups and Authorization" > "Creating a User Group and Assigning Permissions" in <em id="dataartsstudio_01_0004__i169381550757">Identity and Access Management User Guide</em>.</p>
|
||||
<div class="note" id="dataartsstudio_01_0004__en-us_topic_0223009156_note52501597263"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_0004__en-us_topic_0223009156_ul114668532278"><li id="dataartsstudio_01_0004__li1834013912412">When configuring <span id="dataartsstudio_01_0004__text16819177115812">DataArts Studio</span> permissions for a user group, enter <strong id="dataartsstudio_01_0004__b445894134519">DAYU</strong> in the search box to search for the permissions and select the permissions to be granted to the user group, for example, <strong id="dataartsstudio_01_0004__b0458174124513">DAYU User</strong>.</li><li id="dataartsstudio_01_0004__en-us_topic_0223009156_li147098562278">If an IAM user wants to create a workspace, you must assign the IAM user the <span class="parmname" id="dataartsstudio_01_0004__en-us_topic_0223009156_parmname1529101483514"><b>DAYU Administrator</b></span> policy. Users with the <span class="parmname" id="dataartsstudio_01_0004__en-us_topic_0223009156_parmname1549314196359"><b>DAYU Administrator</b></span> policy can perform all operations on <span id="dataartsstudio_01_0004__text1610641412533">DataArts Studio</span>.</li><li id="dataartsstudio_01_0004__li2866162654415"><span id="dataartsstudio_01_0004__text129123284613">DataArts Studio</span> is a project-level service deployed in specific physical regions. If you select <strong id="dataartsstudio_01_0004__b827913464817">All resources</strong> for <strong id="dataartsstudio_01_0004__b350973420578">Scope</strong>, the permission takes effect in all projects of all regions. If you select <strong id="dataartsstudio_01_0004__b1819632815583">Region-specific projects</strong> for <strong id="dataartsstudio_01_0004__b16349103655811">Scope</strong>, the permission takes effect only for a specified project. When accessing <span id="dataartsstudio_01_0004__text5352191557">DataArts Studio</span>, the IAM user must switch to the region where they have been assigned the required permissions.</li></ul>
|
||||
<div class="section" id="dataartsstudio_01_0004__section3404192611368"><h4 class="sectiontitle">Notes and Constraints</h4><ul id="dataartsstudio_01_0004__ul5958194983813"><li id="dataartsstudio_01_0004__li42343448248">The DARTS User role provides permissions related to instances, workspaces, and dependent services. Workspace roles provide service operation permissions in workspaces.</li><li id="dataartsstudio_01_0004__li11959194993815">IAM provides the following two authorization mechanisms. <span id="dataartsstudio_01_0004__en-us_topic_0222691153_text98649123311">DataArts Studio</span> supports IAM roles but not IAM policies.<ul id="dataartsstudio_01_0004__ul4577145434117"><li id="dataartsstudio_01_0004__en-us_topic_0222691153_en-us_topic_0216589782_li18737181101111"><strong id="dataartsstudio_01_0004__b42311658171511">IAM roles</strong>: IAM initially provides a coarse-grained authorization mechanism to define permissions based on users' job responsibilities. Only a limited number of service-level roles are available for authorization. However, traditional IAM roles are not an ideal choice for fine-grained authorization and secure access control.</li><li id="dataartsstudio_01_0004__en-us_topic_0222691153_li144587474243"><strong id="dataartsstudio_01_0004__b12674181818163">IAM policies</strong>: A type of fine-grained authorization mechanism that defines permissions required to perform operations on specific cloud resources under certain conditions. This type of authorization is more flexible and meets the principle of least privilege (PoLP).</li></ul>
|
||||
</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0004__en-us_topic_0223009156_section9135134520119"><h4 class="sectiontitle">Procedure</h4><div class="fignone" id="dataartsstudio_01_0004__fig320863593815"><span class="figcap"><b>Figure 1 </b>Authorization process</span><br><span><img class="eddx" id="dataartsstudio_01_0004__image52081635103816" src="en-us_image_0000002270921874.png"></span></div>
|
||||
<ol id="dataartsstudio_01_0004__ol5977748151916"><li id="dataartsstudio_01_0004__li39771248101915"><a name="dataartsstudio_01_0004__li39771248101915"></a><a name="li39771248101915"></a><span>Create a user group and assign a system role to the group.</span><p><p id="dataartsstudio_01_0004__p55201136510">Log in to the IAM console using <span id="dataartsstudio_01_0004__text1831511164010">a cloud platform account</span>, create a user group and assign a <span id="dataartsstudio_01_0004__text1570132531">DataArts Studio</span> system role to the group. For example, the system role can be DARTS Administrator or DARTS User.</p>
|
||||
<p id="dataartsstudio_01_0004__en-us_topic_0223009156_p108313320205">For details, see "User Groups and Authorization" > "Creating a User Group and Assigning Permissions" in <em id="dataartsstudio_01_0004__i944914123332">Identity and Access Management User Guide</em>.</p>
|
||||
<div class="note" id="dataartsstudio_01_0004__en-us_topic_0223009156_note52501597263"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_0004__en-us_topic_0223009156_ul114668532278"><li id="dataartsstudio_01_0004__li1834013912412">When configuring <span id="dataartsstudio_01_0004__text129169401166">DataArts Studio</span> permissions for a user group, enter DARTS in the search box to search for the permissions and select the permissions to be granted to the user group, for example, <strong id="dataartsstudio_01_0004__b129161940161613">DARTS User</strong>.</li><li id="dataartsstudio_01_0004__li2866162654415"><span id="dataartsstudio_01_0004__text129123284613">DataArts Studio</span> is a project-level service deployed in specific physical regions. If you select <strong id="dataartsstudio_01_0004__b827913464817">All resources</strong> for <strong id="dataartsstudio_01_0004__b350973420578">Scope</strong>, the permission takes effect in all projects of all regions. If you select <strong id="dataartsstudio_01_0004__b1819632815583">Region-specific projects</strong> for <strong id="dataartsstudio_01_0004__b16349103655811">Scope</strong>, the permission takes effect only for a specified project. When accessing <span id="dataartsstudio_01_0004__text5352191557">DataArts Studio</span>, the IAM user must switch to the region where they have been assigned the required permissions.</li></ul>
|
||||
</div></div>
|
||||
</li><li id="dataartsstudio_01_0004__en-us_topic_0223009156_li12832632132013">Create a user and add the user to the user group. Create a user on the IAM console and add the user to the group created in <a href="#dataartsstudio_01_0004__en-us_topic_0223009156_li1983016328204">1</a>.<p id="dataartsstudio_01_0004__en-us_topic_0223009156_p1683243212202">For details, see "IAM Users" > "Creating an IAM User" in <em id="dataartsstudio_01_0004__i016714061014">Identity and Access Management User Guide</em>.</p>
|
||||
</li></ol>
|
||||
</p></li><li id="dataartsstudio_01_0004__li797716482198"><span>Create a user and add it to the user group.</span><p><p id="dataartsstudio_01_0004__p178485310194">Create users on the IAM console and add them to the group created in <a href="#dataartsstudio_01_0004__li39771248101915">step 1</a>.</p>
|
||||
<p id="dataartsstudio_01_0004__p108285546197">For details, see "IAM Users" > "Creating an IAM User" in <em id="dataartsstudio_01_0004__i9320185761913">Identity and Access Management User Guide</em>.</p>
|
||||
<div class="note" id="dataartsstudio_01_0004__note127591741175411"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0004__p676134155414">An IAM user can pass the authentication and access <span id="dataartsstudio_01_0004__text9760148191813">DataArts Studio</span> through an API or SDK only if <strong id="dataartsstudio_01_0004__b10760204891816">Programmatic access</strong> is selected for <strong id="dataartsstudio_01_0004__b16760134811188">Access Type</strong> during the creation of the IAM user.</p>
|
||||
</div></div>
|
||||
</p></li><li id="dataartsstudio_01_0004__li585115271418"><span>Create a custom workspace role for DARTS User, add it as a workspace member, and assign a role to the member.</span><p><p id="dataartsstudio_01_0004__p1579162432010"><span id="dataartsstudio_01_0004__text554811241949">DataArts Studio</span> workspace roles determine the permissions of DARTS User in a workspace. There are five preset roles: admin, developer, deployer, operator, and viewer. If these preset roles can meet your requirements, you do not need to create a custom workspace role. Instead, you can add the user as a workspace member and assign a preset role to the member. Otherwise, you need to create a custom role, add the users as a workspace member, and assign the custom role to the member. For details about how to create a custom workspace role, see <a href="dataartsstudio_01_0120.html">(Optional) Defining a Workspace Role</a>. For details about how to add a workspace member and assign a role to the member, see <a href="dataartsstudio_01_0117.html">Adding a Member and Assigning a Role</a>.</p>
|
||||
<p id="dataartsstudio_01_0004__p142198484228">For details about the permissions of the roles, see "<span id="dataartsstudio_01_0004__text1921247151618">DataArts Studio</span> Permissions" in <em id="dataartsstudio_01_0004__i1392847161611">Service Overview</em>.</p>
|
||||
</p></li><li id="dataartsstudio_01_0004__en-us_topic_0000001489537442_li1177513202816"><span>Log in to the console and verify permissions.</span><p><p id="dataartsstudio_01_0004__en-us_topic_0000001489537442_p1317741312289">Log in to the console using the created user and verify permissions of the user.</p>
|
||||
<ul id="dataartsstudio_01_0004__en-us_topic_0000001489537442_ul1692751312242"><li id="dataartsstudio_01_0004__en-us_topic_0000001489537442_li205729227246">Choose <strong id="dataartsstudio_01_0004__b10786936161912">Service List</strong> > <strong id="dataartsstudio_01_0004__b7825945191914">DataArts Studio</strong>. Locate a <span id="dataartsstudio_01_0004__text1421955017286">DataArts Studio</span> instance and click <strong id="dataartsstudio_01_0004__b15374182913214">Access</strong>. Check whether the workspace list is displayed.</li><li id="dataartsstudio_01_0004__en-us_topic_0000001489537442_li1857212212418">Access a service module (for example, Management Center) to which your current user has been added and check whether you can perform the operations allowed for the workspace role assigned to you.</li></ul>
|
||||
</p></li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0118_0.html">Authorizing Users to Use DataArts Studio</a></div>
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0118.html">Authorizing Users to Use DataArts Studio</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
228
docs/dataartsstudio/umn/dataartsstudio_01_0005_0.html
Normal file
228
docs/dataartsstudio/umn/dataartsstudio_01_0005_0.html
Normal file
File diff suppressed because it is too large
Load Diff
@ -1,23 +1,22 @@
|
||||
<a name="dataartsstudio_01_0006"></a><a name="dataartsstudio_01_0006"></a>
|
||||
|
||||
<h1 class="topictitle1">(Optional) Obtaining Authentication Information</h1>
|
||||
<div id="body8662426"><p id="dataartsstudio_01_0006__p9577341160">When creating OBS links, making API calls, or locating issues, you may need to obtain information such as access keys, project IDs, and endpoints. This section describes how to obtain such information.</p>
|
||||
<div class="section" id="dataartsstudio_01_0006__en-us_topic_0183643042_en-us_topic_0183643042_section6679105711399"><h4 class="sectiontitle">Obtaining an Access Key</h4><div class="p" id="dataartsstudio_01_0006__en-us_topic_0000001129241845_p157171154134613">To obtain an access key, perform the following steps:<ol id="dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_ol535183018588"><li id="dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_li1535103025819">Log in to the management console, move the cursor to the username in the upper right corner, and select <strong id="dataartsstudio_01_0006__en-us_topic_0000001129241845_b1586023610364">My Credentials</strong> from the drop-down list.</li><li id="dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_li173533018584">On the <strong id="dataartsstudio_01_0006__en-us_topic_0000001129241845_b149721128172418">My Credentials</strong> page, choose <strong id="dataartsstudio_01_0006__en-us_topic_0000001129241845_b15803656132414">Access Keys</strong>, and click <strong id="dataartsstudio_01_0006__en-us_topic_0000001129241845_b2452152020258">Create Access Key</strong>. See <a href="#dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615">Figure 1</a>.<div class="fignone" id="dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"><a name="dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><a name="en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><span class="figcap"><b>Figure 1 </b>Clicking Create Access Key</span><br><span><img id="dataartsstudio_01_0006__en-us_topic_0000001129241845_image20389043111611" src="en-us_image_0000001322088556.png"></span></div>
|
||||
</li><li id="dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_li1535530185815">Click <strong id="dataartsstudio_01_0006__en-us_topic_0000001129241845_b8340319122819">OK</strong> and save the access key file as prompted. The access key file will be saved to your browser's configured download location. Open the <strong id="dataartsstudio_01_0006__en-us_topic_0000001129241845_b1940852512813">credentials.csv</strong> file to view <strong id="dataartsstudio_01_0006__en-us_topic_0000001129241845_b191574128718">Access Key Id</strong> and <strong id="dataartsstudio_01_0006__en-us_topic_0000001129241845_b175769149718">Secret Access Key</strong>.<div class="note" id="dataartsstudio_01_0006__en-us_topic_0000001129241845_note4554158201"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_0006__en-us_topic_0000001129241845_ul25541081906"><li id="dataartsstudio_01_0006__en-us_topic_0000001129241845_li175541819018">Only two access keys can be added for each user.</li><li id="dataartsstudio_01_0006__en-us_topic_0000001129241845_li3554138305">To ensure access key security, the access key is automatically downloaded only when it is generated for the first time and cannot be obtained from the management console later. Keep them properly.</li></ul>
|
||||
<div id="body8662426"><p id="dataartsstudio_01_0006__p9577341160">When using <span id="dataartsstudio_01_0006__text198211624115318">DataArts Studio</span>, for example, when creating OBS links, calling APIs, or locating issues, you may need to obtain information such as access keys, project IDs, and endpoints. This section describes how to obtain such information.</p>
|
||||
<div class="section" id="dataartsstudio_01_0006__en-us_topic_0183643042_en-us_topic_0183643042_section6679105711399"><h4 class="sectiontitle">Obtaining an Access Key</h4><div class="p" id="dataartsstudio_01_0006__en-us_topic_0000001129241845_p157171154134613">To obtain an access key, perform the following steps:<ol id="dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_ol535183018588"><li id="dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_li1535103025819">Log in to the TICS console, move the cursor to the username in the upper right corner, and select <strong id="dataartsstudio_01_0006__b1698346784111913">My Credentials</strong> from the drop-down list.</li><li id="dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_li173533018584">On the <strong id="dataartsstudio_01_0006__b1957659294111913">My Credentials</strong> page, choose <span class="menucascade" id="dataartsstudio_01_0006__menucascade1220767440111913"><b><span class="uicontrol" id="dataartsstudio_01_0006__uicontrol760472201111913">Access Keys</span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0006__uicontrol1320938428111913">Create Access Key</span></b></span>. See <a href="#dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615">Figure 1</a>.<div class="fignone" id="dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"><a name="dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><a name="en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><span class="figcap"><b>Figure 1 </b>Clicking Create Access Key</span><br><span><img id="dataartsstudio_01_0006__en-us_topic_0000001129241845_image20389043111611" src="en-us_image_0000002270844902.png"></span></div>
|
||||
</li><li id="dataartsstudio_01_0006__en-us_topic_0000001129241845_en-us_topic_0183643042_li1535530185815">Click <strong id="dataartsstudio_01_0006__b21601729101619">OK</strong> and save the access key file when prompted. The access key file is saved to the default download location in your browser. Open the <strong id="dataartsstudio_01_0006__b361492671616">credentials.csv</strong> file to view the access key with an AK and SK.<div class="note" id="dataartsstudio_01_0006__en-us_topic_0000001129241845_note4554158201"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_0006__en-us_topic_0000001129241845_ul25541081906"><li id="dataartsstudio_01_0006__en-us_topic_0000001129241845_li175541819018">Only two access keys can be added for each user.</li><li id="dataartsstudio_01_0006__en-us_topic_0000001129241845_li3554138305">For security purposes, access keys are automatically downloaded only when they are generated for the first time and cannot be obtained from the console later. Keep them properly.</li></ul>
|
||||
</div></div>
|
||||
</li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0006__section134096463399"><a name="dataartsstudio_01_0006__section134096463399"></a><a name="section134096463399"></a><h4 class="sectiontitle">Obtaining a Project ID and Account ID</h4><div class="p" id="dataartsstudio_01_0006__en-us_topic_0000001129537317_en-us_topic_0183643042_en-us_topic_0080205343_p491327619141">You can obtain the project ID and account ID by performing the following steps:<ol id="dataartsstudio_01_0006__en-us_topic_0000001129537317_ol6260200121819"><li id="dataartsstudio_01_0006__en-us_topic_0000001129537317_li19260803185">Register with and log in to the management console.</li><li id="dataartsstudio_01_0006__en-us_topic_0000001129537317_li142601019186">Hover the cursor on the username in the upper right corner and select <span class="uicontrol" id="dataartsstudio_01_0006__en-us_topic_0000001129537317_uicontrol0260130191818"><b>My Credentials</b></span> from the drop-down list.</li><li id="dataartsstudio_01_0006__en-us_topic_0000001129537317_li1026113031818">On the <strong id="dataartsstudio_01_0006__en-us_topic_0000001129537317_b196637155315">My Credentials</strong> page, obtain the account name and account ID, and obtain the project ID from the project list.</li></ol>
|
||||
<div class="section" id="dataartsstudio_01_0006__section134096463399"><a name="dataartsstudio_01_0006__section134096463399"></a><a name="section134096463399"></a><h4 class="sectiontitle">Obtaining a Project ID and Account ID</h4><div class="p" id="dataartsstudio_01_0006__en-us_topic_0000001129537317_en-us_topic_0183643042_en-us_topic_0080205343_p491327619141">A project is a group of tenant resources, and an account ID corresponds to the current account. The IAM ID corresponds to the current user. You can view the project IDs, account IDs, and user IDs in different regions on the corresponding pages.<ol id="dataartsstudio_01_0006__en-us_topic_0000001129537317_ol6260200121819"><li id="dataartsstudio_01_0006__en-us_topic_0000001129537317_li19260803185">Register with and log in to the management console.</li><li id="dataartsstudio_01_0006__en-us_topic_0000001129537317_li142601019186">Hover the cursor on the username in the upper right corner and select <span class="uicontrol" id="dataartsstudio_01_0006__en-us_topic_0000001129537317_uicontrol0260130191818"><b>My Credentials</b></span> from the drop-down list.</li><li id="dataartsstudio_01_0006__en-us_topic_0000001129537317_li1026113031818">On the <strong id="dataartsstudio_01_0006__b1933425520111913">API Credentials</strong> page, obtain the account name, account ID, IAM username, and IAM user ID, and obtain the project ID from the project list.</li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0006__section7883936162812"><h4 class="sectiontitle">Obtaining a <span id="dataartsstudio_01_0006__en-us_topic_0000001150701582_text1341912581632">DataArts Studio</span> Instance ID and Workspace ID</h4><div class="p" id="dataartsstudio_01_0006__en-us_topic_0000001150701582_en-us_topic_0183643042_en-us_topic_0080205343_p491327619141">To obtain a <span id="dataartsstudio_01_0006__en-us_topic_0000001150701582_text13579131185313">DataArts Studio</span> instance ID and workspace ID, perform the following steps:<ol id="dataartsstudio_01_0006__en-us_topic_0000001150701582_ol6260200121819"><li id="dataartsstudio_01_0006__en-us_topic_0000001150701582_li19260803185">On the <span id="dataartsstudio_01_0006__en-us_topic_0000001150701582_en-us_topic_0187412481_text88021121155819">DataArts Studio</span> console, locate a workspace and click any module, such as <strong id="dataartsstudio_01_0006__en-us_topic_0000001150701582_b7656317547">Management Center</strong>.<div class="fignone" id="dataartsstudio_01_0006__en-us_topic_0000001150701582_fig11331320153513"><span class="figcap"><b>Figure 2 </b>Management Center</span><br><span><img id="dataartsstudio_01_0006__en-us_topic_0000001150701582_en-us_topic_0187412481_image6872534135313" src="en-us_image_0000001322408464.png"></span></div>
|
||||
</li><li id="dataartsstudio_01_0006__en-us_topic_0000001150701582_li142601019186">On the <strong id="dataartsstudio_01_0006__en-us_topic_0000001150701582_b3771191016556">Management Center</strong> page, obtain the values of <strong id="dataartsstudio_01_0006__en-us_topic_0000001150701582_b896222919557">instanceId</strong> and <strong id="dataartsstudio_01_0006__en-us_topic_0000001150701582_b179506356556">workspace</strong> in the browser address bar, which are the instance ID and workspace ID, respectively.<div class="p" id="dataartsstudio_01_0006__en-us_topic_0000001150701582_p187071943102319">As shown in <a href="#dataartsstudio_01_0006__en-us_topic_0000001150701582_fig394214118237">Figure 3</a>, the instance ID is <strong id="dataartsstudio_01_0006__en-us_topic_0000001150701582_b19386135392710">6b88…2688</strong>, and the workspace ID is <strong id="dataartsstudio_01_0006__en-us_topic_0000001150701582_b112256223275">1dd3bc…d93f0</strong>.<div class="fignone" id="dataartsstudio_01_0006__en-us_topic_0000001150701582_fig394214118237"><a name="dataartsstudio_01_0006__en-us_topic_0000001150701582_fig394214118237"></a><a name="en-us_topic_0000001150701582_fig394214118237"></a><span class="figcap"><b>Figure 3 </b>Obtaining the instance ID and workspace ID</span><br><span><img id="dataartsstudio_01_0006__en-us_topic_0000001150701582_image446717368265" src="en-us_image_0000001322408456.png"></span></div>
|
||||
<div class="section" id="dataartsstudio_01_0006__section7883936162812"><h4 class="sectiontitle">Obtaining the <span id="dataartsstudio_01_0006__en-us_topic_0000001150701582_text1341912581632">DataArts Studio</span> Instance ID and Workspace ID</h4><div class="p" id="dataartsstudio_01_0006__en-us_topic_0000001150701582_en-us_topic_0183643042_en-us_topic_0080205343_p491327619141">You can obtain them from the URI on the <span id="dataartsstudio_01_0006__en-us_topic_0000001150701582_text973312442920">DataArts Studio</span> console.<ol id="dataartsstudio_01_0006__en-us_topic_0000001150701582_ol6260200121819"><li id="dataartsstudio_01_0006__en-us_topic_0000001150701582_li554111518432">On the homepage of the <span id="dataartsstudio_01_0006__en-us_topic_0000001150701582_en-us_topic_0187412481_text88021121155819">DataArts Studio</span> console, select a workspace, and click a module, for example, <strong id="dataartsstudio_01_0006__b336323133915">Management Center</strong>.</li><li id="dataartsstudio_01_0006__en-us_topic_0000001150701582_li142601019186">On the <strong id="dataartsstudio_01_0006__b4975726133910">Management Center</strong> page, obtain the values of <strong id="dataartsstudio_01_0006__b3975126143917">instanceId</strong> and <strong id="dataartsstudio_01_0006__b9975182603910">workspace</strong> in the browser address bar, which are the <span id="dataartsstudio_01_0006__en-us_topic_0000001150701582_text1545312442213">DataArts Studio</span> instance ID and workspace ID, respectively.<div class="p" id="dataartsstudio_01_0006__en-us_topic_0000001150701582_p187071943102319">As shown in <a href="#dataartsstudio_01_0006__en-us_topic_0000001150701582_fig394214118237">Figure 2</a>, the instance ID is <strong id="dataartsstudio_01_0006__b1545854719111913">6b88…2688</strong>, and the workspace ID is <strong id="dataartsstudio_01_0006__b267920851111913">1dd3bc…d93f0</strong>.<div class="fignone" id="dataartsstudio_01_0006__en-us_topic_0000001150701582_fig394214118237"><a name="dataartsstudio_01_0006__en-us_topic_0000001150701582_fig394214118237"></a><a name="en-us_topic_0000001150701582_fig394214118237"></a><span class="figcap"><b>Figure 2 </b>Obtaining the instance ID and workspace ID</span><br><span><img id="dataartsstudio_01_0006__image95718161852" src="en-us_image_0000002270956052.png"></span></div>
|
||||
</div>
|
||||
</li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0006__section16737727193510"><h4 class="sectiontitle">Obtaining an Endpoint</h4><p id="dataartsstudio_01_0006__en-us_topic_0000001089114743_p15821453115417">An endpoint is the <strong id="dataartsstudio_01_0006__en-us_topic_0000001089114743_b3336611193312">request address</strong> for calling an API. Endpoints vary depending on services and regions.</p>
|
||||
<div class="section" id="dataartsstudio_01_0006__section16737727193510"><h4 class="sectiontitle">Obtaining an Endpoint</h4><p id="dataartsstudio_01_0006__en-us_topic_0000001089114743_p15821453115417">An endpoint is the <strong id="dataartsstudio_01_0006__en-us_topic_0000001089114743_b1282153175410">request address</strong> for calling an API. Endpoints vary depending on services and regions.</p>
|
||||
<p id="dataartsstudio_01_0006__en-us_topic_0000001089114743_p27115277328">You can obtain endpoints from <a href="https://docs.otc.t-systems.com/en-us/endpoint/index.html" target="_blank" rel="noopener noreferrer">Regions and Endpoints</a>.</p>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
@ -5,12 +5,14 @@
|
||||
</div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0005.html">Data Sources</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0005_0.html">Data Sources</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0009.html">Creating Data Connections</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0009.html">Managing Data Connections</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0010.html">Migrating Resources</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_5105.html">Configuring Environment Isolation for a Workspace in Enterprise Mode</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0350.html">Tutorials</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@ -2,26 +2,34 @@
|
||||
|
||||
<h1 class="topictitle1">Migrating Resources</h1>
|
||||
<div id="body1564469667050"><p id="dataartsstudio_01_0010__p118481119122413">To migrate resources in one workspace to another, you can use the resource migration function provided by <span id="dataartsstudio_01_0010__text1084871952418">DataArts Studio</span>.</p>
|
||||
<p id="dataartsstudio_01_0010__p1418713612214">The resources that can be migrated include the data connections created in Management Center.</p>
|
||||
<div class="section" id="dataartsstudio_01_0010__section13321703214"><h4 class="sectiontitle">Prerequisites</h4><ul id="dataartsstudio_01_0010__ul1468814513610"><li id="dataartsstudio_01_0010__li1871417481229">Resource import and export depend on the OBS service.</li><li id="dataartsstudio_01_0010__li18688165861">There are resources that can be migrated. For details on how to create data connections, see <a href="dataartsstudio_01_0009.html">Creating Data Connections</a>.</li></ul>
|
||||
<p id="dataartsstudio_01_0010__p1418713612214">Resources that can be migrated include the data connections in Management Center.</p>
|
||||
<div class="section" id="dataartsstudio_01_0010__section13321703214"><h4 class="sectiontitle">Prerequisites</h4><ul id="dataartsstudio_01_0010__ul1468814513610"><li id="dataartsstudio_01_0010__li1871417481229">Resources can be imported from OBS or a local path.</li><li id="dataartsstudio_01_0010__li18688165861">There are resources that can be migrated. For details on how to create data connections, see <a href="dataartsstudio_01_0009.html">Managing Data Connections</a>.</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0010__section197713411677"><h4 class="sectiontitle">Constraints</h4><ul id="dataartsstudio_01_0010__ul8306105215815"><li id="dataartsstudio_01_0010__li29038123813">Imported and exported resources are stored in JSON format.</li><li id="dataartsstudio_01_0010__li138111155474">For security concerns, passwords of connections are not exported when the connections are exported. You need to enter the passwords when importing the connections.</li></ul>
|
||||
<div class="section" id="dataartsstudio_01_0010__section197713411677"><h4 class="sectiontitle">Constraints</h4><ul id="dataartsstudio_01_0010__ul8306105215815"><li id="dataartsstudio_01_0010__li29038123813">Only an exported .zip file can be imported. During the import, the system verifies the resources in the file.</li><li id="dataartsstudio_01_0010__li138111155474">For security concerns, passwords of connections are not exported when the connections are exported. You need to enter the passwords when importing the connections.</li><li id="dataartsstudio_01_0010__li15824726191112">The size of the file to be imported from an OBS bucket or local path cannot exceed 10 MB.</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0010__section84691754394"><h4 class="sectiontitle">Exporting a Resource</h4><ol id="dataartsstudio_01_0010__ol1974812164274"><li class="msonormal" id="dataartsstudio_01_0010__li119271017161716">On the <span id="dataartsstudio_01_0010__en-us_topic_0187412481_text108883915434">DataArts Studio</span> console, locate a workspace and click <strong id="dataartsstudio_01_0010__en-us_topic_0187412481_b1993143916438">Management Center</strong>.<div class="fignone" id="dataartsstudio_01_0010__en-us_topic_0187412481_fig11331320153513"><span class="figcap"><b>Figure 1 </b>Management Center</span><br><span><img id="dataartsstudio_01_0010__en-us_topic_0187412481_image6872534135313" src="en-us_image_0000001373087833.png"></span></div>
|
||||
</li><li id="dataartsstudio_01_0010__li124671650203219">In the navigation pane, choose <strong id="dataartsstudio_01_0010__b89281489484">Migrate Resources</strong>.<div class="fignone" id="dataartsstudio_01_0010__fig112561281915"><span class="figcap"><b>Figure 2 </b>Migrating Resources</span><br><span><img id="dataartsstudio_01_0010__image1671344623510" src="en-us_image_0000001321928704.png"></span></div>
|
||||
</li><li id="dataartsstudio_01_0010__li7215285277"><a name="dataartsstudio_01_0010__li7215285277"></a><a name="li7215285277"></a>Click <span class="wintitle" id="dataartsstudio_01_0010__wintitle8675185312140"><b>Create Export Task</b></span> to configure the file name and the OBS path for saving the file. If OBS is unavailable, you only need to set the file name.<div class="fignone" id="dataartsstudio_01_0010__fig173183613715"><span class="figcap"><b>Figure 3 </b>Export Task</span><br><span><img id="dataartsstudio_01_0010__image1360771419536" src="en-us_image_0000001322248296.png"></span></div>
|
||||
</li><li id="dataartsstudio_01_0010__li143694518119">Click <span class="uicontrol" id="dataartsstudio_01_0010__uicontrol1886329111215"><b>Next</b></span> and select the resource to export.</li><li id="dataartsstudio_01_0010__li257513113410">Click <strong id="dataartsstudio_01_0010__b4361355191719">Next</strong> and wait until the export is complete. The resource package is exported to the OBS path set in <a href="#dataartsstudio_01_0010__li7215285277">3</a>. If OBS is unavailable, you can click <strong id="dataartsstudio_01_0010__b93891133182016">Download</strong> in the row of the corresponding migration task to download the exported resource package.<div class="fignone" id="dataartsstudio_01_0010__fig115243158274"><span class="figcap"><b>Figure 4 </b>Export completed</span><br><span><img id="dataartsstudio_01_0010__image726804155317" src="en-us_image_0000001373408421.png"></span></div>
|
||||
<p id="dataartsstudio_01_0010__p4442736153913">If no result is displayed in 1 minute, the export fails. Try again. If the failure persists, contact <span id="dataartsstudio_01_0010__en-us_topic_0000001160798913_text1059016393531">the customer service or technical support</span>.</p>
|
||||
</li></ol>
|
||||
<div class="section" id="dataartsstudio_01_0010__section84691754394"><h4 class="sectiontitle">Exporting a Resource</h4><ol id="dataartsstudio_01_0010__ol27771443151310"><li class="msonormal" id="dataartsstudio_01_0010__li19275175611217"><span>Log in to the <span id="dataartsstudio_01_0010__en-us_topic_0000001397651462_text5574448155719">DataArts Studio</span> console by following the instructions in <a href="dataartsstudio_01_0001.html">Accessing the DataArts Studio Instance Console</a>.</span></li><li class="msonormal" id="dataartsstudio_01_0010__li11777174316135"><span>On the <span id="dataartsstudio_01_0010__en-us_topic_0000001503129708_text82024413513">DataArts Studio</span> console, locate a workspace and click <strong id="dataartsstudio_01_0010__en-us_topic_0000001503129708_b820215416513">Management Center</strong>.</span></li><li id="dataartsstudio_01_0010__li1777715436133"><span>In the navigation pane, choose <strong id="dataartsstudio_01_0010__b89281489484">Migrate Resources</strong>.</span><p><div class="fignone" id="dataartsstudio_01_0010__fig112561281915"><span class="figcap"><b>Figure 1 </b>Migrating Resources</span><br><span><img id="dataartsstudio_01_0010__image1235516539128" src="en-us_image_0000002305439969.png"></span></div>
|
||||
<p id="dataartsstudio_01_0010__p1880613432136"></p>
|
||||
</p></li><li id="dataartsstudio_01_0010__li1677712439132"><span>Click <span class="wintitle" id="dataartsstudio_01_0010__wintitle5751111319203"><b>Create Export Task</b></span> to configure the file name and the OBS path for saving the file. If OBS is unavailable, you only need to set the file name.</span><p><div class="fignone" id="dataartsstudio_01_0010__fig173183613715"><span class="figcap"><b>Figure 2 </b>Export Task</span><br><span><img id="dataartsstudio_01_0010__image1360771419536" src="en-us_image_0000002305406933.png"></span></div>
|
||||
<p id="dataartsstudio_01_0010__p1897784316235"></p>
|
||||
</p></li><li id="dataartsstudio_01_0010__li117772430138"><span>Click <span class="uicontrol" id="dataartsstudio_01_0010__uicontrol1681291711214"><b>Next</b></span> and select the resources to export.</span><p><p id="dataartsstudio_01_0010__p14589150145312"></p>
|
||||
</p></li><li id="dataartsstudio_01_0010__li10777124381318"><span>Click <strong id="dataartsstudio_01_0010__b1671194112214">Next</strong> and wait until the export is complete. The resource package is exported to the OBS path you have set.</span><p><div class="fignone" id="dataartsstudio_01_0010__fig115243158274"><span class="figcap"><b>Figure 3 </b>Export completed</span><br><span><img id="dataartsstudio_01_0010__image726804155317" src="en-us_image_0000002305406921.png"></span></div>
|
||||
<p id="dataartsstudio_01_0010__p4442736153913">If no result is displayed in 1 minute, the export fails. Try again. If the failure persists, contact <span id="dataartsstudio_01_0010__text144183817145">the customer service or technical support</span>.</p>
|
||||
</p></li><li id="dataartsstudio_01_0010__li1377714301310"><span>After the export is complete, you can click <strong id="dataartsstudio_01_0010__b10365745162217">Download</strong> in the row of the corresponding migration task to download the exported resource package.</span><p><div class="fignone" id="dataartsstudio_01_0010__fig1756933011329"><span class="figcap"><b>Figure 4 </b>Downloading the exported result</span><br><span><img id="dataartsstudio_01_0010__image158429583322" src="en-us_image_0000002305406917.png"></span></div>
|
||||
<p id="dataartsstudio_01_0010__p877675153316"></p>
|
||||
</p></li></ol>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0010__section3797132414396"><h4 class="sectiontitle">Importing a Resource</h4><ol id="dataartsstudio_01_0010__ol1932193713140"><li class="msonormal" id="dataartsstudio_01_0010__li19402146161414">On the <span id="dataartsstudio_01_0010__en-us_topic_0187412481_text108883915434_1">DataArts Studio</span> console, locate a workspace and click <strong id="dataartsstudio_01_0010__en-us_topic_0187412481_b1993143916438_1">Management Center</strong>.<div class="fignone" id="dataartsstudio_01_0010__en-us_topic_0187412481_fig11331320153513_1"><span class="figcap"><b>Figure 5 </b>Management Center</span><br><span><img id="dataartsstudio_01_0010__en-us_topic_0187412481_image6872534135313_1" src="en-us_image_0000001373087833.png"></span></div>
|
||||
</li></ol><ol start="2" id="dataartsstudio_01_0010__ol728918554018"><li id="dataartsstudio_01_0010__li16598101284011">In the navigation pane, choose <strong id="dataartsstudio_01_0010__en-us_topic_0182554812_b89281489484">Migrate Resources</strong>.<div class="fignone" id="dataartsstudio_01_0010__en-us_topic_0182554812_fig112561281915"><span class="figcap"><b>Figure 6 </b>Migrating Resources</span><br><span><img id="dataartsstudio_01_0010__en-us_topic_0182554812_image1671344623510" src="en-us_image_0000001321928704.png"></span></div>
|
||||
</li></ol><ol start="3" id="dataartsstudio_01_0010__ol1838411555525"><li id="dataartsstudio_01_0010__li193859550520">Click <span class="wintitle" id="dataartsstudio_01_0010__wintitle1597504811188"><b>Create Import Task</b></span> and configure the path for saving the resources to import. If no OBS bucket is available, select the resource package to be uploaded from a local path.<div class="fignone" id="dataartsstudio_01_0010__fig96755416444"><span class="figcap"><b>Figure 7 </b>Configuring the path for saving the resources to import</span><br><span><img id="dataartsstudio_01_0010__image364221285412" src="en-us_image_0000001373169033.png"></span></div>
|
||||
</li><li id="dataartsstudio_01_0010__li538575513528">Click <span class="uicontrol" id="dataartsstudio_01_0010__uicontrol1930404651516"><b>Next</b></span> and select the resource to import.<div class="fignone" id="dataartsstudio_01_0010__fig887221622918"><span class="figcap"><b>Figure 8 </b>Selecting the resource to import</span><br><span><img id="dataartsstudio_01_0010__image18703304422" src="en-us_image_0000001373288737.png"></span></div>
|
||||
</li><li id="dataartsstudio_01_0010__li184698455281">If you select <strong id="dataartsstudio_01_0010__b1151742615270">DataSource</strong>, click <span class="uicontrol" id="dataartsstudio_01_0010__uicontrol2080213318373"><b>Next</b></span> to configure a data connection. The number of data connections required is determined by the number of data sources. Each data connection requires a password.<div class="fignone" id="dataartsstudio_01_0010__fig13935181811416"><span class="figcap"><b>Figure 9 </b>Configuring a data connection</span><br><span><img id="dataartsstudio_01_0010__image135113918593" src="en-us_image_0000001322408284.png"></span></div>
|
||||
</li><li id="dataartsstudio_01_0010__li7385155516525">Click <strong id="dataartsstudio_01_0010__b1421713356345">Next</strong> and wait until the import is complete.<div class="fignone" id="dataartsstudio_01_0010__fig1353193313612"><span class="figcap"><b>Figure 10 </b>Import completed</span><br><span><img id="dataartsstudio_01_0010__image20126135711015" src="en-us_image_0000001322088392.png"></span></div>
|
||||
<p id="dataartsstudio_01_0010__p280162144815">If no result is displayed in 1 minute, the import fails. Try again. If the failure persists, contact <span id="dataartsstudio_01_0010__text788511384279">the customer service or technical support</span>.</p>
|
||||
</li></ol>
|
||||
<div class="section" id="dataartsstudio_01_0010__section3797132414396"><h4 class="sectiontitle">Importing a Resource</h4><ol id="dataartsstudio_01_0010__ol2078921718166"><li class="msonormal" id="dataartsstudio_01_0010__li7243143919166"><span>Log in to the <span id="dataartsstudio_01_0010__en-us_topic_0000001397651462_text5574448155719_1">DataArts Studio</span> console by following the instructions in <a href="dataartsstudio_01_0001.html">Accessing the DataArts Studio Instance Console</a>.</span></li><li class="msonormal" id="dataartsstudio_01_0010__li1724323910164"><span>On the <span id="dataartsstudio_01_0010__en-us_topic_0000001503129708_text82024413513_1">DataArts Studio</span> console, locate a workspace and click <strong id="dataartsstudio_01_0010__en-us_topic_0000001503129708_b820215416513_1">Management Center</strong>.</span></li><li id="dataartsstudio_01_0010__li1489119478163"><span>In the navigation pane, choose <strong id="dataartsstudio_01_0010__en-us_topic_0182554812_b89281489484">Migrate Resources</strong>.</span><p><div class="fignone" id="dataartsstudio_01_0010__en-us_topic_0182554812_fig112561281915"><span class="figcap"><b>Figure 5 </b>Migrating Resources</span><br><span><img id="dataartsstudio_01_0010__en-us_topic_0182554812_image1235516539128" src="en-us_image_0000002305439969.png"></span></div>
|
||||
<p id="dataartsstudio_01_0010__en-us_topic_0182554812_p1880613432136"></p>
|
||||
</p></li><li id="dataartsstudio_01_0010__li5789191718162"><span>Click <span class="wintitle" id="dataartsstudio_01_0010__wintitle03856552527"><b>Create Import Task</b></span>. On the displayed page, select an import mode and set the OBS bucket and path or local path that stores resources. The resource to be imported must be a .zip file exported from the console.</span><p><div class="fignone" id="dataartsstudio_01_0010__fig96755416444"><span class="figcap"><b>Figure 6 </b>Configuring the path that stores the resources to be imported</span><br><span><img id="dataartsstudio_01_0010__image525261911410" src="en-us_image_0000002270847054.png"></span></div>
|
||||
<p id="dataartsstudio_01_0010__p14635161511617"></p>
|
||||
</p></li><li id="dataartsstudio_01_0010__li1994717161716"><span>Click <strong id="dataartsstudio_01_0010__b17293532182716">Create Import Task</strong> and upload a .zip resource file that you have exported.</span></li><li id="dataartsstudio_01_0010__li278991720168"><span>Click <span class="uicontrol" id="dataartsstudio_01_0010__uicontrol8778518297"><b>Next</b></span> and select the resources to import.</span><p><p id="dataartsstudio_01_0010__p0141152812535"></p>
|
||||
</p></li><li id="dataartsstudio_01_0010__li878961741610"><span>If you select <strong id="dataartsstudio_01_0010__b1151742615270">DataSource</strong>, click <span class="uicontrol" id="dataartsstudio_01_0010__uicontrol2080213318373"><b>Next</b></span> to configure a data connection.</span><p><div class="fignone" id="dataartsstudio_01_0010__fig13935181811416"><span class="figcap"><b>Figure 7 </b>Configuring a data connection</span><br><span><img id="dataartsstudio_01_0010__image135113918593" src="en-us_image_0000002305406925.png"></span></div>
|
||||
</p></li><li id="dataartsstudio_01_0010__li107894175164"><span>Click <span class="uicontrol" id="dataartsstudio_01_0010__en-us_topic_0182554812_uicontrol133851455165217"><b>Next</b></span> and wait until the import task is delivered. When the import task is delivered successfully, the system displays message "Import task started."</span><p><div class="fignone" id="dataartsstudio_01_0010__fig1353193313612"><span class="figcap"><b>Figure 8 </b>Import task started</span><br><span><img id="dataartsstudio_01_0010__image1433519459184" src="en-us_image_0000002305439965.png"></span></div>
|
||||
<p id="dataartsstudio_01_0010__p515218324354"></p>
|
||||
</p></li><li id="dataartsstudio_01_0010__li578971731610"><span>Click <strong id="dataartsstudio_01_0010__b20842182352310">OK</strong>. You can view the import result in the resource migration task list.</span><p><div class="p" id="dataartsstudio_01_0010__p1025084483014">Subtasks that fail are marked in red. You can click their names to view the failure causes.<div class="fignone" id="dataartsstudio_01_0010__fig19832184619289"><span class="figcap"><b>Figure 9 </b>Viewing the import result</span><br><span><img id="dataartsstudio_01_0010__image07738567282" src="en-us_image_0000002305406929.png"></span></div>
|
||||
</div>
|
||||
<p id="dataartsstudio_01_0010__p2904906357"></p>
|
||||
</p></li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
|
||||
@ -4,7 +4,7 @@
|
||||
<div id="body0000001147533075"></div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0116_0.html">Creating and Managing a Workspace</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0116.html">Creating and Managing a Workspace</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0530.html">(Optional) Changing the Job Log Storage Path</a></strong><br>
|
||||
</li>
|
||||
|
||||
@ -8,7 +8,7 @@
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0015.html">Constraints</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0014.html">Supported Data Sources</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0215.html">Supported Data Sources</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0017.html">Managing Clusters</a></strong><br>
|
||||
</li>
|
||||
@ -16,12 +16,12 @@
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0081.html">Managing Jobs</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0125.html">Auditing</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0018.html">Improving Migration Performance</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0110.html">Key Operation Guide</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0086.html">Tutorials</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0110.html">Advanced Operations</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
|
||||
<div class="familylinks">
|
||||
|
||||
@ -3,11 +3,8 @@
|
||||
<h1 class="topictitle1">Overview</h1>
|
||||
<div id="body1563878452040"><p id="dataartsstudio_01_0013__p4422519145022">DataArts Migration is an efficient and easy-to-use data integration service. Based on the big data migration to the cloud and intelligent data lake solutions, CDM provides easy-to-use migration capabilities and can integrate various types of data sources into the data lake, which simplifies data source migration and integration and improves efficiency for you.</p>
|
||||
<p id="dataartsstudio_01_0013__p1159813425254">In this document, DataArts Migration refers to Cloud Data Migration (CDM).</p>
|
||||
<p id="dataartsstudio_01_0013__p18432117154313">You can access the CDM console using either of the following methods:</p>
|
||||
<ul id="dataartsstudio_01_0013__ul4673162874320"><li id="dataartsstudio_01_0013__li1767317284431">Log in to the CDM console and choose <strong id="dataartsstudio_01_0013__b149541440191516">Cluster Management</strong> in the navigation pane.</li><li id="dataartsstudio_01_0013__en-us_topic_0181028490_li586523263418">Log in to the <span id="dataartsstudio_01_0013__text14467155364413">DataArts Studio</span> console. Locate a workspace and click <strong id="dataartsstudio_01_0013__b10481157171519">DataArts Migration</strong>.<div class="fignone" id="dataartsstudio_01_0013__fig746051541519"><span class="figcap"><b>Figure 1 </b>DataArts Migration</span><br><span><img id="dataartsstudio_01_0013__image1841805814533" src="en-us_image_0000001373087921.png"></span></div>
|
||||
</li></ul>
|
||||
<div class="section" id="dataartsstudio_01_0013__en-us_topic_0108275398_section69302054123512"><h4 class="sectiontitle">Introduction to CDM</h4><p id="dataartsstudio_01_0013__en-us_topic_0108275398_p52164437151344">CDM uses a distributed compute framework and concurrent processing techniques to help you migrate enterprise data in batches without any downtime and rapidly build desired data structures.</p>
|
||||
<div class="fignone" id="dataartsstudio_01_0013__fig168071431636"><span class="figcap"><b>Figure 2 </b>CDM</span><br><span><img id="dataartsstudio_01_0013__image345113512419" src="en-us_image_0000001322407976.png"></span></div>
|
||||
<div class="fignone" id="dataartsstudio_01_0013__fig168071431636"><span class="figcap"><b>Figure 1 </b>CDM</span><br><span><img id="dataartsstudio_01_0013__image345113512419" src="en-us_image_0000002270791492.png"></span></div>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0013__en-us_topic_0108275398_section8948312133415"><h4 class="sectiontitle">Functions</h4><ul id="dataartsstudio_01_0013__en-us_topic_0108275398_ul20174521145718"><li id="dataartsstudio_01_0013__en-us_topic_0108275398_li51745219571"><strong id="dataartsstudio_01_0013__en-us_topic_0108275398_b13757734033">Table/file/entire DB migration</strong><p id="dataartsstudio_01_0013__en-us_topic_0108275398_p3767173325717">Tables or files can be migrated in batches. An entire database can be migrated between homogeneous and heterogeneous databases. A job can migrate hundreds of tables.</p>
|
||||
</li><li id="dataartsstudio_01_0013__en-us_topic_0108275398_li123531673310"><strong id="dataartsstudio_01_0013__en-us_topic_0108275398_b13373124715415">Incremental data migration</strong><p id="dataartsstudio_01_0013__en-us_topic_0108275398_p666246937">CDM supports incremental migration of files, relational databases, and HBase/CloudTable, as well as with WHERE clauses and macro variables of date and time.</p>
|
||||
@ -20,7 +17,7 @@
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0013__section102647379456"><h4 class="sectiontitle">Migration Principles</h4><p class="msonormal" id="dataartsstudio_01_0013__en-us_topic_0163295208_p22430675">When a tenant uses CDM, the CDM system provisions a fully-managed CDM instance in the tenant's VPC. The instance allows only console and RESTful API access. Therefore the tenant cannot access the instance through other interfaces (such as SSH). This ensures data isolation between CDM tenants, prevents data leakage, and ensures transmission security during data migration between different cloud services in a VPC. Tenants can also use the VPN to migrate data from the on-premises data center to cloud services to ensure migration security.</p>
|
||||
<p id="dataartsstudio_01_0013__en-us_topic_0163295208_p1908150154719">CDM works in push-pull mode. CDM pulls data from the migration source and pushes the data to the migration destination. Data access operations are initiated by CDM. SSL will be used if the data source (such as RDS) supports it. During the migration, the usernames and passwords of the migration source and destination are required. Such information is stored in the database of the CDM instance. Protecting such information is critical to ensure CDM security.</p>
|
||||
<div class="fignone" id="dataartsstudio_01_0013__en-us_topic_0163295208_fig913012503618"><span class="figcap"><b>Figure 3 </b>Migration principles</span><br><span><img id="dataartsstudio_01_0013__en-us_topic_0163295208_image9828541123015" src="en-us_image_0000001322247992.png"></span></div>
|
||||
<div class="fignone" id="dataartsstudio_01_0013__en-us_topic_0163295208_fig913012503618"><span class="figcap"><b>Figure 2 </b>Migration principles</span><br><span><img id="dataartsstudio_01_0013__en-us_topic_0163295208_image9828541123015" src="en-us_image_0000002270791496.png"></span></div>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@ -1,13 +1,13 @@
|
||||
<a name="dataartsstudio_01_0015"></a><a name="dataartsstudio_01_0015"></a>
|
||||
|
||||
<h1 class="topictitle1">Constraints</h1>
|
||||
<div id="body8662426"><div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section41741324807"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b1491912352113">CDM System Constraints</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol387012301638"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1687013307318">You cannot modify the flavor of an existing cluster. If you require a higher flavor, create a cluster with your desired flavor.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li348111171418">Arm CDM clusters do not support agents. The CDM cluster version (Arm or x86) is determined by the architecture of underlying resources.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li15870183017315">CDM does not support the function of controlling the data migration speed. Therefore, do not perform data migration during peak hours. </li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li114851637462">The baseline and maximum bandwidths of the NIC of the cdm.large CDM instance is 0.8 Gbit/s and 3 Gbit/s, respectively. The theoretical maximum volume of data that can be transmitted per instance per day is about 8 TB. Similarly, the baseline and maximum bandwidths of the NIC of the cdm.xlarge instance are 4 Gbit/s and 10 Gbit/s, respectively, and the theoretical maximum volume of data that can be transmitted per instance per day is about 40 TB. The baseline and maximum bandwidths of the NIC of the cdm.4xlarge instance is 36 Gbit/s and 40 Gbit/s, respectively, and the theoretical maximum volume of data that can be transmitted per instance per day is about 360 TB. You can use multiple CDM instances if you want faster data transfer.<p id="dataartsstudio_01_0015__en-us_topic_0108275404_en-us_topic_0108275404_p1551615411466"><a name="dataartsstudio_01_0015__en-us_topic_0108275404_li114851637462"></a><a name="en-us_topic_0108275404_li114851637462"></a>The actual amount of data that can be migrated in a day depends on the data source type, the read and write performance of the source and destination, and the actual available bandwidth. Typically you can migrate as much as 8 TB per day (large file migration to OBS) using the cdm.large instance. It is recommended that you test the speed with a small amount of data before migration.</p>
|
||||
<div id="body8662426"><div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section41741324807"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b1491912352113">CDM System Constraints</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol387012301638"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1687013307318">You cannot modify the flavor of an existing cluster. If you require a higher flavor, create a cluster with your desired flavor.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li348111171418">Arm CDM clusters do not support agents. The CDM cluster version (Arm or x86) is determined by the architecture of underlying resources.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li15870183017315">CDM does not support the function of controlling the data migration speed. Therefore, do not perform data migration during peak hours. </li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li102008075610">During data migration, CDM imposes pressure on the data source. You are advised to create a database account for data migration and configure an account policy to reduce the resource consumption of the data source. For example, you can configure a policy to delete the connections of the account when the CPU usage exceeds 30% to prevent impact on services.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li114851637462">The baseline and maximum bandwidths of the NIC of the cdm.large CDM instance is 0.8 Gbit/s and 3 Gbit/s, respectively. The theoretical maximum volume of data that can be transmitted per instance per day is about 8 TB. Similarly, the baseline and maximum bandwidths of the NIC of the cdm.xlarge instance are 4 Gbit/s and 10 Gbit/s, respectively, and the theoretical maximum volume of data that can be transmitted per instance per day is about 40 TB. The baseline and maximum bandwidths of the NIC of the cdm.4xlarge instance is 36 Gbit/s and 40 Gbit/s, respectively, and the theoretical maximum volume of data that can be transmitted per instance per day is about 360 TB. You can use multiple CDM instances if you want faster data transfer.<p id="dataartsstudio_01_0015__en-us_topic_0108275404_en-us_topic_0108275404_p1551615411466"><a name="dataartsstudio_01_0015__en-us_topic_0108275404_li114851637462"></a><a name="en-us_topic_0108275404_li114851637462"></a>The actual amount of data that can be migrated in a day depends on the data source type, the read and write performance of the source and destination, and the actual available bandwidth. Typically you can migrate as much as 8 TB per day (large file migration to OBS) using the cdm.large instance. It is recommended that you test the speed with a small amount of data before migration.</p>
|
||||
</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li758482013815">CDM supports incremental file migration (by skipping repeated files), but does not support resumable transfer.<p id="dataartsstudio_01_0015__en-us_topic_0108275404_p53495242813"><a name="dataartsstudio_01_0015__en-us_topic_0108275404_li758482013815"></a><a name="en-us_topic_0108275404_li758482013815"></a>For example, if three files are to be migrated and the second file fails to be migrated due to the network fault. When the migration task is started again, the first file is skipped. The second file, however, cannot be migrated from the point where the fault occurs, but can only be migrated again.</p>
|
||||
</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li195974311420">During file migration, a single task supports millions of files. If there are too many files in the directory to be migrated, you are advised to split the files into different directories and create multiple tasks.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li10481165219410">You can export links and jobs configured on CDM to a local directory. To ensure password security, CDM does not export the link password of the corresponding data source. Therefore, before importing job configurations to CDM, you need to manually input the password in the exported JSON file or configure the password in the import dialog box.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li374145718417">The cluster cannot automatically upgrade to a new version. You need to use the job export and import functions to upgrade the cluster to the new version.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li448111114516">If OBS is unavailable, CDM does not automatically back up users' job configurations. You need to export and back up configuration data using the export function.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li11946809112"><span id="dataartsstudio_01_0015__en-us_topic_0108275404_ph207651219381">If VPC peering connection is configured, the peer VPC subnet may overlap with the CDM management network. As a result, data sources in the peer VPC cannot be accessed. You are advised to use the public network for cross-VPC data migration, or contact the administrator to add specific routes to the VPC peering connection in the CDM background.</span></li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li193610315569">If the destination of a CDM job is a DWS or NewSQL database, constraints of the source end, such as the primary key and unique index, cannot be migrated together.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li9139811175311">When performing a CDM job, ensure that the JSON file formats of the two clusters are the same so that jobs can be imported from the source cluster to the destination cluster.</li></ol>
|
||||
</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li195974311420">During file migration, a single task supports millions of files. If there are too many files in the directory to be migrated, you are advised to split the files into different directories and create multiple tasks.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li10481165219410">You can export links and jobs configured on CDM to a local directory. To ensure password security, CDM does not export the link password of the corresponding data source. Therefore, before importing job configurations to CDM, you need to manually input the password in the exported JSON file or configure the password in the import dialog box.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li374145718417">The cluster cannot automatically upgrade to a new version. You need to use the job export and import functions to upgrade the cluster to the new version.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li448111114516">If OBS is unavailable, CDM does not automatically back up users' job configurations. You need to export and back up configuration data using the export function.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li11946809112"><span id="dataartsstudio_01_0015__en-us_topic_0108275404_ph207651219381">If VPC peering connection is configured, the peer VPC subnet may overlap with the CDM management network. As a result, data sources in the peer VPC cannot be accessed. You are advised to use the public network for cross-VPC data migration, or contact the administrator to add specific routes to the VPC peering connection in the CDM background.</span></li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li193610315569">If the destination of a CDM job is a DWS or NewSQL database, constraints of the source end, such as the primary key and unique index, cannot be migrated together.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li9139811175311">When performing a CDM job, ensure that the JSON file formats of the two clusters are the same so that jobs can be imported from the source cluster to the destination cluster.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li122981410751">If a running job is interrupted unexpectedly, the data that has been written to the destination will not be deleted. You must manually delete the data if needed.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li19577619321">The size of a file to be transferred cannot exceed 1 TB.</li></ol>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section18141628181814"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b129314716715">General Constraints on Database Migration</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol12131857191813"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li31317570181">CDM is mainly used for batch migration. It supports only limited incremental migration but does not support real-time incremental migration. </li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li192216218208">The entire DB migration of CDM supports only data table migration but not migration of database objects such as stored procedures, triggers, functions, and views.<p id="dataartsstudio_01_0015__en-us_topic_0108275404_p867452492013"><a name="dataartsstudio_01_0015__en-us_topic_0108275404_li192216218208"></a><a name="en-us_topic_0108275404_li192216218208"></a>CDM applies only to scenarios where databases are migrated to the cloud at a time, including homogeneous and heterogeneous database migrations. CDM is not applicable to data synchronization, for example, disaster recovery and real-time synchronization.</p>
|
||||
</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1431291119575">If CDM fails to migrate an entire database or table, the data that has been imported to the target table will not be rolled back automatically. If you want to perform migration in transaction mode, configure the <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b925962425814">Import to Staging Table</strong> parameter to enable a rollback upon a migration failure.<p id="dataartsstudio_01_0015__en-us_topic_0108275404_p187345158577">In extreme cases, the created stage table or temporary table cannot be automatically deleted. You need to manually clear the table (the table name of the stage table ends with <span class="uicontrol" id="dataartsstudio_01_0015__en-us_topic_0108275404_uicontrol3737124419572"><b>_cdm_stage</b></span>), for example, <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b117791013173914">cdmtet_cdm_stage</strong>).</p>
|
||||
</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li6930205232919">If CDM needs to access data sources in the on-premises data center (for example, the on-premises MySQL database), the data sources must support Internet access and the CDM instances must be bound with elastic IP addresses. In this case, the security practice is to configure the firewall or security policies to allow only the EIPs of the CDM instances to access the local data sources.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li15135574183">Only common data types are supported, including character strings, digits, and dates. Object types are limited. If objects are too large, migration cannot be performed.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li18131570188">Only the GBK and UTF-8 character sets are supported.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1534605245718">A field name cannot contain & and %.</li></ol>
|
||||
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section18141628181814"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b129314716715">General Constraints on Database Migration</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol12131857191813"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li31317570181">CDM is mainly used for batch migration. It supports only limited incremental migration but does not support real-time incremental migration. </li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li192216218208">The entire DB migration of CDM supports only data table migration but not migration of database objects such as stored procedures, triggers, functions, and views. <p id="dataartsstudio_01_0015__en-us_topic_0108275404_p867452492013"><a name="dataartsstudio_01_0015__en-us_topic_0108275404_li192216218208"></a><a name="en-us_topic_0108275404_li192216218208"></a>CDM applies only to scenarios where databases are migrated to the cloud at a time, including homogeneous and heterogeneous database migrations. CDM is not applicable to data synchronization, for example, disaster recovery and real-time synchronization.</p>
|
||||
</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1431291119575">If CDM fails to migrate an entire database or table, the data that has been imported to the target table will not be rolled back automatically. If you want to perform migration in transaction mode, configure the <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b925962425814">Import to Staging Table</strong> parameter to enable a rollback upon a migration failure.<p id="dataartsstudio_01_0015__en-us_topic_0108275404_p187345158577">In extreme cases, the created stage table or temporary table cannot be automatically deleted. You need to manually clear the table (the name of the stage table ends with <span class="uicontrol" id="dataartsstudio_01_0015__en-us_topic_0108275404_uicontrol3737124419572"><b>_cdm_stage</b></span>), for example, <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b117791013173914">cdmtet_cdm_stage</strong>).</p>
|
||||
</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li6930205232919">If CDM needs to access data sources in the on-premises data center (for example, the on-premises MySQL database), the data sources must support Internet access and the CDM instances must be bound with elastic IP addresses. In this case, the security practice is to configure the firewall or security policies to allow only the EIPs of the CDM instances to access the local data sources.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li15135574183">Only common data types are supported, including character strings, digits, and dates. Object types are limited. If objects are too large, migration cannot be performed.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li18131570188">Only the GBK and UTF-8 character sets are supported.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1534605245718">A field name cannot contain & or %.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li149911049104017">jdbc2hive and hive2jdbc entire DB migration is implemented by field name mapping, and is unavailable if the source and destination field names are inconsistent.</li></ol>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section77841851112219"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b3791114111588">Permissions Configuration for Relational Database Migration</strong></h4><p id="dataartsstudio_01_0015__en-us_topic_0108275404_p114842486258">Common minimum permissions required by relational database migration:</p>
|
||||
<ul id="dataartsstudio_01_0015__en-us_topic_0108275404_ul18115262318"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1281185216232">MySQL: You need to have the read permission on the <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b128551223564">INFORMATION_SCHEMA</strong> database and data tables.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1082195262313">Oracle: You need to have the <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b58704595620">resource</strong> role and have the <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b2870185105610">select </strong>permissions on the data table in the tablespace.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1382195213239">Dameng: You need to have the <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b1860684562">select any table</strong> permission in the schema.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li6821252102312">DWS: You need to have the<strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b11707172592910"> schema usage</strong> permission and the query permission on the data tables.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li2034017536810">SQL Server: You need to have the <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b37110560567">sysadmin</strong> permission.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li11341753586">PostgreSQL: You need to have the <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b109020145715">select</strong> permission on schema tables in the database.</li></ul>
|
||||
@ -15,14 +15,18 @@
|
||||
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section1443661143314"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b88331756193">Constraints on FusionInsight HD and Apache Hadoop</strong></h4><p id="dataartsstudio_01_0015__en-us_topic_0108275404_p102661957113315">If the FusionInsight HD and Apache Hadoop data sources are deployed in the on-premises data center, CDM must access all nodes in the cluster for reading and writing the Hadoop files. Therefore, the network access must be enabled for each node.</p>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section10533131115352"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b626717411286">Constraints on DWS and FusionInsight LibrA</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol123656567357"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1036535610357"><span id="dataartsstudio_01_0015__en-us_topic_0108275404_ph896020457565">If the DWS primary key or table contains only one field, the field type must be a common character string, value, or date. When data is migrated from another database to DWS, if automatic table creation is selected, the primary key must be of the following types. If no primary key is set, at least one of the following fields must be set. Otherwise, the table cannot be created and the CDM job fails.</span><ul id="dataartsstudio_01_0015__en-us_topic_0108275404_ul19587148144414"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li178061658447">INTEGER TYPES: TINYINT, SMALLINT, INT, BIGINT, NUMERIC/DECIMAL</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li13513127191516">CHARACTER TYPES: CHAR, BPCHAR, VARCHAR, VARCHAR2, NVARCHAR2, TEXT</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li17722183661616">DATA/TIME TYPES: DATE, TIME, TIMETZ, TIMESTAMP, TIMESTAMPTZ, INTERVAL, SMALLDATETIME</li></ul>
|
||||
<div class="note" id="dataartsstudio_01_0015__en-us_topic_0108275404_note14604639135010"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0015__en-us_topic_0108275404_p160433915506">For clusters of version 2.9.1.200 or earlier, the NVARCHAR2 data type is not supported for DWS.</p>
|
||||
</div></div>
|
||||
</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1987905110177">In DWS, the character string <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b4284165153511">''</strong> is null. A null character string cannot be inserted into a field with non-null constraints. This is inconsistent with the MySQL behavior. MySQL does not consider that <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b9349145113618">''</strong> is null. Migration from MySQL to DWS may fail due to the preceding reason.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1270919093612">When the Gauss Data Service (GDS) mode is used to quickly import data to DWS, you need to configure a security group or firewall policy to allow DataNodes of DWS or FusionInsight LibrA to access port 25000 of the CDM IP address.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li18441396234">When data is imported to DWS in GDS mode, CDM automatically creates a foreign table for data import. The table name ends with a universally unique identifier (UUID), for example, <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b1738395918464">cdmtest_aecf3f8n0z73dsl72d0d1dk4lcir8cd</strong>. If a job fails, it will be automatically deleted. In extreme cases, you may need to manually delete it.</li></ol>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section131751236114113"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b1247420243517">Constraints on OBS</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol176601786429"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1466017814424">During file migration, the system automatically transfers the files concurrently. In this case, <span class="parmname" id="dataartsstudio_01_0015__en-us_topic_0108275404_parmname947762785413"><b>Concurrent Extractors</b></span> in the task configuration is invalid.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li156608874212">Resumable transfer is not supported. If CDM fails to transfer files, OBS fragments are generated. You need to clear fragments on the OBS console to prevent space occupation.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1523372310451">CDM does not support the versioning control function of OBS.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li13634124513265">During incremental migration, the number of files or objects in the source directory of a single job depends on the CDM cluster flavor. A cdm.large cluster supports a maximum of 300,000 files; a cdm.medium cluster supports a maximum of 200,000 files; and a cdm.small cluster supports a maximum of 100,000 files.<p id="dataartsstudio_01_0015__en-us_topic_0108275404_p640449202611"><a name="dataartsstudio_01_0015__en-us_topic_0108275404_li13634124513265"></a><a name="en-us_topic_0108275404_li13634124513265"></a>If the number of files or objects in a single directory exceeds the upper limit, split the files or objects into multiple migration jobs based on subdirectories.</p>
|
||||
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section131751236114113"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b1247420243517">Constraints on OBS</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol176601786429"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1466017814424">During file migration, the system automatically transfers the files concurrently. In this case, <span class="parmname" id="dataartsstudio_01_0015__en-us_topic_0108275404_parmname947762785413"><b>Concurrent Extractors</b></span> in the task configuration is invalid.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li156608874212">Resumable transmission is not supported. If CDM fails to transfer files, OBS fragments are generated. You need to clear fragments on the OBS console to prevent space occupation.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1523372310451">CDM does not support the versioning control function of OBS.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li13634124513265">During incremental migration, the number of files or objects in the source directory of a single job depends on the CDM cluster flavor. A cdm.large cluster supports a maximum of 300,000 files; a cdm.medium cluster supports a maximum of 200,000 files; and a cdm.small cluster supports a maximum of 100,000 files.<p id="dataartsstudio_01_0015__en-us_topic_0108275404_p640449202611"><a name="dataartsstudio_01_0015__en-us_topic_0108275404_li13634124513265"></a><a name="en-us_topic_0108275404_li13634124513265"></a>If the number of files or objects in a single directory exceeds the upper limit, split the files or objects into multiple migration jobs based on subdirectories.</p>
|
||||
</li></ol>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section730332214560"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b128941110111612">Constraints on DLI</strong></h4><ul id="dataartsstudio_01_0015__en-us_topic_0108275404_ul12224205863311"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1224145816335">To use CDM to migrate data to DLI, you must have the read permissions of OBS.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li222455811330">If the destination is DLI, you are advised to set the number of concurrent extractors to 1. Otherwise, data may fail to be written.</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section15854191754519"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b43946117137">Constraints on Oracle</strong></h4><p id="dataartsstudio_01_0015__en-us_topic_0108275404_p82495121013">Real-time incremental data synchronization is not supported for Oracle databases.</p>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section66348560505"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b192601931173213">Constraints on DCS and Redis</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol0306417135117"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li193061517145115"><span id="dataartsstudio_01_0015__en-us_topic_0108275404_ph27081439382">Because DCS restricts the commands for obtaining keys, it cannot serve as the migration source but can be the migration destination. The Redis service of the third-party cloud cannot serve as the migration source. However, the Redis set up in the on-premises data center or on the ECS can be the migration source and destination.</span></li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li730631785115">Only the hash and string data formats are supported.</li></ol>
|
||||
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section66348560505"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b172432291316">Constraints on DCS and Redis</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol0306417135117"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li193061517145115"><span id="dataartsstudio_01_0015__en-us_topic_0108275404_ph27081439382">The Redis service of the third-party cloud cannot serve as the migration source. However, the Redis set up in the on-premises data center or on the ECS can be the migration source and destination.</span></li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li730631785115">Only the hash and string data formats are supported.</li></ol>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section15580101719556"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b163681082391">Constraints on DDS and MongoDB</strong></h4><p id="dataartsstudio_01_0015__en-us_topic_0108275404_p64431955112453">When you migrate MongoDB or DDS data, CDM reads the first row of the collection as an example of the field list. If the first row of data does not contain all fields of the collection, you need to manually add fields.</p>
|
||||
</div>
|
||||
@ -30,12 +34,11 @@
|
||||
</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1631018351974">When the field type of the index created by CDM is date, the data format must be <em id="dataartsstudio_01_0015__en-us_topic_0108275404_i62199366527">yyyy-MM-dd HH:mm:ss.SSS Z</em>. For example, <span class="parmvalue" id="dataartsstudio_01_0015__en-us_topic_0108275404_parmvalue13548164914523"><b>2018-08-08 08:08:08.888 +08:00</b></span>.<p id="dataartsstudio_01_0015__en-us_topic_0108275404_p11165161042018">During data migration to CSS, if the original data of the <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b16976103125311">date</strong> field does not meet the format requirements, you can use the expression conversion function of CDM to convert the data to the preceding format.</p>
|
||||
</li></ol>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section797519552109"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b550619462313">Constraints on Kafka</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol841312442116"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li2041334471114"><span id="dataartsstudio_01_0015__en-us_topic_0108275404_ph28693044211">The data in the message body is a record in CSV format that supports multiple delimiters. Messages cannot be parsed in binary or other formats.</span></li></ol>
|
||||
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section797519552109"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b550619462313">Constraints on Kafka</strong></h4><ul id="dataartsstudio_01_0015__en-us_topic_0108275404_ul17668230193717"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li566813018378"><span id="dataartsstudio_01_0015__en-us_topic_0108275404_ph28693044211">The data in the message body is a record in CSV format that supports multiple delimiters. Messages cannot be parsed in binary or other formats.</span></li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li176681730173713">If the source is MRS Kafka, custom fields are not supported in field mapping.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li17668113020371">If the source is DMS Kafka, custom fields are supported in field mapping.</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section19323131416133"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b7886141961015">Constraints on CloudTable and HBase</strong></h4><ol id="dataartsstudio_01_0015__en-us_topic_0108275404_ol196986359136"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li469815359134">When you migrate data from CloudTable or HBase, CDM reads the first row of the table as an example of the field list. If the first row of data does not contain all fields of the table, you need to manually add fields.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li156983351133">Because HBase is schema-less, CDM cannot obtain the data types. If the data is stored in binary format, CDM cannot parse the data.</li></ol>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section1557962192010"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b118512401114">Constraints on Hive</strong></h4><p id="dataartsstudio_01_0015__en-us_topic_0108275404_p18581321182015"><span id="dataartsstudio_01_0015__en-us_topic_0108275404_ph11446155313540">When Hive serves as the migration destination, if the storage format is TEXTFILE, delimiters must be explicitly specified in the statement for creating Hive tables. The following gives an example:</span></p>
|
||||
<pre class="screen" id="dataartsstudio_01_0015__en-us_topic_0108275404_screen371715213715">CREATE TABLE csv_tbl(
|
||||
<div class="section" id="dataartsstudio_01_0015__en-us_topic_0108275404_section1557962192010"><h4 class="sectiontitle"><strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b118512401114">Constraints on Hive</strong></h4><ul id="dataartsstudio_01_0015__en-us_topic_0108275404_ul05305291079"><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li1753012913720">If Hive stores timestamp data in Parquet format, timestamps are accurate to the nanosecond, for example, 2023-03-27 00:00:00.000. If the source data precision is higher than the nanosecond, the data will be truncated during field mapping. For example, if the source data is <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b834745810511">2023-03-27 00:00:00.12345</strong>, it will be truncated to <strong id="dataartsstudio_01_0015__en-us_topic_0108275404_b1069823135219">2023-03-27 00:00:00.123</strong> at the destination.</li><li id="dataartsstudio_01_0015__en-us_topic_0108275404_li185301295717"><span id="dataartsstudio_01_0015__en-us_topic_0108275404_ph11446155313540">If Hive serves as the migration destination and the storage format is Textfile, delimiters must be explicitly specified in the statement for creating Hive tables. The following is an example:</span><pre class="screen" id="dataartsstudio_01_0015__en-us_topic_0108275404_screen371715213715">CREATE TABLE csv_tbl(
|
||||
smallint_value smallint,
|
||||
tinyint_value tinyint,
|
||||
int_value int,
|
||||
@ -62,6 +65,7 @@ WITH SERDEPROPERTIES (
|
||||
"escapeChar" = "\\"
|
||||
)
|
||||
STORED AS TEXTFILE;</pre>
|
||||
</li></ul>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
|
||||
@ -6,7 +6,7 @@
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0576.html">Creating a CDM Cluster</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0020.html">Binding or Unbinding an EIP</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0020_0.html">Binding or Unbinding an EIP</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0578.html">Restarting a Cluster</a></strong><br>
|
||||
</li>
|
||||
@ -14,7 +14,7 @@
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0022.html">Downloading Cluster Logs</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0021.html">Viewing Basic Cluster Information and Modifying Cluster Configurations</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0021_0.html">Viewing Basic Cluster Information and Modifying Cluster Configurations</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0121.html">Viewing Metrics</a></strong><br>
|
||||
</li>
|
||||
|
||||
21
docs/dataartsstudio/umn/dataartsstudio_01_0018.html
Normal file
21
docs/dataartsstudio/umn/dataartsstudio_01_0018.html
Normal file
@ -0,0 +1,21 @@
|
||||
<a name="dataartsstudio_01_0018"></a><a name="dataartsstudio_01_0018"></a>
|
||||
|
||||
<h1 class="topictitle1">Improving Migration Performance</h1>
|
||||
<div id="body0000001150631920"></div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0025.html">How Migration Jobs Work</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0076.html">Performance Tuning</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0078.html">Reference: Job Splitting Dimensions</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0077.html">Reference: CDM Performance Test Data</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0012.html">DataArts Migration</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
@ -1,23 +0,0 @@
|
||||
<a name="dataartsstudio_01_0020"></a><a name="dataartsstudio_01_0020"></a>
|
||||
|
||||
<h1 class="topictitle1">Binding or Unbinding an EIP</h1>
|
||||
<div id="body8662426"><div class="section" id="dataartsstudio_01_0020__en-us_topic_0108275471_section6082040915224"><h4 class="sectiontitle">Scenario</h4><p id="dataartsstudio_01_0020__en-us_topic_0108275471_p742920411259">After creating a CDM cluster, you can bind an EIP to or unbind an EIP from the cluster. </p>
|
||||
<ul id="dataartsstudio_01_0020__en-us_topic_0108275471_ul4655334132618"><li id="dataartsstudio_01_0020__en-us_topic_0108275471_li176555345263">If CDM needs to access a local or Internet data source, or a cloud service in another VPC, bind an EIP to the CDM cluster or use a NAT gateway to enable the CDM cluster to share the EIP with ECSs to access the Internet..</li><li id="dataartsstudio_01_0020__en-us_topic_0108275471_li397235713214">To create an EIP exception notification, choose <strong id="dataartsstudio_01_0020__en-us_topic_0108275471_b34407229500">Authorize EIP Check</strong> > <strong id="dataartsstudio_01_0020__en-us_topic_0108275471_b199901434155016">Create Agency</strong> on the <strong id="dataartsstudio_01_0020__en-us_topic_0108275471_b197769479515">Cluster Management</strong> page. The EIP exception notification takes effect only after the VPC policy agency of the corresponding region is created on the IAM management console.</li></ul>
|
||||
<div class="note" id="dataartsstudio_01_0020__en-us_topic_0108275471_note13181556123416"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0020__en-us_topic_0108275471_en-us_topic_0108275298_p1693084519332">If SSL encryption is configured for the access channel of a local data source, CDM cannot connect to the data source using the EIP.</p>
|
||||
</div></div>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0020__en-us_topic_0108275471_section5781841515252"><h4 class="sectiontitle">Prerequisites</h4><ul id="dataartsstudio_01_0020__en-us_topic_0108275471_ul3448175015190"><li id="dataartsstudio_01_0020__en-us_topic_0108275471_li2479787415190">You have created a CDM cluster.</li><li id="dataartsstudio_01_0020__en-us_topic_0108275471_li3269623515192">Your EIP quota is sufficient.</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0020__en-us_topic_0108275471_section1674818115330"><h4 class="sectiontitle">Procedure</h4><ol id="dataartsstudio_01_0020__en-us_topic_0108275471_ol4602013152046"><li id="dataartsstudio_01_0020__en-us_topic_0108275471_li418244016821"><span>Access the CDM console and choose <span class="uicontrol" id="dataartsstudio_01_0020__en-us_topic_0108275471_uicontrol136837859815540"><b>Cluster Management</b></span> in the left navigation pane.</span><p><div class="fignone" id="dataartsstudio_01_0020__en-us_topic_0108275471_fig4803125133011"><span class="figcap"><b>Figure 1 </b>Cluster list</span><br><span><img id="dataartsstudio_01_0020__en-us_topic_0108275471_image1746819721017" src="en-us_image_0000001322088024.png"></span></div>
|
||||
<div class="note" id="dataartsstudio_01_0020__en-us_topic_0108275471_note5185181692417"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0020__en-us_topic_0108275471_p1186131612417">The <strong id="dataartsstudio_01_0020__en-us_topic_0108275471_b1623437165310">Source</strong> column is displayed only when you access the <strong id="dataartsstudio_01_0020__en-us_topic_0108275471_b6281837165318">DataArts Migration</strong> page from the DataArts Studio console.</p>
|
||||
</div></div>
|
||||
</p></li><li id="dataartsstudio_01_0020__en-us_topic_0108275471_li0189204285419"><span>Bind an EIP to or unbind an EIP from a cluster.</span><p><ul id="dataartsstudio_01_0020__en-us_topic_0108275471_ul10803195193010"><li id="dataartsstudio_01_0020__en-us_topic_0108275471_li13803175193019">Binding an EIP: In the <strong id="dataartsstudio_01_0020__en-us_topic_0108275471_b2015317258420">Operation</strong> column, click <span class="uicontrol" id="dataartsstudio_01_0020__en-us_topic_0108275471_uicontrol1415352524218"><b>Bind EIP</b></span>. The <strong id="dataartsstudio_01_0020__en-us_topic_0108275471_b10153182516423">Bind EIP</strong> dialog box is displayed.</li><li id="dataartsstudio_01_0020__en-us_topic_0108275471_li241312592392">Unbinding an EIP: In the <strong id="dataartsstudio_01_0020__en-us_topic_0108275471_b298793728141839">Operation</strong> column, choose <span class="menucascade" id="dataartsstudio_01_0020__en-us_topic_0108275471_menucascade323504945141742"><b><span class="uicontrol" id="dataartsstudio_01_0020__en-us_topic_0108275471_uicontrol2130511470141742">More</span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0020__en-us_topic_0108275471_uicontrol2037634173141742">Unbind EIP</span></b></span>.</li></ul>
|
||||
</p></li><li id="dataartsstudio_01_0020__en-us_topic_0108275471_li33887024151727"><span>Click <span class="uicontrol" id="dataartsstudio_01_0020__en-us_topic_0108275471_uicontrol917090064153628"><b>Yes</b></span>.</span></li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0017.html">Managing Clusters</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
20
docs/dataartsstudio/umn/dataartsstudio_01_0020_0.html
Normal file
20
docs/dataartsstudio/umn/dataartsstudio_01_0020_0.html
Normal file
@ -0,0 +1,20 @@
|
||||
<a name="dataartsstudio_01_0020_0"></a><a name="dataartsstudio_01_0020_0"></a>
|
||||
|
||||
<h1 class="topictitle1">Binding or Unbinding an EIP</h1>
|
||||
<div id="body8662426"><div class="section" id="dataartsstudio_01_0020_0__en-us_topic_0108275471_section6082040915224"><h4 class="sectiontitle">Scenario</h4><p id="dataartsstudio_01_0020_0__en-us_topic_0108275471_p742920411259">After creating a CDM cluster, you can bind an EIP to or unbind an EIP from the cluster. </p>
|
||||
<p id="dataartsstudio_01_0020_0__en-us_topic_0108275471_p12141738191218">If CDM needs to access a local or Internet data source, or a cloud service in another VPC, bind an EIP to the CDM cluster or use a NAT gateway to enable the CDM cluster to share the EIP with ECSs to access the Internet.</p>
|
||||
<div class="note" id="dataartsstudio_01_0020_0__en-us_topic_0108275471_note12930114533313"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0020_0__en-us_topic_0108275471_p1693084519332">If SSL encryption is configured for the access channel of a local data source, CDM cannot connect to the data source using the EIP.</p>
|
||||
</div></div>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0020_0__en-us_topic_0108275471_section5781841515252"><h4 class="sectiontitle">Prerequisites</h4><ul id="dataartsstudio_01_0020_0__en-us_topic_0108275471_ul3448175015190"><li id="dataartsstudio_01_0020_0__en-us_topic_0108275471_li2479787415190">You have created a CDM cluster.</li><li id="dataartsstudio_01_0020_0__en-us_topic_0108275471_li3269623515192">Your EIP quota is sufficient.</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0020_0__en-us_topic_0108275471_section1674818115330"><h4 class="sectiontitle">Procedure</h4><ol id="dataartsstudio_01_0020_0__en-us_topic_0108275471_ol4602013152046"><li id="dataartsstudio_01_0020_0__en-us_topic_0108275471_li418244016821"><span id="dataartsstudio_01_0020_0__en-us_topic_0108275471_en-us_topic_0000001397651462_p119011953152312">Log in to the <span id="dataartsstudio_01_0020_0__en-us_topic_0108275471_en-us_topic_0000001397651462_text5574448155719">DataArts Studio</span> console by following the instructions in <a href="dataartsstudio_01_0001.html">Accessing the DataArts Studio Instance Console</a>. On the <span id="dataartsstudio_01_0020_0__en-us_topic_0108275471_text185611381448">DataArts Studio</span> console, locate a workspace and click <strong id="dataartsstudio_01_0020_0__en-us_topic_0108275471_b16600914612">DataArts Migration</strong> to access the CDM console.</span></li><li id="dataartsstudio_01_0020_0__en-us_topic_0108275471_li0189204285419"><span>Bind an EIP to or unbind an EIP from a cluster.</span><p><ul id="dataartsstudio_01_0020_0__en-us_topic_0108275471_ul10803195193010"><li id="dataartsstudio_01_0020_0__en-us_topic_0108275471_li13803175193019">Binding an EIP: In the <strong id="dataartsstudio_01_0020_0__en-us_topic_0108275471_b2015317258420">Operation</strong> column, click <span class="uicontrol" id="dataartsstudio_01_0020_0__en-us_topic_0108275471_uicontrol1415352524218"><b>Bind EIP</b></span>. The <strong id="dataartsstudio_01_0020_0__en-us_topic_0108275471_b10153182516423">Bind EIP</strong> dialog box is displayed.</li><li id="dataartsstudio_01_0020_0__en-us_topic_0108275471_li241312592392">Unbinding an EIP: In the <strong id="dataartsstudio_01_0020_0__en-us_topic_0108275471_b298793728141839">Operation</strong> column, choose <span class="menucascade" id="dataartsstudio_01_0020_0__en-us_topic_0108275471_menucascade323504945141742"><b><span class="uicontrol" id="dataartsstudio_01_0020_0__en-us_topic_0108275471_uicontrol2130511470141742">More</span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0020_0__en-us_topic_0108275471_uicontrol2037634173141742">Unbind EIP</span></b></span>.</li></ul>
|
||||
</p></li><li id="dataartsstudio_01_0020_0__en-us_topic_0108275471_li33887024151727"><span>Click <span class="uicontrol" id="dataartsstudio_01_0020_0__en-us_topic_0108275471_uicontrol917090064153628"><b>Yes</b></span>.</span></li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0017.html">Managing Clusters</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
@ -1,34 +0,0 @@
|
||||
<a name="dataartsstudio_01_0021"></a><a name="dataartsstudio_01_0021"></a>
|
||||
|
||||
<h1 class="topictitle1">Viewing Basic Cluster Information and Modifying Cluster Configurations</h1>
|
||||
<div id="body8662426"><div class="section" id="dataartsstudio_01_0021__en-us_topic_0108275372_section6082040915224"><h4 class="sectiontitle">Scenario</h4><p id="dataartsstudio_01_0021__en-us_topic_0108275372_p13184211124520">After creating a CDM cluster, you can view its basic information and modify its configurations.</p>
|
||||
<ul id="dataartsstudio_01_0021__en-us_topic_0108275372_ul19578141918455"><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li1177617222457">You can view the following basic cluster information:<ul id="dataartsstudio_01_0021__en-us_topic_0108275372_ul34505418485"><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li49551248144815">Cluster information: cluster version, creation time, project ID, instance ID, and cluster ID</li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li13938113919488">Instance configuration: cluster flavor, CPU, and memory</li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li1691813454916">Network configuration</li></ul>
|
||||
</li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li357841917454">You can modify the following cluster configurations:<ul id="dataartsstudio_01_0021__en-us_topic_0108275372_ul12517341719"><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li65133411112">Notification: If a CDM migration job (only table/file migration) fails or the EIP is abnormal, CDM sends an SMS or email notification to the user. </li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li1451163419115">User isolation: determines whether other users can operate the migration jobs or links in the cluster.<ul id="dataartsstudio_01_0021__en-us_topic_0108275372_ul185117349120"><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li1751534315">If this function is enabled, migration jobs and links in the cluster are isolated. Other IAM users of the <span id="dataartsstudio_01_0021__en-us_topic_0108275372_text145133410115">a cloud platform account</span> cannot operate the jobs and links.</li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li55114348115">If this function is disabled, migration jobs and links in the cluster can be shared by users. All IAM users with the required permission in the <span id="dataartsstudio_01_0021__en-us_topic_0108275372_text1943484611425">a cloud platform account</span> can view and perform operations on the jobs and links in the cluster.<p id="dataartsstudio_01_0021__en-us_topic_0108275372_p1651153414114">After disabling <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_b996710202447">User Isolation</strong>, restart the cluster VM for the settings to take effect.</p>
|
||||
</li></ul>
|
||||
</li></ul>
|
||||
</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0021__en-us_topic_0108275372_section5781841515252"><h4 class="sectiontitle">Prerequisites</h4><p id="dataartsstudio_01_0021__en-us_topic_0108275372_p33513853111130">You have created a CDM cluster.</p>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0021__en-us_topic_0108275372_section1674818115330"><h4 class="sectiontitle">Viewing Basic Cluster Information</h4><ol id="dataartsstudio_01_0021__en-us_topic_0108275372_ol4602013152046"><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li35890017143134"><span>Access the CDM console and choose <span class="uicontrol" id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_uicontrol136837859815540"><b>Cluster Management</b></span> in the left navigation pane.</span><p><div class="fignone" id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_fig4803125133011"><span class="figcap"><b>Figure 1 </b>Cluster list</span><br><span><img id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_image1746819721017" src="en-us_image_0000001322088024.png"></span></div>
|
||||
<div class="note" id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_note5185181692417"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_p1186131612417">The <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_b1623437165310">Source</strong> column is displayed only when you access the <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_b6281837165318">DataArts Migration</strong> page from the DataArts Studio console.</p>
|
||||
</div></div>
|
||||
</p></li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li16142765310"><span>Click the cluster name to view its basic information.</span><p><div class="fignone" id="dataartsstudio_01_0021__en-us_topic_0108275372_fig32088426113643"><span class="figcap"><b>Figure 2 </b>Basic cluster information</span><br><span><img id="dataartsstudio_01_0021__en-us_topic_0108275372_image1392813198346" src="en-us_image_0000001321929596.png"></span></div>
|
||||
<p id="dataartsstudio_01_0021__en-us_topic_0108275372_p1988954512340"></p>
|
||||
</p></li></ol>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0021__en-us_topic_0108275372_section8304145665316"><h4 class="sectiontitle">Modifying Cluster Configurations</h4><ol id="dataartsstudio_01_0021__en-us_topic_0108275372_ol1999165225516"><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li16425756115512"><span>Access the CDM console and choose <span class="uicontrol" id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_uicontrol136837859815540_1"><b>Cluster Management</b></span> in the left navigation pane.</span><p><div class="fignone" id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_fig4803125133011_1"><span class="figcap"><b>Figure 3 </b>Cluster list</span><br><span><img id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_image1746819721017_1" src="en-us_image_0000001322088024.png"></span></div>
|
||||
<div class="note" id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_note5185181692417_1"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_p1186131612417_1">The <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_b1623437165310_1">Source</strong> column is displayed only when you access the <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_en-us_topic_0108275471_b6281837165318_1">DataArts Migration</strong> page from the DataArts Studio console.</p>
|
||||
</div></div>
|
||||
</p></li></ol><ol start="2" id="dataartsstudio_01_0021__en-us_topic_0108275372_ol893465814539"><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li2934258175315"><span>Click the name of a cluster and click the <span class="uicontrol" id="dataartsstudio_01_0021__en-us_topic_0108275372_uicontrol2402161110415"><b>Cluster Configuration</b></span> tab to modify <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_b186144359423">Notification</strong> and <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_b20647429104215">User Isolation</strong> configuration.</span><p><div class="fignone" id="dataartsstudio_01_0021__en-us_topic_0108275372_fig149343582538"><span class="figcap"><b>Figure 4 </b>Modifying cluster configurations</span><br><span><img id="dataartsstudio_01_0021__en-us_topic_0108275372_image826463916352" src="en-us_image_0000001373409313.png"></span></div>
|
||||
</p></li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li16934258135318"><span>Click <span class="uicontrol" id="dataartsstudio_01_0021__en-us_topic_0108275372_uicontrol191388974921518"><b>Save</b></span>. The <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_b148848311621518">Cluster Management</strong> page is displayed.</span></li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li12934195818537"><span>If <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_b119183067121518">User Isolation</strong> is disabled, choose <span class="menucascade" id="dataartsstudio_01_0021__en-us_topic_0108275372_menucascade54419951821518"><b><span class="uicontrol" id="dataartsstudio_01_0021__en-us_topic_0108275372_uicontrol82627482221518">More</span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0021__en-us_topic_0108275372_uicontrol11172047021518">Restart</span></b></span> in the <strong id="dataartsstudio_01_0021__en-us_topic_0108275372_b23573550421518">Operation</strong> column to restart the cluster VM for the settings to take effect.</span><p><div class="fignone" id="dataartsstudio_01_0021__en-us_topic_0108275372_fig159341758205317"><span class="figcap"><b>Figure 5 </b>Restarting a cluster</span><br><span><img id="dataartsstudio_01_0021__en-us_topic_0108275372_image139341458125315" src="en-us_image_0000001373087905.png"></span></div>
|
||||
<ul id="dataartsstudio_01_0021__en-us_topic_0108275372_ul293411589531"><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li199341458205313"><strong id="dataartsstudio_01_0021__en-us_topic_0108275372_b664218019278">Restart CDM service process</strong>: Only the CDM service process is restarted. The cluster VM will not be restarted.</li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li49341958125318"><strong id="dataartsstudio_01_0021__en-us_topic_0108275372_b84235270615490">VM restart</strong>: The service process will be interrupted and VMs in the cluster will be restarted.</li></ul>
|
||||
</p></li><li id="dataartsstudio_01_0021__en-us_topic_0108275372_li1093410587539"><span>Select <span class="uicontrol" id="dataartsstudio_01_0021__en-us_topic_0108275372_uicontrol1876751918166"><b>VM restart</b></span> and click <span class="uicontrol" id="dataartsstudio_01_0021__en-us_topic_0108275372_uicontrol1010382481610"><b>Yes</b></span>.</span></li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0017.html">Managing Clusters</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
27
docs/dataartsstudio/umn/dataartsstudio_01_0021_0.html
Normal file
27
docs/dataartsstudio/umn/dataartsstudio_01_0021_0.html
Normal file
@ -0,0 +1,27 @@
|
||||
<a name="dataartsstudio_01_0021_0"></a><a name="dataartsstudio_01_0021_0"></a>
|
||||
|
||||
<h1 class="topictitle1">Viewing Basic Cluster Information and Modifying Cluster Configurations</h1>
|
||||
<div id="body8662426"><div class="section" id="dataartsstudio_01_0021_0__en-us_topic_0108275372_section6082040915224"><h4 class="sectiontitle">Scenario</h4><p id="dataartsstudio_01_0021_0__en-us_topic_0108275372_p13184211124520">After creating a CDM cluster, you can view its basic information and modify its configurations.</p>
|
||||
<ul id="dataartsstudio_01_0021_0__en-us_topic_0108275372_ul19578141918455"><li id="dataartsstudio_01_0021_0__en-us_topic_0108275372_li1177617222457">You can view the following basic cluster information:<ul id="dataartsstudio_01_0021_0__en-us_topic_0108275372_ul34505418485"><li id="dataartsstudio_01_0021_0__en-us_topic_0108275372_li49551248144815">Cluster information: cluster version, creation time, project ID, instance ID, and cluster ID</li><li id="dataartsstudio_01_0021_0__en-us_topic_0108275372_li13938113919488">Instance configuration: cluster flavor, CPU, and memory</li><li id="dataartsstudio_01_0021_0__en-us_topic_0108275372_li1691813454916">Network configuration</li></ul>
|
||||
</li><li id="dataartsstudio_01_0021_0__en-us_topic_0108275372_li357841917454">You can modify the following cluster configurations:<ul id="dataartsstudio_01_0021_0__en-us_topic_0108275372_ul12517341719"><li id="dataartsstudio_01_0021_0__en-us_topic_0108275372_li65133411112">Notification: If a CDM migration job (only table/file migration) fails or the EIP is abnormal, CDM sends an SMS or email notification to the user. </li><li id="dataartsstudio_01_0021_0__en-us_topic_0108275372_li1451163419115">User isolation: determines whether other users can operate the migration jobs or links in the cluster.<ul id="dataartsstudio_01_0021_0__en-us_topic_0108275372_ul185117349120"><li id="dataartsstudio_01_0021_0__en-us_topic_0108275372_li1751534315">If this function is enabled, migration jobs and links in the cluster are isolated. Other IAM users of the <span id="dataartsstudio_01_0021_0__en-us_topic_0108275372_text145133410115">a cloud platform account</span> cannot operate the jobs and links.</li><li id="dataartsstudio_01_0021_0__en-us_topic_0108275372_li55114348115">If this function is disabled, migration jobs and links in the cluster can be shared by users. All IAM users with the required permission in the <span id="dataartsstudio_01_0021_0__en-us_topic_0108275372_text1943484611425">a cloud platform account</span> can view and perform operations on the jobs and links in the cluster.<p id="dataartsstudio_01_0021_0__en-us_topic_0108275372_p1651153414114">After disabling <strong id="dataartsstudio_01_0021_0__en-us_topic_0108275372_b996710202447">User Isolation</strong>, restart the cluster VM for the settings to take effect.</p>
|
||||
</li></ul>
|
||||
</li></ul>
|
||||
</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0021_0__en-us_topic_0108275372_section5781841515252"><h4 class="sectiontitle">Prerequisites</h4><p id="dataartsstudio_01_0021_0__en-us_topic_0108275372_p33513853111130">You have created a CDM cluster.</p>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0021_0__en-us_topic_0108275372_section1674818115330"><h4 class="sectiontitle">Viewing Basic Cluster Information</h4><ol id="dataartsstudio_01_0021_0__en-us_topic_0108275372_ol4602013152046"><li id="dataartsstudio_01_0021_0__en-us_topic_0108275372_li35890017143134"><span id="dataartsstudio_01_0021_0__en-us_topic_0108275372_en-us_topic_0108275471_en-us_topic_0000001397651462_p119011953152312">Log in to the <span id="dataartsstudio_01_0021_0__en-us_topic_0108275372_en-us_topic_0108275471_en-us_topic_0000001397651462_text5574448155719">DataArts Studio</span> console by following the instructions in <a href="dataartsstudio_01_0001.html">Accessing the DataArts Studio Instance Console</a>. On the <span id="dataartsstudio_01_0021_0__en-us_topic_0108275372_en-us_topic_0108275471_text185611381448">DataArts Studio</span> console, locate a workspace and click <strong id="dataartsstudio_01_0021_0__en-us_topic_0108275372_en-us_topic_0108275471_b16600914612">DataArts Migration</strong> to access the CDM console.</span></li><li id="dataartsstudio_01_0021_0__en-us_topic_0108275372_li16142765310"><span>Click the cluster name to view its basic information.</span><p><p id="dataartsstudio_01_0021_0__en-us_topic_0108275372_p1988954512340"></p>
|
||||
</p></li></ol>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0021_0__en-us_topic_0108275372_section8304145665316"><h4 class="sectiontitle">Modifying Cluster Configurations</h4><ol id="dataartsstudio_01_0021_0__en-us_topic_0108275372_ol1999165225516"><li id="dataartsstudio_01_0021_0__en-us_topic_0108275372_li16425756115512"><span id="dataartsstudio_01_0021_0__en-us_topic_0108275372_en-us_topic_0108275471_en-us_topic_0000001397651462_p119011953152312_1">Log in to the <span id="dataartsstudio_01_0021_0__en-us_topic_0108275372_en-us_topic_0108275471_en-us_topic_0000001397651462_text5574448155719_1">DataArts Studio</span> console by following the instructions in <a href="dataartsstudio_01_0001.html">Accessing the DataArts Studio Instance Console</a>. On the <span id="dataartsstudio_01_0021_0__en-us_topic_0108275372_en-us_topic_0108275471_text185611381448_1">DataArts Studio</span> console, locate a workspace and click <strong id="dataartsstudio_01_0021_0__en-us_topic_0108275372_en-us_topic_0108275471_b16600914612_1">DataArts Migration</strong> to access the CDM console.</span></li></ol><ol start="2" id="dataartsstudio_01_0021_0__en-us_topic_0108275372_ol893465814539"><li id="dataartsstudio_01_0021_0__en-us_topic_0108275372_li2934258175315"><span>Click the name of a cluster and click the <span class="uicontrol" id="dataartsstudio_01_0021_0__en-us_topic_0108275372_uicontrol175133228101"><b>Cluster Configuration</b></span> tab to modify <strong id="dataartsstudio_01_0021_0__en-us_topic_0108275372_b1651322291018">Notification</strong> and <strong id="dataartsstudio_01_0021_0__en-us_topic_0108275372_b25131022191018">User Isolation</strong> configuration.</span><p><p id="dataartsstudio_01_0021_0__en-us_topic_0108275372_p164740175220"></p>
|
||||
</p></li><li id="dataartsstudio_01_0021_0__en-us_topic_0108275372_li16934258135318"><span>Click <span class="uicontrol" id="dataartsstudio_01_0021_0__en-us_topic_0108275372_uicontrol191388974921518"><b>Save</b></span>. The <strong id="dataartsstudio_01_0021_0__en-us_topic_0108275372_b148848311621518">Cluster Management</strong> page is displayed.</span></li><li id="dataartsstudio_01_0021_0__en-us_topic_0108275372_li12934195818537"><span>If <strong id="dataartsstudio_01_0021_0__en-us_topic_0108275372_b119183067121518">User Isolation</strong> is disabled, choose <span class="menucascade" id="dataartsstudio_01_0021_0__en-us_topic_0108275372_menucascade54419951821518"><b><span class="uicontrol" id="dataartsstudio_01_0021_0__en-us_topic_0108275372_uicontrol82627482221518">More</span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0021_0__en-us_topic_0108275372_uicontrol11172047021518">Restart</span></b></span> in the <strong id="dataartsstudio_01_0021_0__en-us_topic_0108275372_b23573550421518">Operation</strong> column to restart the cluster VM for the settings to take effect.</span><p><div class="fignone" id="dataartsstudio_01_0021_0__en-us_topic_0108275372_fig159341758205317"><span class="figcap"><b>Figure 1 </b>Restarting a cluster</span><br><span><img id="dataartsstudio_01_0021_0__en-us_topic_0108275372_image139341458125315" src="en-us_image_0000002305441289.png"></span></div>
|
||||
<ul id="dataartsstudio_01_0021_0__en-us_topic_0108275372_ul293411589531"><li id="dataartsstudio_01_0021_0__en-us_topic_0108275372_li199341458205313"><strong id="dataartsstudio_01_0021_0__en-us_topic_0108275372_b664218019278">Restart CDM service process</strong>: Only the CDM service process is restarted. The cluster VM will not be restarted.</li><li id="dataartsstudio_01_0021_0__en-us_topic_0108275372_li49341958125318"><strong id="dataartsstudio_01_0021_0__en-us_topic_0108275372_b84235270615490">VM restart</strong>: The service process will be interrupted and VMs in the cluster will be restarted.</li></ul>
|
||||
</p></li><li id="dataartsstudio_01_0021_0__en-us_topic_0108275372_li1093410587539"><span>Select <span class="uicontrol" id="dataartsstudio_01_0021_0__en-us_topic_0108275372_uicontrol1876751918166"><b>VM restart</b></span> and click <span class="uicontrol" id="dataartsstudio_01_0021_0__en-us_topic_0108275372_uicontrol1010382481610"><b>Yes</b></span>.</span></li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0017.html">Managing Clusters</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
@ -5,10 +5,7 @@
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0022__en-us_topic_0108275415_section5781841515252"><h4 class="sectiontitle">Prerequisites</h4><p id="dataartsstudio_01_0022__en-us_topic_0108275415_p33513853111130">You have created a CDM cluster.</p>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0022__en-us_topic_0108275415_section1674818115330"><h4 class="sectiontitle">Procedure</h4><ol id="dataartsstudio_01_0022__en-us_topic_0108275415_ol6681758181820"><li id="dataartsstudio_01_0022__en-us_topic_0108275415_li35890017143134"><span>Access the CDM console and choose <span class="uicontrol" id="dataartsstudio_01_0022__en-us_topic_0108275415_en-us_topic_0108275471_uicontrol136837859815540"><b>Cluster Management</b></span> in the left navigation pane.</span><p><div class="fignone" id="dataartsstudio_01_0022__en-us_topic_0108275415_en-us_topic_0108275471_fig4803125133011"><span class="figcap"><b>Figure 1 </b>Cluster list</span><br><span><img id="dataartsstudio_01_0022__en-us_topic_0108275415_en-us_topic_0108275471_image1746819721017" src="en-us_image_0000001322088024.png"></span></div>
|
||||
<div class="note" id="dataartsstudio_01_0022__en-us_topic_0108275415_en-us_topic_0108275471_note5185181692417"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0022__en-us_topic_0108275415_en-us_topic_0108275471_p1186131612417">The <strong id="dataartsstudio_01_0022__en-us_topic_0108275415_en-us_topic_0108275471_b1623437165310">Source</strong> column is displayed only when you access the <strong id="dataartsstudio_01_0022__en-us_topic_0108275415_en-us_topic_0108275471_b6281837165318">DataArts Migration</strong> page from the DataArts Studio console.</p>
|
||||
</div></div>
|
||||
</p></li></ol><ol start="2" id="dataartsstudio_01_0022__en-us_topic_0108275415_ol4602013152046"><li id="dataartsstudio_01_0022__en-us_topic_0108275415_li4368748394623"><span>Locate the row that contains a cluster, click <strong id="dataartsstudio_01_0022__en-us_topic_0108275415_b1674594319426">More</strong> in the <strong id="dataartsstudio_01_0022__en-us_topic_0108275415_b715115534425">Operation</strong> column, and select <strong id="dataartsstudio_01_0022__en-us_topic_0108275415_b1425998431">Download Log</strong> from the drop-down list.</span><p><div class="fignone" id="dataartsstudio_01_0022__en-us_topic_0108275415_fig159341758205317"><span class="figcap"><b>Figure 2 </b>Download Log</span><br><span><img id="dataartsstudio_01_0022__en-us_topic_0108275415_image1359985320200" src="en-us_image_0000001322088076.png"></span></div>
|
||||
<div class="section" id="dataartsstudio_01_0022__en-us_topic_0108275415_section1674818115330"><h4 class="sectiontitle">Procedure</h4><ol id="dataartsstudio_01_0022__en-us_topic_0108275415_ol6681758181820"><li id="dataartsstudio_01_0022__en-us_topic_0108275415_li35890017143134"><span id="dataartsstudio_01_0022__en-us_topic_0108275415_en-us_topic_0108275471_en-us_topic_0000001397651462_p119011953152312">Log in to the <span id="dataartsstudio_01_0022__en-us_topic_0108275415_en-us_topic_0108275471_en-us_topic_0000001397651462_text5574448155719">DataArts Studio</span> console by following the instructions in <a href="dataartsstudio_01_0001.html">Accessing the DataArts Studio Instance Console</a>. On the <span id="dataartsstudio_01_0022__en-us_topic_0108275415_en-us_topic_0108275471_text185611381448">DataArts Studio</span> console, locate a workspace and click <strong id="dataartsstudio_01_0022__en-us_topic_0108275415_en-us_topic_0108275471_b16600914612">DataArts Migration</strong> to access the CDM console.</span></li></ol><ol start="2" id="dataartsstudio_01_0022__en-us_topic_0108275415_ol4602013152046"><li id="dataartsstudio_01_0022__en-us_topic_0108275415_li4368748394623"><span>Locate the row that contains a cluster, click <strong id="dataartsstudio_01_0022__en-us_topic_0108275415_b1674594319426">More</strong> in the <strong id="dataartsstudio_01_0022__en-us_topic_0108275415_b715115534425">Operation</strong> column, and select <strong id="dataartsstudio_01_0022__en-us_topic_0108275415_b1425998431">Download Log</strong> from the drop-down list.</span><p><div class="fignone" id="dataartsstudio_01_0022__en-us_topic_0108275415_fig159341758205317"><span class="figcap"><b>Figure 1 </b>Download Log</span><br><span><img id="dataartsstudio_01_0022__en-us_topic_0108275415_image1359985320200" src="en-us_image_0000002270790548.png"></span></div>
|
||||
</p></li><li id="dataartsstudio_01_0022__en-us_topic_0108275415_li209131722132014"><span>In the displayed dialog box, click <strong id="dataartsstudio_01_0022__en-us_topic_0108275415_b01985196448">OK</strong> to download logs to a local PC.</span></li></ol>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
@ -12,11 +12,13 @@
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_1096.html">Managing Cluster Configurations</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0044.html">Link to a Common Relational Database</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0045.html">Link to OBS</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_1214.html">Link to a Database Shard</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0044.html">Link to PostgreSQL/SQLServer</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_1211.html">Link to a MySQL Database</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0226.html">Link to DWS</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_1211.html">Link to an RDS for MySQL/MySQL Database</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_1212.html">Link to an Oracle Database</a></strong><br>
|
||||
</li>
|
||||
@ -28,18 +30,14 @@
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0040.html">Link to HDFS</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0045.html">Link to OBS</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0028.html">Link to an FTP or SFTP Server</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0032.html">Link to Redis/DCS</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0032.html">Link to Redis</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0031.html">Link to DDS</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0027.html">Link to CloudTable</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0037.html">Link to CloudTable OpenTSDB</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0030.html">Link to MongoDB</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_004501.html">Link to Cassandra</a></strong><br>
|
||||
@ -48,7 +46,23 @@
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0038.html">Link to DMS Kafka</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0035.html">Link to Elasticsearch/CSS</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0035.html">Link to CSS</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_1380.html">Link to Elasticsearch</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0227.html">Link to SAP HANA</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_1214.html">Link to a Database Shard</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0184.html">Link to MRS Hudi</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0285.html">Link to MRS ClickHouse</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0290.html">Link to a ShenTong Database</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0037.html">Link to CloudTable OpenTSDB</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_1215.html">Link to Doris</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
76
docs/dataartsstudio/umn/dataartsstudio_01_0025.html
Normal file
76
docs/dataartsstudio/umn/dataartsstudio_01_0025.html
Normal file
@ -0,0 +1,76 @@
|
||||
<a name="dataartsstudio_01_0025"></a><a name="dataartsstudio_01_0025"></a>
|
||||
|
||||
<h1 class="topictitle1">How Migration Jobs Work</h1>
|
||||
<div id="en-us_topic_0000001340006573_body0000001340006573"><div class="section" id="dataartsstudio_01_0025__en-us_topic_0000001340006573_section14018854920"><h4 class="sectiontitle">Data Migration Model</h4><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p111321034164314"><a href="#dataartsstudio_01_0025__en-us_topic_0000001340006573_fig165851910185417">Figure 1</a> shows the simplified migration model used by CDM.</p>
|
||||
<div class="fignone" id="dataartsstudio_01_0025__en-us_topic_0000001340006573_fig165851910185417"><a name="dataartsstudio_01_0025__en-us_topic_0000001340006573_fig165851910185417"></a><a name="en-us_topic_0000001340006573_fig165851910185417"></a><span class="figcap"><b>Figure 1 </b>Migration model used by CDM</span><br><span><img class="eddx" id="dataartsstudio_01_0025__en-us_topic_0000001340006573_image8585010145411" src="en-us_image_0000002270847386.png"></span></div>
|
||||
<div class="p" id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p731010268319">CDM migrates data through data migration jobs. It works in the following way:<ol id="dataartsstudio_01_0025__en-us_topic_0000001340006573_ol1095184992318"><li id="dataartsstudio_01_0025__en-us_topic_0000001340006573_li79541847152411">When data migration jobs are submitted, CDM splits each job into multiple tasks based on the <strong id="dataartsstudio_01_0025__en-us_topic_0000001340006573_b49451957175511">Concurrent Extractors</strong> parameter in the job configuration.<div class="note" id="dataartsstudio_01_0025__en-us_topic_0000001340006573_note636713355310"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p1036843195312">Jobs for different data sources may be split based on different dimensions. Some jobs may not be split based on the <strong id="dataartsstudio_01_0025__en-us_topic_0000001340006573_b258662735711">Concurrent Extractors</strong> parameter.</p>
|
||||
</div></div>
|
||||
</li><li id="dataartsstudio_01_0025__en-us_topic_0000001340006573_li587861564119">CDM submits the tasks to the running pool in sequence. Tasks (defined by <strong id="dataartsstudio_01_0025__en-us_topic_0000001340006573_b169912243">Maximum Concurrent Extractors</strong>) run concurrently. Excess tasks are queued.</li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0025__en-us_topic_0000001340006573_section649414854011"><h4 class="sectiontitle">Factors Affecting Migration Performance</h4><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p3193738202710">According to the migration model, the migration speed is affected by factors such as the source read speed, network bandwidth, destination write performance, and CDM cluster and job configuration.</p>
|
||||
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0025__en-us_topic_0000001340006573_table191783304012" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Factors affecting migration performance</caption><thead align="left"><tr id="dataartsstudio_01_0025__en-us_topic_0000001340006573_row189182033144015"><th align="left" class="cellrowborder" colspan="2" valign="top" id="mcps1.3.2.3.2.4.1.1"><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p724717129368">Factor</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" id="mcps1.3.2.3.2.4.1.2"><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p291813337406">Description</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dataartsstudio_01_0025__en-us_topic_0000001340006573_row831183012361"><td class="cellrowborder" rowspan="4" valign="top" width="6.99%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p18231931522">Service-related factors</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="10.879999999999999%" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p43123053616">Concurrent extractors of a job</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="82.13000000000001%" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p19978185215266">The number of concurrent extractors can be set for a CDM job during the job creation.</p>
|
||||
<p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p13951195014593">Setting a proper value for this parameter can effectively improve the migration speed. If the value is too small, migration will be too slow. If the value is too large, the migration job is overloaded and may fail.</p>
|
||||
<ul id="dataartsstudio_01_0025__en-us_topic_0000001340006573_ul33201814102416"><li id="dataartsstudio_01_0025__en-us_topic_0000001340006573_li635771819246">When data is to be migrated to files, CDM does not support multiple concurrent tasks. In this case, set a single process to extract data.</li><li id="dataartsstudio_01_0025__en-us_topic_0000001340006573_li19524634132415">If each row of the table contains less than or equal to 1 MB data, data can be extracted concurrently. If each row contains more than 1 MB data, it is recommended that data be extracted in a single thread.</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0025__en-us_topic_0000001340006573_row4918333124012"><td class="cellrowborder" valign="top" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p59181433134019">Maximum concurrent extractors of a cluster</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p97141862273">Setting a proper value for this parameter can effectively improve the migration speed. If the value is too small, migration will be too slow. If the value is too large, the source is overloaded and the system may be unstable.</p>
|
||||
<p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p1958883811461">The maximum concurrent extractors vary depending on the CDM cluster flavor. The upper limit is twice the number of vCPUs. The following are the maximum concurrent extractors of some flavors:</p>
|
||||
<ul id="dataartsstudio_01_0025__en-us_topic_0000001340006573_ul1062511772518"><li id="dataartsstudio_01_0025__en-us_topic_0000001340006573_li56258712519">cdm.large: 16</li><li id="dataartsstudio_01_0025__en-us_topic_0000001340006573_li141087167257">cdm.xlarge: 32</li><li id="dataartsstudio_01_0025__en-us_topic_0000001340006573_li1169617261258">cdm.4xlarge: 128</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0025__en-us_topic_0000001340006573_row14998141610377"><td class="cellrowborder" valign="top" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p5998151693711">Service model</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p1614419297502">If the number of CDM jobs that run concurrently exceeds the maximum concurrent extractors for the CDM cluster, some jobs will be queued, and the migration will be prolonged.</p>
|
||||
<p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p1755711268587">Avoid running too many jobs simultaneously, which may cause slow migration due to insufficient resources.</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0025__en-us_topic_0000001340006573_row977220313535"><td class="cellrowborder" valign="top" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p157721438531">Data model</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p1138153133519">The migration speed is also affected by the data structure. The following are some examples:</p>
|
||||
<ul id="dataartsstudio_01_0025__en-us_topic_0000001340006573_ul1041917412365"><li id="dataartsstudio_01_0025__en-us_topic_0000001340006573_li17419144163617">The wider a table is and the more string types the table has, the slower the migration is.</li><li id="dataartsstudio_01_0025__en-us_topic_0000001340006573_li141924118364">A large file is migrated more quickly than multiple small files whose total size is the same as the large file.</li><li id="dataartsstudio_01_0025__en-us_topic_0000001340006573_li476165713441">The more content a message has and the higher bandwidth it uses, the less transactions per second (TPS) are.</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0025__en-us_topic_0000001340006573_row4555145241818"><td class="cellrowborder" colspan="2" valign="top" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p1781875918188">Source read speed</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p11818135951817">It depends on the performance of the data source at the source.</p>
|
||||
<p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p1381885913189">For details about how to increase the read speed, see the documents of data sources at the source.</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0025__en-us_topic_0000001340006573_row3669175417187"><td class="cellrowborder" colspan="2" valign="top" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p1381820597181">Network bandwidth</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p4818105981814">The CDM cluster can communicate with the data source through an intranet, public network VPN, NAT, or Direct Connect.</p>
|
||||
<ul id="dataartsstudio_01_0025__en-us_topic_0000001340006573_ul158186599183"><li id="dataartsstudio_01_0025__en-us_topic_0000001340006573_li1781812597181">If they communicate through an intranet, the network bandwidth varies depending on the CDM instance flavor.<ul id="dataartsstudio_01_0025__en-us_topic_0000001340006573_ul1481895911818"><li id="dataartsstudio_01_0025__en-us_topic_0000001340006573_li7819959131817">For cdm.large instances, the baseline and maximum bandwidths of the CDM cluster NIC are 0.8 and 3 Gbit/s, respectively.</li><li id="dataartsstudio_01_0025__en-us_topic_0000001340006573_li16819659161819">For cdm.xlarge instances, the baseline and maximum bandwidths of the CDM cluster NIC are 4 and 10 Gbit/s, respectively.</li><li id="dataartsstudio_01_0025__en-us_topic_0000001340006573_li781925915188">For cdm.4xlarge instances, the baseline and maximum bandwidths of the CDM cluster NIC are 36 and 40 Gbit/s, respectively.</li></ul>
|
||||
</li><li id="dataartsstudio_01_0025__en-us_topic_0000001340006573_li78191859141816">If they communicate through the Internet, the network bandwidth is subject to the Internet bandwidth. The bandwidth for the CDM cluster depends on the EIP bound to the CDM cluster, and the bandwidth for the data source depends on the Internet bandwidth.</li><li id="dataartsstudio_01_0025__en-us_topic_0000001340006573_li38190592187">If they communicate through a VPN, NAT, or Direct Connect, the network bandwidth is subject to the VPN, NAT, or Direct Connect bandwidth.</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0025__en-us_topic_0000001340006573_row10430750201819"><td class="cellrowborder" colspan="2" valign="top" headers="mcps1.3.2.3.2.4.1.1 "><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p1781935951818">Destination write performance</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.3.2.4.1.2 "><p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p1981995951819">It depends on the performance of the data source at the destination.</p>
|
||||
<p id="dataartsstudio_01_0025__en-us_topic_0000001340006573_p3819859171815">For details about how to improve the performance, see the documents of data sources at the destination.</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0018.html">Improving Migration Performance</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
@ -1,11 +1,11 @@
|
||||
<a name="dataartsstudio_01_0028"></a><a name="dataartsstudio_01_0028"></a>
|
||||
|
||||
<h1 class="topictitle1">Link to an FTP or SFTP Server</h1>
|
||||
<div id="body8662426"><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p1616721175217">The FTP/SFTP link is used to migrate files from the on-premises file server or ECS to database.</p>
|
||||
<div class="note" id="dataartsstudio_01_0028__en-us_topic_0108275400_note193108573515"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p183106578514">Only FTP servers running Linux are supported.</p>
|
||||
<div id="body8662426"><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p1616721175217">The FTP/SFTP link is used to migrate files from the on-premises file server or ECS to a database.</p>
|
||||
<div class="note" id="dataartsstudio_01_0028__en-us_topic_0108275400_note193108573515"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_0028__en-us_topic_0108275400_ul103927387116"><li id="dataartsstudio_01_0028__en-us_topic_0108275400_li18637205191114">Only FTP servers running Linux are supported.</li><li id="dataartsstudio_01_0028__en-us_topic_0108275400_li13978165615117">Do not change the password or user when the job is running. If you do so, the password will not take effect immediately and the job will fail.</li></ul>
|
||||
</div></div>
|
||||
<div class="p" id="dataartsstudio_01_0028__en-us_topic_0108275400_p404591711373">When connecting CDM to an FTP or SFTP server, configure the parameters as described in <a href="#dataartsstudio_01_0028__en-us_topic_0108275400_table34037531171418">Table 1</a>.
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0028__en-us_topic_0108275400_table34037531171418"></a><a name="en-us_topic_0108275400_table34037531171418"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0028__en-us_topic_0108275400_table34037531171418" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0028__en-us_topic_0108275400_row56630393171418"><th align="left" class="cellrowborder" valign="top" width="18.060000000000002%" id="mcps1.3.3.2.2.4.1.1"><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p23659124171418">Parameter</p>
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0028__en-us_topic_0108275400_table34037531171418"></a><a name="en-us_topic_0108275400_table34037531171418"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0028__en-us_topic_0108275400_table34037531171418" frame="border" border="1" rules="all"><caption><b>Table 1 </b>FTP/SFTP link parameters</caption><thead align="left"><tr id="dataartsstudio_01_0028__en-us_topic_0108275400_row56630393171418"><th align="left" class="cellrowborder" valign="top" width="18.060000000000002%" id="mcps1.3.3.2.2.4.1.1"><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p23659124171418">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="61.31999999999999%" id="mcps1.3.3.2.2.4.1.2"><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p37340867171418">Description</p>
|
||||
</th>
|
||||
@ -29,7 +29,7 @@
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0028__en-us_topic_0108275400_row19710159171418"><td class="cellrowborder" valign="top" width="18.060000000000002%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p53019059171418">Port</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.31999999999999%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p66685350171418">Port number of the FTP or SFTP server, which is 21 by default</p>
|
||||
<td class="cellrowborder" valign="top" width="61.31999999999999%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p66685350171418">Port number of the FTP or SFTP server. The default value is <strong id="dataartsstudio_01_0028__en-us_topic_0108275400_b567214731616">21</strong> for FTP and <strong id="dataartsstudio_01_0028__en-us_topic_0108275400_b284375012161">22</strong> for SFTP.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dataartsstudio_01_0028__en-us_topic_0108275400_p32804307171418">21</p>
|
||||
</td>
|
||||
|
||||
@ -3,48 +3,67 @@
|
||||
<h1 class="topictitle1">Link to MongoDB</h1>
|
||||
<div id="body8662426"><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p868619161103">This link is used to transfer data from a third-party cloud MongoDB service or MongoDB created in the on-premises data center or ECS to a big data platform.</p>
|
||||
<p id="dataartsstudio_01_0030__en-us_topic_0108275382_p1471816353573">When connecting CDM to an on-premises MongoDB database, configure the parameters as described in <a href="#dataartsstudio_01_0030__en-us_topic_0108275382_table34037531171418">Table 1</a>.</p>
|
||||
<div class="note" id="dataartsstudio_01_0030__en-us_topic_0108275382_note8867140110"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0030__en-us_topic_0108275382_en-us_topic_0108275292_p167832113185">Do not change the password or user when the job is running. If you do so, the password will not take effect immediately and the job will fail.</p>
|
||||
</div></div>
|
||||
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0030__en-us_topic_0108275382_table34037531171418"></a><a name="en-us_topic_0108275382_table34037531171418"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0030__en-us_topic_0108275382_table34037531171418" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row56630393171418"><th align="left" class="cellrowborder" valign="top" width="19.18%" id="mcps1.3.3.2.4.1.1"><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p23659124171418">Parameter</p>
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0030__en-us_topic_0108275382_table34037531171418"></a><a name="en-us_topic_0108275382_table34037531171418"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0030__en-us_topic_0108275382_table34037531171418" frame="border" border="1" rules="all"><caption><b>Table 1 </b>MongoDB link parameters</caption><thead align="left"><tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row56630393171418"><th align="left" class="cellrowborder" valign="top" width="19.18%" id="mcps1.3.4.2.4.1.1"><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p23659124171418">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="60.540000000000006%" id="mcps1.3.3.2.4.1.2"><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p37340867171418">Description</p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="60.540000000000006%" id="mcps1.3.4.2.4.1.2"><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p37340867171418">Description</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="20.28%" id="mcps1.3.3.2.4.1.3"><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p4711375171418">Example Value</p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="20.28%" id="mcps1.3.4.2.4.1.3"><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p4711375171418">Example Value</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row148131718155810"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p1081471865814">Name</p>
|
||||
<tbody><tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row148131718155810"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.4.2.4.1.1 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p1081471865814">Name</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.4.2.4.1.2 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p1981416180585">mongodb_link</p>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.4.2.4.1.3 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p1981416180585">mongodb_link</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row19710159171418"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p62657656114131">Server List</p>
|
||||
<tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row19710159171418"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.4.2.4.1.1 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p62657656114131">Server List</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p733031416592">List of MongoDB server addresses. Enter each address in the format of <em id="dataartsstudio_01_0030__en-us_topic_0108275382_i1991794965716">IP address or domain name of the database server</em>:<em id="dataartsstudio_01_0030__en-us_topic_0108275382_i392284911579">port number</em>, and separate the entered addresses with semicolons (;).</p>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.4.2.4.1.2 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p733031416592">List of MongoDB server addresses. Enter each address in the format of <em id="dataartsstudio_01_0030__en-us_topic_0108275382_i1991794965716">IP address or domain name of the database server</em>:<em id="dataartsstudio_01_0030__en-us_topic_0108275382_i392284911579">port number</em>, and separate the entered addresses with semicolons (;).</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p3891070991628">192.168.0.1:7300;192.168.0.2:7301</p>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.4.2.4.1.3 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p3891070991628">192.168.0.1:7300;192.168.0.2:7301</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row11588738102344"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p66272570102344">Database Name</p>
|
||||
<tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row11588738102344"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.4.2.4.1.1 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p66272570102344">Database Name</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p66477930102344">Name of the MongoDB database to be connected</p>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.4.2.4.1.2 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p66477930102344">Name of the MongoDB database to be connected</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p16003259102344">DB_mongodb</p>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.4.2.4.1.3 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p16003259102344">DB_mongodb</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row35421096102350"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p50536504102350">Username</p>
|
||||
<tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row35421096102350"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.4.2.4.1.1 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p50536504102350">Username</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p5438008102436">Username for logging in to MongoDB</p>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.4.2.4.1.2 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p5438008102436">Username for logging in to MongoDB</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p52218594102350">cdm</p>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.4.2.4.1.3 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p52218594102350">cdm</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row21870968171418"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p26718016171418">Password</p>
|
||||
<tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row21870968171418"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.4.2.4.1.1 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p26718016171418">Password</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p5950554015418">Password for logging in to MongoDB</p>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.4.2.4.1.2 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p5950554015418">Password for logging in to MongoDB</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p38901992114142">-</p>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.4.2.4.1.3 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p38901992114142">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row19478242163617"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.4.2.4.1.1 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p13479154220366">Direct Connection</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.4.2.4.1.2 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p1479114233617">This mode applies to the scenario where the network of the primary node is normal but the network of the replica node is abnormal.</p>
|
||||
<div class="note" id="dataartsstudio_01_0030__en-us_topic_0108275382_note14321640183713"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0030__en-us_topic_0108275382_ul9679184783711"><li id="dataartsstudio_01_0030__en-us_topic_0108275382_li11679174719374">Only one IP address can be configured for the server list in direct connection mode.</li><li id="dataartsstudio_01_0030__en-us_topic_0108275382_li196791847113715">This mode applies to the scenario where the network of the primary node is normal but the network of the replica node is abnormal.</li></ul>
|
||||
</div></div>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.4.2.4.1.3 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p9479642193611">No</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0030__en-us_topic_0108275382_row6816189161612"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.4.2.4.1.1 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p4972202771619">Link Attributes</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.4.2.4.1.2 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p18516203414013">Custom link attributes. The MongoDB attributes are supported. The unit is ms. The link attributes are as follows:</p>
|
||||
<ul id="dataartsstudio_01_0030__en-us_topic_0108275382_ul157311334124120"><li id="dataartsstudio_01_0030__en-us_topic_0108275382_li3732143424119"><strong id="dataartsstudio_01_0030__en-us_topic_0108275382_b32341637145718">socketTimeout</strong>: The default value is <strong id="dataartsstudio_01_0030__en-us_topic_0108275382_b16915155475718">60000</strong>.</li><li id="dataartsstudio_01_0030__en-us_topic_0108275382_li4732153454120"><strong id="dataartsstudio_01_0030__en-us_topic_0108275382_b73091824588">maxWaitTime</strong>: The default value is <strong id="dataartsstudio_01_0030__en-us_topic_0108275382_b108525126589">10000</strong>.</li><li id="dataartsstudio_01_0030__en-us_topic_0108275382_li1473233415413"><strong id="dataartsstudio_01_0030__en-us_topic_0108275382_b646122914583">connectTimeout</strong>. The default value is <strong id="dataartsstudio_01_0030__en-us_topic_0108275382_b171801533125812">10000</strong>.</li><li id="dataartsstudio_01_0030__en-us_topic_0108275382_li207321634194117"><strong id="dataartsstudio_01_0030__en-us_topic_0108275382_b85640373580">serverSelectionTimeout</strong>: The default value is <strong id="dataartsstudio_01_0030__en-us_topic_0108275382_b152481856115819">5000</strong>.</li></ul>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.4.2.4.1.3 "><p id="dataartsstudio_01_0030__en-us_topic_0108275382_p78176914164">socketTimeout=60000</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
|
||||
@ -1,50 +1,61 @@
|
||||
<a name="dataartsstudio_01_0031"></a><a name="dataartsstudio_01_0031"></a>
|
||||
|
||||
<h1 class="topictitle1">Link to DDS</h1>
|
||||
<div id="body8662426"><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p175011321165416">The DDS link is used to synchronize data from Document Database Service (DDS) on <span id="dataartsstudio_01_0031__en-us_topic_0173586864_text1085374545910">cloud</span> to a big data platform.</p>
|
||||
<div id="body8662426"><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p175011321165416">The DDS link is used to synchronize data from Document Database Service (DDS) on the cloud to a big data platform.</p>
|
||||
<p id="dataartsstudio_01_0031__en-us_topic_0173586864_p1471816353573">When connecting CDM to DDS, configure the parameters as described in <a href="#dataartsstudio_01_0031__en-us_topic_0173586864_table34037531171418">Table 1</a>.</p>
|
||||
<div class="note" id="dataartsstudio_01_0031__en-us_topic_0173586864_note8867140110"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0031__en-us_topic_0173586864_en-us_topic_0108275292_p167832113185">Do not change the password or user when the job is running. If you do so, the password will not take effect immediately and the job will fail.</p>
|
||||
</div></div>
|
||||
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0031__en-us_topic_0173586864_table34037531171418"></a><a name="en-us_topic_0173586864_table34037531171418"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0031__en-us_topic_0173586864_table34037531171418" frame="border" border="1" rules="all"><caption><b>Table 1 </b>DDS link parameters</caption><thead align="left"><tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row56630393171418"><th align="left" class="cellrowborder" valign="top" width="18.509999999999998%" id="mcps1.3.3.2.4.1.1"><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p23659124171418">Parameter</p>
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0031__en-us_topic_0173586864_table34037531171418"></a><a name="en-us_topic_0173586864_table34037531171418"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0031__en-us_topic_0173586864_table34037531171418" frame="border" border="1" rules="all"><caption><b>Table 1 </b>DDS link parameters</caption><thead align="left"><tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row56630393171418"><th align="left" class="cellrowborder" valign="top" width="18.509999999999998%" id="mcps1.3.4.2.4.1.1"><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p23659124171418">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="61.309999999999995%" id="mcps1.3.3.2.4.1.2"><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p37340867171418">Description</p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="61.309999999999995%" id="mcps1.3.4.2.4.1.2"><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p37340867171418">Description</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="20.18%" id="mcps1.3.3.2.4.1.3"><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p4711375171418">Example Value</p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="20.18%" id="mcps1.3.4.2.4.1.3"><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p4711375171418">Example Value</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row148131718155810"><td class="cellrowborder" valign="top" width="18.509999999999998%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p1081471865814">Name</p>
|
||||
<tbody><tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row148131718155810"><td class="cellrowborder" valign="top" width="18.509999999999998%" headers="mcps1.3.4.2.4.1.1 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p1081471865814">Name</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.309999999999995%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
|
||||
<td class="cellrowborder" valign="top" width="61.309999999999995%" headers="mcps1.3.4.2.4.1.2 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.18%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p1981416180585">dds_link</p>
|
||||
<td class="cellrowborder" valign="top" width="20.18%" headers="mcps1.3.4.2.4.1.3 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p1981416180585">dds_link</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row19710159171418"><td class="cellrowborder" valign="top" width="18.509999999999998%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p62657656114131">Server List</p>
|
||||
<tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row19710159171418"><td class="cellrowborder" valign="top" width="18.509999999999998%" headers="mcps1.3.4.2.4.1.1 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p62657656114131">Server List</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.309999999999995%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p733031416592">List of server addresses. Enter each address in the format of <em id="dataartsstudio_01_0031__en-us_topic_0173586864_i7949144516352">IP address or domain name of the database server</em>:<em id="dataartsstudio_01_0031__en-us_topic_0173586864_i14949345193515">port number</em>, and separate the entered addresses with semicolons (;).</p>
|
||||
<td class="cellrowborder" valign="top" width="61.309999999999995%" headers="mcps1.3.4.2.4.1.2 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p733031416592">List of server addresses. Enter each address in the format of <em id="dataartsstudio_01_0031__en-us_topic_0173586864_i7949144516352">IP address or domain name of the database server</em>:<em id="dataartsstudio_01_0031__en-us_topic_0173586864_i14949345193515">port number</em>, and separate the entered addresses with semicolons (;).</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.18%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p3891070991628">192.168.0.1:7300;192.168.0.2:7301</p>
|
||||
<td class="cellrowborder" valign="top" width="20.18%" headers="mcps1.3.4.2.4.1.3 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p3891070991628">192.168.0.1:7300;192.168.0.2:7301</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row11588738102344"><td class="cellrowborder" valign="top" width="18.509999999999998%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p66272570102344">Database Name</p>
|
||||
<tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row11588738102344"><td class="cellrowborder" valign="top" width="18.509999999999998%" headers="mcps1.3.4.2.4.1.1 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p66272570102344">Database Name</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.309999999999995%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p66477930102344">Name of the DDS database to be connected</p>
|
||||
<td class="cellrowborder" valign="top" width="61.309999999999995%" headers="mcps1.3.4.2.4.1.2 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p66477930102344">Name of the DDS database to be connected</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.18%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p16003259102344">DB_dds</p>
|
||||
<td class="cellrowborder" valign="top" width="20.18%" headers="mcps1.3.4.2.4.1.3 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p16003259102344">DB_dds</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row35421096102350"><td class="cellrowborder" valign="top" width="18.509999999999998%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p50536504102350">Username</p>
|
||||
<tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row35421096102350"><td class="cellrowborder" valign="top" width="18.509999999999998%" headers="mcps1.3.4.2.4.1.1 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p50536504102350">Username</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.309999999999995%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p5438008102436">Username used for logging in to DDS</p>
|
||||
<td class="cellrowborder" valign="top" width="61.309999999999995%" headers="mcps1.3.4.2.4.1.2 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p5438008102436">Username used for logging in to DDS</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.18%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p52218594102350">cdm</p>
|
||||
<td class="cellrowborder" valign="top" width="20.18%" headers="mcps1.3.4.2.4.1.3 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p52218594102350">cdm</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row21870968171418"><td class="cellrowborder" valign="top" width="18.509999999999998%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p26718016171418">Password</p>
|
||||
<tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row21870968171418"><td class="cellrowborder" valign="top" width="18.509999999999998%" headers="mcps1.3.4.2.4.1.1 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p26718016171418">Password</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.309999999999995%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p5950554015418">Password used for logging in to DDS</p>
|
||||
<td class="cellrowborder" valign="top" width="61.309999999999995%" headers="mcps1.3.4.2.4.1.2 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p5950554015418">Password used for logging in to DDS</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.18%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p38901992114142">-</p>
|
||||
<td class="cellrowborder" valign="top" width="20.18%" headers="mcps1.3.4.2.4.1.3 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p38901992114142">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0031__en-us_topic_0173586864_row1994019229415"><td class="cellrowborder" valign="top" width="18.509999999999998%" headers="mcps1.3.4.2.4.1.1 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p13479154220366">Is direct connection mode</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.309999999999995%" headers="mcps1.3.4.2.4.1.2 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p1479114233617">This mode applies to the scenario where the network of the primary node is normal but that of the replica node is abnormal.</p>
|
||||
<div class="note" id="dataartsstudio_01_0031__en-us_topic_0173586864_note14321640183713"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0031__en-us_topic_0173586864_ul9679184783711"><li id="dataartsstudio_01_0031__en-us_topic_0173586864_li11679174719374">Only one IP address can be configured for the server list in direct connection mode.</li><li id="dataartsstudio_01_0031__en-us_topic_0173586864_li196791847113715">This mode applies to the scenario where the network of the primary node is normal but the network of the replica node is abnormal.</li></ul>
|
||||
</div></div>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.18%" headers="mcps1.3.4.2.4.1.3 "><p id="dataartsstudio_01_0031__en-us_topic_0173586864_p9479642193611">No</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@ -2,52 +2,56 @@
|
||||
|
||||
<h1 class="topictitle1">Link to Kafka</h1>
|
||||
<div id="body8662426"><div class="section" id="dataartsstudio_01_0033__en-us_topic_0108275385_section8886729122818"><h4 class="sectiontitle">MRS Kafka</h4><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p1822602317293">When connecting CDM to Kafka of MRS, configure the parameters as described in <a href="#dataartsstudio_01_0033__en-us_topic_0108275385_table3104110173020">Table 1</a>.</p>
|
||||
<div class="note" id="dataartsstudio_01_0033__en-us_topic_0108275385_note8867140110"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108275292_p167832113185">Do not change the password or user when the job is running. If you do so, the password will not take effect immediately and the job will fail.</p>
|
||||
</div></div>
|
||||
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0033__en-us_topic_0108275385_table3104110173020"></a><a name="en-us_topic_0108275385_table3104110173020"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0033__en-us_topic_0108275385_table3104110173020" frame="border" border="1" rules="all"><caption><b>Table 1 </b>MRS Kafka link parameters</caption><thead align="left"><tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row9104908308"><th align="left" class="cellrowborder" valign="top" width="18.95%" id="mcps1.3.1.3.2.4.1.1"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p5104190113020">Parameter</p>
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0033__en-us_topic_0108275385_table3104110173020"></a><a name="en-us_topic_0108275385_table3104110173020"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0033__en-us_topic_0108275385_table3104110173020" frame="border" border="1" rules="all"><caption><b>Table 1 </b>MRS Kafka link parameters</caption><thead align="left"><tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row9104908308"><th align="left" class="cellrowborder" valign="top" width="18.95%" id="mcps1.3.1.4.2.4.1.1"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p5104190113020">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="61.42999999999999%" id="mcps1.3.1.3.2.4.1.2"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p181045015309"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0065840554_b842352706191716">Description</strong></p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="61.42999999999999%" id="mcps1.3.1.4.2.4.1.2"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p181045015309"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0065840554_b842352706191716">Description</strong></p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="19.62%" id="mcps1.3.1.3.2.4.1.3"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p810450163019"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b842352706173959">Example Value</strong></p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="19.62%" id="mcps1.3.1.4.2.4.1.3"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p810450163019"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b842352706173959">Example Value</strong></p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row1110420173014"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.3.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p1510415063017">Name</p>
|
||||
<tbody><tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row1110420173014"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p1510415063017">Name</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.3.2.4.1.2 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p116413181186">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
|
||||
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.4.2.4.1.2 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p116413181186">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.3.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p91041304307">kafka_link</p>
|
||||
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p91041304307">kafka_link</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row11045013017"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.3.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p121041208302">Manager IP</p>
|
||||
<tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row11045013017"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p121041208302">Manager IP</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.3.2.4.1.2 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p6104305303">Floating IP address of MRS Manager. Click <span class="uicontrol" id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108275286_uicontrol578864992012"><b>Select</b></span> next to the <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108275286_b2078834920203">Manager IP</strong> text box to select an MRS cluster. CDM automatically fills in the authentication information.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.3.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p1210414014308">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row1110417013011"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.3.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p16104120163017">Username</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.3.2.4.1.2 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p141051706305">Username used for logging in to MRS Manager</p>
|
||||
<div class="p" id="dataartsstudio_01_0033__en-us_topic_0108275385_p194519141759">To create a data connection for an MRS security cluster, do not use user <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b554524219105248">admin</strong>. The <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b123106598105248">admin</strong> user is the default management page user and cannot be used as the authentication user of the security cluster. You can create an MRS user and set <span class="parmname" id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_en-us_topic_0187412481_parmname3468191262313"><b>Username</b></span> and <span class="parmname" id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_en-us_topic_0187412481_parmname64683124231"><b>Password</b></span> to the username and password of the created MRS user when creating an MRS data connection.<div class="note" id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_note15451659151217"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_ul17715141011134"><li id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_li8715121031318">If the CDM cluster version is 2.9.0 or later and the MRS cluster version is 3.1.0 or later, the created user must have the permissions of the <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b11836193312371">Manager_viewer</strong> role to create links on CDM. To perform operations on databases, tables, and data of a component, you also need to add the user group permissions of the component to the user.</li><li id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_li5415103511136">If the CDM cluster version is earlier than 2.9.0 or the MRS cluster version is earlier than 3.1.0, the created user must have the permissions of <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b1088016562338">Manager_administrator</strong> or <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b1288695693319">System_administrator</strong> to create links on CDM.</li><li id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_li1733135017192">A user with only the <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b6765133911341">Manager_tenant</strong> or <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b1377216393342">Manager_auditor</strong> permission cannot create connections.</li></ul>
|
||||
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.4.2.4.1.2 "><div class="p" id="dataartsstudio_01_0033__en-us_topic_0108275385_p218148165010">Floating IP address of MRS Manager. Click <span class="uicontrol" id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108275286_uicontrol578864992012"><b>Select</b></span> next to the <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108275286_b2078834920203">Manager IP</strong> text box to select an MRS cluster. CDM automatically fills in the authentication information.<div class="note" id="dataartsstudio_01_0033__note1340014473413"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0033__en-us_topic_0182566327_p116249795810"><span id="dataartsstudio_01_0033__en-us_topic_0182566327_text7355181825814">DataArts Studio</span> does not support MRS clusters whose Kerberos encryption type is <strong id="dataartsstudio_01_0033__en-us_topic_0182566327_b143479402717">aes256-sha2,aes128-sha2</strong>, and only supports MRS clusters whose Kerberos encryption type is <strong id="dataartsstudio_01_0033__en-us_topic_0182566327_b19532103219813">aes256-sha1,aes128-sha1</strong>.</p>
|
||||
</div></div>
|
||||
</div>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.3.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p710517023010">-</p>
|
||||
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p718110815509">127.0.0.1</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row3105201309"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.3.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p18105507306">Password</p>
|
||||
<tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row1110417013011"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p16104120163017">Username</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.3.2.4.1.2 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p71054011307">Password used for logging in to MRS Manager</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.3.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p191051703302">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row177699297305"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.3.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p310410043015">Authentication Method</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.3.2.4.1.2 "><div class="p" id="dataartsstudio_01_0033__en-us_topic_0108275385_p171048073013">Authentication method used for accessing MRS<ul id="dataartsstudio_01_0033__en-us_topic_0108275385_ul17104806309"><li id="dataartsstudio_01_0033__en-us_topic_0108275385_li151041006308"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b84235270611123">SIMPLE</strong>: for non-security mode</li><li id="dataartsstudio_01_0033__en-us_topic_0108275385_li11104108309"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b193121128127">KERBEROS</strong>: for security mode</li></ul>
|
||||
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.4.2.4.1.2 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p141051706305">Username used for logging in to MRS Manager</p>
|
||||
<div class="p" id="dataartsstudio_01_0033__en-us_topic_0108275385_p194519141759">To create a data connection for an MRS security cluster, do not use user <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b554524219105248">admin</strong>. The <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b123106598105248">admin</strong> user is the default management page user and cannot be used as the authentication user of the security cluster. You can create an MRS user and set <span class="parmname" id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_en-us_topic_0187412481_parmname3468191262313"><b>Username</b></span> and <span class="parmname" id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_en-us_topic_0187412481_parmname64683124231"><b>Password</b></span> to the username and password of the created MRS user when creating an MRS data connection.<div class="note" id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_note15451659151217"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_ul17715141011134"><li id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_li8715121031318">If the CDM cluster version is 2.9.0 or later and the MRS cluster version is 3.1.0 or later, the created user must have the permissions of the <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b8979935645">Manager_viewer</strong> role to create links on CDM. To perform operations on databases, tables, and columns of an MRS component, you also need to add the database, table, and column permissions of the MRS component to the user by following the instructions in the MRS documentation.</li><li id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_li5415103511136">If the CDM cluster version is earlier than 2.9.0 or the MRS cluster version is earlier than 3.1.0, the created user must have the permissions of <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b1088016562338">Manager_administrator</strong> or <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b1288695693319">System_administrator</strong> to create links on CDM.</li><li id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_li1733135017192">A user with only the <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b6765133911341">Manager_tenant</strong> or <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b1377216393342">Manager_auditor</strong> permission cannot create connections.</li></ul>
|
||||
</div></div>
|
||||
</div>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.3.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p191042018308">Yes</p>
|
||||
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p710517023010">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row3105201309"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p18105507306">Password</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.4.2.4.1.2 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p71054011307">Password used for logging in to MRS Manager</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p191051703302">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row177699297305"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p310410043015">Authentication Method</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.4.2.4.1.2 "><div class="p" id="dataartsstudio_01_0033__en-us_topic_0108275385_p171048073013">Authentication method used for accessing MRS<ul id="dataartsstudio_01_0033__en-us_topic_0108275385_ul17104806309"><li id="dataartsstudio_01_0033__en-us_topic_0108275385_li151041006308"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b84235270611123">SIMPLE</strong>: for non-security mode</li><li id="dataartsstudio_01_0033__en-us_topic_0108275385_li11104108309"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b193121128127">KERBEROS</strong>: for security mode</li></ul>
|
||||
</div>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p191042018308">Yes</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
@ -60,9 +64,9 @@
|
||||
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0033__en-us_topic_0108275385_table1990636915212"></a><a name="en-us_topic_0108275385_table1990636915212"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0033__en-us_topic_0108275385_table1990636915212" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row4257242215212"><th align="left" class="cellrowborder" valign="top" width="18.95%" id="mcps1.3.2.4.2.4.1.1"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p3100089215212"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0065840554_b84235270692541">Parameter</strong></p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="61.42999999999999%" id="mcps1.3.2.4.2.4.1.2"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p2804435515212"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b1340701018">Description</strong></p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="61.42999999999999%" id="mcps1.3.2.4.2.4.1.2"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p2804435515212"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b37959942">Description</strong></p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="19.62%" id="mcps1.3.2.4.2.4.1.3"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p5700024515212"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b1996756275">Example Value</strong></p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="19.62%" id="mcps1.3.2.4.2.4.1.3"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p5700024515212"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b1153592201">Example Value</strong></p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@ -2,46 +2,48 @@
|
||||
|
||||
<h1 class="topictitle1">Link to DLI</h1>
|
||||
<div id="body8662426"><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p493133413817">When connecting CDM to DLI, configure the parameters as described in <a href="#dataartsstudio_01_0036__en-us_topic_0108275410_table22075105144748">Table 1</a>.</p>
|
||||
<div class="note" id="dataartsstudio_01_0036__en-us_topic_0108275410_note8867140110"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275292_p167832113185">Do not change the password or user when the job is running. If you do so, the password will not take effect immediately and the job will fail.</p>
|
||||
</div></div>
|
||||
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0036__en-us_topic_0108275410_table22075105144748"></a><a name="en-us_topic_0108275410_table22075105144748"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0036__en-us_topic_0108275410_table22075105144748" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row19905440144748"><th align="left" class="cellrowborder" valign="top" width="19.509999999999998%" id="mcps1.3.2.2.4.1.1"><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p1727937144748">Parameter</p>
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0036__en-us_topic_0108275410_table22075105144748"></a><a name="en-us_topic_0108275410_table22075105144748"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0036__en-us_topic_0108275410_table22075105144748" frame="border" border="1" rules="all"><caption><b>Table 1 </b>DLI link parameters</caption><thead align="left"><tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row19905440144748"><th align="left" class="cellrowborder" valign="top" width="19.509999999999998%" id="mcps1.3.3.2.4.1.1"><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p1727937144748">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="58.75%" id="mcps1.3.2.2.4.1.2"><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p5745174144748">Description</p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="58.75%" id="mcps1.3.3.2.4.1.2"><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p5745174144748">Description</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="21.740000000000002%" id="mcps1.3.2.2.4.1.3"><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p62705927144748">Example Value</p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="21.740000000000002%" id="mcps1.3.3.2.4.1.3"><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p62705927144748">Example Value</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row11298866916"><td class="cellrowborder" valign="top" width="19.509999999999998%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p15298176296">Name</p>
|
||||
<tbody><tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row11298866916"><td class="cellrowborder" valign="top" width="19.509999999999998%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p15298176296">Name</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="58.75%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
|
||||
<td class="cellrowborder" valign="top" width="58.75%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p19298156493">dli_link</p>
|
||||
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p19298156493">dli_link</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row46015358144748"><td class="cellrowborder" valign="top" width="19.509999999999998%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p31612872145433">AK</p>
|
||||
<tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row46015358144748"><td class="cellrowborder" valign="top" width="19.509999999999998%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p31612872145433">AK</p>
|
||||
</td>
|
||||
<td class="cellrowborder" rowspan="2" valign="top" width="58.75%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p181471423104">AK/SK required for authentication during access to the DLI database.</p>
|
||||
<td class="cellrowborder" rowspan="2" valign="top" width="58.75%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p181471423104">AK/SK required for authentication during access to the DLI database.</p>
|
||||
<p id="dataartsstudio_01_0036__en-us_topic_0108275410_p2087724103311">You need to create an access key for the current account and obtain an AK/SK pair.</p>
|
||||
<ol id="dataartsstudio_01_0036__en-us_topic_0108275410_ol1361418377715"><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535103025819">Log in to the management console, move the cursor to the username in the upper right corner, and select <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b1586023610364">My Credentials</strong> from the drop-down list.</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_li173533018584">On the <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b149721128172418">My Credentials</strong> page, choose <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b15803656132414">Access Keys</strong>, and click <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b2452152020258">Create Access Key</strong>. See <a href="#dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615">Figure 1</a>.<div class="fignone" id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"><a name="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><a name="en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><span class="figcap"><b>Figure 1 </b>Clicking Create Access Key</span><br><span><img id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_image20389043111611" src="en-us_image_0000001322088088.png"></span></div>
|
||||
<ol id="dataartsstudio_01_0036__en-us_topic_0108275410_ol1361418377715"><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535103025819">Log in to the management console, move the cursor to the username in the upper right corner, and select <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b1586023610364">My Credentials</strong> from the drop-down list.</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_li173533018584">On the <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b149721128172418">My Credentials</strong> page, choose <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b15803656132414">Access Keys</strong>, and click <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b2452152020258">Create Access Key</strong>. See <a href="#dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615">Figure 1</a>.<div class="fignone" id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"><a name="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><a name="en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><span class="figcap"><b>Figure 1 </b>Clicking Create Access Key</span><br><span><img id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_image20389043111611" src="en-us_image_0000002270789428.png"></span></div>
|
||||
</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535530185815">Click <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b8340319122819">OK</strong> and save the access key file as prompted. The access key file will be saved to your browser's configured download location. Open the <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b1940852512813">credentials.csv</strong> file to view <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b191574128718">Access Key Id</strong> and <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b175769149718">Secret Access Key</strong>.<div class="note" id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_note4554158201"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_ul25541081906"><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_li175541819018">Only two access keys can be added for each user.</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_li3554138305">To ensure access key security, the access key is automatically downloaded only when it is generated for the first time and cannot be obtained from the management console later. Keep them properly.</li></ul>
|
||||
</div></div>
|
||||
</li></ol>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p5195678145433">-</p>
|
||||
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p5195678145433">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row23643456144748"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p29552890145433">SK</p>
|
||||
<tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row23643456144748"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p29552890145433">SK</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p32797946145433">-</p>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p32797946145433">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row12160822504"><td class="cellrowborder" valign="top" width="19.509999999999998%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p1016019285015">Project ID</p>
|
||||
<tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row12160822504"><td class="cellrowborder" valign="top" width="19.509999999999998%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p1016019285015">Project ID</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="58.75%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p1637616424613">Project ID in the region where DLI resides</p>
|
||||
<div class="p" id="dataartsstudio_01_0036__en-us_topic_0108275410_p1668482916813">You can obtain the project ID and account ID by performing the following steps:<ol id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_ol6260200121819"><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_li19260803185">Register with and log in to the management console.</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_li142601019186">Hover the cursor on the username in the upper right corner and select <span class="uicontrol" id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_uicontrol0260130191818"><b>My Credentials</b></span> from the drop-down list.</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_li1026113031818">On the <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_b196637155315">My Credentials</strong> page, obtain the account name and account ID, and obtain the project ID from the project list.</li></ol>
|
||||
<td class="cellrowborder" valign="top" width="58.75%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p1637616424613">Project ID in the region where DLI resides</p>
|
||||
<div class="p" id="dataartsstudio_01_0036__en-us_topic_0108275410_p1668482916813">A project is a group of tenant resources, and an account ID corresponds to the current account. The IAM ID corresponds to the current user. You can view the project IDs, account IDs, and user IDs in different regions on the corresponding pages.<ol id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_ol6260200121819"><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_li19260803185">Register with and log in to the management console.</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_li142601019186">Hover the cursor on the username in the upper right corner and select <span class="uicontrol" id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_uicontrol0260130191818"><b>My Credentials</b></span> from the drop-down list.</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_li1026113031818">On the <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_b0801614153013">API Credentials</strong> page, obtain the account name, account ID, IAM username, and IAM user ID, and obtain the project ID from the project list.</li></ol>
|
||||
</div>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p11608245019">-</p>
|
||||
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p11608245019">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
|
||||
@ -3,7 +3,7 @@
|
||||
<h1 class="topictitle1">Link to CloudTable OpenTSDB</h1>
|
||||
<div id="body8662426"><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p493133413817">When connecting CDM to CloudTable OpenTSDB, configure the parameters as described in <a href="#dataartsstudio_01_0037__en-us_topic_0133463138_table22075105144748">Table 1</a>.</p>
|
||||
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0037__en-us_topic_0133463138_table22075105144748"></a><a name="en-us_topic_0133463138_table22075105144748"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0037__en-us_topic_0133463138_table22075105144748" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0037__en-us_topic_0133463138_row19905440144748"><th align="left" class="cellrowborder" valign="top" width="20.07%" id="mcps1.3.2.2.4.1.1"><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p1727937144748">Parameter</p>
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0037__en-us_topic_0133463138_table22075105144748"></a><a name="en-us_topic_0133463138_table22075105144748"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0037__en-us_topic_0133463138_table22075105144748" frame="border" border="1" rules="all"><caption><b>Table 1 </b>CloudTable OpenTSDB link parameters</caption><thead align="left"><tr id="dataartsstudio_01_0037__en-us_topic_0133463138_row19905440144748"><th align="left" class="cellrowborder" valign="top" width="20.07%" id="mcps1.3.2.2.4.1.1"><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p1727937144748">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="58.19%" id="mcps1.3.2.2.4.1.2"><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p5745174144748">Description</p>
|
||||
</th>
|
||||
@ -36,7 +36,7 @@
|
||||
<tr id="dataartsstudio_01_0037__en-us_topic_0133463138_row1392892065413"><td class="cellrowborder" valign="top" width="20.07%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p1016019285015">Project ID</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p1637616424613">Project ID in the region where CloudTable resides</p>
|
||||
<div class="p" id="dataartsstudio_01_0037__en-us_topic_0133463138_p1668482916813">You can obtain the project ID and account ID by performing the following steps:<ol id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129537317_ol6260200121819"><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129537317_li19260803185">Register with and log in to the management console.</li><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129537317_li142601019186">Hover the cursor on the username in the upper right corner and select <span class="uicontrol" id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129537317_uicontrol0260130191818"><b>My Credentials</b></span> from the drop-down list.</li><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129537317_li1026113031818">On the <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129537317_b196637155315">My Credentials</strong> page, obtain the account name and account ID, and obtain the project ID from the project list.</li></ol>
|
||||
<div class="p" id="dataartsstudio_01_0037__en-us_topic_0133463138_p1668482916813">A project is a group of tenant resources, and an account ID corresponds to the current account. The IAM ID corresponds to the current user. You can view the project IDs, account IDs, and user IDs in different regions on the corresponding pages.<ol id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129537317_ol6260200121819"><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129537317_li19260803185">Register with and log in to the management console.</li><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129537317_li142601019186">Hover the cursor on the username in the upper right corner and select <span class="uicontrol" id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129537317_uicontrol0260130191818"><b>My Credentials</b></span> from the drop-down list.</li><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129537317_li1026113031818">On the <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129537317_b0801614153013">API Credentials</strong> page, obtain the account name, account ID, IAM username, and IAM user ID, and obtain the project ID from the project list.</li></ol>
|
||||
</div>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p11608245019">-</p>
|
||||
@ -53,7 +53,7 @@
|
||||
</td>
|
||||
<td class="cellrowborder" rowspan="2" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0037__en-us_topic_0133463138_p181471423104">AK and SK for accessing CloudTable.</p>
|
||||
<p id="dataartsstudio_01_0037__en-us_topic_0133463138_p2396698815212">You need to create an access key for the current account and obtain an AK/SK pair.</p>
|
||||
<ol id="dataartsstudio_01_0037__en-us_topic_0133463138_ol1361418377715"><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535103025819">Log in to the management console, move the cursor to the username in the upper right corner, and select <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b1586023610364">My Credentials</strong> from the drop-down list.</li><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_li173533018584">On the <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b149721128172418">My Credentials</strong> page, choose <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b15803656132414">Access Keys</strong>, and click <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b2452152020258">Create Access Key</strong>. See <a href="#dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615">Figure 1</a>.<div class="fignone" id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"><a name="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><a name="en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><span class="figcap"><b>Figure 1 </b>Clicking Create Access Key</span><br><span><img id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_image20389043111611" src="en-us_image_0000001322088088.png"></span></div>
|
||||
<ol id="dataartsstudio_01_0037__en-us_topic_0133463138_ol1361418377715"><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535103025819">Log in to the management console, move the cursor to the username in the upper right corner, and select <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b1586023610364">My Credentials</strong> from the drop-down list.</li><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_li173533018584">On the <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b149721128172418">My Credentials</strong> page, choose <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b15803656132414">Access Keys</strong>, and click <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b2452152020258">Create Access Key</strong>. See <a href="#dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615">Figure 1</a>.<div class="fignone" id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"><a name="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><a name="en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><span class="figcap"><b>Figure 1 </b>Clicking Create Access Key</span><br><span><img id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_image20389043111611" src="en-us_image_0000002270789428.png"></span></div>
|
||||
</li><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535530185815">Click <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b8340319122819">OK</strong> and save the access key file as prompted. The access key file will be saved to your browser's configured download location. Open the <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b1940852512813">credentials.csv</strong> file to view <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b191574128718">Access Key Id</strong> and <strong id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_b175769149718">Secret Access Key</strong>.<div class="note" id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_note4554158201"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_ul25541081906"><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_li175541819018">Only two access keys can be added for each user.</li><li id="dataartsstudio_01_0037__en-us_topic_0133463138_en-us_topic_0000001129241845_li3554138305">To ensure access key security, the access key is automatically downloaded only when it is generated for the first time and cannot be obtained from the management console later. Keep them properly.</li></ul>
|
||||
</div></div>
|
||||
</li></ol>
|
||||
|
||||
@ -2,56 +2,68 @@
|
||||
|
||||
<h1 class="topictitle1">Link to DMS Kafka</h1>
|
||||
<div id="body8662426"><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p493133413817">When connecting CDM to DMS Kafka, configure the parameters as described in <a href="#dataartsstudio_01_0038__en-us_topic_0143085538_table22075105144748">Table 1</a>.</p>
|
||||
<div class="note" id="dataartsstudio_01_0038__en-us_topic_0143085538_note8867140110"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0038__en-us_topic_0143085538_en-us_topic_0108275292_p167832113185">Do not change the password or user when the job is running. If you do so, the password will not take effect immediately and the job will fail.</p>
|
||||
</div></div>
|
||||
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0038__en-us_topic_0143085538_table22075105144748"></a><a name="en-us_topic_0143085538_table22075105144748"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0038__en-us_topic_0143085538_table22075105144748" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row19905440144748"><th align="left" class="cellrowborder" valign="top" width="20.62%" id="mcps1.3.2.2.4.1.1"><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1727937144748">Parameter</p>
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0038__en-us_topic_0143085538_table22075105144748"></a><a name="en-us_topic_0143085538_table22075105144748"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0038__en-us_topic_0143085538_table22075105144748" frame="border" border="1" rules="all"><caption><b>Table 1 </b>DMS Kafka link parameter</caption><thead align="left"><tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row19905440144748"><th align="left" class="cellrowborder" valign="top" width="20.62%" id="mcps1.3.3.2.4.1.1"><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1727937144748">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="58.19%" id="mcps1.3.2.2.4.1.2"><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p5745174144748">Description</p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="58.19%" id="mcps1.3.3.2.4.1.2"><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p5745174144748">Description</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="21.19%" id="mcps1.3.2.2.4.1.3"><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p62705927144748">Example Value</p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="21.19%" id="mcps1.3.3.2.4.1.3"><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p62705927144748">Example Value</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row11298866916"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p15298176296">Name</p>
|
||||
<tbody><tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row11298866916"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p15298176296">Name</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
|
||||
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p19298156493">dms_link</p>
|
||||
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p19298156493">dms_link</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row87539715534"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1375357165315">Service Type</p>
|
||||
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row87539715534"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1375357165315">Service Type</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p147692714538">DMS Kafka edition. Currently, only the Platinum edition is available.</p>
|
||||
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p147692714538">DMS Kafka edition. Currently, only the Platinum edition is available.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p2076910795316">Platinum</p>
|
||||
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p2076910795316">Platinum</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row1351774015574"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p132674594583">Kafka Broker</p>
|
||||
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row1351774015574"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p132674594583">Kafka Broker</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p55181140195712">Address of a Kafka premium instance. The format is host:port.</p>
|
||||
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p55181140195712">Address of a Kafka premium instance. The format is host:port.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p17518440165713">-</p>
|
||||
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p17518440165713">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row4239164445710"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p082419415916">Kafka SASL_SSL</p>
|
||||
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row4239164445710"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p082419415916">Kafka SASL_SSL</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p112168292347">Whether to enable SSL authentication when a client connects to a Kafka premium instance.</p>
|
||||
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p112168292347">Whether to enable SSL authentication when a client connects to a Kafka premium instance. This function must be enabled if the SASL_SSL security protocol is enabled for the link to the DMS Kafka instance.</p>
|
||||
<p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1563192753418">If Kafka SASL_SSL is enabled, data will be encrypted before transmission for higher security, but performance will suffer.</p>
|
||||
<div class="note" id="dataartsstudio_01_0038__en-us_topic_0143085538_note8128203721419"><span class="notetitle"> NOTE: </span><div class="notebody"><div class="p" id="dataartsstudio_01_0038__en-us_topic_0143085538_p1912916377146">When SSL authentication is enabled, Kafka continuously parses the Kafka broker connection address as a domain name, which undermines performance. You are advised to add the self-mapping of the broker connection address to the <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b1070019196334">/etc/hosts</strong> file on the ECS corresponding to the CDM cluster (search for the ECS based on the cluster IP address) so that the client can quickly resolve the broker of the instance. For example, if the Kafka broker address is 10.154.48.120, add the following self-mapping to the <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b8535222173918">/etc/hosts</strong> file:<pre class="codeblock" id="dataartsstudio_01_0038__en-us_topic_0143085538_codeblock1239483724412">10.154.48.120 10.154.48.120</pre>
|
||||
</div>
|
||||
</div></div>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p42402440579">Yes</p>
|
||||
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p42402440579">Yes</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row1521465119"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p181416274499">Username</p>
|
||||
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row1521465119"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p181416274499">Username</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p814182718498">Username for connecting to DMS Kafka. This parameter is displayed when <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b9583164417318">Kafka SASL_SSL</strong> is enabled.</p>
|
||||
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p814182718498">Username for connecting to DMS Kafka. This parameter is displayed when <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b9583164417318">Kafka SASL_SSL</strong> is enabled.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1522641120">-</p>
|
||||
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1522641120">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row1831717229110"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p11141202744912">Password</p>
|
||||
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row1831717229110"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p11141202744912">Password</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1376018356512">Password for connecting to DMS Kafka. This parameter is displayed when <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b724513571337">Kafka SASL_SSL</strong> is enabled.</p>
|
||||
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1376018356512">Password for connecting to DMS Kafka. This parameter is displayed when <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b724513571337">Kafka SASL_SSL</strong> is enabled.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p4317522121118">-</p>
|
||||
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p4317522121118">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row150769172412"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p10507189102415">Kafka Properties</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.3.2.4.1.2 "><ul id="dataartsstudio_01_0038__en-us_topic_0143085538_ul94385497269"><li id="dataartsstudio_01_0038__en-us_topic_0143085538_li5438949152611">If a security protocol is enabled for the link to the DMS Kafka instance, you must add a data encryption attribute, and set the attribute name to <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b362755215567">security.protocol</strong> and value to <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b84924192284">SASL_SSL</strong> or <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b18897161289">SASL_PLAINTEXT</strong> based on the security protocol of the Kafka instance.</li><li id="dataartsstudio_01_0038__en-us_topic_0143085538_li64384499262">If SASL authentication is enabled for the link to the DMS Kafka instance, you must add an authentication mode attribute, and set the attribute name to <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b18530203931913">sasl.mechanism</strong> and value to <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b17530133911918">PLAIN</strong> or <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b1353053917197">SCRAM-SHA-512</strong> based on the SASL authentication mechanism configured for the Kafka instance (set the value to either <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b145315395193">PLAIN</strong> or <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b1653111394197">SCRAM-SHA-512</strong> if both are supported).</li></ul>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p750712916242">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@ -1,11 +1,12 @@
|
||||
<a name="dataartsstudio_01_0040"></a><a name="dataartsstudio_01_0040"></a>
|
||||
|
||||
<h1 class="topictitle1">Link to HDFS</h1>
|
||||
<div id="body8662426"><div class="p" id="dataartsstudio_01_0040__en-us_topic_0108275286_p396911259314">CDM supports the following HDFS data sources:<ul id="dataartsstudio_01_0040__en-us_topic_0108275286_ul1998193319335"><li id="dataartsstudio_01_0040__en-us_topic_0108275286_li189813313319"><a href="#dataartsstudio_01_0040__en-us_topic_0108275286_section127371747103314">MRS HDFS</a></li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_li46813410343"><a href="#dataartsstudio_01_0040__en-us_topic_0108275286_section1851831133416">FusionInsight HDFS</a></li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_li88038432344"><a href="#dataartsstudio_01_0040__en-us_topic_0108275286_section690499173512">Apache HDFS</a></li></ul>
|
||||
<div id="body8662426"><div class="p" id="dataartsstudio_01_0040__en-us_topic_0108275286_p396911259314">CDM supports the following HDFS data sources:<ul id="dataartsstudio_01_0040__en-us_topic_0108275286_ul1998193319335"><li id="dataartsstudio_01_0040__en-us_topic_0108275286_li189813313319"><a href="#dataartsstudio_01_0040__en-us_topic_0108275286_section127371747103314">MRS HDFS</a></li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_li46813410343"><a href="#dataartsstudio_01_0040__en-us_topic_0108275286_section1851831133416">FusionInsight HDFS</a></li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_li88038432344"><a href="#dataartsstudio_01_0040__en-us_topic_0108275286_section690499173512">Apache HDFS</a><div class="note" id="dataartsstudio_01_0040__en-us_topic_0108275286_note8867140110"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108275292_p167832113185">Do not change the password or user when the job is running. If you do so, the password will not take effect immediately and the job will fail.</p>
|
||||
</div></div>
|
||||
</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dataartsstudio_01_0040__en-us_topic_0108275286_section127371747103314"><a name="dataartsstudio_01_0040__en-us_topic_0108275286_section127371747103314"></a><a name="en-us_topic_0108275286_section127371747103314"></a><h4 class="sectiontitle">MRS HDFS</h4><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p124412208341">When connecting CDM to HDFS of MRS, configure the parameters as described in <a href="#dataartsstudio_01_0040__en-us_topic_0108275286_table6441152003419">Table 1</a>.</p>
|
||||
<div class="note" id="dataartsstudio_01_0040__en-us_topic_0108275286_note5285102815136"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_ul268415325415"><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_li116841636546">Before creating an MRS link, you need to add an authenticated Kerberos user on MRS and log in to the MRS management page to change the initial password. Then use the new user to create an MRS link.</li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_li36846319542">To connect to an MRS 2.<em id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_i1155152111254">x</em> cluster, create a CDM cluster of version 2.<em id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_i115512112257">x</em> first. CDM 1.8.<em id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_i0707423162514">x</em> clusters cannot connect to MRS 2.<em id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_i0707423142520">x</em> clusters.</li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_li132471615165418"><div class="p" id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_p134241819125419"><a name="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_li132471615165418"></a><a name="en-us_topic_0108275286_en-us_topic_0108604188_li132471615165418"></a>Ensure that the MRS cluster and the <span id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0187412481_text20329182914416">DataArts Studio</span> instance can communicate with each other. The following requirements must be met for network interconnection:<ul id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0187412481_ul1715617232281"><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0187412481_li17205293217">If the CDM cluster in the <span id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0187412481_text18857423192811">DataArts Studio</span> instance and the MRS cluster are in different regions, a public network or a dedicated connection is required. If the Internet is used for communication, ensure that an EIP has been bound to the CDM cluster, and the MRS cluster can access the Internet and the port has been enabled in the firewall rule.</li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0187412481_li13205893215">If the CDM cluster in the <span id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0187412481_text1342355131010">DataArts Studio</span> instance and the MRS cluster are in the same region, VPC, subnet, and security group, they can communicate with each other by default. If they are in the same VPC but in different subnets or security groups, you must configure routing rules and security group rules. For details about how to configure routing rules, see <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0187412481_b1434805571014">Custom Route in Region Type I</strong> > <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0187412481_b334855520100">Adding Routes</strong> in <em id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0187412481_i6348155516105">Virtual Private Cloud (VPC) Usage Guide</em>. For details about how to configure security group rules, see <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0187412481_b9349185517107">Security Group</strong> > <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0187412481_b1835085511016">Adding a Security Group Rule</strong> in <em id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0187412481_i135012558101">Virtual Private Cloud (VPC) Usage Guide</em>.</li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0187412481_li20156162311283">The MRS cluster and the <span id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0187412481_text16325123854710">DataArts Studio</span> workspace belong to the same enterprise project. If they do not, you can modify the enterprise project of the workspace.</li></ul>
|
||||
</div>
|
||||
<div class="note" id="dataartsstudio_01_0040__en-us_topic_0108275286_note5285102815136"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_ul268415325415"><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_li116841636546">Before creating an MRS link, you need to add an authenticated Kerberos user on MRS and log in to the MRS management page to change the initial password. Then use the new user to create an MRS link.</li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_li36846319542">To connect to an MRS 2.<em id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_i1155152111254">x</em> cluster, create a CDM cluster of version 2.<em id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_i115512112257">x</em> first. CDM 1.8.<em id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_i0707423162514">x</em> clusters cannot connect to MRS 2.<em id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_i0707423142520">x</em> clusters.</li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_li132471615165418">If the connection fails after you select a cluster, check whether the MRS cluster can communicate with the CDM instance which functions as the agent. They can communicate with each other in the following scenarios:<ul id="dataartsstudio_01_0040__ul9471834174919"><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0000001503606428_li17205293217">If the CDM cluster in the <span id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0000001503606428_text15319922125112">DataArts Studio</span> instance and the MRS cluster are in different regions, a public network or a dedicated connection is required. If the Internet is used for communication, ensure that an EIP has been bound to the CDM cluster, and the MRS cluster can access the Internet and the port has been enabled in the firewall rule.</li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0000001503606428_li13205893215">If the CDM cluster in the <span id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0000001503606428_text867019165375">DataArts Studio</span> instance and the cloud service are in the same region, VPC, subnet, and security group, they can communicate with each other by default. If they are in the same VPC but in different subnets or security groups, you must configure routing rules and security group rules. For details about how to configure routing rules, see "Adding a Custom Route" in <em id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0000001503606428_i1267271614375">Virtual Private Cloud (VPC) Usage Guide</em>. For details about how to configure security group rules, see "Security Group" > "Adding a Security Group Rule" in <em id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0000001503606428_i15675816103713">Virtual Private Cloud (VPC) Usage Guide</em>.</li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0000001503606428_li20156162311283">The MRS cluster and the <span id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108604188_en-us_topic_0000001503606428_text4156132310284">DataArts Studio</span> workspace belong to the same enterprise project. If they do not, you can modify the enterprise project of the workspace.</li></ul>
|
||||
</li></ul>
|
||||
</div></div>
|
||||
|
||||
@ -26,7 +27,9 @@
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0040__en-us_topic_0108275286_row2456122053415"><td class="cellrowborder" valign="top" width="20.51%" headers="mcps1.3.2.4.2.4.1.1 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p13456172019344">Manager IP</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="57.720000000000006%" headers="mcps1.3.2.4.2.4.1.2 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p1345602010341">Floating IP address of MRS Manager. Click <span class="uicontrol" id="dataartsstudio_01_0040__en-us_topic_0108275286_uicontrol578864992012"><b>Select</b></span> next to the <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_b2078834920203">Manager IP</strong> text box to select an MRS cluster. CDM automatically fills in the authentication information.</p>
|
||||
<td class="cellrowborder" valign="top" width="57.720000000000006%" headers="mcps1.3.2.4.2.4.1.2 "><div class="p" id="dataartsstudio_01_0040__en-us_topic_0108275286_p1345602010341">Floating IP address of MRS Manager. Click <span class="uicontrol" id="dataartsstudio_01_0040__en-us_topic_0108275286_uicontrol578864992012"><b>Select</b></span> next to the <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_b2078834920203">Manager IP</strong> text box to select an MRS cluster. CDM automatically fills in the authentication information.<div class="note" id="dataartsstudio_01_0040__note1340014473413"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0040__en-us_topic_0182566327_p116249795810"><span id="dataartsstudio_01_0040__en-us_topic_0182566327_text7355181825814">DataArts Studio</span> does not support MRS clusters whose Kerberos encryption type is <strong id="dataartsstudio_01_0040__en-us_topic_0182566327_b143479402717">aes256-sha2,aes128-sha2</strong>, and only supports MRS clusters whose Kerberos encryption type is <strong id="dataartsstudio_01_0040__en-us_topic_0182566327_b19532103219813">aes256-sha1,aes128-sha1</strong>.</p>
|
||||
</div></div>
|
||||
</div>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.77%" headers="mcps1.3.2.4.2.4.1.3 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p13456420143418">127.0.0.1</p>
|
||||
</td>
|
||||
@ -34,7 +37,7 @@
|
||||
<tr id="dataartsstudio_01_0040__en-us_topic_0108275286_row16456152011347"><td class="cellrowborder" valign="top" width="20.51%" headers="mcps1.3.2.4.2.4.1.1 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p94561620113420">Username</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="57.720000000000006%" headers="mcps1.3.2.4.2.4.1.2 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p64738206349">If <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_b7848458134816">Authentication Method</strong> is set to <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_b12431727490">KERBEROS</strong>, you must provide the username and password used for logging in to MRS Manager. If you need to create a snapshot when exporting a directory from HDFS, the user configured here must have the administrator permission on HDFS.</p>
|
||||
<div class="p" id="dataartsstudio_01_0040__en-us_topic_0108275286_p194519141759">To create a data connection for an MRS security cluster, do not use user <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b554524219105248">admin</strong>. The <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b123106598105248">admin</strong> user is the default management page user and cannot be used as the authentication user of the security cluster. You can create an MRS user and set <span class="parmname" id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_en-us_topic_0187412481_parmname3468191262313"><b>Username</b></span> and <span class="parmname" id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_en-us_topic_0187412481_parmname64683124231"><b>Password</b></span> to the username and password of the created MRS user when creating an MRS data connection.<div class="note" id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_note15451659151217"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_ul17715141011134"><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_li8715121031318">If the CDM cluster version is 2.9.0 or later and the MRS cluster version is 3.1.0 or later, the created user must have the permissions of the <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b11836193312371">Manager_viewer</strong> role to create links on CDM. To perform operations on databases, tables, and data of a component, you also need to add the user group permissions of the component to the user.</li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_li5415103511136">If the CDM cluster version is earlier than 2.9.0 or the MRS cluster version is earlier than 3.1.0, the created user must have the permissions of <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b1088016562338">Manager_administrator</strong> or <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b1288695693319">System_administrator</strong> to create links on CDM.</li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_li1733135017192">A user with only the <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b6765133911341">Manager_tenant</strong> or <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b1377216393342">Manager_auditor</strong> permission cannot create connections.</li></ul>
|
||||
<div class="p" id="dataartsstudio_01_0040__en-us_topic_0108275286_p194519141759">To create a data connection for an MRS security cluster, do not use user <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b554524219105248">admin</strong>. The <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b123106598105248">admin</strong> user is the default management page user and cannot be used as the authentication user of the security cluster. You can create an MRS user and set <span class="parmname" id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_en-us_topic_0187412481_parmname3468191262313"><b>Username</b></span> and <span class="parmname" id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_en-us_topic_0187412481_parmname64683124231"><b>Password</b></span> to the username and password of the created MRS user when creating an MRS data connection.<div class="note" id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_note15451659151217"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_ul17715141011134"><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_li8715121031318">If the CDM cluster version is 2.9.0 or later and the MRS cluster version is 3.1.0 or later, the created user must have the permissions of the <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b8979935645">Manager_viewer</strong> role to create links on CDM. To perform operations on databases, tables, and columns of an MRS component, you also need to add the database, table, and column permissions of the MRS component to the user by following the instructions in the MRS documentation.</li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_li5415103511136">If the CDM cluster version is earlier than 2.9.0 or the MRS cluster version is earlier than 3.1.0, the created user must have the permissions of <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b1088016562338">Manager_administrator</strong> or <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b1288695693319">System_administrator</strong> to create links on CDM.</li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_li1733135017192">A user with only the <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b6765133911341">Manager_tenant</strong> or <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b1377216393342">Manager_auditor</strong> permission cannot create connections.</li></ul>
|
||||
</div></div>
|
||||
</div>
|
||||
</td>
|
||||
@ -83,7 +86,7 @@
|
||||
<tr id="dataartsstudio_01_0040__en-us_topic_0108275286_row19389228162513"><td class="cellrowborder" valign="top" width="20.51%" headers="mcps1.3.2.4.2.4.1.1 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p1713125033015">Cluster Config Name</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="57.720000000000006%" headers="mcps1.3.2.4.2.4.1.2 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p1171175111302">This parameter is valid only when <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b762945800105248">Use Cluster Config</strong> is set to <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b1557791163105248">Yes</strong>. Select a cluster configuration that has been created.</p>
|
||||
<p id="dataartsstudio_01_0040__en-us_topic_0108275286_p192211597367">For details, see <a href="dataartsstudio_01_1096.html">Managing Cluster Configurations</a>.</p>
|
||||
<p id="dataartsstudio_01_0040__en-us_topic_0108275286_p192211597367">For details about how to configure a cluster, see "DataArts Migration" > "Managing Links" > "Managing Cluster Configurations" in <em id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_i19630121210434">User Guide</em>.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.77%" headers="mcps1.3.2.4.2.4.1.3 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p0147252193019">hdfs_01</p>
|
||||
</td>
|
||||
@ -180,7 +183,7 @@
|
||||
<tr id="dataartsstudio_01_0040__en-us_topic_0108275286_row12659162762719"><td class="cellrowborder" valign="top" width="20.74%" headers="mcps1.3.3.3.2.4.1.1 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p1764662782719">Cluster Config Name</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="57.97%" headers="mcps1.3.3.3.2.4.1.2 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p16646142715274">This parameter is valid only when <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b762945800105248_1">Use Cluster Config</strong> is set to <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b1557791163105248_1">Yes</strong>. Select a cluster configuration that has been created.</p>
|
||||
<p id="dataartsstudio_01_0040__en-us_topic_0108275286_p146461327142719">For details, see <a href="dataartsstudio_01_1096.html">Managing Cluster Configurations</a>.</p>
|
||||
<p id="dataartsstudio_01_0040__en-us_topic_0108275286_p146461327142719">For details about how to configure a cluster, see "DataArts Migration" > "Managing Links" > "Managing Cluster Configurations" in <em id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_i19630121210434_1">User Guide</em>.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.29%" headers="mcps1.3.3.3.2.4.1.3 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p76468275271">hdfs_01</p>
|
||||
</td>
|
||||
@ -222,24 +225,10 @@
|
||||
<td class="cellrowborder" valign="top" width="20.96%" headers="mcps1.3.4.3.2.4.1.3 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p109305910356">KERBEROS</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0040__en-us_topic_0108275286_row176991243103216"><td class="cellrowborder" valign="top" width="20.96%" headers="mcps1.3.4.3.2.4.1.1 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p1754151515313">Principal</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="58.08%" headers="mcps1.3.4.3.2.4.1.2 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p1224139143111">When <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b10663459113914">Authentication Method</strong> is set to <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b273611125401">KERBEROS</strong>, this parameter is mandatory. It is the username in the Kerberos security mode and can be obtained from the Hadoop administrator. The value of this parameter must be the same as that in the Keytab file.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.96%" headers="mcps1.3.4.3.2.4.1.3 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p0483184663113">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0040__en-us_topic_0108275286_row385893819326"><td class="cellrowborder" valign="top" width="20.96%" headers="mcps1.3.4.3.2.4.1.1 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p1232143803114">Keytab File</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="58.08%" headers="mcps1.3.4.3.2.4.1.2 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p178963963114">When <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b656312469418">Authentication Method</strong> is set to <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b1756334674114">KERBEROS</strong>, a Keytab file must be uploaded. The Keytab file is an authentication credential and can be obtained from the Hadoop administrator. Before obtaining the keytab file, you need to change the password of this user at least once in the cluster. Otherwise, the downloaded keytab file may be unavailable. After a user password is changed, the exported keytab file becomes invalid, and you need to export a keytab file again.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.96%" headers="mcps1.3.4.3.2.4.1.3 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p578521710314">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0040__en-us_topic_0108275286_row693151312543"><td class="cellrowborder" valign="top" width="20.96%" headers="mcps1.3.4.3.2.4.1.1 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p174517362557">Run Mode</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="58.08%" headers="mcps1.3.4.3.2.4.1.2 "><div class="p" id="dataartsstudio_01_0040__en-us_topic_0108275286_p693111135543">Run mode of the HDFS link. The options are as follows:<ul id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108275286_ul1747017597574_1"><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108275286_li6848185317587_1"><strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108275286_b03725315400_1">EMBEDDED</strong>: The link instance runs with CDM. This mode delivers better performance.</li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108275286_li1261464125915_1"><strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108275286_b1859873319585_1">STANDALONE</strong>: The link instance runs in an independent process. If CDM needs to connect to multiple Hadoop data sources (MRS, Hadoop, or CloudTable) with both Kerberos and Simple authentication modes, select <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108275286_b9202184312114_1">STANDALONE</strong> or configure different agents.<p id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108275286_p8792217159_1">Note: The STANDALONE mode is used to solve the version conflict problem. If the connector versions of the source and destination ends of the same link are different, a JAR file conflict occurs. In this case, you need to place the source or destination end in the STANDALONE process to prevent the migration failure caused by the conflict.</p>
|
||||
</li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108275286_li893446123812_1"><strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108275286_b181003145318_1">Agent</strong>: The link instance runs on an agent.</li></ul>
|
||||
<td class="cellrowborder" valign="top" width="58.08%" headers="mcps1.3.4.3.2.4.1.2 "><div class="p" id="dataartsstudio_01_0040__en-us_topic_0108275286_p693111135543">Run mode of the HDFS link. The options are as follows:<ul id="dataartsstudio_01_0040__en-us_topic_0108275286_ul118812510251"><li id="dataartsstudio_01_0040__en-us_topic_0108275286_li88811453254"><strong id="dataartsstudio_01_0040__en-us_topic_0108275286_b1130034924">EMBEDDED</strong>: The link instance runs with CDM. This mode delivers better performance.</li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_li1688117511256"><strong id="dataartsstudio_01_0040__en-us_topic_0108275286_b174476832">STANDALONE</strong>: The link instance runs in an independent process. If CDM needs to connect to multiple Hadoop data sources (MRS, Hadoop, or CloudTable) with both Kerberos and Simple authentication modes, select <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_b525219538">STANDALONE</strong> or configure different agents.<p id="dataartsstudio_01_0040__en-us_topic_0108275286_p17881145172520">Note: The STANDALONE mode is used to solve the version conflict problem. If the connector versions of the source and destination ends of the same link are different, a JAR file conflict occurs. In this case, you need to place the source or destination end in the STANDALONE process to prevent the migration failure caused by the conflict.</p>
|
||||
</li><li id="dataartsstudio_01_0040__en-us_topic_0108275286_li10881125162514"><strong id="dataartsstudio_01_0040__en-us_topic_0108275286_b174245713138">Agent</strong>: The link instance runs on an agent. For Apache HDFS, you can select <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_b36952016141417">Agent</strong> only if <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_b109381449141416">Authentication Method</strong> is set to <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_b777195813149">SIMPLE</strong>.</li></ul>
|
||||
</div>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.96%" headers="mcps1.3.4.3.2.4.1.3 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p15931141318544">STANDALONE</p>
|
||||
@ -256,7 +245,7 @@
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0040__en-us_topic_0108275286_row13173134416"><td class="cellrowborder" valign="top" width="20.96%" headers="mcps1.3.4.3.2.4.1.1 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p20303117444">Agent</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="58.08%" headers="mcps1.3.4.3.2.4.1.2 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p461134915213">If <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_b15875155217453">Run Mode</strong> is set to <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_b182701956124516">Agent</strong>, click <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_b58831016464">Select</strong> and select the agent created in <a href="dataartsstudio_01_0128.html#dataartsstudio_01_0128__en-us_topic_0207402273_en-us_topic_0191978474_section1072083564713">Connecting to an Agent</a>.</p>
|
||||
<td class="cellrowborder" valign="top" width="58.08%" headers="mcps1.3.4.3.2.4.1.2 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p461134915213">This parameter is required when <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_b91971643153316">Authentication Method</strong> is set to <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_b1069295119333">SIMPLE</strong> and <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_b728710263410">Run Mode</strong> is set to <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_b1672531316346">Agent</strong>. Select the agent created in <a href="dataartsstudio_01_0128.html#dataartsstudio_01_0128__en-us_topic_0207402273_en-us_topic_0191978474_section1072083564713">Connecting to an Agent</a>.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.96%" headers="mcps1.3.4.3.2.4.1.3 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p123193116445">-</p>
|
||||
</td>
|
||||
@ -270,8 +259,8 @@
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0040__en-us_topic_0108275286_row9301151462916"><td class="cellrowborder" valign="top" width="20.96%" headers="mcps1.3.4.3.2.4.1.1 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p029911492914">Cluster Config Name</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="58.08%" headers="mcps1.3.4.3.2.4.1.2 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p16299171492913">This parameter is valid only when <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b762945800105248_2">Use Cluster Config</strong> is set to <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b1557791163105248_2">Yes</strong>. Select a cluster configuration that has been created.</p>
|
||||
<p id="dataartsstudio_01_0040__en-us_topic_0108275286_p20299121492914">For details, see <a href="dataartsstudio_01_1096.html">Managing Cluster Configurations</a>.</p>
|
||||
<td class="cellrowborder" valign="top" width="58.08%" headers="mcps1.3.4.3.2.4.1.2 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p16299171492913">This parameter is valid when <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b22346420399">Use Cluster Config</strong> is set to <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b63141112399">Yes</strong> or <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b108571051133916">Authentication Method</strong> is set to <strong id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_b03686134014">KERBEROS</strong>. Select a cluster configuration that has been created.</p>
|
||||
<p id="dataartsstudio_01_0040__en-us_topic_0108275286_p20299121492914">For details about how to configure a cluster, see "DataArts Migration" > "Managing Links" > "Managing Cluster Configurations" in <em id="dataartsstudio_01_0040__en-us_topic_0108275286_en-us_topic_0108618545_i19630121210434_2">User Guide</em>.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.96%" headers="mcps1.3.4.3.2.4.1.3 "><p id="dataartsstudio_01_0040__en-us_topic_0108275286_p4299181416295">hdfs_01</p>
|
||||
</td>
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@ -2,61 +2,64 @@
|
||||
|
||||
<h1 class="topictitle1">Link to OBS</h1>
|
||||
<div id="body8662426"><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p10847147142919">When connecting CDM to the destination OBS bucket, you need to add the read and write permissions to the destination OBS bucket, and file authentication is not required.</p>
|
||||
<div class="note" id="dataartsstudio_01_0045__en-us_topic_0108275368_note18752146121711"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_0045__en-us_topic_0108275368_ul1797192611414"><li id="dataartsstudio_01_0045__en-us_topic_0108275368_li189717265416">If the CDM cluster and OBS bucket are not in the same region, the CDM cluster cannot access the OBS bucket.</li><li id="dataartsstudio_01_0045__en-us_topic_0108275368_li894710289414">Do not change the password or user when the job is running. If you do so, the password will not take effect immediately and the job will fail.</li></ul>
|
||||
</div></div>
|
||||
<div class="p" id="dataartsstudio_01_0045__en-us_topic_0108275368_p5749387015151">When connecting CDM to OBS, configure the parameters as described in <a href="#dataartsstudio_01_0045__en-us_topic_0108275368_table56513226152843">Table 1</a>.
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0045__en-us_topic_0108275368_table56513226152843"></a><a name="en-us_topic_0108275368_table56513226152843"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0045__en-us_topic_0108275368_table56513226152843" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row51765490152843"><th align="left" class="cellrowborder" valign="top" width="16.5%" id="mcps1.3.2.2.2.4.1.1"><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p25915791152843"><strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0065840554_b84235270692541">Parameter</strong></p>
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0045__en-us_topic_0108275368_table56513226152843"></a><a name="en-us_topic_0108275368_table56513226152843"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0045__en-us_topic_0108275368_table56513226152843" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row51765490152843"><th align="left" class="cellrowborder" valign="top" width="16.5%" id="mcps1.3.3.2.2.4.1.1"><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p25915791152843"><strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0065840554_b84235270692541">Parameter</strong></p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="62.870000000000005%" id="mcps1.3.2.2.2.4.1.2"><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p38360350165510"><strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0065840554_b842352706191716">Description</strong></p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="62.870000000000005%" id="mcps1.3.3.2.2.4.1.2"><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p38360350165510"><strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0065840554_b842352706191716">Description</strong></p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="20.630000000000003%" id="mcps1.3.2.2.2.4.1.3"><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p64999942163911"><strong id="dataartsstudio_01_0045__en-us_topic_0108275368_b842352706173959">Example Value</strong></p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="20.630000000000003%" id="mcps1.3.3.2.2.4.1.3"><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p64999942163911"><strong id="dataartsstudio_01_0045__en-us_topic_0108275368_b842352706173959">Example Value</strong></p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row172676953014"><td class="cellrowborder" valign="top" width="16.5%" headers="mcps1.3.2.2.2.4.1.1 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p426714916301">Name</p>
|
||||
<tbody><tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row172676953014"><td class="cellrowborder" valign="top" width="16.5%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p426714916301">Name</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="62.870000000000005%" headers="mcps1.3.2.2.2.4.1.2 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
|
||||
<td class="cellrowborder" valign="top" width="62.870000000000005%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.630000000000003%" headers="mcps1.3.2.2.2.4.1.3 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p1826719919305">obs_link</p>
|
||||
<td class="cellrowborder" valign="top" width="20.630000000000003%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p1826719919305">obs_link</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row58346992152843"><td class="cellrowborder" valign="top" width="16.5%" headers="mcps1.3.2.2.2.4.1.1 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p25657651152843">OBS Endpoint</p>
|
||||
<tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row58346992152843"><td class="cellrowborder" valign="top" width="16.5%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p25657651152843">OBS Endpoint</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="62.870000000000005%" headers="mcps1.3.2.2.2.4.1.2 "><div class="p" id="dataartsstudio_01_0045__en-us_topic_0108275368_p11141143515423">You can obtain the endpoint by either of the following means:<ul id="dataartsstudio_01_0045__en-us_topic_0108275368_ul36191496587"><li id="dataartsstudio_01_0045__en-us_topic_0108275368_li2239658154217">To obtain the endpoint of an OBS bucket, go to the OBS console and click the bucket name to go to its details page.</li><li id="dataartsstudio_01_0045__en-us_topic_0108275368_li19581153518113">An endpoint is the <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_b542311569437">request address</strong> for calling an API. Endpoints vary depending on services and regions. You can obtain endpoints from <a href="https://docs.otc.t-systems.com/en-us/endpoint/index.html" target="_blank" rel="noopener noreferrer">Regions and Endpoints</a>.</li></ul>
|
||||
</div>
|
||||
<p id="dataartsstudio_01_0045__en-us_topic_0108275368_p138036103816">You can enter a bucket-level domain name, for example, <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_b37380815468">test.<em id="dataartsstudio_01_0045__en-us_topic_0108275368_i108746140463">xx</em>.com</strong>. In this case, you can query only the <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_b14738198114610">test</strong> bucket.</p>
|
||||
<td class="cellrowborder" valign="top" width="62.870000000000005%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p11141143515423">An endpoint is the <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_b19610171474212">request address</strong> for calling an API. Endpoints vary depending on services and regions. You can obtain the OBS bucket endpoint by either of the following means:</p>
|
||||
<p id="dataartsstudio_01_0045__en-us_topic_0108275368_p843214618464">To obtain the endpoint of an OBS bucket, go to the OBS console and click the bucket name to go to its details page.</p>
|
||||
<div class="note" id="dataartsstudio_01_0045__en-us_topic_0108275368_note136619272103"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0108275368_ul1797192611414"><li id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0108275368_li189717265416">If the CDM cluster and OBS bucket are not in the same region, the CDM cluster cannot access the OBS bucket.</li><li id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0108275368_li894710289414">Do not change the password or user when the job is running. If you do so, the password will not take effect immediately and the job will fail.</li></ul>
|
||||
</div></div>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.630000000000003%" headers="mcps1.3.2.2.2.4.1.3 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p89819474596">-</p>
|
||||
<td class="cellrowborder" valign="top" width="20.630000000000003%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p89819474596">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row55420632152843"><td class="cellrowborder" valign="top" width="16.5%" headers="mcps1.3.2.2.2.4.1.1 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p18947563152843">Port</p>
|
||||
<tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row55420632152843"><td class="cellrowborder" valign="top" width="16.5%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p18947563152843">Port</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="62.870000000000005%" headers="mcps1.3.2.2.2.4.1.2 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p60445924165510">Data transmission port. The HTTPS port number is 443 and the HTTP port number is 80.</p>
|
||||
<td class="cellrowborder" valign="top" width="62.870000000000005%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p60445924165510">Data transmission port. The HTTPS port number is 443 and the HTTP port number is 80.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.630000000000003%" headers="mcps1.3.2.2.2.4.1.3 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p25723188163911">443</p>
|
||||
<td class="cellrowborder" valign="top" width="20.630000000000003%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p25723188163911">443</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row4804240203017"><td class="cellrowborder" valign="top" width="16.5%" headers="mcps1.3.2.2.2.4.1.1 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p158041427194014">OBS Bucket Type</p>
|
||||
<tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row4804240203017"><td class="cellrowborder" valign="top" width="16.5%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p158041427194014">OBS Bucket Type</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="62.870000000000005%" headers="mcps1.3.2.2.2.4.1.2 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p6804122764019">Select a value from the drop-down list, generally, <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_b76332430487">Object Storage</strong>.</p>
|
||||
<td class="cellrowborder" valign="top" width="62.870000000000005%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p6804122764019">Select a value from the drop-down list, generally, <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_b76332430487">Object Storage</strong>.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.630000000000003%" headers="mcps1.3.2.2.2.4.1.3 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p208045273406">Object Storage</p>
|
||||
<td class="cellrowborder" valign="top" width="20.630000000000003%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p208045273406">Object Storage</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row55275051152843"><td class="cellrowborder" valign="top" width="16.5%" headers="mcps1.3.2.2.2.4.1.1 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p3311745152843">AK</p>
|
||||
<tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row55275051152843"><td class="cellrowborder" valign="top" width="16.5%" headers="mcps1.3.3.2.2.4.1.1 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p3311745152843">AK</p>
|
||||
</td>
|
||||
<td class="cellrowborder" rowspan="2" valign="top" width="62.870000000000005%" headers="mcps1.3.2.2.2.4.1.2 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0108275368_p41664200165510">AK and SK are used to log in to the OBS server.</p>
|
||||
<td class="cellrowborder" rowspan="2" valign="top" width="62.870000000000005%" headers="mcps1.3.3.2.2.4.1.2 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0108275368_p41664200165510">AK and SK are used to log in to the OBS server.</p>
|
||||
<p id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0108275368_p1660302262810">You need to create an access key for the current account and obtain an AK/SK pair.</p>
|
||||
<div class="p" id="dataartsstudio_01_0045__en-us_topic_0108275368_p13152215453">To obtain an access key, perform the following steps:<ol id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_ol535183018588"><li id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535103025819">Log in to the management console, move the cursor to the username in the upper right corner, and select <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b1586023610364">My Credentials</strong> from the drop-down list.</li><li id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_li173533018584">On the <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b149721128172418">My Credentials</strong> page, choose <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b15803656132414">Access Keys</strong>, and click <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b2452152020258">Create Access Key</strong>. See <a href="#dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615">Figure 1</a>.<div class="fignone" id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"><a name="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><a name="en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><span class="figcap"><b>Figure 1 </b>Clicking Create Access Key</span><br><span><img id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_image20389043111611" src="en-us_image_0000001322088088.png"></span></div>
|
||||
<div class="p" id="dataartsstudio_01_0045__en-us_topic_0108275368_p13152215453">To obtain an access key, perform the following steps:<ol id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_ol535183018588"><li id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535103025819">Log in to the management console, move the cursor to the username in the upper right corner, and select <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b1586023610364">My Credentials</strong> from the drop-down list.</li><li id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_li173533018584">On the <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b149721128172418">My Credentials</strong> page, choose <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b15803656132414">Access Keys</strong>, and click <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b2452152020258">Create Access Key</strong>. See <a href="#dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615">Figure 1</a>.<div class="fignone" id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"><a name="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><a name="en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><span class="figcap"><b>Figure 1 </b>Clicking Create Access Key</span><br><span><img id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_image20389043111611" src="en-us_image_0000002270789428.png"></span></div>
|
||||
</li><li id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535530185815">Click <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b8340319122819">OK</strong> and save the access key file as prompted. The access key file will be saved to your browser's configured download location. Open the <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b1940852512813">credentials.csv</strong> file to view <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b191574128718">Access Key Id</strong> and <strong id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_b175769149718">Secret Access Key</strong>.<div class="note" id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_note4554158201"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_ul25541081906"><li id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_li175541819018">Only two access keys can be added for each user.</li><li id="dataartsstudio_01_0045__en-us_topic_0108275368_en-us_topic_0000001129241845_li3554138305">To ensure access key security, the access key is automatically downloaded only when it is generated for the first time and cannot be obtained from the management console later. Keep them properly.</li></ul>
|
||||
</div></div>
|
||||
</li></ol>
|
||||
</div>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.630000000000003%" headers="mcps1.3.2.2.2.4.1.3 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p28831327163911">-</p>
|
||||
<td class="cellrowborder" valign="top" width="20.630000000000003%" headers="mcps1.3.3.2.2.4.1.3 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p28831327163911">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row3886299152843"><td class="cellrowborder" valign="top" headers="mcps1.3.2.2.2.4.1.1 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p63749320152843">SK</p>
|
||||
<tr id="dataartsstudio_01_0045__en-us_topic_0108275368_row3886299152843"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.4.1.1 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p63749320152843">SK</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.2.2.2.4.1.2 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p12963499163911">-</p>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.4.1.2 "><p id="dataartsstudio_01_0045__en-us_topic_0108275368_p12963499163911">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
|
||||
@ -1,64 +1,66 @@
|
||||
<a name="dataartsstudio_01_004501"></a><a name="dataartsstudio_01_004501"></a>
|
||||
|
||||
<h1 class="topictitle1">Link to Cassandra</h1>
|
||||
<div id="body8662426">
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_004501__en-us_topic_0000001086742916_table34037531171418" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row56630393171418"><th align="left" class="cellrowborder" valign="top" width="19.18%" id="mcps1.3.1.2.4.1.1"><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p23659124171418">Parameter</p>
|
||||
<div id="body8662426"><div class="note" id="dataartsstudio_01_004501__en-us_topic_0000001086742916_note8867140110"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_en-us_topic_0108275292_p167832113185">Do not change the password or user when the job is running. If you do so, the password will not take effect immediately and the job will fail.</p>
|
||||
</div></div>
|
||||
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_004501__en-us_topic_0000001086742916_table34037531171418" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row56630393171418"><th align="left" class="cellrowborder" valign="top" width="19.18%" id="mcps1.3.2.2.4.1.1"><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p23659124171418">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="60.540000000000006%" id="mcps1.3.1.2.4.1.2"><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p37340867171418">Description</p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="60.540000000000006%" id="mcps1.3.2.2.4.1.2"><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p37340867171418">Description</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="20.28%" id="mcps1.3.1.2.4.1.3"><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p4711375171418">Example Value</p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="20.28%" id="mcps1.3.2.2.4.1.3"><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p4711375171418">Example Value</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row148131718155810"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.1.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1081471865814">Name</p>
|
||||
<tbody><tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row148131718155810"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1081471865814">Name</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.1.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.1.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1981416180585">mongodb_link</p>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1981416180585">mongodb_link</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row19710159171418"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.1.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1560893315570">Service node</p>
|
||||
<tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row19710159171418"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1560893315570">Service node</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.1.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1963014245571">An address of one node or addresses of multiple nodes. Separate addresses with semicolons (;). You are advised to configure multiple nodes at a time.</p>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1963014245571">An address of one node or addresses of multiple nodes. Separate addresses with semicolons (;). You are advised to configure multiple nodes at a time.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.1.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p639334617571">192.168.0.1;192.168.0.2</p>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p639334617571">192.168.0.1;192.168.0.2</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row11588738102344"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.1.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p94244579576">Port</p>
|
||||
<tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row11588738102344"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p94244579576">Port</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.1.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p66477930102344">Port number of the Cassandra node to be connected.</p>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p66477930102344">Port number of the Cassandra node to be connected.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.1.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p31421021155810">9042</p>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p31421021155810">9042</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row35421096102350"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.1.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p50536504102350">Username</p>
|
||||
<tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row35421096102350"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p50536504102350">Username</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.1.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p5438008102436">User name for connecting to Cassandra.</p>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p5438008102436">User name for connecting to Cassandra.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.1.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p52218594102350">cdm</p>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p52218594102350">cdm</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row21870968171418"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.1.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p26718016171418">Password</p>
|
||||
<tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row21870968171418"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p26718016171418">Password</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.1.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p5950554015418">Password for connecting to Cassandra.</p>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p5950554015418">Password for connecting to Cassandra.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.1.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p38901992114142">-</p>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p38901992114142">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row12724184313582"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.1.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p10725543105813">Connection timeout duration</p>
|
||||
<tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row12724184313582"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p10725543105813">Connection timeout duration</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.1.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1786004019351">(Optional) Displayed when you click <strong id="dataartsstudio_01_004501__en-us_topic_0000001086742916_b171971123155817">Show Advanced Attributes</strong>.</p>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1786004019351">(Optional) Displayed when you click <strong id="dataartsstudio_01_004501__en-us_topic_0000001086742916_b171971123155817">Show Advanced Attributes</strong>.</p>
|
||||
<p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p37255439586">Connection timeout interval, in seconds.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.1.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1272534355820">5</p>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1272534355820">5</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row14629948175817"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.1.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p18629134835818">Read timeout duration</p>
|
||||
<tr id="dataartsstudio_01_004501__en-us_topic_0000001086742916_row14629948175817"><td class="cellrowborder" valign="top" width="19.18%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p18629134835818">Read timeout duration</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.1.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p04959434352">(Optional) Displayed when you click <strong id="dataartsstudio_01_004501__en-us_topic_0000001086742916_b6721037105812">Show Advanced Attributes</strong>.</p>
|
||||
<td class="cellrowborder" valign="top" width="60.540000000000006%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p04959434352">(Optional) Displayed when you click <strong id="dataartsstudio_01_004501__en-us_topic_0000001086742916_b6721037105812">Show Advanced Attributes</strong>.</p>
|
||||
<p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1662944815810">Read timeout interval, in seconds. If the value is less than or equal to 0, no timeout occurs.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.1.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1662974817581">12</p>
|
||||
<td class="cellrowborder" valign="top" width="20.28%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_004501__en-us_topic_0000001086742916_p1662974817581">12</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@ -12,13 +12,17 @@
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0051.html">From Hive</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0120.html">From DLI</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0120_0.html">From DLI</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0052.html">From FTP/SFTP</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0053.html">From HTTP</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0054.html">From a Common Relational Database</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0054.html">From PostgreSQL/SQL Server</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0387.html">From DWS</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0388.html">From SAP HANA</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_1254.html">From MySQL</a></strong><br>
|
||||
</li>
|
||||
@ -36,6 +40,14 @@
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0060.html">From OpenTSDB</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0185.html">From MRS Hudi</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0286.html">From MRS ClickHouse</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0291.html">From a ShenTong Database</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dataartsstudio_01_0136.html">From Doris</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
|
||||
<div class="familylinks">
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
@ -1,61 +1,74 @@
|
||||
<a name="dataartsstudio_01_0050"></a><a name="dataartsstudio_01_0050"></a>
|
||||
|
||||
<h1 class="topictitle1">From HBase/CloudTable</h1>
|
||||
<div id="body8662426"><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p516813286351">When the source link of a job is the <a href="dataartsstudio_01_0039.html">Link to HBase</a> or <a href="dataartsstudio_01_0027.html">Link to CloudTable</a>, that is, when data is exported from MRS HBase, FusionInsight HBase, CloudTable, or Apache HBase, configure the source job parameters based on <a href="#dataartsstudio_01_0050__en-us_topic_0108275276_table5046103815165">Table 1</a>.</p>
|
||||
<div id="body8662426"><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p516813286351">If the source link of a job is an <a href="dataartsstudio_01_0039.html">HBase</a> or <a href="dataartsstudio_01_0027.html">CloudTable</a> link, that is, if data is exported from MRS HBase, FusionInsight HBase, CloudTable, or Apache HBase, configure the source job parameters based on <a href="#dataartsstudio_01_0050__en-us_topic_0108275276_table5046103815165">Table 1</a>.</p>
|
||||
<div class="note" id="dataartsstudio_01_0050__en-us_topic_0108275276_note18976163112245"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ol id="dataartsstudio_01_0050__en-us_topic_0108275276_ol12963193284516"><li id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275404_li469815359134">When you migrate data from CloudTable or HBase, CDM reads the first row of the table as an example of the field list. If the first row of data does not contain all fields of the table, you need to manually add fields.</li><li id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275404_li156983351133">Because HBase is schema-less, CDM cannot obtain the data types. If the data is stored in binary format, CDM cannot parse the data.</li></ol><ol start="3" id="dataartsstudio_01_0050__en-us_topic_0108275276_ol196211215464"><li id="dataartsstudio_01_0050__en-us_topic_0108275276_li116210284615">When data is exported from HBase or CloudTable, because HBase/CloudTable is schema-less storage systems, CDM requires that the source numeric fields be stored in regular decimal format rather than in binary format. For example, the value 100 needs to be stored as <span class="parmvalue" id="dataartsstudio_01_0050__en-us_topic_0108275276_parmvalue18659236162419"><b>100</b></span> rather than <span class="parmvalue" id="dataartsstudio_01_0050__en-us_topic_0108275276_parmvalue19660113615246"><b>01100100</b></span>.</li></ol>
|
||||
</div></div>
|
||||
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0050__en-us_topic_0108275276_table5046103815165"></a><a name="en-us_topic_0108275276_table5046103815165"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0050__en-us_topic_0108275276_table5046103815165" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row585315215165"><th align="left" class="cellrowborder" valign="top" width="16.05%" id="mcps1.3.3.2.4.1.1"><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p1626397215165">Parameter</p>
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0050__en-us_topic_0108275276_table5046103815165"></a><a name="en-us_topic_0108275276_table5046103815165"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0050__en-us_topic_0108275276_table5046103815165" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row585315215165"><th align="left" class="cellrowborder" valign="top" width="18.509999999999998%" id="mcps1.3.3.2.5.1.1"><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p10837171103918">Category</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="61.89%" id="mcps1.3.3.2.4.1.2"><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p4231334915165">Description</p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="18.86%" id="mcps1.3.3.2.5.1.2"><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p1626397215165">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="22.06%" id="mcps1.3.3.2.4.1.3"><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p482921015165">Example Value</p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="42.230000000000004%" id="mcps1.3.3.2.5.1.3"><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p4231334915165">Description</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="20.4%" id="mcps1.3.3.2.5.1.4"><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p482921015165">Example Value</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row4012116315165"><td class="cellrowborder" valign="top" width="16.05%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p2858877215165">Table Name</p>
|
||||
<tbody><tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row4012116315165"><td class="cellrowborder" rowspan="2" valign="top" width="18.509999999999998%" headers="mcps1.3.3.2.5.1.1 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p683715153917">Basic parameters</p>
|
||||
<p id="dataartsstudio_01_0050__en-us_topic_0108275276_p1983719163918"></p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.89%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p3398923015165">Name of the HBase table that data will be exported from</p>
|
||||
<td class="cellrowborder" valign="top" width="18.86%" headers="mcps1.3.3.2.5.1.2 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p2858877215165">Table Name</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="42.230000000000004%" headers="mcps1.3.3.2.5.1.3 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p3398923015165">Name of the HBase table that data will be exported from</p>
|
||||
<p id="dataartsstudio_01_0050__en-us_topic_0108275276_p1210244910548">This parameter can be configured as a macro variable of date and time and a path name can contain multiple macro variables. When the macro variable of date and time works with a scheduled job, the incremental data can be synchronized periodically. </p>
|
||||
<div class="note" id="dataartsstudio_01_0050__en-us_topic_0108275276_note1391794455811"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275319_p52974484409">If you have configured a macro variable of date and time and schedule a CDM job through <span id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275319_text1929717485405">DataArts Studio DataArts Factory</span>, the system replaces the macro variable of date and time with (<em id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275319_i2814743133910">Planned start time of the data development job</em> – <em id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275319_i118151243173917">Offset</em>) rather than (<em id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275319_i3816184313913">Actual start time of the CDM job</em> – <em id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275319_i1981664317393">Offset</em>).</p>
|
||||
</div></div>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="22.06%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p166427315165">TBL_2</p>
|
||||
<td class="cellrowborder" valign="top" width="20.4%" headers="mcps1.3.3.2.5.1.4 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p166427315165">TBL_2</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row2085795312515"><td class="cellrowborder" valign="top" width="16.05%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p9857953135118">Column Families</p>
|
||||
<tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row2085795312515"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.1 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p9857953135118">Column Families</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.89%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p168572535513">(Optional) Column families to which the exported data belongs</p>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.2 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p168572535513">(Optional) Column families to which the exported data belongs</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="22.06%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p11857175335116">CF1&CF2</p>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.3 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p11857175335116">CF1&CF2</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row68131455163415"><td class="cellrowborder" valign="top" width="16.05%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p198131455173412">Split Rowkey</p>
|
||||
<tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row68131455163415"><td class="cellrowborder" rowspan="4" valign="top" width="18.509999999999998%" headers="mcps1.3.3.2.5.1.1 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p3837512391">Advanced attributes</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.89%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p14813655143413">(Optional) Whether to split a rowkey. The default value is <span class="parmvalue" id="dataartsstudio_01_0050__en-us_topic_0108275276_parmvalue164898924418270"><b>No</b></span>.</p>
|
||||
<td class="cellrowborder" valign="top" width="18.86%" headers="mcps1.3.3.2.5.1.2 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p198131455173412">Split Rowkey</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="22.06%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p881355511346">Yes</p>
|
||||
<td class="cellrowborder" valign="top" width="42.230000000000004%" headers="mcps1.3.3.2.5.1.3 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p14813655143413">(Optional) Whether to split a rowkey. The default value is <span class="parmvalue" id="dataartsstudio_01_0050__en-us_topic_0108275276_parmvalue164898924418270"><b>No</b></span>.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="20.4%" headers="mcps1.3.3.2.5.1.4 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p881355511346">Yes</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row1431725743415"><td class="cellrowborder" valign="top" width="16.05%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p3317457133416">Rowkey Delimiter</p>
|
||||
<tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row1431725743415"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.1 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p3317457133416">Rowkey Delimiter</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.89%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p1631810574340">(Optional) Delimiter used to split a rowkey. If this parameter is left empty, the rowkey will not be split.</p>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.2 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p1631810574340">(Optional) Delimiter used to split a rowkey. If this parameter is left empty, the rowkey will not be split.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="22.06%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p15318175714341">|</p>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.3 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p15318175714341">|</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row667043895219"><td class="cellrowborder" valign="top" width="16.05%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p1967023835217">Start Time</p>
|
||||
<tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row667043895219"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.1 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p1967023835217">Start Time</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.89%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p091005834018">(Optional) <span id="dataartsstudio_01_0050__en-us_topic_0108275276_ph5654161619427">Start time (including the value) for extracting data. The format is <em id="dataartsstudio_01_0050__en-us_topic_0108275276_i38211611191413">yyyy-MM-dd HH:mm:ss</em>. Only the data generated at the specified time and later is extracted.</span></p>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.2 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p091005834018">(Optional) <span id="dataartsstudio_01_0050__en-us_topic_0108275276_ph5654161619427">Start time (including the value) for extracting data. The format is <em id="dataartsstudio_01_0050__en-us_topic_0108275276_i38211611191413">yyyy-MM-dd HH:mm:ss</em>. Only the data generated at the specified time and later is extracted.</span></p>
|
||||
<p id="dataartsstudio_01_0050__en-us_topic_0108275276_p116711580415">This parameter can be set to a macro variable of date and time. When the macro variable of date and time works with a scheduled job, the incremental data can be synchronized periodically. </p>
|
||||
<div class="note" id="dataartsstudio_01_0050__en-us_topic_0108275276_note45791757134910"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275319_p52974484409_1">If you have configured a macro variable of date and time and schedule a CDM job through <span id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275319_text1929717485405_1">DataArts Studio DataArts Factory</span>, the system replaces the macro variable of date and time with (<em id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275319_i2814743133910_1">Planned start time of the data development job</em> – <em id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275319_i118151243173917_1">Offset</em>) rather than (<em id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275319_i3816184313913_1">Actual start time of the CDM job</em> – <em id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275319_i1981664317393_1">Offset</em>).</p>
|
||||
</div></div>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="22.06%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p17670173812526">2019-01-01 20:00:00</p>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.3 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p17670173812526">2019-01-01 20:00:00</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row6700144113522"><td class="cellrowborder" valign="top" width="16.05%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p1970004165215">End Time</p>
|
||||
<tr id="dataartsstudio_01_0050__en-us_topic_0108275276_row6700144113522"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.1 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p1970004165215">End Time</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="61.89%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p2700041145210">(Optional) <span id="dataartsstudio_01_0050__en-us_topic_0108275276_ph5201142410429">End time (excluding the value) for extracting data. The format is <em id="dataartsstudio_01_0050__en-us_topic_0108275276_i1268214522145">yyyy-MM-dd HH:mm:ss</em>. Only the data generated before the time point is extracted.</span></p>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.2 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p2700041145210">(Optional) <span id="dataartsstudio_01_0050__en-us_topic_0108275276_ph5201142410429">End time (excluding the value) for extracting data. The format is <em id="dataartsstudio_01_0050__en-us_topic_0108275276_i1268214522145">yyyy-MM-dd HH:mm:ss</em>. Only the data generated before the time point is extracted.</span></p>
|
||||
<p id="dataartsstudio_01_0050__en-us_topic_0108275276_p92671211101710">This parameter can be set to a macro variable of date and time. </p>
|
||||
<div class="note" id="dataartsstudio_01_0050__en-us_topic_0108275276_note11381953104418"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275319_p52974484409_2">If you have configured a macro variable of date and time and schedule a CDM job through <span id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275319_text1929717485405_2">DataArts Studio DataArts Factory</span>, the system replaces the macro variable of date and time with (<em id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275319_i2814743133910_2">Planned start time of the data development job</em> – <em id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275319_i118151243173917_2">Offset</em>) rather than (<em id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275319_i3816184313913_2">Actual start time of the CDM job</em> – <em id="dataartsstudio_01_0050__en-us_topic_0108275276_en-us_topic_0108275319_i1981664317393_2">Offset</em>).</p>
|
||||
</div></div>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="22.06%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p17007416523">2019-02-01 20:00:00</p>
|
||||
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.5.1.3 "><p id="dataartsstudio_01_0050__en-us_topic_0108275276_p17007416523">2019-02-01 20:00:00</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
@ -1,7 +1,7 @@
|
||||
<a name="dataartsstudio_01_0053"></a><a name="dataartsstudio_01_0053"></a>
|
||||
|
||||
<h1 class="topictitle1">From HTTP</h1>
|
||||
<div id="body8662426"><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p6222841216210">When the source link of a job is the HTTP link, configure the source job parameters based on <a href="#dataartsstudio_01_0053__en-us_topic_0114711714_table5046103815165">Table 1</a>. <span id="dataartsstudio_01_0053__en-us_topic_0114711714_ph5509115455119">Currently, data can only be exported from the HTTP URLs.</span></p>
|
||||
<div id="body8662426"><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p6222841216210">If the source link of a job is an HTTP link, configure the source job parameters based on <a href="#dataartsstudio_01_0053__en-us_topic_0114711714_table5046103815165">Table 1</a>. <span id="dataartsstudio_01_0053__en-us_topic_0114711714_ph5509115455119">Currently, data can only be exported from the HTTP URLs.</span></p>
|
||||
|
||||
<div class="tablenoborder"><a name="dataartsstudio_01_0053__en-us_topic_0114711714_table5046103815165"></a><a name="en-us_topic_0114711714_table5046103815165"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0053__en-us_topic_0114711714_table5046103815165" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0053__en-us_topic_0114711714_row585315215165"><th align="left" class="cellrowborder" valign="top" width="14.531453145314533%" id="mcps1.3.2.2.4.1.1"><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p1626397215165">Parameter</p>
|
||||
</th>
|
||||
@ -16,7 +16,8 @@
|
||||
<td class="cellrowborder" valign="top" width="64.41644164416441%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p41044235294">Use the GET method to obtain data from the HTTP/HTTPS URL.</p>
|
||||
<p id="dataartsstudio_01_0053__en-us_topic_0114711714_p0123115172917">These connectors are used to read files with an HTTP/HTTPS URL, such as reading public files on the third-party object storage system and web disks.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.052105210521052%" headers="mcps1.3.2.2.4.1.3 "> </td>
|
||||
<td class="cellrowborder" valign="top" width="21.052105210521052%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p205821717567">-</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0053__en-us_topic_0114711714_row1120101174711"><td class="cellrowborder" valign="top" width="14.531453145314533%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p282108154917">Pull List File</p>
|
||||
</td>
|
||||
@ -48,9 +49,9 @@
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0053__en-us_topic_0114711714_row1497845915165"><td class="cellrowborder" valign="top" width="14.531453145314533%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p529563715165">File Format</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="64.41644164416441%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p16728112982816">CDM supports <strong id="dataartsstudio_01_0053__en-us_topic_0114711714_b842352706111710">Binary</strong> only, which indicates that files (even not in binary format) will be directly transferred.</p>
|
||||
<td class="cellrowborder" valign="top" width="64.41644164416441%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0053__p440214575817">Format used for transmitting data. The CSV and JSON formats are supported for migration to tables, and the binary format is supported for file migration.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.052105210521052%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p3753014815165">Binary</p>
|
||||
<td class="cellrowborder" valign="top" width="21.052105210521052%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0053__p3753014815165">Binary</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0053__en-us_topic_0114711714_row195259453167"><td class="cellrowborder" valign="top" width="14.531453145314533%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p5526745191614">Compression Format</p>
|
||||
@ -83,14 +84,6 @@
|
||||
<td class="cellrowborder" valign="top" width="21.052105210521052%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p143961517125716">No</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0053__en-us_topic_0114711714_row1825392374119"><td class="cellrowborder" valign="top" width="14.531453145314533%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p1273915511715">Encryption</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="64.41644164416441%" headers="mcps1.3.2.2.4.1.2 "><div class="p" id="dataartsstudio_01_0053__en-us_topic_0114711714_p943615213200">If the source data is encrypted, CDM can decrypt the data before exporting it. Select whether to decrypt the source data and select a decryption algorithm. The options are as follows:<ul id="dataartsstudio_01_0053__en-us_topic_0114711714_en-us_topic_0108275319_ul44410501486"><li id="dataartsstudio_01_0053__en-us_topic_0114711714_en-us_topic_0108275319_li193971654134816"><strong id="dataartsstudio_01_0053__en-us_topic_0114711714_en-us_topic_0108275319_b1668710442516">NONE</strong>: Export data without decrypting it.</li><li id="dataartsstudio_01_0053__en-us_topic_0114711714_en-us_topic_0108275319_li4983122011199"><strong id="dataartsstudio_01_0053__en-us_topic_0114711714_en-us_topic_0108275319_en-us_topic_0108275301_b573661743016">AES-256-GCM</strong>: The AES 256-bit encryption algorithm is used to encrypt data. Currently, only the AES-256-GCM (NoPadding) encryption algorithm is supported. This parameter is used for encryption at the migration destination and decryption at the migration source.</li></ul>
|
||||
</div>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.052105210521052%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p1173985171713">AES-256-GCM</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0053__en-us_topic_0114711714_row156119916465"><td class="cellrowborder" valign="top" width="14.531453145314533%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p131273401892">Disregard Non-existent Path or File</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="64.41644164416441%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p16127540398">If this is set to <strong id="dataartsstudio_01_0053__en-us_topic_0114711714_b3157554194315">Yes</strong>, the job can be successfully executed even if the source path does not exist.</p>
|
||||
@ -98,20 +91,6 @@
|
||||
<td class="cellrowborder" valign="top" width="21.052105210521052%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p712717406915">No</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0053__en-us_topic_0114711714_row543132624117"><td class="cellrowborder" valign="top" width="14.531453145314533%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p2560191135113">DEK</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="64.41644164416441%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p13560410513">This parameter is displayed only when <span class="parmname" id="dataartsstudio_01_0053__en-us_topic_0114711714_en-us_topic_0108275319_parmname66772555430"><b>Encryption</b></span> is set to <span class="parmvalue" id="dataartsstudio_01_0053__en-us_topic_0114711714_en-us_topic_0108275319_parmvalue13159151114411"><b>AES-256-GCM</b></span>. The key consists of 64 hexadecimal numbers and must be the same as the <span class="parmname" id="dataartsstudio_01_0053__en-us_topic_0114711714_en-us_topic_0108275319_parmname48334346128"><b>DEK</b></span> configured during encryption. If the decryption and encryption keys are inconsistent, the system does not report an exception, but the decrypted data is incorrect.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.052105210521052%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p10560111155111">DD0AE00DFECD78BF051BCFDA25BD4E320DB0A7AC75A1F3FC3D3C56A457DCDC1B</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0053__en-us_topic_0114711714_row86157268413"><td class="cellrowborder" valign="top" width="14.531453145314533%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p24773525117">IV</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="64.41644164416441%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p24771354512">This parameter is displayed only when <span class="parmname" id="dataartsstudio_01_0053__en-us_topic_0114711714_en-us_topic_0108275319_en-us_topic_0108275319_parmname966563574610"><b>Encryption</b></span> is set to <span class="parmvalue" id="dataartsstudio_01_0053__en-us_topic_0114711714_en-us_topic_0108275319_en-us_topic_0108275319_parmvalue1866643584620"><b>AES-256-GCM</b></span>. The initialization vector consists of 32 hexadecimal numbers and must be the same as the <span class="parmname" id="dataartsstudio_01_0053__en-us_topic_0114711714_en-us_topic_0108275319_en-us_topic_0108275319_parmname18666143514465"><b>IV</b></span> configured during encryption. If the initialization vectors are inconsistent, the system does not report an exception, but the decrypted data is incorrect.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="21.052105210521052%" headers="mcps1.3.2.2.4.1.3 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p647775195111">5C91687BA886EDCD12ACBC3FF19A3C3F</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dataartsstudio_01_0053__en-us_topic_0114711714_row10363922103613"><td class="cellrowborder" valign="top" width="14.531453145314533%" headers="mcps1.3.2.2.4.1.1 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p116778319321">MD5 File Extension</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="64.41644164416441%" headers="mcps1.3.2.2.4.1.2 "><p id="dataartsstudio_01_0053__en-us_topic_0114711714_p205522046409">This parameter is used to check whether the files extracted by CDM are consistent with source files. </p>
|
||||
|
||||
Some files were not shown because too many files have changed in this diff Show More
Reference in New Issue
Block a user