yexinru/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
Files
8f01f116a5ad22cc6ad22bdf6cdc797063a2f5f1
doc-exports/docs/dataartsstudio/umn/dataartsstudio_01_0036.html
chenxiaoxiong f9e2808b7c DataArts UMN 20250810 version 
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Co-authored-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
Co-committed-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
2025-09-02 10:44:13 +00:00

150 lines
19 KiB
HTML
Raw Blame History

<a name="dataartsstudio_01_0036"></a><a name="dataartsstudio_01_0036"></a>
<h1 class="topictitle1">DLI Link Parameters</h1>
<div id="body8662426"><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p493133413817">When connecting CDM to DLI, configure the parameters as described in <a href="#dataartsstudio_01_0036__en-us_topic_0108275410_table22075105144748">Table 1</a>.</p>
<div class="note" id="dataartsstudio_01_0036__en-us_topic_0108275410_note8867140110"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_0036__en-us_topic_0108275410_ul199644331503"><li id="dataartsstudio_01_0036__en-us_topic_0108275410_li1643315369013"><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p597917371605"><a name="dataartsstudio_01_0036__en-us_topic_0108275410_li1643315369013"></a><a name="en-us_topic_0108275410_li1643315369013"></a>Do not change the password or user when the job is running. If you do so, the password will not take effect immediately and the job will fail.</p>
</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_li44855501502">When data is migrated to DLI, DLI generates data files in the <i><span class="varname" id="dataartsstudio_01_0036__en-us_topic_0108275410_varname2784340134817">dli-trans*</span></i> temporary OBS bucket. Therefore, you need to grant the user who uses the AK/SK the permissions to read and write the <i><span class="varname" id="dataartsstudio_01_0036__en-us_topic_0108275410_varname15817205441711">dli-trans*</span></i> bucket and create directories. Otherwise, the migration will fail. For details about how to add permission policies for temporary bucket <i><span class="varname" id="dataartsstudio_01_0036__en-us_topic_0108275410_varname205724401642">dli-trans*</span></i>, see <a href="#dataartsstudio_01_0036__en-us_topic_0108275410_section103343291605">Adding an Authorization Policy for the dli-trans* Temporary Bucket</a>.</li></ul>
</div></div>
<div class="tablenoborder"><a name="dataartsstudio_01_0036__en-us_topic_0108275410_table22075105144748"></a><a name="en-us_topic_0108275410_table22075105144748"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0036__en-us_topic_0108275410_table22075105144748" frame="border" border="1" rules="all"><caption><b>Table 1 </b>DLI link parameters</caption><thead align="left"><tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row19905440144748"><th align="left" class="cellrowborder" valign="top" width="19.509999999999998%" id="mcps1.3.3.2.4.1.1"><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p1727937144748">Parameter</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="58.75%" id="mcps1.3.3.2.4.1.2"><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p5745174144748">Description</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="21.740000000000002%" id="mcps1.3.3.2.4.1.3"><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p62705927144748">Example Value</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row11298866916"><td class="cellrowborder" valign="top" width="19.509999999999998%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p15298176296">Name</p>
</td>
<td class="cellrowborder" valign="top" width="58.75%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
</td>
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p19298156493">dli_link</p>
</td>
</tr>
<tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row46015358144748"><td class="cellrowborder" valign="top" width="19.509999999999998%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p31612872145433">AK</p>
</td>
<td class="cellrowborder" rowspan="2" valign="top" width="58.75%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p181471423104">AK/SK required for authentication during access to the DLI database.</p>
<p id="dataartsstudio_01_0036__en-us_topic_0108275410_p2087724103311">You need to create an access key for the current account and obtain an AK/SK pair.</p>
<ol id="dataartsstudio_01_0036__en-us_topic_0108275410_ol1361418377715"><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535103025819">Log in to the management console, move the cursor to the username in the upper right corner, and select <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b1586023610364">My Credentials</strong> from the drop-down list.</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_li173533018584">On the <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b149721128172418">My Credentials</strong> page, choose <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b15803656132414">Access Keys</strong>, and click <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b2452152020258">Create Access Key</strong>. See <a href="#dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615">Figure 1</a>.<div class="fignone" id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"><a name="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><a name="en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_fig1552229194615"></a><span class="figcap"><b>Figure 1 </b>Clicking Create Access Key</span><br><span><img id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_image20389043111611" src="en-us_image_0000002269194761.png" title="Click to enlarge" class="imgResize"></span></div>
</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_en-us_topic_0183643042_li1535530185815">Click <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b8340319122819">OK</strong> and save the access key file as prompted. The access key file will be saved to your browser's configured download location. Open the <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b1940852512813">credentials.csv</strong> file to view <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b191574128718">Access Key Id</strong> and <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_b175769149718">Secret Access Key</strong>.<div class="note" id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_note4554158201"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_ul25541081906"><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_li175541819018">Only two access keys can be added for each user.</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129241845_li3554138305">To ensure access key security, the access key is automatically downloaded only when it is generated for the first time and cannot be obtained from the management console later. Keep them properly.</li></ul>
</div></div>
</li></ol>
</td>
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p5195678145433">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row23643456144748"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p29552890145433">SK</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p32797946145433">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row12160822504"><td class="cellrowborder" valign="top" width="19.509999999999998%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p1016019285015">Project ID</p>
</td>
<td class="cellrowborder" valign="top" width="58.75%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p1637616424613">Project ID in the region where DLI resides</p>
<div class="p" id="dataartsstudio_01_0036__en-us_topic_0108275410_p1668482916813">A project is a group of tenant resources, and an account ID corresponds to the current account. The IAM ID corresponds to the current user. You can view the project IDs, account IDs, and user IDs in different regions on the corresponding pages.<ol id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_ol6260200121819"><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_li19260803185">Register with and log in to the management console.</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_li142601019186">Hover the cursor on the username in the upper right corner and select <span class="uicontrol" id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_uicontrol0260130191818"><b>My Credentials</b></span> from the drop-down list.</li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_li1026113031818">On the <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0000001129537317_b588761635018">API Credentials</strong> page, obtain the account name, account ID, IAM username, and IAM user ID, and obtain the project and its ID from the project list.</li></ol>
</div>
</td>
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p11608245019">-</p>
</td>
</tr>
<tr id="dataartsstudio_01_0036__en-us_topic_0108275410_row611720468"><td class="cellrowborder" valign="top" width="19.509999999999998%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p121279465">Batch Size</p>
</td>
<td class="cellrowborder" valign="top" width="58.75%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p202147124619">Number of rows written each time. When the number of rows written reaches the value of <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_b118611529139">Commit Size</strong>, the rows will be committed to the database.</p>
</td>
<td class="cellrowborder" valign="top" width="21.740000000000002%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0036__en-us_topic_0108275410_p1442626124619">50000</p>
</td>
</tr>
</tbody>
</table>
</div>
<div class="section" id="dataartsstudio_01_0036__en-us_topic_0108275410_section103343291605"><a name="dataartsstudio_01_0036__en-us_topic_0108275410_section103343291605"></a><a name="en-us_topic_0108275410_section103343291605"></a><h4 class="sectiontitle">Adding an Authorization Policy for the <i><span class="varname" id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_varname206618501348">dli-trans*</span></i> Temporary Bucket</h4><ol id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_ol1691979818"><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_li18291646181214"><span>Log in to the IAM console.</span></li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_li155018156819"><span>In the navigation pane, choose <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_b182211471230">Permissions</strong> &gt; <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_b0228154711312">Policies/Roles</strong> and click <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_b522814475315">Create Custom Policy</strong> in the upper right corner.</span><p><div class="fignone" id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_fig6217451719"><span class="figcap"><b>Figure 2 </b>Creating a custom policy</span><br><span><img id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_image6872564356" src="en-us_image_0000002269114785.png" title="Click to enlarge" class="imgResize"></span></div>
</p></li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_li61017525541"><span>On the <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_b109708177422">Create Custom Policy</strong> page, select <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_b1497121714219">JSON</strong> for <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_b697111712429">Policy View</strong> and create custom policy <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_b841217459568">obs</strong><strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_b19873131815578">_dli-trans</strong>.</span><p><pre class="screen" id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_screen191821233115320">{
"Version": "1.1",
"Statement": [
{
"Effect": "Allow",
"Action": [
"obs:object:GetObject",
"obs:object:DeleteObjectVersion",
"obs:bucket:GetBucketLocation",
"obs:object:GetAccessLabel",
"obs:bucket:PutEncryptionConfiguration",
"obs:bucket:PutBucketStoragePolicy",
"obs:object:DeleteAccessLabel",
"obs:bucket:PutBucketCustomDomainConfiguration",
"obs:bucket:GetLifecycleConfiguration",
"obs:bucket:PutBucketInventoryConfiguration",
"obs:bucket:DeleteDirectColdAccessConfiguration",
"obs:object:AbortMultipartUpload",
"obs:bucket:PutBucketLogging",
"obs:bucket:DeleteBucketWebsite",
"obs:object:DeleteObject",
"obs:bucket:PutBucketVersioning",
"obs:bucket:GetBucketWebsite",
"obs:bucket:GetBucketLogging",
"obs:bucket:DeleteBucketCustomDomainConfiguration",
"obs:object:PutObject",
"obs:object:RestoreObject",
"obs:bucket:PutReplicationConfiguration",
"obs:bucket:GetBucketQuota",
"obs:object:GetObjectVersionAcl",
"obs:bucket:DeleteBucket",
"obs:bucket:CreateBucket",
"obs:bucket:GetDirectColdAccessConfiguration",
"obs:bucket:PutDirectColdAccessConfiguration",
"obs:bucket:GetBucketAcl",
"obs:bucket:GetBucketVersioning",
"obs:bucket:GetBucketInventoryConfiguration",
"obs:bucket:GetBucketStoragePolicy",
"obs:bucket:GetEncryptionConfiguration",
"obs:bucket:PutBucketCORS",
"obs:bucket:PutBucketTagging",
"obs:bucket:GetBucketTagging",
"obs:bucket:PutLifecycleConfiguration",
"obs:bucket:GetBucketCustomDomainConfiguration",
"obs:object:ListMultipartUploadParts",
"obs:object:ModifyObjectMetaData",
"obs:bucket:ListBucketVersions",
"obs:bucket:PutBucketQuota",
"obs:object:PutAccessLabel",
"obs:bucket:ListBucket",
"obs:bucket:GetBucketCORS",
"obs:bucket:DeleteBucketInventoryConfiguration",
"obs:object:GetObjectVersion",
"obs:bucket:PutBucketWebsite",
"obs:bucket:DeleteReplicationConfiguration",
"obs:object:GetObjectAcl",
"obs:bucket:GetBucketNotification",
"obs:bucket:PutBucketNotification",
"obs:bucket:GetReplicationConfiguration",
"obs:bucket:GetBucketPolicy",
"obs:bucket:DeleteBucketTagging",
"obs:bucket:GetBucketStorage"
],
"Resource": [
"OBS:*:*:object:*",
"OBS:*:*:bucket:dli-trans*"
]
}
]
}</pre>
<div class="fignone" id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_fig5410103910579"><span class="figcap"><b>Figure 3 </b>Creating custom policy <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_b9531185014425">obs</strong><strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_b145311350144211">_dli-trans</strong></span><br><span><img id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_image38706532576" src="en-us_image_0000002234075564.png" title="Click to enlarge" class="imgResize"></span></div>
<p id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_p621182518916"></p>
</p></li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_li585471612815"><span>Click <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_b152221038164313">OK</strong>.</span></li><li id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_li16729115395815"><span>In the navigation pane, choose <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_b15495821124414">User Groups</strong>, locate the user group to which the DLI link user using the AK/SK belongs, and click <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_b1019945613459">Authorize</strong> to assign the custom <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_b255420451929">obs</strong><strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_b355416451029">_dli-trans</strong> policy to the user.</span><p><div class="fignone" id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_fig19120206269"><span class="figcap"><b>Figure 4 </b>Assigning the custom <strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_b1665171415620">obs</strong><strong id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_b166521416613">_dli-trans</strong> policy to a user group</span><br><span><img id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_image192471129362" src="en-us_image_0000002269114801.png" title="Click to enlarge" class="imgResize"></span></div>
<p id="dataartsstudio_01_0036__en-us_topic_0108275410_en-us_topic_0108275441_p1382093816711"></p>
</p></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0157.html">Configuring Link Parameters</a></div>
</div>
</div>
<script language="JavaScript">
<!--
initImageViewer('.imgResize');
var msg_imageMax = "view original image";
var msg_imageClose = "close";
//--></script>
View Git Blame Copy Permalink