forked from docs/doc-exports
chenxiaoxiong
f9e2808b7c
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: chenxiaoxiong <chenxiaoxiong@huawei.com> Co-committed-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
99 lines
14 KiB
HTML
99 lines
14 KiB
HTML
<a name="dataartsstudio_01_0033"></a><a name="dataartsstudio_01_0033"></a>
|
|
|
|
<h1 class="topictitle1">Kafka Link Parameters</h1>
|
|
<div id="body8662426"><div class="section" id="dataartsstudio_01_0033__en-us_topic_0108275385_section8886729122818"><h4 class="sectiontitle">MRS Kafka</h4><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p1822602317293">When connecting CDM to Kafka of MRS, configure the parameters as described in <a href="#dataartsstudio_01_0033__en-us_topic_0108275385_table3104110173020">Table 1</a>.</p>
|
|
<div class="note" id="dataartsstudio_01_0033__en-us_topic_0108275385_note8867140110"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108275292_p167832113185">Do not change the password or user when the job is running. If you do so, the password will not take effect immediately and the job will fail.</p>
|
|
</div></div>
|
|
|
|
<div class="tablenoborder"><a name="dataartsstudio_01_0033__en-us_topic_0108275385_table3104110173020"></a><a name="en-us_topic_0108275385_table3104110173020"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0033__en-us_topic_0108275385_table3104110173020" frame="border" border="1" rules="all"><caption><b>Table 1 </b>MRS Kafka link parameters</caption><thead align="left"><tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row9104908308"><th align="left" class="cellrowborder" valign="top" width="18.95%" id="mcps1.3.1.4.2.4.1.1"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p5104190113020">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="61.42999999999999%" id="mcps1.3.1.4.2.4.1.2"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p181045015309"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0065840554_b842352706191716">Description</strong></p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="19.62%" id="mcps1.3.1.4.2.4.1.3"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p810450163019"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b842352706173959">Example Value</strong></p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row1110420173014"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p1510415063017">Name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.4.2.4.1.2 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p116413181186">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p91041304307">kafka_link</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row11045013017"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p121041208302">Manager IP</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.4.2.4.1.2 "><div class="p" id="dataartsstudio_01_0033__en-us_topic_0108275385_p218148165010">Floating IP address of MRS Manager. Click <span class="uicontrol" id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108275286_uicontrol578864992012"><b>Select</b></span> next to the <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108275286_b2078834920203">Manager IP</strong> text box to select an MRS cluster. CDM automatically fills in the authentication information.<div class="note" id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108275286_note1340014473413"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108275286_en-us_topic_0182566327_p116249795810"><span id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108275286_en-us_topic_0182566327_text7355181825814">DataArts Studio</span> does not support MRS clusters whose Kerberos encryption type is <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108275286_en-us_topic_0182566327_b143479402717">aes256-sha2,aes128-sha2</strong>, and only supports MRS clusters whose Kerberos encryption type is <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108275286_en-us_topic_0182566327_b19532103219813">aes256-sha1,aes128-sha1</strong>.</p>
|
|
</div></div>
|
|
</div>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p718110815509">127.0.0.1</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row1110417013011"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p16104120163017">Username</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.4.2.4.1.2 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p141051706305">Username used for logging in to MRS Manager</p>
|
|
<div class="p" id="dataartsstudio_01_0033__en-us_topic_0108275385_p194519141759">To create a data connection for an MRS security cluster, do not use user <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b554524219105248">admin</strong>. The <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b123106598105248">admin</strong> user is the default management page user and cannot be used as the authentication user of the security cluster. You can create an MRS user and set <span class="parmname" id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_en-us_topic_0187412481_parmname3468191262313"><b>Username</b></span> and <span class="parmname" id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_en-us_topic_0187412481_parmname64683124231"><b>Password</b></span> to the username and password of the created MRS user when creating an MRS data connection.<div class="note" id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_note15451659151217"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_ul17715141011134"><li id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_li8715121031318">If the CDM cluster version is 2.9.0 or later and the MRS cluster version is 3.1.0 or later, the created user must have the permissions of the <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b8979935645">Manager_viewer</strong> role to create links on CDM. To perform operations on databases, tables, and columns of an MRS component, you also need to add the database, table, and column permissions of the MRS component to the user by following the instructions in the MRS documentation.</li><li id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_li5415103511136">If the CDM cluster version is earlier than 2.9.0 or the MRS cluster version is earlier than 3.1.0, the created user must have the permissions of <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b1088016562338">Manager_administrator</strong> or <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b1288695693319">System_administrator</strong> to create links on CDM.</li><li id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_li1733135017192">A user with only the <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b6765133911341">Manager_tenant</strong> or <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b1377216393342">Manager_auditor</strong> permission cannot create connections.</li></ul>
|
|
</div></div>
|
|
</div>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p710517023010">-</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row3105201309"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p18105507306">Password</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.4.2.4.1.2 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p71054011307">Password used for logging in to MRS Manager</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p191051703302">-</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row177699297305"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.1.4.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p310410043015">Authentication Method</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.1.4.2.4.1.2 "><div class="p" id="dataartsstudio_01_0033__en-us_topic_0108275385_p171048073013">Authentication method used for accessing MRS<ul id="dataartsstudio_01_0033__en-us_topic_0108275385_ul17104806309"><li id="dataartsstudio_01_0033__en-us_topic_0108275385_li151041006308"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b84235270611123">SIMPLE</strong>: for non-security mode</li><li id="dataartsstudio_01_0033__en-us_topic_0108275385_li11104108309"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b193121128127">KERBEROS</strong>: for security mode</li></ul>
|
|
</div>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.1.4.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p191042018308">Yes</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
<p id="dataartsstudio_01_0033__en-us_topic_0108275385_p9243914122">Click <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b141941925616">Show Advanced Attributes</strong>, and then click <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b7127311869">Add</strong> to add configuration attributes of other clients. The name and value of each attribute must be configured. You can click <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b83443253616">Delete</strong> to delete no longer used attributes.</p>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0033__en-us_topic_0108275385_section13645174115297"><h4 class="sectiontitle">Apache Kafka</h4><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p17584131395814">The Apache Kafka link is applicable to data migration of the third-party Hadoop in the local data center or ECS. You must use Direct Connect to connect to Hadoop in the local data center.</p>
|
|
<p id="dataartsstudio_01_0033__en-us_topic_0108275385_p2116754152029">When connecting CDM to Kafka of Apache Hadoop, configure the parameters as described in <a href="#dataartsstudio_01_0033__en-us_topic_0108275385_table1990636915212">Table 2</a>.</p>
|
|
|
|
<div class="tablenoborder"><a name="dataartsstudio_01_0033__en-us_topic_0108275385_table1990636915212"></a><a name="en-us_topic_0108275385_table1990636915212"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0033__en-us_topic_0108275385_table1990636915212" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Parameter description</caption><thead align="left"><tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row4257242215212"><th align="left" class="cellrowborder" valign="top" width="18.95%" id="mcps1.3.2.4.2.4.1.1"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p3100089215212"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0065840554_b84235270692541">Parameter</strong></p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="61.42999999999999%" id="mcps1.3.2.4.2.4.1.2"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p2804435515212"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b1351820074">Description</strong></p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="19.62%" id="mcps1.3.2.4.2.4.1.3"><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p5700024515212"><strong id="dataartsstudio_01_0033__en-us_topic_0108275385_b1501787170">Example Value</strong></p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row845118401045"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.2.4.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p645116401542">Name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.2.4.2.4.1.2 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.2.4.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p7451104018412">kafka_link</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0033__en-us_topic_0108275385_row4324016315212"><td class="cellrowborder" valign="top" width="18.95%" headers="mcps1.3.2.4.2.4.1.1 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p1279229115212">Kafka broker</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="61.42999999999999%" headers="mcps1.3.2.4.2.4.1.2 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p36793163165241">IP address and port number of the Kafka broker</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="19.62%" headers="mcps1.3.2.4.2.4.1.3 "><p id="dataartsstudio_01_0033__en-us_topic_0108275385_p7230798165241">192.168.1.1:9092</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
<p id="dataartsstudio_01_0033__en-us_topic_0108275385_p8119146192913">Click <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b141941925616_1">Show Advanced Attributes</strong>, and then click <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b7127311869_1">Add</strong> to add configuration attributes of other clients. The name and value of each attribute must be configured. You can click <strong id="dataartsstudio_01_0033__en-us_topic_0108275385_en-us_topic_0108618545_b83443253616_1">Delete</strong> to delete no longer used attributes.</p>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0157.html">Configuring Link Parameters</a></div>
|
|
</div>
|
|
</div>
|
|
|