forked from docs/doc-exports
chenxiaoxiong
f9e2808b7c
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: chenxiaoxiong <chenxiaoxiong@huawei.com> Co-committed-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
79 lines
9.4 KiB
HTML
79 lines
9.4 KiB
HTML
<a name="dataartsstudio_01_0038"></a><a name="dataartsstudio_01_0038"></a>
|
|
|
|
<h1 class="topictitle1">DMS Kafka Link Parameters</h1>
|
|
<div id="body8662426"><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p493133413817">When connecting CDM to DMS Kafka, configure the parameters as described in <a href="#dataartsstudio_01_0038__en-us_topic_0143085538_table22075105144748">Table 1</a>.</p>
|
|
<div class="note" id="dataartsstudio_01_0038__en-us_topic_0143085538_note8867140110"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0038__en-us_topic_0143085538_en-us_topic_0108275292_p167832113185">Do not change the password or user when the job is running. If you do so, the password will not take effect immediately and the job will fail.</p>
|
|
</div></div>
|
|
|
|
<div class="tablenoborder"><a name="dataartsstudio_01_0038__en-us_topic_0143085538_table22075105144748"></a><a name="en-us_topic_0143085538_table22075105144748"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0038__en-us_topic_0143085538_table22075105144748" frame="border" border="1" rules="all"><caption><b>Table 1 </b>DMS Kafka link parameter</caption><thead align="left"><tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row19905440144748"><th align="left" class="cellrowborder" valign="top" width="20.62%" id="mcps1.3.3.2.4.1.1"><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1727937144748">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="58.19%" id="mcps1.3.3.2.4.1.2"><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p5745174144748">Description</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="21.19%" id="mcps1.3.3.2.4.1.3"><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p62705927144748">Example Value</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row11298866916"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p15298176296">Name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1369564463813">Link name, which should be defined based on the data source type, so it is easier to remember what the link is for</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p19298156493">dms_link</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row87539715534"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1375357165315">Service Type</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p147692714538">DMS Kafka edition. Currently, only the Platinum edition is available.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p2076910795316">Platinum</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row1351774015574"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p132674594583">Kafka Broker</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p55181140195712">Address of a Kafka premium instance. The format is host:port.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p17518440165713">-</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row4239164445710"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p082419415916">Kafka SASL_SSL</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p112168292347">Whether to enable SSL authentication when a client connects to a Kafka premium instance. This function must be enabled if the SASL_SSL security protocol is enabled for the link to the DMS Kafka instance.</p>
|
|
<p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1563192753418">If Kafka SASL_SSL is enabled, data will be encrypted before transmission for higher security, but performance will suffer.</p>
|
|
<div class="note" id="dataartsstudio_01_0038__en-us_topic_0143085538_note8128203721419"><span class="notetitle"> NOTE: </span><div class="notebody"><div class="p" id="dataartsstudio_01_0038__en-us_topic_0143085538_p1912916377146">When SSL authentication is enabled, Kafka continuously parses the Kafka broker connection address as a domain name, which undermines performance. You are advised to add the self-mapping of the broker connection address to the <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b1070019196334">/etc/hosts</strong> file on the ECS corresponding to the CDM cluster (search for the ECS based on the cluster IP address) so that the client can quickly resolve the broker of the instance. For example, if the Kafka broker address is 10.154.48.120, add the following self-mapping to the <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b8535222173918">/etc/hosts</strong> file:<pre class="codeblock" id="dataartsstudio_01_0038__en-us_topic_0143085538_codeblock1239483724412">10.154.48.120 10.154.48.120</pre>
|
|
</div>
|
|
</div></div>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p42402440579">Yes</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row1521465119"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p181416274499">Username</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p814182718498">Username for connecting to DMS Kafka. This parameter is displayed when <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b9583164417318">Kafka SASL_SSL</strong> is enabled.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1522641120">-</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row1831717229110"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p11141202744912">Password</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.3.2.4.1.2 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p1376018356512">Password for connecting to DMS Kafka. This parameter is displayed when <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b724513571337">Kafka SASL_SSL</strong> is enabled.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p4317522121118">-</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0038__en-us_topic_0143085538_row150769172412"><td class="cellrowborder" valign="top" width="20.62%" headers="mcps1.3.3.2.4.1.1 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p10507189102415">Kafka Properties</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="58.19%" headers="mcps1.3.3.2.4.1.2 "><ul id="dataartsstudio_01_0038__en-us_topic_0143085538_ul94385497269"><li id="dataartsstudio_01_0038__en-us_topic_0143085538_li5438949152611">If a security protocol is enabled for the link to the DMS Kafka instance, you must add a data encryption attribute, and set the attribute name to <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b362755215567">security.protocol</strong> and value to <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b84924192284">SASL_SSL</strong> or <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b18897161289">SASL_PLAINTEXT</strong> based on the security protocol of the Kafka instance.</li><li id="dataartsstudio_01_0038__en-us_topic_0143085538_li64384499262">If SASL authentication is enabled for the link to the DMS Kafka instance, you must add an authentication mode attribute, and set the attribute name to <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b18530203931913">sasl.mechanism</strong> and value to <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b17530133911918">PLAIN</strong> or <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b1353053917197">SCRAM-SHA-512</strong> based on the SASL authentication mechanism configured for the Kafka instance (set the value to either <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b145315395193">PLAIN</strong> or <strong id="dataartsstudio_01_0038__en-us_topic_0143085538_b1653111394197">SCRAM-SHA-512</strong> if both are supported).</li></ul>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.19%" headers="mcps1.3.3.2.4.1.3 "><p id="dataartsstudio_01_0038__en-us_topic_0143085538_p750712916242">-</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0157.html">Configuring Link Parameters</a></div>
|
|
</div>
|
|
</div>
|
|
|