forked from docs/doc-exports
DMS UMN 20241010 version
Reviewed-by: Mützel, Andrea <andrea.muetzel@t-systems.com> Co-authored-by: chenjunjie <chenjunjie@huawei.com> Co-committed-by: chenjunjie <chenjunjie@huawei.com>
This commit is contained in:
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
@ -13,12 +13,12 @@
|
||||
</thead>
|
||||
<tbody><tr id="TagManagement__row43636201815"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.4.2.3.1.1 "><p id="TagManagement__p336313201814">Tag key</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.4.2.3.1.2 "><ul id="TagManagement__ul133310231694"><li id="TagManagement__li833315236915">Cannot be left blank.</li><li id="TagManagement__li1733312319916">Must be unique for the same instance.</li><li id="TagManagement__li071752814194">Can contain 1 to 128 characters.</li><li id="TagManagement__li187665401268">Can contain letters, digits, spaces, and special characters _.:=+-@ : = + - @</li><li id="TagManagement__li1933311235916">Cannot start or end with a space.</li><li id="TagManagement__li10155182510220">Cannot start with <strong id="TagManagement__b20870191531115">_sys_</strong>.</li></ul>
|
||||
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.4.2.3.1.2 "><ul id="TagManagement__ul133310231694"><li id="TagManagement__li833315236915">Cannot be left blank.</li><li id="TagManagement__li1733312319916">Must be unique for the same instance.</li><li id="TagManagement__li071752814194">Can contain 1 to 128 characters.</li><li id="TagManagement__li187665401268">Can contain letters, digits, spaces, and special characters _ . : = + - @</li><li id="TagManagement__li1933311235916">Cannot start or end with a space.</li><li id="TagManagement__li10155182510220">Cannot start with <strong id="TagManagement__b20870191531115">_sys_</strong>.</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="TagManagement__row193632201781"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.4.2.3.1.1 "><p id="TagManagement__p736315201282">Tag value</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.4.2.3.1.2 "><ul id="TagManagement__ul1216717306916"><li id="TagManagement__li2279188184015">Can contain 0 to 255 characters.</li><li id="TagManagement__li1169310184412">Can contain letters, digits, spaces, and special characters _.:=+-@ : = + - @</li><li id="TagManagement__li358452535110">Cannot start or end with a space in instance creation.</li></ul>
|
||||
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.4.2.3.1.2 "><ul id="TagManagement__ul1216717306916"><li id="TagManagement__li2279188184015">Can contain 0 to 255 characters.</li><li id="TagManagement__li1169310184412">Can contain letters, digits, spaces, and special characters _ . : = + - @</li><li id="TagManagement__li358452535110">Cannot start or end with a space in instance creation.</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
Binary file not shown.
|
Before Width: | Height: | Size: 6.6 KiB |
Binary file not shown.
|
Before Width: | Height: | Size: 14 KiB |
Binary file not shown.
|
Before Width: | Height: | Size: 8.8 KiB |
Binary file not shown.
|
Before Width: | Height: | Size: 16 KiB |
Binary file not shown.
|
Before Width: | Height: | Size: 50 KiB |
Binary file not shown.
|
Before Width: | Height: | Size: 18 KiB |
BIN
docs/dms/umn/en-us_image_0000001654533317.png
Normal file
BIN
docs/dms/umn/en-us_image_0000001654533317.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 485 B |
Binary file not shown.
|
Before Width: | Height: | Size: 473 B |
Binary file not shown.
|
Before Width: | Height: | Size: 473 B |
Binary file not shown.
|
Before Width: | Height: | Size: 24 KiB |
Binary file not shown.
|
Before Width: | Height: | Size: 33 KiB |
Binary file not shown.
|
Before Width: | Height: | Size: 22 KiB |
Binary file not shown.
|
Before Width: | Height: | Size: 36 KiB |
Binary file not shown.
|
Before Width: | Height: | Size: 26 KiB |
|
Before Width: | Height: | Size: 9.3 KiB After Width: | Height: | Size: 9.3 KiB |
BIN
docs/dms/umn/en-us_image_0000002027334552.png
Normal file
BIN
docs/dms/umn/en-us_image_0000002027334552.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 43 KiB |
BIN
docs/dms/umn/en-us_image_0000002027493428.png
Normal file
BIN
docs/dms/umn/en-us_image_0000002027493428.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 36 KiB |
BIN
docs/dms/umn/en-us_image_0000002028172432.png
Normal file
BIN
docs/dms/umn/en-us_image_0000002028172432.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 23 KiB |
BIN
docs/dms/umn/en-us_image_0000002029015544.png
Normal file
BIN
docs/dms/umn/en-us_image_0000002029015544.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 53 KiB |
BIN
docs/dms/umn/en-us_image_0000002029070918.png
Normal file
BIN
docs/dms/umn/en-us_image_0000002029070918.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 36 KiB |
BIN
docs/dms/umn/en-us_image_0000002029078598.png
Normal file
BIN
docs/dms/umn/en-us_image_0000002029078598.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 16 KiB |
BIN
docs/dms/umn/en-us_image_0000002063422361.png
Normal file
BIN
docs/dms/umn/en-us_image_0000002063422361.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 23 KiB |
BIN
docs/dms/umn/en-us_image_0000002064922489.png
Normal file
BIN
docs/dms/umn/en-us_image_0000002064922489.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 12 KiB |
BIN
docs/dms/umn/en-us_image_0000002064933413.png
Normal file
BIN
docs/dms/umn/en-us_image_0000002064933413.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 5.4 KiB |
BIN
docs/dms/umn/en-us_image_0000002064945101.png
Normal file
BIN
docs/dms/umn/en-us_image_0000002064945101.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 16 KiB |
BIN
docs/dms/umn/en-us_image_0000002065020989.png
Normal file
BIN
docs/dms/umn/en-us_image_0000002065020989.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 8.9 KiB |
BIN
docs/dms/umn/en-us_image_0000002065181241.png
Normal file
BIN
docs/dms/umn/en-us_image_0000002065181241.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 21 KiB |
|
Before Width: | Height: | Size: 354 B After Width: | Height: | Size: 354 B |
|
Before Width: | Height: | Size: 587 B After Width: | Height: | Size: 587 B |
@ -5,40 +5,42 @@
|
||||
<ul id="kafka-bp-migration__ul955893365311"><li id="kafka-bp-migration__li20807548639">Migrating services to the cloud without downtime<p id="kafka-bp-migration__p23722521738"><a name="kafka-bp-migration__li20807548639"></a><a name="li20807548639"></a>Services that have high requirements on continuity must be smoothly migrated to the cloud because they cannot afford a long downtime.</p>
|
||||
</li><li id="kafka-bp-migration__li19558173316537">Re-deploying services on the cloud<p id="kafka-bp-migration__p1955853315314"><a name="kafka-bp-migration__li19558173316537"></a><a name="li19558173316537"></a>A Kafka instance deployed within an AZ is not capable of cross-AZ disaster recovery. For higher reliability, you can re-deploy services to an instance that is deployed across AZs.</p>
|
||||
</li></ul>
|
||||
<div class="section" id="kafka-bp-migration__section3209103772218"><h4 class="sectiontitle">Constraints</h4><ul id="kafka-bp-migration__ul325420218232"><li id="kafka-bp-migration__li7254521182312">When Smart Connect is used to migrate services, it consumes the source Kafka messages and produces messages to the target Kafka instance, occupying the bandwidth of the source and the target Kafka.</li><li id="kafka-bp-migration__li131181193012">To maintain performance, Smart Connect only synchronizes the source and target data in real time. The consumption progress is synchronized in batches, so the consumption progress on the source and target partitions may vary from 0 to 100.</li></ul>
|
||||
</div>
|
||||
<div class="section" id="kafka-bp-migration__section1284410782819"><h4 class="sectiontitle">Preparation</h4><ol id="kafka-bp-migration__ol12783651202016"><li id="kafka-bp-migration__li15761833132812">Configure the network environment.<p id="kafka-bp-migration__p5857104883517"><a name="kafka-bp-migration__li15761833132812"></a><a name="li15761833132812"></a>A Kafka instance can be accessed within a VPC or over a public network. For public network access, the producer and consumer must have public access permissions, and the following security group rules must be configured.</p>
|
||||
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="kafka-bp-migration__table221215285815" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Security group rules</caption><thead align="left"><tr id="kafka-bp-migration__row12120281784"><th align="left" class="cellrowborder" valign="top" width="13.211321132113211%" id="mcps1.3.3.2.1.2.2.6.1.1"><p id="kafka-bp-migration__p82125284818">Direction</p>
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="kafka-bp-migration__table221215285815" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Security group rules</caption><thead align="left"><tr id="kafka-bp-migration__row12120281784"><th align="left" class="cellrowborder" valign="top" width="13.211321132113211%" id="mcps1.3.4.2.1.2.2.6.1.1"><p id="kafka-bp-migration__p82125284818">Direction</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="15.151515151515152%" id="mcps1.3.3.2.1.2.2.6.1.2"><p id="kafka-bp-migration__p521314281811">Protocol</p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="15.151515151515152%" id="mcps1.3.4.2.1.2.2.6.1.2"><p id="kafka-bp-migration__p521314281811">Protocol</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="15.151515151515152%" id="mcps1.3.3.2.1.2.2.6.1.3"><p id="kafka-bp-migration__p1121312289817">Port</p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="15.151515151515152%" id="mcps1.3.4.2.1.2.2.6.1.3"><p id="kafka-bp-migration__p1121312289817">Port</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="18.02180218021802%" id="mcps1.3.3.2.1.2.2.6.1.4"><p id="kafka-bp-migration__p1421310286815">Source</p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="18.02180218021802%" id="mcps1.3.4.2.1.2.2.6.1.4"><p id="kafka-bp-migration__p1421310286815">Source</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="38.46384638463846%" id="mcps1.3.3.2.1.2.2.6.1.5"><p id="kafka-bp-migration__p81371838802">Description</p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="38.46384638463846%" id="mcps1.3.4.2.1.2.2.6.1.5"><p id="kafka-bp-migration__p81371838802">Description</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="kafka-bp-migration__row1421316282820"><td class="cellrowborder" valign="top" width="13.211321132113211%" headers="mcps1.3.3.2.1.2.2.6.1.1 "><p id="kafka-bp-migration__p2021319281816">Inbound</p>
|
||||
<tbody><tr id="kafka-bp-migration__row1421316282820"><td class="cellrowborder" valign="top" width="13.211321132113211%" headers="mcps1.3.4.2.1.2.2.6.1.1 "><p id="kafka-bp-migration__p2021319281816">Inbound</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="15.151515151515152%" headers="mcps1.3.3.2.1.2.2.6.1.2 "><p id="kafka-bp-migration__p1021352815816">TCP</p>
|
||||
<td class="cellrowborder" valign="top" width="15.151515151515152%" headers="mcps1.3.4.2.1.2.2.6.1.2 "><p id="kafka-bp-migration__p1021352815816">TCP</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="15.151515151515152%" headers="mcps1.3.3.2.1.2.2.6.1.3 "><p id="kafka-bp-migration__p1921320288819">9094</p>
|
||||
<td class="cellrowborder" valign="top" width="15.151515151515152%" headers="mcps1.3.4.2.1.2.2.6.1.3 "><p id="kafka-bp-migration__p1921320288819">9094</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="18.02180218021802%" headers="mcps1.3.3.2.1.2.2.6.1.4 "><p id="kafka-bp-migration__p1121316281483">0.0.0.0/0</p>
|
||||
<td class="cellrowborder" valign="top" width="18.02180218021802%" headers="mcps1.3.4.2.1.2.2.6.1.4 "><p id="kafka-bp-migration__p1121316281483">0.0.0.0/0</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="38.46384638463846%" headers="mcps1.3.3.2.1.2.2.6.1.5 "><p id="kafka-bp-migration__p151381038801">Accessing a Kafka instance in a public network (in plaintext)</p>
|
||||
<td class="cellrowborder" valign="top" width="38.46384638463846%" headers="mcps1.3.4.2.1.2.2.6.1.5 "><p id="kafka-bp-migration__p151381038801">Accessing a Kafka instance in a public network (in plaintext)</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="kafka-bp-migration__row131381384015"><td class="cellrowborder" valign="top" width="13.211321132113211%" headers="mcps1.3.3.2.1.2.2.6.1.1 "><p id="kafka-bp-migration__p2138123810010">Inbound</p>
|
||||
<tr id="kafka-bp-migration__row131381384015"><td class="cellrowborder" valign="top" width="13.211321132113211%" headers="mcps1.3.4.2.1.2.2.6.1.1 "><p id="kafka-bp-migration__p2138123810010">Inbound</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="15.151515151515152%" headers="mcps1.3.3.2.1.2.2.6.1.2 "><p id="kafka-bp-migration__p3138538509">TCP</p>
|
||||
<td class="cellrowborder" valign="top" width="15.151515151515152%" headers="mcps1.3.4.2.1.2.2.6.1.2 "><p id="kafka-bp-migration__p3138538509">TCP</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="15.151515151515152%" headers="mcps1.3.3.2.1.2.2.6.1.3 "><p id="kafka-bp-migration__p21387381002">9095</p>
|
||||
<td class="cellrowborder" valign="top" width="15.151515151515152%" headers="mcps1.3.4.2.1.2.2.6.1.3 "><p id="kafka-bp-migration__p21387381002">9095</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="18.02180218021802%" headers="mcps1.3.3.2.1.2.2.6.1.4 "><p id="kafka-bp-migration__p151384381409">0.0.0.0/0</p>
|
||||
<td class="cellrowborder" valign="top" width="18.02180218021802%" headers="mcps1.3.4.2.1.2.2.6.1.4 "><p id="kafka-bp-migration__p151384381409">0.0.0.0/0</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="38.46384638463846%" headers="mcps1.3.3.2.1.2.2.6.1.5 "><p id="kafka-bp-migration__p1345124955213">Accessing a Kafka instance in a public network (in ciphertext)</p>
|
||||
<td class="cellrowborder" valign="top" width="38.46384638463846%" headers="mcps1.3.4.2.1.2.2.6.1.5 "><p id="kafka-bp-migration__p1345124955213">Accessing a Kafka instance in a public network (in ciphertext)</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
@ -49,19 +51,19 @@
|
||||
</li></ol>
|
||||
</div>
|
||||
<div class="section" id="kafka-bp-migration__section66351235101020"><h4 class="sectiontitle">Migration Scheme 1: Migrating the Production First</h4><p id="kafka-bp-migration__p132040473113">Migrate the message production service to the new Kafka instance. After migration, the original Kafka instance will no longer produce messages. After all messages of the original Kafka instance are consumed, migrate the message consumption service to the new Kafka instance to consume messages of this instance.</p>
|
||||
<p id="kafka-bp-migration__p1676071901716">This is a common migration scheme. It is simple and easy to control on the service side. During the migration, the message sequence is ensured, so this scheme is <strong id="kafka-bp-migration__b14859155612147">suitable for scenarios with strict requirements on the message sequence</strong>. However, latency may occur because there is a period when you have to wait for all data to be consumed.</p>
|
||||
<ol id="kafka-bp-migration__ol102566315910"><li id="kafka-bp-migration__li125618316592"><span>Change the Kafka connection address of the producer to that of the new Kafka instance.</span></li><li id="kafka-bp-migration__li625673175912"><span>Restart the production service so that the producer can send new messages to the new Kafka instance.</span></li><li id="kafka-bp-migration__li1925613325914"><a name="kafka-bp-migration__li1925613325914"></a><a name="li1925613325914"></a><span>Check the consumption progress of each consumer group in the original Kafka instance until all data in the original Kafka instance is consumed.</span></li><li id="kafka-bp-migration__li82565385913"><span>Change the Kafka connection addresses of the consumers to those of the new Kafka instance.</span></li><li id="kafka-bp-migration__li13256133185917"><span>Restart the consumption service so that consumers can consume messages from the new Kafka instance.</span></li><li id="kafka-bp-migration__li12561138598"><span>Check whether consumers consume messages properly from the new Kafka instance.</span></li><li id="kafka-bp-migration__li1325673145918"><span>The migration is complete.</span></li></ol>
|
||||
<p id="kafka-bp-migration__p1456915924519">This is a common migration scheme. It is simple and easy to control on the service side. During the migration, the message sequence is ensured, so this scheme is <strong id="kafka-bp-migration__b167441119142616">suitable for scenarios with strict requirements on the message sequence</strong>. However, latency may occur because there is a period when you have to wait for all data to be consumed.</p>
|
||||
</div>
|
||||
<div class="section" id="kafka-bp-migration__section163553541014"><h4 class="sectiontitle">Migration Scheme 2: Migrating the Production Later</h4><p id="kafka-bp-migration__p10292175955518">Use multiple consumers for the consumption service. Some consume messages from the original Kafka instance, and others consume messages from the new Kafka instances. Then, migrate the production service to the new Kafka instance so that all messages can be consumed in time.</p>
|
||||
<p id="kafka-bp-migration__p11914729171817">For a certain period of time, the consumption service consumes messages from both the original and new Kafka instances. Before the migration, message consumption from the new Kafka instance has already started, so there is no latency. However, early on in the migration, data is consumed from both the original and new Kafka instances, so the messages may not be consumed in the order that they are produced. This scheme is <strong id="kafka-bp-migration__b166211273158">suitable for services that require low latency but do not require strict message sequence</strong>.</p>
|
||||
<ol id="kafka-bp-migration__ol240126202"><li id="kafka-bp-migration__li1741142611015"><span>Start new consumer clients, set the Kafka connection addresses to that of the new Kafka instance, and consume data from the new Kafka instance.</span><p><div class="note" id="kafka-bp-migration__note18111437128"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="kafka-bp-migration__p121143715219">Original consumer clients must continue running. Messages are consumed from both the original and new Kafka instances.</p>
|
||||
</div></div>
|
||||
</p></li><li id="kafka-bp-migration__li34113261704"><span>Change the Kafka connection address of the producer to that of the new Kafka instance.</span></li><li id="kafka-bp-migration__li3417261805"><span>Restart the producer client to migrate the production service to the new Kafka instance.</span></li><li id="kafka-bp-migration__li141826403"><span>After the production service is migrated, check whether the consumption service connected to the new Kafka instance is normal.</span></li><li id="kafka-bp-migration__li134116261701"><span>After all data in the original Kafka is consumed, close the original consumption clients.</span></li><li id="kafka-bp-migration__li9418265012"><span>The migration is complete.</span></li></ol>
|
||||
<p id="kafka-bp-migration__p383015239103">In this scheme, the migration process is controlled by services. For a certain period of time, the consumption service consumes messages from both the original and new Kafka instances. Before the migration, message consumption from the new Kafka instance has already started, so there is no latency. However, early on in the migration, data is consumed from both the original and new Kafka instances, so the messages may not be consumed in the order that they are produced. This scheme is <strong id="kafka-bp-migration__b69670112920">suitable for services that require low latency but do not require strict message sequence</strong>.</p>
|
||||
</div>
|
||||
<div class="section" id="kafka-bp-migration__section20636193514107"><h4 class="sectiontitle">Migration Scheme 3: Migrating the Consumption First</h4><p id="kafka-bp-migration__p1678612717184">Use Smart Connect to synchronize the two Kafka instances, migrate the consumer first and then the producer to the new Kafka instance.</p>
|
||||
<p id="kafka-bp-migration__p768122111202">This scheme uses Smart Connect to synchronize the source and target data in real time. However, the consumption progress is synchronized in batches. The consumption progress on the source and target partition may vary from 0 to 100. As a result, some messages are repeatedly consumed. This scheme applies to services where the message production must continue, end-to-end latency must be low, and repeated consumption can be tolerated.</p>
|
||||
<ol id="kafka-bp-migration__ol989251919189"><li id="kafka-bp-migration__li198921919131816"><span>Create a Smart Connect task for Kafka data replication. For details, see <a href="kafka-ug-0034.html">Replicating Kafka Instance Data</a>.</span></li><li id="kafka-bp-migration__li1947982952418"><span>On the <strong id="kafka-bp-migration__b48881092308">Message Query</strong> page of the Kafka console, check whether the latest messages and the synchronization progress of both Kafka instances are consistent. For details, see <a href="kafka-ug-190904001.html">Viewing Kafka Messages</a>.</span><p><ul id="kafka-bp-migration__ul8371183742315"><li id="kafka-bp-migration__li133710373231">Yes: Go to <a href="#kafka-bp-migration__li1925613325914">3</a>.</li><li id="kafka-bp-migration__li0305124915232">No: Check whether the synchronized data per minute of both Kafka instances is normal. If yes, wait for the synchronization progress of both Kafka instances to be consistent, then go to <a href="#kafka-bp-migration__li1925613325914">3</a>.</li></ul>
|
||||
</p></li><li id="kafka-bp-migration__li1388980192810"><span>Change the Kafka connection addresses of the consumers to those of the new Kafka instance.</span></li><li id="kafka-bp-migration__li11889130152814"><span>Restart the consumption service so that consumers can consume messages from the new Kafka instance.</span></li><li id="kafka-bp-migration__li754993211278"><span>Check whether consumers consume messages properly from the new Kafka instance.</span></li><li id="kafka-bp-migration__li412301715295"><span>Change the Kafka connection address of the producer to that of the new Kafka instance.</span></li><li id="kafka-bp-migration__li10347184972910"><span>Restart the producer client to migrate the production service to the new Kafka instance.</span></li><li id="kafka-bp-migration__li853892113308"><span>After the production service is migrated, check whether the consumption service connected to the new Kafka instance is normal.</span></li><li id="kafka-bp-migration__li49330113516"><span>The migration is complete.</span></li></ol>
|
||||
<p id="kafka-bp-migration__p1182384111146">This scheme uses Smart Connect to synchronize the source and target data in real time. However, the consumption progress is synchronized in batches. The consumption progress on the source and target partition may vary from 0 to 100. As a result, some messages are repeatedly consumed. This scheme applies to services where the message production must continue, end-to-end latency must be low, and repeated consumption can be tolerated.</p>
|
||||
</div>
|
||||
<div class="section" id="kafka-bp-migration__section118231336159"><h4 class="sectiontitle">How Do I Migrate Persisted Data Along with Services?</h4><p id="kafka-bp-migration__p1255416262446">You can migrate consumed data from the original instance to a new instance by using Smart Connect. This tool mirrors the original Kafka producer and consumer into new ones and migrates data to the new Kafka instance. For details, see <a href="kafka-ug-0034.html">Replicating Kafka Instance Data</a>.</p>
|
||||
<p id="kafka-bp-migration__p16312115832318">Note that each cloud Kafka instance stores data in three replicas. Therefore, the storage space of the new instance should be three times that of the original single-replica message storage.</p>
|
||||
|
||||
@ -8,7 +8,7 @@
|
||||
</div>
|
||||
<div class="section" id="kafka-dnat__section124115445717"><h4 class="sectiontitle">Step 1: Obtain Information About the Kafka Instance</h4><ol id="kafka-dnat__ol667514716913"><li id="kafka-dnat__li10427115412419"><span>Log in to the console.</span></li><li id="kafka-dnat__li14905725134512"><span>Click <span><img id="kafka-dnat__image1337542211106" src="en-us_image_0143929918.png"></span> in the upper left corner to select a region.</span><p><div class="note" id="kafka-dnat__note596412409275"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="kafka-dnat__p11964174020277">Select the region where your Kafka instance is located.</p>
|
||||
</div></div>
|
||||
</p></li><li id="kafka-dnat__li296363971814"><span>Click <strong id="kafka-dnat__b112249313195654">Service List</strong> and choose <strong id="kafka-dnat__b80900414195654">Application</strong> > <strong id="kafka-dnat__b79452334595654">Distributed Message Service</strong>. The Kafka instance list is displayed.</span></li><li id="kafka-dnat__li1933311013310"><span>Click the desired Kafka instance to view its details.</span></li><li id="kafka-dnat__li122701357121013"><a name="kafka-dnat__li122701357121013"></a><a name="li122701357121013"></a><span>In the <strong id="kafka-dnat__b115501449105610">Connection</strong> area on the <strong id="kafka-dnat__b1590151577">Basic Information</strong> tab page, view and record the private network access addresses of the Kafka instance. In the <strong id="kafka-dnat__b1694527155816">Network</strong> area, view and record the VPC and subnet where the Kafka instance is located.</span><p><div class="fignone" id="kafka-dnat__fig151109411894"><span class="figcap"><b>Figure 1 </b>Kafka instance information</span><br><span><img id="kafka-dnat__image17455915189" src="en-us_image_0000001803492553.png"></span></div>
|
||||
</p></li><li id="kafka-dnat__li296363971814"><span>Click <strong id="kafka-dnat__b112249313195654">Service List</strong> and choose <strong id="kafka-dnat__b80900414195654">Application</strong> > <strong id="kafka-dnat__b79452334595654">Distributed Message Service</strong>. The Kafka instance list is displayed.</span></li><li id="kafka-dnat__li1933311013310"><span>Click the desired Kafka instance to view its details.</span></li><li id="kafka-dnat__li122701357121013"><a name="kafka-dnat__li122701357121013"></a><a name="li122701357121013"></a><span>In the <strong id="kafka-dnat__b115501449105610">Connection</strong> area on the <strong id="kafka-dnat__b1590151577">Basic Information</strong> tab page, view and record the private network access addresses of the Kafka instance. In the <strong id="kafka-dnat__b1694527155816">Network</strong> area, view and record the VPC and subnet where the Kafka instance is located.</span><p><div class="fignone" id="kafka-dnat__fig151109411894"><span class="figcap"><b>Figure 1 </b>Kafka instance information</span><br><span><img id="kafka-dnat__image29782016164116" src="en-us_image_0000002029070918.png"></span></div>
|
||||
</p></li></ol>
|
||||
</div>
|
||||
<div class="section" id="kafka-dnat__section1978616273411"><h4 class="sectiontitle">Step 2: Create a Public NAT Gateway</h4><ol id="kafka-dnat__ol3501123519425"><li id="kafka-dnat__li1957691705312"><span>Click <strong id="kafka-dnat__b122081736155919">Service List</strong> and choose <strong id="kafka-dnat__b193951538165913">Network</strong> > <strong id="kafka-dnat__b927844065913">NAT Gateway</strong>.</span></li><li id="kafka-dnat__li28081940204316"><span>Click <strong id="kafka-dnat__b1721018511592">Create Public NAT Gateway</strong>.</span></li><li id="kafka-dnat__li16120183014016"><span>Set the following parameters:</span><p><ul id="kafka-dnat__ul1635420195413"><li id="kafka-dnat__li17354619749"><strong id="kafka-dnat__b16088560271412">Region</strong>: Select the region that the Kafka instance is in.</li><li id="kafka-dnat__li119702211761"><strong id="kafka-dnat__b16495154642716">Name</strong>: Enter a name for the public NAT gateway.</li><li id="kafka-dnat__li1993217546714"><strong id="kafka-dnat__b13966656102720">VPC</strong>: Select the VPC recorded in <a href="#kafka-dnat__li122701357121013">5</a>.</li><li id="kafka-dnat__li11533071682"><strong id="kafka-dnat__b13833177132817">Subnet</strong>: Select the subnet recorded in <a href="#kafka-dnat__li122701357121013">5</a>.</li></ul>
|
||||
@ -24,7 +24,7 @@
|
||||
</p></li><li id="kafka-dnat__li183907943516"><span>Create DNAT rules for other private network addresses of the Kafka instance recorded in <a href="#kafka-dnat__li122701357121013">5</a>. <strong id="kafka-dnat__b1172611241982">Configure a unique EIP for each DNAT rule.</strong></span><p><p id="kafka-dnat__p1944471016354">For details about how to create a DNAT rule, see <a href="#kafka-dnat__li2872030202015">2</a> to <a href="#kafka-dnat__li295532675915">4</a>.</p>
|
||||
</p></li><li id="kafka-dnat__li1062193864112"><a name="kafka-dnat__li1062193864112"></a><a name="li1062193864112"></a><span>After all DNAT rules are created, click the <strong id="kafka-dnat__b31657489369">DNAT Rules</strong> tab to view the created DNAT rules and record the EIPs corresponding to the private IP addresses.</span></li></ol>
|
||||
</div>
|
||||
<div class="section" id="kafka-dnat__section1937716142915"><h4 class="sectiontitle">Step 4: Map EIPs to the Port 9011 of Private IP Addresses</h4><ol id="kafka-dnat__ol194925410487"><li id="kafka-dnat__li5884135811429"><span>Click <strong id="kafka-dnat__b6016345795654">Service List</strong> and choose <strong id="kafka-dnat__b88010161395654">Application</strong> > <strong id="kafka-dnat__b17632873995654">Distributed Message Service</strong>. The Kafka instance list is displayed.</span></li><li id="kafka-dnat__li742112394811"><span>Click the desired Kafka instance to view its details.</span></li><li id="kafka-dnat__li319117501325"><span>In the <strong id="kafka-dnat__b12591145315012">Advanced Settings</strong> section on the <strong id="kafka-dnat__b165917531009">Basic Information</strong> tab page, click <strong id="kafka-dnat__b8591353202">Modify</strong> next to <strong id="kafka-dnat__b75911653803">Cross-VPC Access</strong>.</span></li><li id="kafka-dnat__li11450213708"><span>Change the values of <strong id="kafka-dnat__b828373793819">advertised.listeners IP Address/Domain Name</strong> to the EIPs in the DNAT rules. Ensure that the mapping between the private network addresses and the EIPs is consistent with that recorded in <a href="#kafka-dnat__li1062193864112">6</a>. Then click <strong id="kafka-dnat__b7580159203815">Save</strong>.</span><p><div class="fignone" id="kafka-dnat__fig15689320154314"><a name="kafka-dnat__fig15689320154314"></a><a name="fig15689320154314"></a><span class="figcap"><b>Figure 5 </b>Changing the advertised.listeners IP address (for DNAT access)</span><br><span><img id="kafka-dnat__image1968919207433" src="en-us_image_0000001329138322.png"></span></div>
|
||||
<div class="section" id="kafka-dnat__section1937716142915"><h4 class="sectiontitle">Step 4: Map EIPs to the Port 9011 of Private IP Addresses</h4><ol id="kafka-dnat__ol194925410487"><li id="kafka-dnat__li5884135811429"><span>Click <strong id="kafka-dnat__b6016345795654">Service List</strong> and choose <strong id="kafka-dnat__b88010161395654">Application</strong> > <strong id="kafka-dnat__b17632873995654">Distributed Message Service</strong>. The Kafka instance list is displayed.</span></li><li id="kafka-dnat__li742112394811"><span>Click the desired Kafka instance to view its details.</span></li><li id="kafka-dnat__li319117501325"><span>In the <strong id="kafka-dnat__b12591145315012">Advanced Settings</strong> section on the <strong id="kafka-dnat__b165917531009">Basic Information</strong> tab page, click <strong id="kafka-dnat__b8591353202">Modify</strong> next to <strong id="kafka-dnat__b75911653803">Cross-VPC Access</strong>.</span></li><li id="kafka-dnat__li11450213708"><span>Change the values of <strong id="kafka-dnat__b828373793819">advertised.listeners IP Address/Domain Name</strong> to the EIPs in the DNAT rules. Ensure that the mapping between the private network addresses and the EIPs is consistent with that recorded in <a href="#kafka-dnat__li1062193864112">6</a>. Then click <strong id="kafka-dnat__b7580159203815">Save</strong>.</span><p><div class="fignone" id="kafka-dnat__fig15689320154314"><a name="kafka-dnat__fig15689320154314"></a><a name="fig15689320154314"></a><span class="figcap"><b>Figure 5 </b>Changing the advertised.listeners IP address (for DNAT access)</span><br><span><img id="kafka-dnat__image149814191477" src="en-us_image_0000002029078598.png"></span></div>
|
||||
</p></li></ol>
|
||||
</div>
|
||||
<div class="section" id="kafka-dnat__section72114271643"><h4 class="sectiontitle">Step 5: Verify Connectivity</h4><p id="kafka-dnat__p2063111531619">Check whether messages can be created and retrieved by referring to <a href="kafka-ug-180604020.html">Connecting to Kafka Using the Client (Plaintext Access)</a> or <a href="kafka-ug-180801001.html">Connecting to Kafka Using the Client (Ciphertext Access)</a>.</p>
|
||||
|
||||
@ -2,7 +2,7 @@
|
||||
|
||||
<h1 class="topictitle1">How Do I Increase the Partition Quantity?</h1>
|
||||
<div id="body1598670216256"><p id="kafka-faq-0005__p8934179194916">You can increase the partition quantity by adding brokers.</p>
|
||||
<p id="kafka-faq-0005__p109345984919">To do so, go to the Kafka console, locate the row that contains the desired instance, and choose <strong id="kafka-faq-0005__b3119158141916">More</strong> > <strong id="kafka-faq-0005__b91203582192">Modify Specifications</strong>. On the page that is displayed, add brokers as required. For details, see <a href="kafka-ug-181221001.html">Modifying Instance Specifications</a>.</p>
|
||||
<p id="kafka-faq-0005__p109345984919">To do so, go to the Kafka console, locate the row that contains the desired instance, and choose <strong id="kafka-faq-0005__b3119158141916">More</strong> > <strong id="kafka-faq-0005__b91203582192">Modify Specifications</strong>. On the page that is displayed, add brokers as required. For details, see <a href="kafka-ug-181221001.html">Modifying Kafka Instance Specifications</a>.</p>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
|
||||
@ -5,7 +5,7 @@
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="kafka-faq-191030003.html">Topics and Partitions</a></div>
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="kafka-faq-200423001.html">Consumer Groups</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
@ -59,16 +59,6 @@
|
||||
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.3.1.2 "><p id="kafka-faq-0033__p554291918919">2000</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="kafka-faq-0033__row1769129182013"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.3.1.1 "><p id="kafka-faq-0033__p129651125181920">kafka.2u4g.cluster.beta</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.3.1.2 "><p id="kafka-faq-0033__p1596542551918">2000</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="kafka-faq-0033__row217671722017"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.3.1.1 "><p id="kafka-faq-0033__p8176117102012">kafka.4u8g.cluster.beta</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.3.1.2 "><p id="kafka-faq-0033__p117720174208">4000</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="kafka-faq-0033__row65421619596"><td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.3.1.1 "><p id="kafka-faq-0033__p115421719394">kafka.4u8g.cluster</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.3.2.3.1.2 "><p id="kafka-faq-0033__p1054214193914">4000</p>
|
||||
|
||||
@ -2,8 +2,8 @@
|
||||
|
||||
<h1 class="topictitle1">How Do I View the Number of Accumulated Messages?</h1>
|
||||
<div id="body0000001181826821"><p id="kafka-faq-0041__p112522472014">View the number of accumulated messages using any of the following methods:</p>
|
||||
<ul id="kafka-faq-0041__ul1657019511234"><li id="kafka-faq-0041__li11570185132316">On the <strong id="kafka-faq-0041__b499124111440">Consumer Groups</strong> page of an instance, click the name of the consumer group whose accumulated messages are to be viewed. The consumer group details page is displayed. On the <strong id="kafka-faq-0041__b1917019202457">Consumer Offset</strong> tab page, view the number of messages accumulated in each topic of your target consumer group. For details, see <a href="kafka_ug_0021.html">Querying Consumer Group Details</a>.</li><li id="kafka-faq-0041__li26102327574">On the <strong id="kafka-faq-0041__b45722427480">Monitoring</strong> tab page of an instance, click the <strong id="kafka-faq-0041__b679914312497">By Consumer Group</strong> tab. Select the desired consumer group for <strong id="kafka-faq-0041__b194991033184918">Consumer Group</strong> and <strong id="kafka-faq-0041__b1569817593497">All topics</strong> for <strong id="kafka-faq-0041__b0386184185010">Topic</strong>. The <strong id="kafka-faq-0041__b1910192318528">Consumer Available Messages</strong> metric reflects the number of messages accumulated in all topics of this consumer group. For details about viewing the monitoring data, see <a href="kafka-ug-190605001.html">Viewing Metrics</a>.</li><li id="kafka-faq-0041__li20593381704">On the <strong id="kafka-faq-0041__b2824949165211">Consumer Groups</strong> tab page of the Cloud Eye console, click the <strong id="kafka-faq-0041__b1082494985210">By Consumer Group</strong> tab. Select the desired consumer group for <strong id="kafka-faq-0041__b1682417498528">Consumer Group</strong> and <strong id="kafka-faq-0041__b108251249145219">All topics</strong> for <strong id="kafka-faq-0041__b11825249165211">Topic</strong>. The <strong id="kafka-faq-0041__b4825104910529">Consumer Available Messages</strong> metric reflects the number of messages accumulated in all topics of this consumer group. For details about viewing the monitoring data, see <a href="kafka-ug-190605001.html">Viewing Metrics</a>.</li><li id="kafka-faq-0041__li589275520402">In the <strong id="kafka-faq-0041__b168614112118">/bin</strong> directory on the <a href="https://cwiki.apache.org/confluence/display/KAFKA/Clients" target="_blank" rel="noopener noreferrer">Kafka client</a>, run command <strong id="kafka-faq-0041__b102956215204">kafka-consumer-groups.sh --bootstrap-server $<em id="kafka-faq-0041__i162742719229">{connection-address}</em> --describe --group $<em id="kafka-faq-0041__i73992011192212">{consumer-group-name}</em></strong> to check number of accumulated messages of each topic in a consumer group. <strong id="kafka-faq-0041__b13303137155517">LAG</strong> indicates the total number of messages accumulated in each topic.<div class="fignone" id="kafka-faq-0041__fig158441312131415"><span class="figcap"><b>Figure 1 </b>Viewing the total number of messages accumulated in each topic</span><br><span><img id="kafka-faq-0041__image188441312201411" src="en-us_image_0000001435265813.png"></span></div>
|
||||
<div class="note" id="kafka-faq-0041__note1457918331113"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="kafka-faq-0041__p135791733101111">If SASL authentication is enabled for the Kafka instance, the <strong id="kafka-faq-0041__b11865588534">--command-config <em id="kafka-faq-0041__i17861585532">{SASL authentication configuration file consumer.properties}</em></strong> parameter must be added to the preceding command. For details about the configuration file <strong id="kafka-faq-0041__b1687205820532">consumer.properties</strong>, see the CLI access instructions provided in <a href="kafka-ug-180801001.html">Accessing a Kafka Instance with SASL</a>.</p>
|
||||
<ul id="kafka-faq-0041__ul1657019511234"><li id="kafka-faq-0041__li11570185132316">On the <strong id="kafka-faq-0041__b499124111440">Consumer Groups</strong> page of an instance, click the name of the consumer group whose accumulated messages are to be viewed. The consumer group details page is displayed. On the <strong id="kafka-faq-0041__b1917019202457">Consumer Offset</strong> tab page, view the number of messages accumulated in each topic of your target consumer group. For details, see <a href="kafka-ug-0014.html">Viewing Consumer Offsets</a>.</li><li id="kafka-faq-0041__li26102327574">On the <strong id="kafka-faq-0041__b11827104364415">Monitoring</strong> tab page of an instance, click the <strong id="kafka-faq-0041__b5827194334412">By Consumer Group</strong> tab. Select the desired consumer group for <strong id="kafka-faq-0041__b0827104374412">Consumer Group</strong> and <strong id="kafka-faq-0041__b482744319443">All topics</strong> for <strong id="kafka-faq-0041__b158271543114415">Topic</strong>. The <strong id="kafka-faq-0041__b58274435449">Consumer Available Messages</strong> metric reflects the number of messages accumulated in all topics of this consumer group. For details about viewing the monitoring data, see <a href="kafka-ug-190605001.html">Viewing Kafka Metrics</a>.</li><li id="kafka-faq-0041__li20593381704">On the <strong id="kafka-faq-0041__b2824949165211">Consumer Groups</strong> tab page of the Cloud Eye console, click the <strong id="kafka-faq-0041__b1082494985210">By Consumer Group</strong> tab. Select the desired consumer group for <strong id="kafka-faq-0041__b1682417498528">Consumer Group</strong> and <strong id="kafka-faq-0041__b108251249145219">All topics</strong> for <strong id="kafka-faq-0041__b11825249165211">Topic</strong>. The <strong id="kafka-faq-0041__b4825104910529">Consumer Available Messages</strong> metric reflects the number of messages accumulated in all topics of this consumer group. For details about viewing the monitoring data, see <a href="kafka-ug-190605001.html">Viewing Kafka Metrics</a>.</li><li id="kafka-faq-0041__li589275520402">In the <strong id="kafka-faq-0041__b168614112118">/bin</strong> directory on the <a href="https://cwiki.apache.org/confluence/display/KAFKA/Clients" target="_blank" rel="noopener noreferrer">Kafka client</a>, run command <strong id="kafka-faq-0041__b102956215204">kafka-consumer-groups.sh --bootstrap-server $<em id="kafka-faq-0041__i162742719229">{connection-address}</em> --describe --group $<em id="kafka-faq-0041__i73992011192212">{consumer-group-name}</em></strong> to check number of accumulated messages of each topic in a consumer group. <strong id="kafka-faq-0041__b13303137155517">LAG</strong> indicates the total number of messages accumulated in each topic.<div class="fignone" id="kafka-faq-0041__fig158441312131415"><span class="figcap"><b>Figure 1 </b>Viewing the total number of messages accumulated in each topic</span><br><span><img id="kafka-faq-0041__image188441312201411" src="en-us_image_0000001435265813.png"></span></div>
|
||||
<div class="note" id="kafka-faq-0041__note1457918331113"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="kafka-faq-0041__p135791733101111">If SASL authentication is enabled for the Kafka instance, the <strong id="kafka-faq-0041__b3510834194511">--command-config <em id="kafka-faq-0041__i185101934184518">{SASL authentication configuration file consumer.properties}</em></strong> parameter must be added to the preceding commands. For details about the configuration file <strong id="kafka-faq-0041__b3510334184516">consumer.properties</strong>, see the CLI access instructions provided in <a href="kafka-ug-180801001.html">Connecting to Kafka Using the Client (Ciphertext Access)</a>.</p>
|
||||
</div></div>
|
||||
</li></ul>
|
||||
</div>
|
||||
|
||||
@ -2,7 +2,7 @@
|
||||
|
||||
<h1 class="topictitle1">Will a Consumer Group Without Active Consumers Be Automatically Deleted in 14 Days?</h1>
|
||||
<div id="body0000001254716933"><p id="kafka-faq-0043__p093314113619">This depends on the <strong id="kafka-faq-0043__b153191322102314">offsets.retention.minutes</strong> and <strong id="kafka-faq-0043__b18841236123716">auto.create.groups.enable</strong> parameters.</p>
|
||||
<ul id="kafka-faq-0043__ul64371941143718"><li id="kafka-faq-0043__li74411242387">For instances created much earlier, <strong id="kafka-faq-0043__b1441122790">auto.create.groups.enable</strong> is set to <strong id="kafka-faq-0043__b1344722199">true</strong> by default. <strong id="kafka-faq-0043__b8446228917">offsets.retention.minutes</strong> determines how long before a consumer group is deleted automatically, which can be changed on the console. For details, see <a href="kafka-ug-0007.html">Modifying Kafka Instance Configuration Parameters</a>.</li><li id="kafka-faq-0043__li184871512219">For newly created instances:<ul id="kafka-faq-0043__ul143481836296"><li id="kafka-faq-0043__li139061637592">If <strong id="kafka-faq-0043__b1390683717917">auto.create.groups.enable</strong> is <strong id="kafka-faq-0043__b20202945135019">false</strong>, you need to manually delete consumer groups.</li><li id="kafka-faq-0043__li79067378913">If <strong id="kafka-faq-0043__b149065370910">auto.create.groups.enable</strong> is <strong id="kafka-faq-0043__b2821541135117">true</strong>, a consumer group that has never committed an offset will be automatically deleted after 10 minutes.</li><li id="kafka-faq-0043__li8906143711910">If <strong id="kafka-faq-0043__b9337191145813">auto.create.groups.enable</strong> is <strong id="kafka-faq-0043__b203371611155812">true</strong>, and a consumer group has committed an offset, <strong id="kafka-faq-0043__b151566376159">offsets.retention.minutes</strong> determines how long before the group is deleted automatically, which can be changed on the console. For details, see <a href="kafka-ug-0007.html">Modifying Kafka Instance Configuration Parameters</a>.</li></ul>
|
||||
<ul id="kafka-faq-0043__ul64371941143718"><li id="kafka-faq-0043__li74411242387">For instances created much earlier, <strong id="kafka-faq-0043__b15208161124014">auto.create.groups.enable</strong> is set to <strong id="kafka-faq-0043__b7208711164012">true</strong> by default. <strong id="kafka-faq-0043__b6208411194014">offsets.retention.minutes</strong> determines how long before a consumer group is deleted automatically, which can be changed on the console. For details, see <a href="kafka-ug-0007.html">Modifying Kafka Instance Configuration Parameters</a>.</li><li id="kafka-faq-0043__li184871512219">For newly created instances:<ul id="kafka-faq-0043__ul143481836296"><li id="kafka-faq-0043__li139061637592">If <strong id="kafka-faq-0043__b1390683717917">auto.create.groups.enable</strong> is <strong id="kafka-faq-0043__b20202945135019">false</strong>, you need to manually delete consumer groups.</li><li id="kafka-faq-0043__li79067378913">If <strong id="kafka-faq-0043__b149065370910">auto.create.groups.enable</strong> is <strong id="kafka-faq-0043__b2821541135117">true</strong>, a consumer group that has never committed an offset will be automatically deleted after 10 minutes.</li><li id="kafka-faq-0043__li8906143711910">If <strong id="kafka-faq-0043__b72711837104013">auto.create.groups.enable</strong> is <strong id="kafka-faq-0043__b1227133720402">true</strong>, and a consumer group has committed an offset, <strong id="kafka-faq-0043__b1271113710404">offsets.retention.minutes</strong> determines how long before the group is deleted automatically, which can be changed on the console. For details, see <a href="kafka-ug-0007.html">Modifying Kafka Instance Configuration Parameters</a>.</li></ul>
|
||||
</li></ul>
|
||||
<p id="kafka-faq-0043__p31251757201617">Kafka uses the <strong id="kafka-faq-0043__b457617446710">offsets.retention.minutes</strong> parameter to control how long to keep offsets for a consumer group. If offsets are not committed within this period, they will be deleted. If Kafka determines that there are no active consumers in a consumer group (for example, when the consumer group is empty) and there are no offsets, Kafka will delete the consumer group.</p>
|
||||
<p id="kafka-faq-0043__p1595465285520"></p>
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@ -26,8 +26,6 @@
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="kafka-faq-0010.html">Will a Kafka Instance Be Restarted After Its Automatic Topic Creation Setting Is Modified?</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="kafka-faq-0031.html">Can I Delete Unnecessary Topics in a Consumer Group?</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="kafka-faq-0038.html">What Can I Do If a Consumer Fails to Retrieve Messages from a Topic Due to Insufficient Permissions?</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
|
||||
@ -12,6 +12,8 @@
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="kafka_faq_0060.html">Why Can't I View Consumers When Instance Consumption Is Normal?</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="kafka-faq-0031.html">Can I Delete Unnecessary Topics in a Consumer Group?</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
|
||||
<div class="familylinks">
|
||||
|
||||
@ -3,9 +3,9 @@
|
||||
<h1 class="topictitle1">Can I Modify the Port for Accessing a Kafka Instance?</h1>
|
||||
<div id="body1587865348901"><p id="kafka-faq-200426011__p4878510182510">No. You must access a Kafka instance through one of the following ports:</p>
|
||||
<ul id="kafka-faq-200426011__ul49261127121910"><li id="kafka-faq-200426011__li412819171397">Accessing a Kafka instance <strong id="kafka-faq-200426011__b18135201575720">without</strong> SASL:<p id="kafka-faq-200426011__p17744586143">The port varies with the access mode:</p>
|
||||
<ul id="kafka-faq-200426011__ul8532551514"><li id="kafka-faq-200426011__li67168180153">Intra-VPC access: port <strong id="kafka-faq-200426011__b771841841515">9092</strong></li><li id="kafka-faq-200426011__li1953135141514">Public access: port <strong id="kafka-faq-200426011__b912818171793">9094</strong></li><li id="kafka-faq-200426011__li16222142351518">Cross-VPC access using a VPC endpoint: port <strong id="kafka-faq-200426011__b8547203816281">9011</strong></li><li id="kafka-faq-200426011__li113739478425">Cross-VPC access using a peering connection: port: <strong id="kafka-faq-200426011__b16571927134314">9092</strong>.</li><li id="kafka-faq-200426011__li596411912310">DNAT access: port <strong id="kafka-faq-200426011__b151193913306">9011</strong></li></ul>
|
||||
<ul id="kafka-faq-200426011__ul8532551514"><li id="kafka-faq-200426011__li67168180153">Intra-VPC access using IPv4 addresses: port <strong id="kafka-faq-200426011__b771841841515">9092</strong></li><li id="kafka-faq-200426011__li1854710164425">Intra-VPC access using IPv6 addresses: port <strong id="kafka-faq-200426011__b549218531518">9192</strong></li><li id="kafka-faq-200426011__li1953135141514">Public access: port <strong id="kafka-faq-200426011__b912818171793">9094</strong></li><li id="kafka-faq-200426011__li16222142351518">Cross-VPC access using a VPC endpoint: port <strong id="kafka-faq-200426011__b8547203816281">9011</strong></li><li id="kafka-faq-200426011__li113739478425">Cross-VPC access using a peering connection: port: <strong id="kafka-faq-200426011__b16571927134314">9092</strong>.</li><li id="kafka-faq-200426011__li596411912310">DNAT access: port <strong id="kafka-faq-200426011__b151193913306">9011</strong></li></ul>
|
||||
</li><li id="kafka-faq-200426011__li640810249920">Accessing a Kafka instance <strong id="kafka-faq-200426011__b158311240145818">with</strong> SASL:<p id="kafka-faq-200426011__p134801502154">The port varies with the access mode:</p>
|
||||
<ul id="kafka-faq-200426011__ul4480165081515"><li id="kafka-faq-200426011__li194808504155">Intra-VPC access: port <strong id="kafka-faq-200426011__b7608164412587">9093</strong></li><li id="kafka-faq-200426011__li248055014155">Public access: port <strong id="kafka-faq-200426011__b15831164595812">9095</strong></li><li id="kafka-faq-200426011__li11480145017154">Cross-VPC access using a VPC endpoint: port <strong id="kafka-faq-200426011__b1637104213431">9011</strong></li><li id="kafka-faq-200426011__li2781105784319">Cross-VPC access using a peering connection: port: <strong id="kafka-faq-200426011__b1899724564310">9093</strong>.</li><li id="kafka-faq-200426011__li1270815381131">DNAT access: port <strong id="kafka-faq-200426011__b2083854243015">9011</strong></li></ul>
|
||||
<ul id="kafka-faq-200426011__ul4480165081515"><li id="kafka-faq-200426011__li194808504155">Intra-VPC access using IPv4 addresses: port <strong id="kafka-faq-200426011__b7608164412587">9093</strong></li><li id="kafka-faq-200426011__li17147016114310">Intra-VPC access using IPv6 addresses: port <strong id="kafka-faq-200426011__b1964145231515">9193</strong></li><li id="kafka-faq-200426011__li248055014155">Public access: port <strong id="kafka-faq-200426011__b15831164595812">9095</strong></li><li id="kafka-faq-200426011__li11480145017154">Cross-VPC access using a VPC endpoint: port <strong id="kafka-faq-200426011__b1637104213431">9011</strong></li><li id="kafka-faq-200426011__li2781105784319">Cross-VPC access using a peering connection: port: <strong id="kafka-faq-200426011__b1899724564310">9093</strong>.</li><li id="kafka-faq-200426011__li1270815381131">DNAT access: port <strong id="kafka-faq-200426011__b2083854243015">9011</strong></li></ul>
|
||||
</li></ul>
|
||||
<p id="kafka-faq-200426011__p18670173852010">Ensure that proper rules have been configured for the security group of the instance. For details, see <a href="kafka-faq-180604024.html">How Do I Select and Configure a Security Group?</a></p>
|
||||
</div>
|
||||
|
||||
@ -1,7 +1,7 @@
|
||||
<a name="kafka-faq-200426014"></a><a name="kafka-faq-200426014"></a>
|
||||
|
||||
<h1 class="topictitle1">How Do I Change the SASL_SSL Setting of a Kafka Instance?</h1>
|
||||
<div id="body1587865348902"><p id="kafka-faq-200426014__p19737193914120">The SASL_SSL setting can be changed for cluster instances (see <a href="kafka_ug_0044.html">Configuring Plaintext or Ciphertext Access to Kafka Instances</a>), but cannot be changed for single-node instances.</p>
|
||||
<div id="body1587865348902"><ul id="kafka-faq-200426014__ul497003083018"><li id="kafka-faq-200426014__li14633435143011">The SASL_SSL setting can be changed for cluster instances. For details, see <a href="kafka_ug_0044.html">Configuring Plaintext or Ciphertext Access to Kafka Instances</a>.</li><li id="kafka-faq-200426014__li2970103033014">A single-node instance does not support SASL_SSL.</li><li id="kafka-faq-200426014__li1320815529302">SASL_SSL cannot be modified for instances with IPv6 enabled.</li></ul>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
|
||||
@ -1,7 +1,7 @@
|
||||
<a name="kafka-faq-200426015"></a><a name="kafka-faq-200426015"></a>
|
||||
|
||||
<h1 class="topictitle1">Can I Access a Kafka Instance Over a Public Network?</h1>
|
||||
<div id="body1587865348902"><p id="kafka-faq-200426015__p13681326121514">Yes. For details, see the <a href="kafka-ug190605003.html">instance access instructions</a>.</p>
|
||||
<div id="body1587865348902"><p id="kafka-faq-200426015__p13681326121514">Yes. For details, see the <a href="kafka-ug190605003.html">Connecting to an Instance</a>.</p>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
|
||||
@ -3,7 +3,7 @@
|
||||
<h1 class="topictitle1">How Many Connection Addresses Does a Kafka Instance Have by Default?</h1>
|
||||
<div id="body1587865348902"><p id="kafka-faq-200426016__p32241022919">The number of connection addresses of a Kafka instance is the same as the number of brokers of the instance. The following table lists the number of brokers corresponding to each flavor.</p>
|
||||
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="kafka-faq-200426016__table0528422185117" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Kafka instance specifications (v1.1.0/v2.3.0/v2.7 cluster instances)</caption><thead align="left"><tr id="kafka-faq-200426016__kafka-specification_row652112022012"><th align="left" class="cellrowborder" valign="top" width="13.598640135986404%" id="mcps1.3.2.2.9.1.1"><p id="kafka-faq-200426016__kafka-specification_p15704194442115">Flavor</p>
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="kafka-faq-200426016__table0528422185117" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Kafka instance specifications (cluster)</caption><thead align="left"><tr id="kafka-faq-200426016__kafka-specification_row652112022012"><th align="left" class="cellrowborder" valign="top" width="13.598640135986404%" id="mcps1.3.2.2.9.1.1"><p id="kafka-faq-200426016__kafka-specification_p15704194442115">Flavor</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="8.35916408359164%" id="mcps1.3.2.2.9.1.2"><p id="kafka-faq-200426016__kafka-specification_p127043444212">Brokers</p>
|
||||
</th>
|
||||
@ -86,7 +86,7 @@
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="18.388161183881614%" headers="mcps1.3.2.2.9.1.7 "><p id="kafka-faq-200426016__kafka-specification_p17715354123319">300 GB–1,500,000 GB</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.2.2.9.1.8 "><p id="kafka-faq-200426016__kafka-specification_p159621537201410">250</p>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.2.2.9.1.8 "><p id="kafka-faq-200426016__kafka-specification_p244383861311">375</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="kafka-faq-200426016__kafka-specification_row13522112012013"><td class="cellrowborder" valign="top" width="13.598640135986404%" headers="mcps1.3.2.2.9.1.1 "><p id="kafka-faq-200426016__kafka-specification_p1579205452110">kafka.12u24g.cluster</p>
|
||||
@ -103,7 +103,7 @@
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="18.388161183881614%" headers="mcps1.3.2.2.9.1.7 "><p id="kafka-faq-200426016__kafka-specification_p473011816366">300 GB–1,500,000 GB</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.2.2.9.1.8 "><p id="kafka-faq-200426016__kafka-specification_p0934164510144">375</p>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.2.2.9.1.8 "><p id="kafka-faq-200426016__kafka-specification_p14443193821314">625</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="kafka-faq-200426016__kafka-specification_row1852319202204"><td class="cellrowborder" valign="top" width="13.598640135986404%" headers="mcps1.3.2.2.9.1.1 "><p id="kafka-faq-200426016__kafka-specification_p48025416215">kafka.16u32g.cluster</p>
|
||||
@ -120,7 +120,7 @@
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="18.388161183881614%" headers="mcps1.3.2.2.9.1.7 "><p id="kafka-faq-200426016__kafka-specification_p177571811113616">300 GB–1,500,000 GB</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.2.2.9.1.8 "><p id="kafka-faq-200426016__kafka-specification_p11359505144">500</p>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.2.2.9.1.8 "><p id="kafka-faq-200426016__kafka-specification_p164431138191310">750</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
@ -182,62 +182,6 @@
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="kafka-faq-200426016__table8263936135616" frame="border" border="1" rules="all"><caption><b>Table 3 </b>Kafka instance specifications (v3.x cluster instances)</caption><thead align="left"><tr id="kafka-faq-200426016__kafka-specification_row1594719353718"><th align="left" class="cellrowborder" valign="top" width="13.598640135986404%" id="mcps1.3.4.2.9.1.1"><p id="kafka-faq-200426016__kafka-specification_p8947123133715">Flavor</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="8.349165083491652%" id="mcps1.3.4.2.9.1.2"><p id="kafka-faq-200426016__kafka-specification_p394712311371">Brokers</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="10.34896510348965%" id="mcps1.3.4.2.9.1.3"><p id="kafka-faq-200426016__kafka-specification_p194716333716">TPS per Broker</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="9.829017098290171%" id="mcps1.3.4.2.9.1.4"><p id="kafka-faq-200426016__kafka-specification_p199476383716">Maximum Partitions per Broker</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="10.108989101089891%" id="mcps1.3.4.2.9.1.5"><p id="kafka-faq-200426016__kafka-specification_p12947833373">Recommended Consumer Groups per Broker</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="13.20867913208679%" id="mcps1.3.4.2.9.1.6"><p id="kafka-faq-200426016__kafka-specification_p1194718353716">Maximum Client Connections per Broker</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="18.388161183881614%" id="mcps1.3.4.2.9.1.7"><p id="kafka-faq-200426016__kafka-specification_p494733183712">Storage Space</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="16.168383161683835%" id="mcps1.3.4.2.9.1.8"><p id="kafka-faq-200426016__kafka-specification_p594719313718">Traffic per Broker (MB/s)</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="kafka-faq-200426016__kafka-specification_row189471310372"><td class="cellrowborder" valign="top" width="13.598640135986404%" headers="mcps1.3.4.2.9.1.1 "><p id="kafka-faq-200426016__kafka-specification_p1052313653715">kafka.2u4g.cluster.beta</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="8.349165083491652%" headers="mcps1.3.4.2.9.1.2 "><p id="kafka-faq-200426016__kafka-specification_p2523143615377">3</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="10.34896510348965%" headers="mcps1.3.4.2.9.1.3 "><p id="kafka-faq-200426016__kafka-specification_p7523153663716">30,000</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="9.829017098290171%" headers="mcps1.3.4.2.9.1.4 "><p id="kafka-faq-200426016__kafka-specification_p95234369376">250</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="10.108989101089891%" headers="mcps1.3.4.2.9.1.5 "><p id="kafka-faq-200426016__kafka-specification_p2052310366378">20</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="13.20867913208679%" headers="mcps1.3.4.2.9.1.6 "><p id="kafka-faq-200426016__kafka-specification_p6523203603712">2000</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="18.388161183881614%" headers="mcps1.3.4.2.9.1.7 "><p id="kafka-faq-200426016__kafka-specification_p8523636193712">300 GB</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.4.2.9.1.8 "><p id="kafka-faq-200426016__kafka-specification_p9523163616376">100</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="kafka-faq-200426016__kafka-specification_row1594723123713"><td class="cellrowborder" valign="top" width="13.598640135986404%" headers="mcps1.3.4.2.9.1.1 "><p id="kafka-faq-200426016__kafka-specification_p7523193663712">kafka.4u8g.cluster.beta</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="8.349165083491652%" headers="mcps1.3.4.2.9.1.2 "><p id="kafka-faq-200426016__kafka-specification_p115231136103711">3</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="10.34896510348965%" headers="mcps1.3.4.2.9.1.3 "><p id="kafka-faq-200426016__kafka-specification_p1152363693717">100,000</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="9.829017098290171%" headers="mcps1.3.4.2.9.1.4 "><p id="kafka-faq-200426016__kafka-specification_p1052316368375">500</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="10.108989101089891%" headers="mcps1.3.4.2.9.1.5 "><p id="kafka-faq-200426016__kafka-specification_p4523163618373">100</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="13.20867913208679%" headers="mcps1.3.4.2.9.1.6 "><p id="kafka-faq-200426016__kafka-specification_p165231836143715">4000</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="18.388161183881614%" headers="mcps1.3.4.2.9.1.7 "><p id="kafka-faq-200426016__kafka-specification_p145231936193717">300 GB</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.4.2.9.1.8 "><p id="kafka-faq-200426016__kafka-specification_p75239365375">200</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
|
||||
@ -4,7 +4,7 @@
|
||||
<div id="body1587865451575"><p id="kafka-faq-200426024__p144651566368">The number of topics is related to the total number of topic partitions and the number of partitions in each topic. There is an upper limit on the aggregate number of partitions of topics. When this limit is reached, no more topics can be created.</p>
|
||||
<p id="kafka-faq-200426024__p1211614225486">The partition limit varies depending on the flavor, as shown in the following table.</p>
|
||||
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="kafka-faq-200426024__table0528422185117" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Kafka instance specifications (v1.1.0/v2.3.0/v2.7 cluster instances)</caption><thead align="left"><tr id="kafka-faq-200426024__kafka-specification_row652112022012"><th align="left" class="cellrowborder" valign="top" width="13.598640135986404%" id="mcps1.3.3.2.9.1.1"><p id="kafka-faq-200426024__kafka-specification_p15704194442115">Flavor</p>
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="kafka-faq-200426024__table0528422185117" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Kafka instance specifications (cluster)</caption><thead align="left"><tr id="kafka-faq-200426024__kafka-specification_row652112022012"><th align="left" class="cellrowborder" valign="top" width="13.598640135986404%" id="mcps1.3.3.2.9.1.1"><p id="kafka-faq-200426024__kafka-specification_p15704194442115">Flavor</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="8.35916408359164%" id="mcps1.3.3.2.9.1.2"><p id="kafka-faq-200426024__kafka-specification_p127043444212">Brokers</p>
|
||||
</th>
|
||||
@ -87,7 +87,7 @@
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="18.388161183881614%" headers="mcps1.3.3.2.9.1.7 "><p id="kafka-faq-200426024__kafka-specification_p17715354123319">300 GB–1,500,000 GB</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.3.2.9.1.8 "><p id="kafka-faq-200426024__kafka-specification_p159621537201410">250</p>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.3.2.9.1.8 "><p id="kafka-faq-200426024__kafka-specification_p244383861311">375</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="kafka-faq-200426024__kafka-specification_row13522112012013"><td class="cellrowborder" valign="top" width="13.598640135986404%" headers="mcps1.3.3.2.9.1.1 "><p id="kafka-faq-200426024__kafka-specification_p1579205452110">kafka.12u24g.cluster</p>
|
||||
@ -104,7 +104,7 @@
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="18.388161183881614%" headers="mcps1.3.3.2.9.1.7 "><p id="kafka-faq-200426024__kafka-specification_p473011816366">300 GB–1,500,000 GB</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.3.2.9.1.8 "><p id="kafka-faq-200426024__kafka-specification_p0934164510144">375</p>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.3.2.9.1.8 "><p id="kafka-faq-200426024__kafka-specification_p14443193821314">625</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="kafka-faq-200426024__kafka-specification_row1852319202204"><td class="cellrowborder" valign="top" width="13.598640135986404%" headers="mcps1.3.3.2.9.1.1 "><p id="kafka-faq-200426024__kafka-specification_p48025416215">kafka.16u32g.cluster</p>
|
||||
@ -121,7 +121,7 @@
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="18.388161183881614%" headers="mcps1.3.3.2.9.1.7 "><p id="kafka-faq-200426024__kafka-specification_p177571811113616">300 GB–1,500,000 GB</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.3.2.9.1.8 "><p id="kafka-faq-200426024__kafka-specification_p11359505144">500</p>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.3.2.9.1.8 "><p id="kafka-faq-200426024__kafka-specification_p164431138191310">750</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
@ -183,62 +183,6 @@
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="kafka-faq-200426024__table8263936135616" frame="border" border="1" rules="all"><caption><b>Table 3 </b>Kafka instance specifications (v3.x cluster instances)</caption><thead align="left"><tr id="kafka-faq-200426024__kafka-specification_row1594719353718"><th align="left" class="cellrowborder" valign="top" width="13.598640135986404%" id="mcps1.3.5.2.9.1.1"><p id="kafka-faq-200426024__kafka-specification_p8947123133715">Flavor</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="8.349165083491652%" id="mcps1.3.5.2.9.1.2"><p id="kafka-faq-200426024__kafka-specification_p394712311371">Brokers</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="10.34896510348965%" id="mcps1.3.5.2.9.1.3"><p id="kafka-faq-200426024__kafka-specification_p194716333716">TPS per Broker</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="9.829017098290171%" id="mcps1.3.5.2.9.1.4"><p id="kafka-faq-200426024__kafka-specification_p199476383716">Maximum Partitions per Broker</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="10.108989101089891%" id="mcps1.3.5.2.9.1.5"><p id="kafka-faq-200426024__kafka-specification_p12947833373">Recommended Consumer Groups per Broker</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="13.20867913208679%" id="mcps1.3.5.2.9.1.6"><p id="kafka-faq-200426024__kafka-specification_p1194718353716">Maximum Client Connections per Broker</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="18.388161183881614%" id="mcps1.3.5.2.9.1.7"><p id="kafka-faq-200426024__kafka-specification_p494733183712">Storage Space</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="16.168383161683835%" id="mcps1.3.5.2.9.1.8"><p id="kafka-faq-200426024__kafka-specification_p594719313718">Traffic per Broker (MB/s)</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="kafka-faq-200426024__kafka-specification_row189471310372"><td class="cellrowborder" valign="top" width="13.598640135986404%" headers="mcps1.3.5.2.9.1.1 "><p id="kafka-faq-200426024__kafka-specification_p1052313653715">kafka.2u4g.cluster.beta</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="8.349165083491652%" headers="mcps1.3.5.2.9.1.2 "><p id="kafka-faq-200426024__kafka-specification_p2523143615377">3</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="10.34896510348965%" headers="mcps1.3.5.2.9.1.3 "><p id="kafka-faq-200426024__kafka-specification_p7523153663716">30,000</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="9.829017098290171%" headers="mcps1.3.5.2.9.1.4 "><p id="kafka-faq-200426024__kafka-specification_p95234369376">250</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="10.108989101089891%" headers="mcps1.3.5.2.9.1.5 "><p id="kafka-faq-200426024__kafka-specification_p2052310366378">20</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="13.20867913208679%" headers="mcps1.3.5.2.9.1.6 "><p id="kafka-faq-200426024__kafka-specification_p6523203603712">2000</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="18.388161183881614%" headers="mcps1.3.5.2.9.1.7 "><p id="kafka-faq-200426024__kafka-specification_p8523636193712">300 GB</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.5.2.9.1.8 "><p id="kafka-faq-200426024__kafka-specification_p9523163616376">100</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="kafka-faq-200426024__kafka-specification_row1594723123713"><td class="cellrowborder" valign="top" width="13.598640135986404%" headers="mcps1.3.5.2.9.1.1 "><p id="kafka-faq-200426024__kafka-specification_p7523193663712">kafka.4u8g.cluster.beta</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="8.349165083491652%" headers="mcps1.3.5.2.9.1.2 "><p id="kafka-faq-200426024__kafka-specification_p115231136103711">3</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="10.34896510348965%" headers="mcps1.3.5.2.9.1.3 "><p id="kafka-faq-200426024__kafka-specification_p1152363693717">100,000</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="9.829017098290171%" headers="mcps1.3.5.2.9.1.4 "><p id="kafka-faq-200426024__kafka-specification_p1052316368375">500</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="10.108989101089891%" headers="mcps1.3.5.2.9.1.5 "><p id="kafka-faq-200426024__kafka-specification_p4523163618373">100</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="13.20867913208679%" headers="mcps1.3.5.2.9.1.6 "><p id="kafka-faq-200426024__kafka-specification_p165231836143715">4000</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="18.388161183881614%" headers="mcps1.3.5.2.9.1.7 "><p id="kafka-faq-200426024__kafka-specification_p145231936193717">300 GB</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.5.2.9.1.8 "><p id="kafka-faq-200426024__kafka-specification_p75239365375">200</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
|
||||
@ -4,7 +4,7 @@
|
||||
<div id="body1587865451575"><p id="kafka-faq-200426025__p11227976415">Kafka manages messages by partition. If there are too many partitions, message creation, storage, and retrieval will be fragmented, affecting the performance and stability. If the total number of partitions of topics reaches the upper limit, you cannot create more topics.</p>
|
||||
<p id="kafka-faq-200426025__p1211614225486">The partition limit varies depending on the flavor, as shown in the following table.</p>
|
||||
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="kafka-faq-200426025__table0528422185117" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Kafka instance specifications (v1.1.0/v2.3.0/v2.7 cluster instances)</caption><thead align="left"><tr id="kafka-faq-200426025__kafka-specification_row652112022012"><th align="left" class="cellrowborder" valign="top" width="13.598640135986404%" id="mcps1.3.3.2.9.1.1"><p id="kafka-faq-200426025__kafka-specification_p15704194442115">Flavor</p>
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="kafka-faq-200426025__table0528422185117" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Kafka instance specifications (cluster)</caption><thead align="left"><tr id="kafka-faq-200426025__kafka-specification_row652112022012"><th align="left" class="cellrowborder" valign="top" width="13.598640135986404%" id="mcps1.3.3.2.9.1.1"><p id="kafka-faq-200426025__kafka-specification_p15704194442115">Flavor</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="8.35916408359164%" id="mcps1.3.3.2.9.1.2"><p id="kafka-faq-200426025__kafka-specification_p127043444212">Brokers</p>
|
||||
</th>
|
||||
@ -87,7 +87,7 @@
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="18.388161183881614%" headers="mcps1.3.3.2.9.1.7 "><p id="kafka-faq-200426025__kafka-specification_p17715354123319">300 GB–1,500,000 GB</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.3.2.9.1.8 "><p id="kafka-faq-200426025__kafka-specification_p159621537201410">250</p>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.3.2.9.1.8 "><p id="kafka-faq-200426025__kafka-specification_p244383861311">375</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="kafka-faq-200426025__kafka-specification_row13522112012013"><td class="cellrowborder" valign="top" width="13.598640135986404%" headers="mcps1.3.3.2.9.1.1 "><p id="kafka-faq-200426025__kafka-specification_p1579205452110">kafka.12u24g.cluster</p>
|
||||
@ -104,7 +104,7 @@
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="18.388161183881614%" headers="mcps1.3.3.2.9.1.7 "><p id="kafka-faq-200426025__kafka-specification_p473011816366">300 GB–1,500,000 GB</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.3.2.9.1.8 "><p id="kafka-faq-200426025__kafka-specification_p0934164510144">375</p>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.3.2.9.1.8 "><p id="kafka-faq-200426025__kafka-specification_p14443193821314">625</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="kafka-faq-200426025__kafka-specification_row1852319202204"><td class="cellrowborder" valign="top" width="13.598640135986404%" headers="mcps1.3.3.2.9.1.1 "><p id="kafka-faq-200426025__kafka-specification_p48025416215">kafka.16u32g.cluster</p>
|
||||
@ -121,7 +121,7 @@
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="18.388161183881614%" headers="mcps1.3.3.2.9.1.7 "><p id="kafka-faq-200426025__kafka-specification_p177571811113616">300 GB–1,500,000 GB</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.3.2.9.1.8 "><p id="kafka-faq-200426025__kafka-specification_p11359505144">500</p>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.3.2.9.1.8 "><p id="kafka-faq-200426025__kafka-specification_p164431138191310">750</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
@ -183,62 +183,6 @@
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="kafka-faq-200426025__table8263936135616" frame="border" border="1" rules="all"><caption><b>Table 3 </b>Kafka instance specifications (v3.x cluster instances)</caption><thead align="left"><tr id="kafka-faq-200426025__kafka-specification_row1594719353718"><th align="left" class="cellrowborder" valign="top" width="13.598640135986404%" id="mcps1.3.5.2.9.1.1"><p id="kafka-faq-200426025__kafka-specification_p8947123133715">Flavor</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="8.349165083491652%" id="mcps1.3.5.2.9.1.2"><p id="kafka-faq-200426025__kafka-specification_p394712311371">Brokers</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="10.34896510348965%" id="mcps1.3.5.2.9.1.3"><p id="kafka-faq-200426025__kafka-specification_p194716333716">TPS per Broker</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="9.829017098290171%" id="mcps1.3.5.2.9.1.4"><p id="kafka-faq-200426025__kafka-specification_p199476383716">Maximum Partitions per Broker</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="10.108989101089891%" id="mcps1.3.5.2.9.1.5"><p id="kafka-faq-200426025__kafka-specification_p12947833373">Recommended Consumer Groups per Broker</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="13.20867913208679%" id="mcps1.3.5.2.9.1.6"><p id="kafka-faq-200426025__kafka-specification_p1194718353716">Maximum Client Connections per Broker</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="18.388161183881614%" id="mcps1.3.5.2.9.1.7"><p id="kafka-faq-200426025__kafka-specification_p494733183712">Storage Space</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="16.168383161683835%" id="mcps1.3.5.2.9.1.8"><p id="kafka-faq-200426025__kafka-specification_p594719313718">Traffic per Broker (MB/s)</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="kafka-faq-200426025__kafka-specification_row189471310372"><td class="cellrowborder" valign="top" width="13.598640135986404%" headers="mcps1.3.5.2.9.1.1 "><p id="kafka-faq-200426025__kafka-specification_p1052313653715">kafka.2u4g.cluster.beta</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="8.349165083491652%" headers="mcps1.3.5.2.9.1.2 "><p id="kafka-faq-200426025__kafka-specification_p2523143615377">3</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="10.34896510348965%" headers="mcps1.3.5.2.9.1.3 "><p id="kafka-faq-200426025__kafka-specification_p7523153663716">30,000</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="9.829017098290171%" headers="mcps1.3.5.2.9.1.4 "><p id="kafka-faq-200426025__kafka-specification_p95234369376">250</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="10.108989101089891%" headers="mcps1.3.5.2.9.1.5 "><p id="kafka-faq-200426025__kafka-specification_p2052310366378">20</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="13.20867913208679%" headers="mcps1.3.5.2.9.1.6 "><p id="kafka-faq-200426025__kafka-specification_p6523203603712">2000</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="18.388161183881614%" headers="mcps1.3.5.2.9.1.7 "><p id="kafka-faq-200426025__kafka-specification_p8523636193712">300 GB</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.5.2.9.1.8 "><p id="kafka-faq-200426025__kafka-specification_p9523163616376">100</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="kafka-faq-200426025__kafka-specification_row1594723123713"><td class="cellrowborder" valign="top" width="13.598640135986404%" headers="mcps1.3.5.2.9.1.1 "><p id="kafka-faq-200426025__kafka-specification_p7523193663712">kafka.4u8g.cluster.beta</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="8.349165083491652%" headers="mcps1.3.5.2.9.1.2 "><p id="kafka-faq-200426025__kafka-specification_p115231136103711">3</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="10.34896510348965%" headers="mcps1.3.5.2.9.1.3 "><p id="kafka-faq-200426025__kafka-specification_p1152363693717">100,000</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="9.829017098290171%" headers="mcps1.3.5.2.9.1.4 "><p id="kafka-faq-200426025__kafka-specification_p1052316368375">500</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="10.108989101089891%" headers="mcps1.3.5.2.9.1.5 "><p id="kafka-faq-200426025__kafka-specification_p4523163618373">100</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="13.20867913208679%" headers="mcps1.3.5.2.9.1.6 "><p id="kafka-faq-200426025__kafka-specification_p165231836143715">4000</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="18.388161183881614%" headers="mcps1.3.5.2.9.1.7 "><p id="kafka-faq-200426025__kafka-specification_p145231936193717">300 GB</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="16.168383161683835%" headers="mcps1.3.5.2.9.1.8 "><p id="kafka-faq-200426025__kafka-specification_p75239365375">200</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
|
||||
Some files were not shown because too many files have changed in this diff Show More
Reference in New Issue
Block a user