forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
62 lines
5.4 KiB
HTML
62 lines
5.4 KiB
HTML
<a name="mrs_01_1044"></a><a name="mrs_01_1044"></a>
|
|
|
|
<h1 class="topictitle1">Kafka Performance Tuning</h1>
|
|
<div id="body1590133087329"><div class="section" id="mrs_01_1044__sbc0f3e2916424866b33762c441d269c4"><h4 class="sectiontitle">Scenario</h4><p id="mrs_01_1044__aebfacc51e7484b7891f16e57c5efd7dc">You can modify Kafka server parameters to improve Kafka processing capabilities in specific service scenarios.</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_1044__s6ebbf105cc7a4a03b02781c6a5cd5317"><h4 class="sectiontitle">Parameter Tuning</h4><p id="mrs_01_1044__p1387717455414">Modify the service configuration parameters. For details, see <a href="mrs_01_2125.html">Modifying Cluster Service Configuration Parameters</a>. For details about the tuning parameters, see <a href="#mrs_01_1044__td2ff03d5b464413597bebde9472f162f">Table 1</a>.</p>
|
|
|
|
<div class="tablenoborder"><a name="mrs_01_1044__td2ff03d5b464413597bebde9472f162f"></a><a name="td2ff03d5b464413597bebde9472f162f"></a><table cellpadding="4" cellspacing="0" summary="" id="mrs_01_1044__td2ff03d5b464413597bebde9472f162f" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Tuning parameters</caption><thead align="left"><tr id="mrs_01_1044__r2c97688692e140b5a47552613530a953"><th align="left" class="cellrowborder" valign="top" width="35.099999999999994%" id="mcps1.3.2.3.2.4.1.1"><p id="mrs_01_1044__aa4e1e2bab64e4ef793363baa06cf2085">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="20.36%" id="mcps1.3.2.3.2.4.1.2"><p id="mrs_01_1044__a8b25df13cba244ec8b8dd5820feffc48">Default Value</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="44.54%" id="mcps1.3.2.3.2.4.1.3"><p id="mrs_01_1044__acbe1f1344f61482d86f35f93c413992d">Scenario</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="mrs_01_1044__r1b5056e4eb3f4013b8392013d3ac7416"><td class="cellrowborder" valign="top" width="35.099999999999994%" headers="mcps1.3.2.3.2.4.1.1 "><p id="mrs_01_1044__a7a1466aaa38f4e4d8de53c1efa82a04b">num.recovery.threads.per.data.dir</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="20.36%" headers="mcps1.3.2.3.2.4.1.2 "><p id="mrs_01_1044__en-us_topic_0116526961_p189280094820">10</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.54%" headers="mcps1.3.2.3.2.4.1.3 "><p id="mrs_01_1044__af00cf560371649bd97285df5be4f776c">During the Kafka startup process, if a large volume of data exists, you can increase the value of this parameter to accelerate the startup.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1044__r511aaf1d58bc4c309cf3297d7f4133dd"><td class="cellrowborder" valign="top" width="35.099999999999994%" headers="mcps1.3.2.3.2.4.1.1 "><p id="mrs_01_1044__ace7d9a06d3d74a1cbdec5e2703ae9d72">background.threads</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="20.36%" headers="mcps1.3.2.3.2.4.1.2 "><p id="mrs_01_1044__a2070c95dbd76413e92514e82997ef104">10</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.54%" headers="mcps1.3.2.3.2.4.1.3 "><p id="mrs_01_1044__a650b6172a3484bb6b6c0d8b1d3de43a1">Specifies the number of threads processed by a broker background task. If a large volume of data exists, you can increase the value of this parameter to improve broker processing capabilities.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1044__re96249f5ee8b4ecea3e93993201bf9af"><td class="cellrowborder" valign="top" width="35.099999999999994%" headers="mcps1.3.2.3.2.4.1.1 "><p id="mrs_01_1044__a8bdd549812bd4cb78fd2e7606fc736c1">num.replica.fetchers</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="20.36%" headers="mcps1.3.2.3.2.4.1.2 "><p id="mrs_01_1044__en-us_topic_0116526961_p490816394820">1</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.54%" headers="mcps1.3.2.3.2.4.1.3 "><p id="mrs_01_1044__a4660391059b74e7aba6849b18a62b897">Specifies the number of threads used when a replica requests to the Leader for data synchronization. If the value of this parameter is increased, the replica I/O concurrency increases.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1044__r2724cc2680e14eb4a7fdb225239e1357"><td class="cellrowborder" valign="top" width="35.099999999999994%" headers="mcps1.3.2.3.2.4.1.1 "><p id="mrs_01_1044__a82efb0ac10b24c3bbe0af43a2a4f7834">num.io.threads</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="20.36%" headers="mcps1.3.2.3.2.4.1.2 "><p id="mrs_01_1044__a7460348321dc40b29507f3296fbd474e">8</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.54%" headers="mcps1.3.2.3.2.4.1.3 "><p id="mrs_01_1044__a030825cab57743ccb71a4ca1c63e9107">Specifies the number of threads used by the broker to process disk I/O. It is recommended that the number of threads be greater than or equal to the number of disks.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="mrs_01_1044__ra8a612e7aa734ab9ac54c8e638059f8c"><td class="cellrowborder" valign="top" width="35.099999999999994%" headers="mcps1.3.2.3.2.4.1.1 "><p id="mrs_01_1044__a364e006fee954296ab43ec7183749f9b">KAFKA_HEAP_OPTS</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="20.36%" headers="mcps1.3.2.3.2.4.1.2 "><p id="mrs_01_1044__p120124695917">-Xmx6G -Xms6G</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="44.54%" headers="mcps1.3.2.3.2.4.1.3 "><p id="mrs_01_1044__a0ea96a84713c46068d38d497db0dd149">Specifies the Kafka JVM heap memory setting. If the data volume on the broker is large, adjust the heap memory size.</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_1043.html">Performance Tuning</a></div>
|
|
</div>
|
|
</div>
|
|
|