Files
doc-exports/docs/dms/umn/CLASS.TXT.json
chenjunjie 190f09501c DMS UMN 20250314 version
Reviewed-by: Liudmila Denisova <ldenisov@noreply.gitea.eco.tsi-dev.otc-service.com>
Co-authored-by: chenjunjie <chenjunjie@huawei.com>
Co-committed-by: chenjunjie <chenjunjie@huawei.com>
2025-10-06 09:50:17 +00:00

1640 lines
64 KiB
JSON

[
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Service Overview",
"uri":"kafka-ug-0723001.html",
"doc_type":"usermanual",
"p_code":"",
"code":"1"
},
{
"desc":"Apache Kafka is distributed message middleware that features high throughput, data persistence, horizontal scalability, and stream data processing. It adopts the publish-",
"product_code":"dms",
"title":"What Is DMS?",
"uri":"kafka-pd-190605001.html",
"doc_type":"usermanual",
"p_code":"1",
"code":"2"
},
{
"desc":"DMS provides easy-to-use message queuing based on Apache Kafka. Services can be quickly migrated to the cloud without any change, reducing maintenance and usage costs.Rap",
"product_code":"dms",
"title":"Product Advantages",
"uri":"kafka-advantage.html",
"doc_type":"usermanual",
"p_code":"1",
"code":"3"
},
{
"desc":"Kafka is popular message-oriented middleware that features highly reliable, asynchronous message delivery. It is widely used for transmitting data between different syste",
"product_code":"dms",
"title":"Application Scenarios",
"uri":"kafka-scenarios.html",
"doc_type":"usermanual",
"p_code":"1",
"code":"4"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Kafka Instance Specifications",
"uri":"kafka-pd-0053.html",
"doc_type":"usermanual",
"p_code":"1",
"code":"5"
},
{
"desc":"A single-node Kafka instance has one broker, is compatible with open-source Kafka 2.7, and is applicable to test scenarios. Do not use it for production services.In the f",
"product_code":"dms",
"title":"Single-node Kafka Instances",
"uri":"kafka-pd-0056.html",
"doc_type":"usermanual",
"p_code":"5",
"code":"6"
},
{
"desc":"A cluster Kafka instance has three or more brokers, and is compatible with open-source Kafka 2.3.0, 2.7, and 3.x.In the following table:For Kafka instances, the number of",
"product_code":"dms",
"title":"Cluster Kafka Instances",
"uri":"Kafka-specification.html",
"doc_type":"usermanual",
"p_code":"5",
"code":"7"
},
{
"desc":"A single-node Kafka instance has only one broker. These instances do not guarantee performance or reliability and are for trial use or testing only. In the production env",
"product_code":"dms",
"title":"Comparing Single-node and Cluster Kafka Instances",
"uri":"kafka-pd-0052.html",
"doc_type":"usermanual",
"p_code":"1",
"code":"8"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Comparing Kafka and RocketMQ",
"uri":"kafka_pd_0004.html",
"doc_type":"usermanual",
"p_code":"1",
"code":"9"
},
{
"desc":"DMS is compatible with open-source Kafka and has customized and enhanced Kafka features. In addition to the advantages of open-source Kafka, DMS for Kafka provides more r",
"product_code":"dms",
"title":"Comparing DMS for Kafka and Open-Source Kafka",
"uri":"kafka-pd-200720001.html",
"doc_type":"usermanual",
"p_code":"1",
"code":"10"
},
{
"desc":"This section describes the notes and constraints on Distributed Message Service (DMS). Use your Kafka instances as prescribed to avoid program exceptions.Any instability ",
"product_code":"dms",
"title":"Notes and Constraints",
"uri":"kafka-pd-190605003.html",
"doc_type":"usermanual",
"p_code":"1",
"code":"11"
},
{
"desc":"Cloud Trace Service (CTS)CTS generates traces to provide you with a history of operations performed on cloud service resources. The traces include operation requests sent",
"product_code":"dms",
"title":"Related Services",
"uri":"kafka-pd-190605002.html",
"doc_type":"usermanual",
"p_code":"1",
"code":"12"
},
{
"desc":"DMS for Kafka of the cloud service platform uses Kafka as the message engine. This chapter presents explanations of basic concepts of Kafka.A topic is a category for mess",
"product_code":"dms",
"title":"Basic Concepts",
"uri":"glossary-kafka.html",
"doc_type":"usermanual",
"p_code":"1",
"code":"13"
},
{
"desc":"If you need to grant your enterprise personnel permission to access your DMS resources, use Identity and Access Management (IAM). IAM provides identity authentication, fi",
"product_code":"dms",
"title":"Permissions",
"uri":"ProductDescPrivilegeManagement.html",
"doc_type":"usermanual",
"p_code":"1",
"code":"14"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Getting Started",
"uri":"kafka-ug-00003.html",
"doc_type":"usermanual",
"p_code":"",
"code":"15"
},
{
"desc":"This section takes the example of creating a Kafka instance (ciphertext access and SASL_SSL) and accessing it on the client (private network, within a virtual private clo",
"product_code":"dms",
"title":"Getting Started with Kafka for Message Production and Consumption",
"uri":"kafka-qs-0409001.html",
"doc_type":"usermanual",
"p_code":"15",
"code":"16"
},
{
"desc":"Distributed Message Service is a message queuing service that is based on the open-source Apache Kafka. It provides Kafka instances with isolated computing, storage, and ",
"product_code":"dms",
"title":"Process of Using Kafka",
"uri":"kafka-ug-0069.html",
"doc_type":"usermanual",
"p_code":"",
"code":"17"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Permissions Management",
"uri":"UserPrivilegeManagement.html",
"doc_type":"usermanual",
"p_code":"",
"code":"18"
},
{
"desc":"This section describes how to use Identity and Access Management (IAM) for fine-grained permissions control for your Distributed Message Service (DMS) for Kafka resources",
"product_code":"dms",
"title":"Creating an IAM User and Granting DMS for Kafka Permissions",
"uri":"CreateUserAndGrantPolicy.html",
"doc_type":"usermanual",
"p_code":"18",
"code":"19"
},
{
"desc":"Kafka instances are tenant-exclusive, and physically isolated in deployment. You can customize the computing capabilities and storage space of a Kafka instance as require",
"product_code":"dms",
"title":"Creating a Kafka Instance",
"uri":"kafka-ug-180604013.html",
"doc_type":"usermanual",
"p_code":"",
"code":"20"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Configuring Topics",
"uri":"kafka-ug-0720001.html",
"doc_type":"usermanual",
"p_code":"",
"code":"21"
},
{
"desc":"Topics store messages created by producers and subscribed by consumers. If Automatic Topic Creation is not enabled during Kafka instance creation, you need to manually cr",
"product_code":"dms",
"title":"Creating a Kafka Topic",
"uri":"kafka-ug-180604018.html",
"doc_type":"usermanual",
"p_code":"21",
"code":"22"
},
{
"desc":"Kafka instances with ciphertext access enabled support access control list (ACL) for topics. You can differentiate user permissions by granting users different permission",
"product_code":"dms",
"title":"Configuring Kafka Topic Permissions",
"uri":"kafka-ug-0002.html",
"doc_type":"usermanual",
"p_code":"21",
"code":"23"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Managing Topics",
"uri":"kafka-ug-0058.html",
"doc_type":"usermanual",
"p_code":"21",
"code":"24"
},
{
"desc":"On the Kafka console, you can view basic information, partition and producer information, and subscriptions of a topic.If an instance contains more than 10,000 consumer g",
"product_code":"dms",
"title":"Viewing Kafka Topic Details",
"uri":"kafka_ug_0045.html",
"doc_type":"usermanual",
"p_code":"24",
"code":"25"
},
{
"desc":"This section describes how to modify configurations in Table 1 of a Kafka topic on the console.Modifying Synchronous Replication, Synchronous Flushing, Message Timestamp,",
"product_code":"dms",
"title":"Modifying Kafka Topic Configurations",
"uri":"kafka-ug-0038.html",
"doc_type":"usermanual",
"p_code":"24",
"code":"26"
},
{
"desc":"After creating a topic, you can change the number of partitions as required. Changing the number of partitions does not restart the instance or affect services.Methods fo",
"product_code":"dms",
"title":"Changing Kafka Partition Quantity",
"uri":"kafka-ug-0006.html",
"doc_type":"usermanual",
"p_code":"24",
"code":"27"
},
{
"desc":"The replicas of a Kafka topic can be modified as required.Reassigning partitions can modify replicas automatically or manually on the Kafka console. For more information,",
"product_code":"dms",
"title":"Modifying Kafka Topic Replicas",
"uri":"kafka-ug-0072.html",
"doc_type":"usermanual",
"p_code":"24",
"code":"28"
},
{
"desc":"Export the topic list on the console. Batch export is supported.A topic has been created.The topic list contains the following information: topic name, number of partitio",
"product_code":"dms",
"title":"Exporting the Kafka Topic List",
"uri":"kafka_ug_0027.html",
"doc_type":"usermanual",
"p_code":"24",
"code":"29"
},
{
"desc":"Partition reassignment is to reassign replicas of a partition to different brokers to solve the problem of unbalanced broker load.Partition reassignment is required in th",
"product_code":"dms",
"title":"Reassigning Kafka Partitions",
"uri":"kafka_ug_0023.html",
"doc_type":"usermanual",
"p_code":"24",
"code":"30"
},
{
"desc":"Automatic Topic Creation indicates that a topic will be automatically created when a message is produced in or consumed from a topic that does not exist. By default, the ",
"product_code":"dms",
"title":"Configuring Automatic Topic Creation",
"uri":"kafka_ug_0043.html",
"doc_type":"usermanual",
"p_code":"24",
"code":"31"
},
{
"desc":"This document describes how to delete a topic.Deleting a Kafka Topic (Console)Deleting a Kafka Topic on the ClientDeleting a topic clears the topic data permanently.For a",
"product_code":"dms",
"title":"Deleting a Kafka Topic",
"uri":"kafka-ug-180604019.html",
"doc_type":"usermanual",
"p_code":"24",
"code":"32"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Connecting to an Instance",
"uri":"kafka-ug190605003.html",
"doc_type":"usermanual",
"p_code":"",
"code":"33"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Configuring Kafka Network Connections",
"uri":"kafka-ug-0059.html",
"doc_type":"usermanual",
"p_code":"33",
"code":"34"
},
{
"desc":"A client can connect to a Kafka instance over a public or private network. Notes before using a private network:By default, a client and a Kafka instance are interconnect",
"product_code":"dms",
"title":"Kafka Network Connection Conditions",
"uri":"kafka-ug-180604012.html",
"doc_type":"usermanual",
"p_code":"34",
"code":"35"
},
{
"desc":"A client can use IPv4 or IPv6 addresses to access a Kafka instance over a public network.By IPv4: On the Kafka console, enable public access and configure EIPs for the in",
"product_code":"dms",
"title":"Configuring Kafka Public Access",
"uri":"kafka-ug-0319001.html",
"doc_type":"usermanual",
"p_code":"34",
"code":"36"
},
{
"desc":"VPCs are logically isolated from each other. If a Kafka instance and a Kafka client are in different VPCs within a region, they cannot communicate with each other. In thi",
"product_code":"dms",
"title":"Accessing Kafka Using a VPC Endpoint Across VPCs",
"uri":"kafka-ug-0001.html",
"doc_type":"usermanual",
"p_code":"34",
"code":"37"
},
{
"desc":"Enable public access in either of the following ways:On the Kafka console, access Kafka instances using EIPs. For details, see Configuring Kafka Public Access.Configure p",
"product_code":"dms",
"title":"Accessing Kafka in a Public Network Using DNAT",
"uri":"kafka-dnat.html",
"doc_type":"usermanual",
"p_code":"34",
"code":"38"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Configuring Kafka Access Control",
"uri":"kafka-ug-0061.html",
"doc_type":"usermanual",
"p_code":"33",
"code":"39"
},
{
"desc":"You can access a Kafka instance in plaintext or ciphertext. This section describes how to change the access mode on the console.Plaintext access: Clients connect to the K",
"product_code":"dms",
"title":"Configuring Plaintext or Ciphertext Access to Kafka Instances",
"uri":"kafka_ug_0044.html",
"doc_type":"usermanual",
"p_code":"39",
"code":"40"
},
{
"desc":"Kafka instances with ciphertext access enabled support access control list (ACL) for topics. You can differentiate user permissions by granting users different permission",
"product_code":"dms",
"title":"Configuring Kafka ACL Users",
"uri":"kafka-ug-0003.html",
"doc_type":"usermanual",
"p_code":"39",
"code":"41"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Configuring the Kafka Client",
"uri":"kafka-ug-0062.html",
"doc_type":"usermanual",
"p_code":"33",
"code":"42"
},
{
"desc":"This section provides recommendations on configuring common parameters for Kafka producers and consumers. Kafka clients in different versions may have different parameter",
"product_code":"dms",
"title":"Setting Parameters for Kafka Clients",
"uri":"Kafka-client-parameter.html",
"doc_type":"usermanual",
"p_code":"42",
"code":"43"
},
{
"desc":"Ensure that the owner thread does not exit abnormally. Otherwise, the client may fail to initiate consumption requests and the consumption will be blocked.Commit messages",
"product_code":"dms",
"title":"Suggestions on Using the Kafka Client",
"uri":"Kafka-client-best-practice.html",
"doc_type":"usermanual",
"p_code":"42",
"code":"44"
},
{
"desc":"This section describes how to access a Kafka instance in plaintext on an open-source Kafka client. With plaintext access enabled, there is no authentication required in s",
"product_code":"dms",
"title":"Connecting to Kafka Using the Client (Plaintext Access)",
"uri":"kafka-ug-180604020.html",
"doc_type":"usermanual",
"p_code":"33",
"code":"45"
},
{
"desc":"This section describes how to access a Kafka instance in ciphertext on an open-source Kafka client. The client connects to the Kafka instance with SASL authentication. If",
"product_code":"dms",
"title":"Connecting to Kafka Using the Client (Ciphertext Access)",
"uri":"kafka-ug-180801001.html",
"doc_type":"usermanual",
"p_code":"33",
"code":"46"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Managing Messages",
"uri":"kafka-ug-0720002.html",
"doc_type":"usermanual",
"p_code":"",
"code":"47"
},
{
"desc":"When messages are lost or fail to be consumed, you can query the content and attributes of specific messages for troubleshooting.You can view the offset of different part",
"product_code":"dms",
"title":"Viewing Kafka Messages",
"uri":"kafka-ug-190904001.html",
"doc_type":"usermanual",
"p_code":"47",
"code":"48"
},
{
"desc":"Aging time is a period that messages in a topic are retained for. Consumers must consume messages before this period ends. Otherwise, the messages will be deleted and can",
"product_code":"dms",
"title":"Changing Kafka Message Retention Period",
"uri":"kafka-ug-200506001.html",
"doc_type":"usermanual",
"p_code":"47",
"code":"49"
},
{
"desc":"This section describes how to delete messages stored in a topic on the console.Deleting messages takes effect permanently.Before deleting a message, set the auto.offset.r",
"product_code":"dms",
"title":"Deleting Kafka Messages",
"uri":"kafka_ug_0046.html",
"doc_type":"usermanual",
"p_code":"47",
"code":"50"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Managing Consumer Groups",
"uri":"kafka-ug-0011.html",
"doc_type":"usermanual",
"p_code":"",
"code":"51"
},
{
"desc":"A consumer subscribes to a topic. A consumer group consists of one or more consumers. Within a consumer group, each consumer can consume multiple partitions at the same t",
"product_code":"dms",
"title":"Creating a Kafka Consumer Group",
"uri":"kafka-ug-0041.html",
"doc_type":"usermanual",
"p_code":"51",
"code":"52"
},
{
"desc":"After a consumer group is created, you can view its configuration and status.The consumer group name, status, and Coordinator (ID) are displayed. Coordinator (ID) indicat",
"product_code":"dms",
"title":"Querying the Kafka Consumer Group List",
"uri":"kafka_ug_0021.html",
"doc_type":"usermanual",
"p_code":"51",
"code":"53"
},
{
"desc":"If a consumer group has consumers who are accessing a Kafka instance, you can view their connection information.The consumer list and connection address can be viewed onl",
"product_code":"dms",
"title":"Viewing Kafka Consumer Information",
"uri":"kafka-ug-0015.html",
"doc_type":"usermanual",
"p_code":"51",
"code":"54"
},
{
"desc":"A consumption offset indicates the consumption progress of a consumer. This section describes how to view and reset consumption offsets.Messages may be consumed more than",
"product_code":"dms",
"title":"Viewing and Resetting Kafka Consumption Offsets",
"uri":"kafka-ug-0014.html",
"doc_type":"usermanual",
"p_code":"51",
"code":"55"
},
{
"desc":"You can export a list of consumer groups in a Kafka instance.Select the desired consumer groups and choose Export > Export selected data to an XLSX file to export specifi",
"product_code":"dms",
"title":"Exporting Kafka Consumer Groups",
"uri":"kafka-ug-0056.html",
"doc_type":"usermanual",
"p_code":"51",
"code":"56"
},
{
"desc":"You can delete a consumer group in either of the following ways:On the console.Use Kafka CLI. (Ensure that the Kafka instance version is the same as the CLI version.)If a",
"product_code":"dms",
"title":"Deleting a Kafka Consumer Group",
"uri":"kafka-ug-0012.html",
"doc_type":"usermanual",
"p_code":"51",
"code":"57"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Managing Instances",
"uri":"kafka-ug-180604011.html",
"doc_type":"usermanual",
"p_code":"",
"code":"58"
},
{
"desc":"After creating a Kafka instance, you can view the details or modify some parameters of it on the console as required. These parameters include the instance name, descript",
"product_code":"dms",
"title":"Viewing and Modifying Basic Information of a Kafka Instance",
"uri":"kafka-ug-180604014.html",
"doc_type":"usermanual",
"p_code":"58",
"code":"59"
},
{
"desc":"This section describes how to view the disk usage of each broker of a Kafka instance on the console.Unavailable for single-node instances.You can query topics that use th",
"product_code":"dms",
"title":"Viewing Kafka Disk Usage",
"uri":"kafka-ug-0004.html",
"doc_type":"usermanual",
"p_code":"58",
"code":"60"
},
{
"desc":"After you initiate certain instance operations listed in Table 1, a background task will start for each operation. On the console, you can view the background task status",
"product_code":"dms",
"title":"Viewing Kafka Background Tasks",
"uri":"kafka-ug-200119002.html",
"doc_type":"usermanual",
"p_code":"58",
"code":"61"
},
{
"desc":"Distributed Message Service allows you to view sample Java, Go, and Python code of producing and consuming messages on the console. You can quickly complete Kafka client ",
"product_code":"dms",
"title":"Viewing Sample Code of Kafka Production and Consumption",
"uri":"kafka_ug_0024.html",
"doc_type":"usermanual",
"p_code":"58",
"code":"62"
},
{
"desc":"Your Kafka instances, topics, and consumers come with default configuration parameter settings. You can modify common parameters on the DMS console. For details about par",
"product_code":"dms",
"title":"Modifying Kafka Instance Configuration Parameters",
"uri":"kafka-ug-0007.html",
"doc_type":"usermanual",
"p_code":"58",
"code":"63"
},
{
"desc":"Tags facilitate Kafka instance identification and management.You can add tags to a Kafka instance when creating the instance or add tags on the Tags page of the created i",
"product_code":"dms",
"title":"Configuring Kafka Instance Tags",
"uri":"TagManagement.html",
"doc_type":"usermanual",
"p_code":"58",
"code":"64"
},
{
"desc":"You can export a list of instances on the DMS console.Select the desired instances and choose Export > Export selected data to an XLSX file to export specified instances.",
"product_code":"dms",
"title":"Exporting the Kafka Instance List",
"uri":"kafka-ug-0053.html",
"doc_type":"usermanual",
"p_code":"58",
"code":"65"
},
{
"desc":"You can restart one or more Kafka instances in batches on the DMS console.When a Kafka instance is being restarted, message consumption and production requests of clients",
"product_code":"dms",
"title":"Restarting a Kafka Instance",
"uri":"kafka-ug-180604015.html",
"doc_type":"usermanual",
"p_code":"58",
"code":"66"
},
{
"desc":"Delete one or more Kafka instances at a time on the DMS console.Deleting a Kafka instance will clear the instance data without any backup. Exercise caution.The status of ",
"product_code":"dms",
"title":"Deleting Kafka Instances",
"uri":"kafka-ug-180604016.html",
"doc_type":"usermanual",
"p_code":"58",
"code":"67"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Modifying Instance Specifications",
"uri":"kafka-ug-0075.html",
"doc_type":"usermanual",
"p_code":"",
"code":"68"
},
{
"desc":"After creating a Kafka instance, you can increase its specifications. Table 1 lists available modification options. Only one object can be modified per operation: broker ",
"product_code":"dms",
"title":"Modifying Cluster Kafka Instance Specifications",
"uri":"kafka-ug-181221001.html",
"doc_type":"usermanual",
"p_code":"68",
"code":"69"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Migrating Data",
"uri":"kafka_ug_0016.html",
"doc_type":"usermanual",
"p_code":"",
"code":"70"
},
{
"desc":"You can migrate Kafka services to connect message producers and consumers to a new Kafka instance and can even migrate persisted message data to the new Kafka instance. K",
"product_code":"dms",
"title":"Kafka Data Migration Overview",
"uri":"kafka-bp-migration.html",
"doc_type":"usermanual",
"p_code":"70",
"code":"71"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Migrating Data Using Smart Connect",
"uri":"kafka-ug-0065.html",
"doc_type":"usermanual",
"p_code":"70",
"code":"72"
},
{
"desc":"Smart Connect synchronizes data between Kafka and other cloud services (such as OBS) or between two Kafka instances for backup or migration.Procedure for using Smart Conn",
"product_code":"dms",
"title":"Enabling Smart Connect",
"uri":"kafka_ug_0017.html",
"doc_type":"usermanual",
"p_code":"72",
"code":"73"
},
{
"desc":"Create a Smart Connect task to copy data unidirectionally or bidirectionally between two Kafka instances.Data in the source Kafka instance is synchronized to the target K",
"product_code":"dms",
"title":"Replicating Kafka Instance Data",
"uri":"kafka-ug-0034.html",
"doc_type":"usermanual",
"p_code":"72",
"code":"74"
},
{
"desc":"Create a Smart Connect task to dump Kafka instance data to OBS for message data backup.Data in the source Kafka instance is synchronized to the dumping file in real time.",
"product_code":"dms",
"title":"Dumping Kafka Data to Object Storage Service (OBS)",
"uri":"kafka-ug-0035.html",
"doc_type":"usermanual",
"p_code":"72",
"code":"75"
},
{
"desc":"View, delete, start, pause, or restart a Smart Connect task.Unavailable for single-node instances.A Smart Connect task has been created.The source and target are displaye",
"product_code":"dms",
"title":"Managing Smart Connect Tasks",
"uri":"kafka_ug_0018.html",
"doc_type":"usermanual",
"p_code":"72",
"code":"76"
},
{
"desc":"Disable Smart Connect and resources can be freed.Disabling Smart Connect does not affect services.Brokers related to Smart Connect are automatically deleted.If you disabl",
"product_code":"dms",
"title":"Disabling Smart Connect",
"uri":"kafka_ug_0041.html",
"doc_type":"usermanual",
"p_code":"72",
"code":"77"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Monitoring and Alarms",
"uri":"kafka-ug-180413001.html",
"doc_type":"usermanual",
"p_code":"",
"code":"78"
},
{
"desc":"Cloud Eye monitors Kafka instance metrics in real time. You can view these metrics on the Cloud Eye console.At least one Kafka instance has been created. The instance has",
"product_code":"dms",
"title":"Viewing Kafka Metrics",
"uri":"kafka-ug-190605001.html",
"doc_type":"usermanual",
"p_code":"78",
"code":"79"
},
{
"desc":"This section describes metrics reported by DMS to Cloud Eye as well as their namespaces and dimensions. You can use the Cloud Eye console or APIs to query the Kafka metri",
"product_code":"dms",
"title":"Kafka Metrics",
"uri":"kafka-ug-180413002.html",
"doc_type":"usermanual",
"p_code":"78",
"code":"80"
},
{
"desc":"This section describes the alarm rules of some metrics and how to configure them. In actual services, you are advised to configure alarm rules for metrics based on the fo",
"product_code":"dms",
"title":"Configuring a Kafka Alarm Rule",
"uri":"kafka-ug-180524001.html",
"doc_type":"usermanual",
"p_code":"78",
"code":"81"
},
{
"desc":"With Cloud Trace Service (CTS), you can record operations associated with DMS for later query, audit, and backtrack operations.CTS has been enabled.See Querying Real-Time",
"product_code":"dms",
"title":"Viewing Kafka Audit Logs",
"uri":"kafka-ug-180418002.html",
"doc_type":"usermanual",
"p_code":"",
"code":"82"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"FAQs",
"uri":"kafka-ug-0723004.html",
"doc_type":"usermanual",
"p_code":"",
"code":"83"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Instances",
"uri":"kafka-faq-191030002.html",
"doc_type":"usermanual",
"p_code":"83",
"code":"84"
},
{
"desc":"To improve the reliability of a Kafka instance, you are advised to select three AZs or more when creating the instance. You cannot select two AZs.Each Kafka instance cont",
"product_code":"dms",
"title":"Why Can't I Select Two AZs?",
"uri":"kafka-faq-200426002.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"85"
},
{
"desc":"The possible cause is that you do not have the Server Administrator and VPC Administrator permissions. For details about how to add permissions to a user group, see Viewi",
"product_code":"dms",
"title":"Why Can't I View the Subnet and Security Group Information When Creating a DMS Instance?",
"uri":"kafka-faq-200426003.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"86"
},
{
"desc":"The storage space is the space for storing messages (including messages in replicas), logs and metadata. To select a storage space, specify the disk type and disk size. F",
"product_code":"dms",
"title":"How Do I Select Storage Space for a Kafka Instance?",
"uri":"kafka-faq-200426005.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"87"
},
{
"desc":"High I/O: The average latency is 6 to 10 ms, and the maximum bandwidth is 150 MB/s (read + write).Ultra-high I/O: The average latency is 1 to 3 ms, and the maximum bandwi",
"product_code":"dms",
"title":"How Do I Choose Between High I/O and Ultra-high I/O?",
"uri":"kafka-faq-200426006.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"88"
},
{
"desc":"The following policies are supported:Stop productionWhen the memory usage reaches the disk capacity threshold (95%), new messages will no longer be created, but existing ",
"product_code":"dms",
"title":"Which Capacity Threshold Policy Should I Use?",
"uri":"kafka-faq-200426007.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"89"
},
{
"desc":"Kafka v2.3.0, v2.7, and v3.x.For details about how to create a Kafka instance, see Creating a Kafka Instance.",
"product_code":"dms",
"title":"Which Kafka Versions Are Supported?",
"uri":"kafka-faq-200426008.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"90"
},
{
"desc":"Kafka instances are managed using ZooKeeper. Opening ZooKeeper may cause misoperations and service losses. ZooKeeper is used only within Kafka clusters and does not provi",
"product_code":"dms",
"title":"What Is the ZooKeeper Address of a Kafka Instance?",
"uri":"kafka-faq-200426009.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"91"
},
{
"desc":"Kafka instances are classified into single-node and cluster types. A single-node instance has only one broker in single-node mode. A cluster instance consists of three or",
"product_code":"dms",
"title":"Are Kafka Instances in Cluster Mode?",
"uri":"kafka-faq-200426010.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"92"
},
{
"desc":"No. You must access a Kafka instance through one of the following ports:Accessing a Kafka instance without SASL:The port varies with the access mode:Intra-VPC access usin",
"product_code":"dms",
"title":"Can I Modify the Port for Accessing a Kafka Instance?",
"uri":"kafka-faq-200426011.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"93"
},
{
"desc":"The certificates are valid for more than 15 years. You do not need to worry about certificate expiration. The certificates are used for one-way authentication when enabli",
"product_code":"dms",
"title":"How Long Are Kafka SSL Certificates Valid for?",
"uri":"kafka-faq-200426012.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"94"
},
{
"desc":"On the Kafka console, you can create a Smart Connect task for instance data replication. For details, see Replicating Kafka Instance Data.",
"product_code":"dms",
"title":"How Do I Synchronize Data from One Kafka Instance to Another?",
"uri":"kafka-faq-200426013.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"95"
},
{
"desc":"The SASL_SSL setting of a cluster Kafka instance can be changed after instance creation. For details, see Configuring Plaintext or Ciphertext Access to Kafka Instances.A ",
"product_code":"dms",
"title":"How Do I Change the SASL_SSL Setting of a Kafka Instance?",
"uri":"kafka-faq-200426014.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"96"
},
{
"desc":"There are two SASL authentication mechanisms for Kafka instances: SCRAM-SHA-512 and PLAIN.For instances with IPv6 disabled, the mechanism cannot be modified after ciphert",
"product_code":"dms",
"title":"How Do I Modify the SASL Mechanism?",
"uri":"kafka_faq_0052.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"97"
},
{
"desc":"There are two security protocols for Kafka instances: SASL_SSL and SASL_PLAINTEXT.For instances with IPv6 disabled, the security protocol can be changed on the console. I",
"product_code":"dms",
"title":"How Do I Change the Security Protocol?",
"uri":"kafka_faq_0062.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"98"
},
{
"desc":"No. A Kafka instance will not be restarted if you modify its enterprise project.",
"product_code":"dms",
"title":"Will a Kafka Instance Be Restarted After Its Enterprise Project Is Modified?",
"uri":"kafka-faq-0008.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"99"
},
{
"desc":"Kafka brokers and ZooKeeper are deployed on the same VM.",
"product_code":"dms",
"title":"Are Kafka Brokers and ZooKeeper Deployed on the Same VM or on Different VMs?",
"uri":"kafka-faq-0015.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"100"
},
{
"desc":"For security purposes, TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 is supported.",
"product_code":"dms",
"title":"Which Cipher Suites Are Supported by Kafka?",
"uri":"kafka-faq-0020.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"101"
},
{
"desc":"No. The AZ cannot be changed once the instance is created. To use multiple AZs, create another instance.",
"product_code":"dms",
"title":"Can I Change Single-AZ Deployment to Multi-AZ Deployment for an Instance?",
"uri":"kafka-faq-0023.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"102"
},
{
"desc":"DMS for Kafka supports cross-AZ disaster recovery. If you select multiple AZs when creating an instance, cross-AZ disaster recovery will be available.You can view the AZs",
"product_code":"dms",
"title":"Does DMS for Kafka Support Cross-AZ Disaster Recovery? Where Can I Check Whether an Existing Instance is Across-AZs?",
"uri":"kafka-faq-0025.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"103"
},
{
"desc":"Yes.",
"product_code":"dms",
"title":"Do Kafka Instances Support Disk Encryption?",
"uri":"kafka-faq-0030.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"104"
},
{
"desc":"No. Once an instance is created, its VPC and subnet cannot be changed.",
"product_code":"dms",
"title":"Can I Change the VPC and Subnet After a Kafka Instance Is Created?",
"uri":"kafka-faq-0036.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"105"
},
{
"desc":"You can find Kafka Streams use cases on the official Kafka website.",
"product_code":"dms",
"title":"Where Can I Find Kafka Streams Use Cases?",
"uri":"kafka-faq-0037.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"106"
},
{
"desc":"No. Kafka instances cannot be upgraded once they are created. To use a higher Kafka version, create another Kafka instance.",
"product_code":"dms",
"title":"Can I Upgrade Kafka Instances?",
"uri":"kafka-faq-0040.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"107"
},
{
"desc":"On the DMS console, click the name of the target Kafka instance. Disable Public Access in the Connection section on the Basic Information tab page, and then enable it aga",
"product_code":"dms",
"title":"How Do I Bind an EIP Again?",
"uri":"kafka_faq_0046.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"108"
},
{
"desc":"Each broker of a Kafka instance has a 100 GB disk. The automatic deletion policy has been configured and a topic with 180 partitions has been created. The earliest messag",
"product_code":"dms",
"title":"Why Are the Earliest Messages Not Automatically Deleted When the Disk Capacity Reaches 95%?",
"uri":"kafka-faq-0070.html",
"doc_type":"usermanual",
"p_code":"84",
"code":"109"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Specification Modification",
"uri":"kafka_faq_0053.html",
"doc_type":"usermanual",
"p_code":"83",
"code":"110"
},
{
"desc":"Table 1 describes the impact of increasing specifications.",
"product_code":"dms",
"title":"Does Specification Modification Affect Services?",
"uri":"kafka-faq-0035.html",
"doc_type":"usermanual",
"p_code":"110",
"code":"111"
},
{
"desc":"No. Data will not be migrated when you increase specifications.",
"product_code":"dms",
"title":"Will Data Migration Be Involved When I Increase Specifications?",
"uri":"kafka_faq_0054.html",
"doc_type":"usermanual",
"p_code":"110",
"code":"112"
},
{
"desc":"Possible cause: When you increase the broker flavor, a rolling restart is performed on brokers. During the restart, partition leaders are changed. The producer has cached",
"product_code":"dms",
"title":"Why Does Message Production Fail During Scaling?",
"uri":"kafka_faq_0056.html",
"doc_type":"usermanual",
"p_code":"110",
"code":"113"
},
{
"desc":"Symptom: Specifications fail to be increased, and a message is displayed indicating that the underlying ECS/EVS resources are insufficient. However, the required ECSs can",
"product_code":"dms",
"title":"What Can I Do When I Fail to Increase Specifications Due to Insufficient Resources?",
"uri":"kafka_faq_0057.html",
"doc_type":"usermanual",
"p_code":"110",
"code":"114"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Connections",
"uri":"kafka-faq-191030001.html",
"doc_type":"usermanual",
"p_code":"83",
"code":"115"
},
{
"desc":"Kafka instances can be accessed within a VPC, across VPCs, through DNAT, or over public networks. Before accessing a Kafka instance, configure a security group.If they us",
"product_code":"dms",
"title":"How Do I Select and Configure a Security Group?",
"uri":"kafka-faq-180604024.html",
"doc_type":"usermanual",
"p_code":"115",
"code":"116"
},
{
"desc":"Yes. For details, see the Connecting to an Instance.",
"product_code":"dms",
"title":"Can I Access a Kafka Instance Over a Public Network?",
"uri":"kafka-faq-200426015.html",
"doc_type":"usermanual",
"p_code":"115",
"code":"117"
},
{
"desc":"The number of connection addresses of a Kafka instance is the same as the number of brokers of the instance. The following table lists the number of brokers corresponding",
"product_code":"dms",
"title":"How Many Connection Addresses Does a Kafka Instance Have by Default?",
"uri":"kafka-faq-200426016.html",
"doc_type":"usermanual",
"p_code":"115",
"code":"118"
},
{
"desc":"Yes. You can access a Kafka instance across regions over a public network or by using direct connections.",
"product_code":"dms",
"title":"Do Kafka Instances Support Cross-Region Access?",
"uri":"kafka-faq-200426017.html",
"doc_type":"usermanual",
"p_code":"115",
"code":"119"
},
{
"desc":"Yes. You can use one of the following methods to access a Kafka instance across VPCs:Establish a VPC peering connection to allow two VPCs to communicate with each other. ",
"product_code":"dms",
"title":"Do Kafka Instances Support Cross-VPC Access?",
"uri":"kafka-faq-200426019.html",
"doc_type":"usermanual",
"p_code":"115",
"code":"120"
},
{
"desc":"Yes.If the client and the instance are in the same VPC, cross-subnet access is supported. By default, subnets in the same VPC can communicate with each other.",
"product_code":"dms",
"title":"Do Kafka Instances Support Cross-Subnet Access?",
"uri":"kafka-faq-200426020.html",
"doc_type":"usermanual",
"p_code":"115",
"code":"121"
},
{
"desc":"No, Kerberos authentication is not supported. Kafka supports client authentication with SASL and API calling authentication using tokens and AK/SK.To access an instance i",
"product_code":"dms",
"title":"Does DMS for Kafka Support Authentication with Kerberos?",
"uri":"kafka-faq-200426023.html",
"doc_type":"usermanual",
"p_code":"115",
"code":"122"
},
{
"desc":"Yes. No password is required when accessing a Kafka instance in plaintext. For details, see Connecting to Kafka Using the Client (Plaintext Access).",
"product_code":"dms",
"title":"Does DMS for Kafka Support Password-Free Access?",
"uri":"kafka-faq-200708002.html",
"doc_type":"usermanual",
"p_code":"115",
"code":"123"
},
{
"desc":"Click the name of your Kafka instance. In the Connection section on the Basic Information page, view Instance Address (Public Network).For details about how to connect to",
"product_code":"dms",
"title":"How Do I Obtain the Public Access Address After Public Access Is Enabled?",
"uri":"kafka-faq-0001.html",
"doc_type":"usermanual",
"p_code":"115",
"code":"124"
},
{
"desc":"No.",
"product_code":"dms",
"title":"Does DMS for Kafka Support Authentication on Clients by the Server?",
"uri":"kafka-faq-0026.html",
"doc_type":"usermanual",
"p_code":"115",
"code":"125"
},
{
"desc":"No. You can only use JKS certificates for connecting to instances in Java.",
"product_code":"dms",
"title":"Can I Use PEM SSL Truststore When Connecting to a Kafka Instance with SASL_SSL Enabled?",
"uri":"kafka-faq-0027.html",
"doc_type":"usermanual",
"p_code":"115",
"code":"126"
},
{
"desc":"JKS certificates are used for connecting to instances in Java and CRT certificates are used for connecting to instances in Python.",
"product_code":"dms",
"title":"What Are the Differences Between JKS and CRT Certificates?",
"uri":"kafka-faq-0028.html",
"doc_type":"usermanual",
"p_code":"115",
"code":"127"
},
{
"desc":"TLS 1.2.",
"product_code":"dms",
"title":"Which TLS Version Does DMS for Kafka Support?",
"uri":"kafka-faq-0029.html",
"doc_type":"usermanual",
"p_code":"115",
"code":"128"
},
{
"desc":"Yes. The maximum allowed number of client connections varies by instance specifications.",
"product_code":"dms",
"title":"Is There a Limit on the Number of Client Connections to a Kafka Instance?",
"uri":"kafka-faq-0033.html",
"doc_type":"usermanual",
"p_code":"115",
"code":"129"
},
{
"desc":"Each Kafka broker allows a maximum of 1000 connections from each IP address by default. Excess connections will be rejected. You can change the limit by referring to Modi",
"product_code":"dms",
"title":"How Many Connections Are Allowed from Each IP Address?",
"uri":"kafka-faq-0034.html",
"doc_type":"usermanual",
"p_code":"115",
"code":"130"
},
{
"desc":"No, and you cannot specify the IP addresses.",
"product_code":"dms",
"title":"Can I Change the Private Network Addresses of a Kafka Instance?",
"uri":"kafka_faq_0048.html",
"doc_type":"usermanual",
"p_code":"115",
"code":"131"
},
{
"desc":"Yes. All Kafka instances and users use the same SSL certificate.To obtain the SSL certificate, perform the following steps:",
"product_code":"dms",
"title":"Is the Same SSL Certificate Used for Different Instances?",
"uri":"kafka_faq_0051.html",
"doc_type":"usermanual",
"p_code":"115",
"code":"132"
},
{
"desc":"If a Sarama client is used to send and receive messages, the following issues may occur:Sarama cannot detect partition changes. Adding topic partitions requires client re",
"product_code":"dms",
"title":"Why Is It Not Recommended to Use a Sarama Client for Messaging?",
"uri":"kafka_faq_0061.html",
"doc_type":"usermanual",
"p_code":"115",
"code":"133"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Topics and Partitions",
"uri":"kafka-faq-191030003.html",
"doc_type":"usermanual",
"p_code":"83",
"code":"134"
},
{
"desc":"The number of topics is related to the total number of topic partitions and the number of partitions in each topic. There is an upper limit on the aggregate number of par",
"product_code":"dms",
"title":"Is There a Limit on the Number of Topics in a Kafka Instance?",
"uri":"kafka-faq-200426024.html",
"doc_type":"usermanual",
"p_code":"134",
"code":"135"
},
{
"desc":"Kafka manages messages by partition. If there are too many partitions, message creation, storage, and retrieval will be fragmented, affecting the performance and stabilit",
"product_code":"dms",
"title":"Why Is Partition Quantity Limited?",
"uri":"kafka-faq-200426025.html",
"doc_type":"usermanual",
"p_code":"134",
"code":"136"
},
{
"desc":"No. If you want to use fewer partitions, delete the corresponding topic, create another one, and specify the desired number of partitions.",
"product_code":"dms",
"title":"Can I Reduce the Partition Quantity?",
"uri":"kafka-faq-200426101.html",
"doc_type":"usermanual",
"p_code":"134",
"code":"137"
},
{
"desc":"Possible cause: The aggregate number of partitions of created topics has reached the upper limit. The limit varies with instance specifications. For details, see Single-n",
"product_code":"dms",
"title":"Why Do I Fail to Create Topics?",
"uri":"kafka-faq-200426026.html",
"doc_type":"usermanual",
"p_code":"134",
"code":"138"
},
{
"desc":"Automatic topic creation is supported, but batch topic import is not supported. You can only export topics in batches.Enable automatic topic creation using one of the fol",
"product_code":"dms",
"title":"Do Kafka Instances Support Batch Importing Topics or Automatic Topic Creation?",
"uri":"kafka-faq-200426027.html",
"doc_type":"usermanual",
"p_code":"134",
"code":"139"
},
{
"desc":"Yes. Use either of the following methods to check the disk space used by a topic:In the row containing the desired Kafka instance, click View Metric to go to the Cloud Ey",
"product_code":"dms",
"title":"Can I View the Disk Space Used by a Topic?",
"uri":"kafka-faq-200426030.html",
"doc_type":"usermanual",
"p_code":"134",
"code":"140"
},
{
"desc":"If you have enabled SASL_SSL for your Kafka instance, you can configure ACL permissions for your topics. On the Topics page of the Kafka console, click Grant User Permiss",
"product_code":"dms",
"title":"Can I Add ACL Permissions for Topics?",
"uri":"kafka-faq-200426032.html",
"doc_type":"usermanual",
"p_code":"134",
"code":"141"
},
{
"desc":"Messages are not deleted immediately after being retrieved. They are deleted only when the aging time expires.You can shorten the aging time or expand the storage space.",
"product_code":"dms",
"title":"What Should I Do If Kafka Storage Space Is Used Up Because Retrieved Messages Are Not Deleted?",
"uri":"kafka-faq-0003.html",
"doc_type":"usermanual",
"p_code":"134",
"code":"142"
},
{
"desc":"You can increase the partition quantity by increasing broker flavors or adding brokers. For details, see Modifying Cluster Kafka Instance Specifications.",
"product_code":"dms",
"title":"How Do I Increase the Partition Quantity?",
"uri":"kafka-faq-0005.html",
"doc_type":"usermanual",
"p_code":"134",
"code":"143"
},
{
"desc":"Enabling or disabling automatic topic creation may cause instance restarts. For details, see the information displayed on the Kafka console.",
"product_code":"dms",
"title":"Will a Kafka Instance Be Restarted After Its Automatic Topic Creation Setting Is Modified?",
"uri":"kafka-faq-0010.html",
"doc_type":"usermanual",
"p_code":"134",
"code":"144"
},
{
"desc":"Symptom: Different consumers in a consumer group have different topic permissions. When a consumer attempts to retrieve messages from a topic, the error message \"Not auth",
"product_code":"dms",
"title":"What Can I Do If a Consumer Fails to Retrieve Messages from a Topic Due to Insufficient Permissions?",
"uri":"kafka-faq-0038.html",
"doc_type":"usermanual",
"p_code":"134",
"code":"145"
},
{
"desc":"No. However, you can increase the total number of partitions by increasing the broker quantity or flavor. For details, see Modifying Cluster Kafka Instance Specifications",
"product_code":"dms",
"title":"Can I Purchase Partitions Separately?",
"uri":"kafka-faq-0068.html",
"doc_type":"usermanual",
"p_code":"134",
"code":"146"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Consumer Groups",
"uri":"kafka-faq-200423001.html",
"doc_type":"usermanual",
"p_code":"83",
"code":"147"
},
{
"desc":"When parameter auto.create.groups.enable is set to true, you do not need to create a consumer group, producer, or consumer because they are generated automatically when y",
"product_code":"dms",
"title":"Do I Need to Create Consumer Groups, Producers, and Consumers for Kafka Instances?",
"uri":"kafka-faq-200426033.html",
"doc_type":"usermanual",
"p_code":"147",
"code":"148"
},
{
"desc":"This depends on the offsets.retention.minutes and auto.create.groups.enable parameters.For instances created much earlier, auto.create.groups.enable is set to true by def",
"product_code":"dms",
"title":"Will a Consumer Group Without Active Consumers Be Automatically Deleted in 14 Days?",
"uri":"kafka-faq-0043.html",
"doc_type":"usermanual",
"p_code":"147",
"code":"149"
},
{
"desc":"Possible cause: Automatic consumer group creation has been enabled and your service is connected to the consumer group and consuming messages. Therefore, the consumer gro",
"product_code":"dms",
"title":"Why Does a Deleted Consumer Group Still Exist?",
"uri":"kafka_faq_0059.html",
"doc_type":"usermanual",
"p_code":"147",
"code":"150"
},
{
"desc":"Check whether Flink is used for consumption. Flink uses the assign mode and the client assigns specific partitions to be consumed, so you cannot see any consumer on the K",
"product_code":"dms",
"title":"Why Can't I View Consumers When Instance Consumption Is Normal?",
"uri":"kafka_faq_0060.html",
"doc_type":"usermanual",
"p_code":"147",
"code":"151"
},
{
"desc":"Just simply unsubscribe from them on the Kafka client.",
"product_code":"dms",
"title":"Can I Delete Unnecessary Topics in a Consumer Group?",
"uri":"kafka-faq-0031.html",
"doc_type":"usermanual",
"p_code":"147",
"code":"152"
},
{
"desc":"If you cannot find a consumer group from the console, the possible causes are as follows:auto.create.groups.enable is set to true, the consumer group status is EMPTY, and",
"product_code":"dms",
"title":"Why Are Consumer Groups Missing?",
"uri":"kafka-faq-0069.html",
"doc_type":"usermanual",
"p_code":"147",
"code":"153"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Messages",
"uri":"kafka-faq-190416001.html",
"doc_type":"usermanual",
"p_code":"83",
"code":"154"
},
{
"desc":"10 MB.",
"product_code":"dms",
"title":"What Is the Maximum Size of a Message that Can be Created?",
"uri":"kafka-faq-200426035.html",
"doc_type":"usermanual",
"p_code":"154",
"code":"155"
},
{
"desc":"Rebalancing is a process where partitions of topics are re-allocated for a consumer group.In normal cases, rebalancing occurs inevitably when a consumer is added to or re",
"product_code":"dms",
"title":"Why Does Message Poll Often Fail During Rebalancing?",
"uri":"kafka-faq-200426036.html",
"doc_type":"usermanual",
"p_code":"154",
"code":"156"
},
{
"desc":"Possible cause 1: The message has been aged.Solution: Change the aging time.Solution: Change the aging time.Possible cause 2: The createTime timestamp of the message is i",
"product_code":"dms",
"title":"Why Can't I Query Messages on the Console?",
"uri":"kafka-faq-200426037.html",
"doc_type":"usermanual",
"p_code":"154",
"code":"157"
},
{
"desc":"Symptom: An alarm is generated for the Accumulated Messages metric.Solution:Log in to the Kafka console and click the instance for which the alarm is generated. The insta",
"product_code":"dms",
"title":"What Can I Do If Kafka Messages Are Accumulated?",
"uri":"kafka-faq-200426100.html",
"doc_type":"usermanual",
"p_code":"154",
"code":"158"
},
{
"desc":"If the aging time has been set for a topic, the value of the log.retention.hours parameter does not take effect for the topic. The value of the log.retention.hours parame",
"product_code":"dms",
"title":"Why Do Messages Still Exist After the Retention Period Elapses?",
"uri":"kafka-faq-200708001.html",
"doc_type":"usermanual",
"p_code":"154",
"code":"159"
},
{
"desc":"No.",
"product_code":"dms",
"title":"Do Kafka Instances Support Delayed Message Delivery?",
"uri":"kafka-faq-0018.html",
"doc_type":"usermanual",
"p_code":"154",
"code":"160"
},
{
"desc":"View the number of accumulated messages using any of the following methods:On the Consumer Groups page of an instance, click the name of the consumer group whose accumula",
"product_code":"dms",
"title":"How Do I View the Number of Accumulated Messages?",
"uri":"kafka-faq-0041.html",
"doc_type":"usermanual",
"p_code":"154",
"code":"161"
},
{
"desc":"The message creation time is specified by CreateTime when a producer creates messages. If this parameter is not set during message creation, the message creation time is ",
"product_code":"dms",
"title":"Why Is the Message Creation Time Displayed as Year 1970?",
"uri":"kafka-faq-0045.html",
"doc_type":"usermanual",
"p_code":"154",
"code":"162"
},
{
"desc":"message.max.bytes can be modified on the Parameters page on the Kafka console. For details, see Modifying Kafka Instance Configuration Parameters.The maximum value of mes",
"product_code":"dms",
"title":"How Do I Modify message.max.bytes?",
"uri":"kafka_faq_0058.html",
"doc_type":"usermanual",
"p_code":"154",
"code":"163"
},
{
"desc":"If you have enabled idempotence or transactions on the producer client, and produced messages, message offsets are not continuous on the consumer client or on the Message",
"product_code":"dms",
"title":"Why Are Offsets Not Continuous?",
"uri":"kafka-faq-0065.html",
"doc_type":"usermanual",
"p_code":"154",
"code":"164"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Monitoring & Alarm",
"uri":"kafka-faq-191030004.html",
"doc_type":"usermanual",
"p_code":"83",
"code":"165"
},
{
"desc":"If topic monitoring data is not displayed, the possible causes are as follows:The topic name starts with a special character, such as an underscore (_) or a number sign (",
"product_code":"dms",
"title":"Why Can't I View the Monitoring Data?",
"uri":"kafka-faq-200426041.html",
"doc_type":"usermanual",
"p_code":"165",
"code":"166"
},
{
"desc":"Symptom: The monitoring data shows that there are 810 million accumulated messages. However, the Kafka console shows that there are 100 million messages in all six topics",
"product_code":"dms",
"title":"Why Is the Monitored Number of Accumulated Messages Inconsistent with the Message Quantity Displayed on the Kafka Console?",
"uri":"kafka-faq-0007.html",
"doc_type":"usermanual",
"p_code":"165",
"code":"167"
},
{
"desc":"The monitoring data is reported every minute. The reported data will be displayed on the monitoring page after being sorted. This process takes less than 20 minutes. Afte",
"product_code":"dms",
"title":"Why Is a Consumer Group Still on the Monitoring Page After Being Deleted?",
"uri":"kafka-faq-0022.html",
"doc_type":"usermanual",
"p_code":"165",
"code":"168"
},
{
"desc":"Metrics including Disk Read Speed, Disk Write Speed, Average Disk Read Time, Average Disk Write Time, and CPU Usage output instantaneous values. These metrics are for ref",
"product_code":"dms",
"title":"Why Do Metrics Fluctuate Significantly (Disk Read/Write Speed, Average Disk Read/Write Time, and CPU Usage)?",
"uri":"kafka-faq-0063.html",
"doc_type":"usermanual",
"p_code":"165",
"code":"169"
},
{
"desc":"It is normal that JVM Heap Memory Usage of JVM is displayed in a sawtooth shape on the monitoring page. The maximum value may further increase or the fluctuation may be g",
"product_code":"dms",
"title":"Why Does JVM Heap Memory Usage of JVM Fluctuate Significantly?",
"uri":"kafka-faq-0064.html",
"doc_type":"usermanual",
"p_code":"165",
"code":"170"
},
{
"desc":"The metric data of the message production rate is reported once every minute. Message production rate = Number of messages produced per minute/60. The value is rounded do",
"product_code":"dms",
"title":"Why Is Production Rate Still 0 When There Are Produced Messages?",
"uri":"kafka-faq-0066.html",
"doc_type":"usermanual",
"p_code":"165",
"code":"171"
},
{
"desc":"On the Consumer Offset tab page of the consumer group details page, there are stacked messages in a topic (total stack ≠ 0), whereas the Consumer Available Messages on th",
"product_code":"dms",
"title":"Why Is the Number of Stacked Messages Monitored as 0 when Messages Are Stacked?",
"uri":"kafka-faq-0067.html",
"doc_type":"usermanual",
"p_code":"165",
"code":"172"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Troubleshooting",
"uri":"kafka-ug-0723006.html",
"doc_type":"usermanual",
"p_code":"",
"code":"173"
},
{
"desc":"This section describes how to troubleshoot Kafka connection problems.If the connection to a Kafka instance is abnormal, perform the following operations to troubleshoot t",
"product_code":"dms",
"title":"Troubleshooting Kafka Connection Exceptions",
"uri":"kafka-faq-0604001.html",
"doc_type":"usermanual",
"p_code":"173",
"code":"174"
},
{
"desc":"The duration from message creation to retrieval occasionally reaches 6 minutes, which is not tolerable to services.Service requests are stacked and cannot be processed in",
"product_code":"dms",
"title":"Troubleshooting 6-Min Latency Between Message Creation and Retrieval",
"uri":"kafka-trouble-0709001.html",
"doc_type":"usermanual",
"p_code":"173",
"code":"175"
},
{
"desc":"The system displays the error message \"Disk error when trying to access log file on the disk\".The disk usage of the broker is too high.Expand the disk space by referring ",
"product_code":"dms",
"title":"Troubleshooting Message Creation Failures",
"uri":"kafka-trouble-0001.html",
"doc_type":"usermanual",
"p_code":"173",
"code":"176"
},
{
"desc":"A deleted topic still exists.Automatic topic creation has been enabled for the instance, and a consumer is connecting to the topic. If services are not stopped, message c",
"product_code":"dms",
"title":"Troubleshooting Topic Deletion Failures",
"uri":"kafka-trouble-0002.html",
"doc_type":"usermanual",
"p_code":"173",
"code":"177"
},
{
"desc":"For a Kafka instance deployed in multiple AZs, if one of the AZs is faulty, error message \"Topic {{topic_name}} not present in metadata after 60000 ms\" may be reported on",
"product_code":"dms",
"title":"Troubleshooting Error \"Topic {{topic_name}} not present in metadata after 60000 ms\" During Message Production or Consumption",
"uri":"kafka-trouble-0004.html",
"doc_type":"usermanual",
"p_code":"173",
"code":"178"
},
{
"desc":"To consume Kafka messages in Flink 1.15, the consumption progress fails to be submitted, and the error messages \"COORDINATOR_NOT_AVAILABLE\" are thrown.Bug on the Kafka cl",
"product_code":"dms",
"title":"Flink 1.15 Consumption Progress Submission Failure",
"uri":"kafka_trouble_0007.html",
"doc_type":"usermanual",
"p_code":"173",
"code":"179"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Change History",
"uri":"kafka-ug-00001.html",
"doc_type":"usermanual",
"p_code":"",
"code":"180"
},
{
"desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"product_code":"dms",
"title":"Acronyms and Abbreviations",
"uri":"kafka-ug-00002.html",
"doc_type":"usermanual",
"p_code":"",
"code":"181"
},
{
"desc":"See Glossary.",
"product_code":"dms",
"title":"Glossary",
"uri":"dms-ug-0312114.html",
"doc_type":"usermanual",
"p_code":"",
"code":"182"
}
]