yexinru/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
Files
f173c9af19589dd902fe55c5a05e9147dc8cbda4
doc-exports/docs/mrs/component-operation-guide/ALL_META.TXT.json
Yang, Tong 6182f91ba8 MRS component operation guide_normal 2.0.38.SP20 version 
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2022-12-09 14:55:21 +00:00

8052 lines
362 KiB
JSON
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

[
{
"uri":"mrs_01_0756.html",
"product_code":"mrs",
"code":"1",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Alluxio",
"title":"Using Alluxio",
"githuburl":""
},
{
"uri":"mrs_01_0759.html",
"product_code":"mrs",
"code":"2",
"des":"If you want to use a unified client API and a global namespace to access persistent storage systems including HDFS and OBS to separate computing from storage, you can con",
"doc_type":"cmpntguide",
"kw":"Configuring an Underlying Storage System,Using Alluxio,Component Operation Guide (Normal)",
"title":"Configuring an Underlying Storage System",
"githuburl":""
},
{
"uri":"mrs_01_0760.html",
"product_code":"mrs",
"code":"3",
"des":"The port number used for accessing the Alluxio file system is 19998, and the access address is alluxio://<Master node IP address of Alluxio>:19998/<PATH>. This section us",
"doc_type":"cmpntguide",
"kw":"Accessing Alluxio Using a Data Application,Using Alluxio,Component Operation Guide (Normal)",
"title":"Accessing Alluxio Using a Data Application",
"githuburl":""
},
{
"uri":"mrs_01_0757.html",
"product_code":"mrs",
"code":"4",
"des":"Create a cluster with Alluxio installed.Log in to the active Master node in a cluster as user root using the password set during cluster creation.Run the following comman",
"doc_type":"cmpntguide",
"kw":"Common Operations of Alluxio,Using Alluxio,Component Operation Guide (Normal)",
"title":"Common Operations of Alluxio",
"githuburl":""
},
{
"uri":"mrs_01_0385.html",
"product_code":"mrs",
"code":"5",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using CarbonData (for Versions Earlier Than MRS 3.x)",
"title":"Using CarbonData (for Versions Earlier Than MRS 3.x)",
"githuburl":""
},
{
"uri":"mrs_01_0386.html",
"product_code":"mrs",
"code":"6",
"des":"This section is for MRS 3.x or earlier. For MRS 3.x or later, see Using CarbonData (for MRS 3.x or Later).This section describes the procedure of using Spark CarbonData. ",
"doc_type":"cmpntguide",
"kw":"Using CarbonData from Scratch,Using CarbonData (for Versions Earlier Than MRS 3.x),Component Operati",
"title":"Using CarbonData from Scratch",
"githuburl":""
},
{
"uri":"mrs_01_0387.html",
"product_code":"mrs",
"code":"7",
"des":"CarbonData tables are similar to tables in the relational database management system (RDBMS). RDBMS tables consist of rows and columns to store data. CarbonData tables ha",
"doc_type":"cmpntguide",
"kw":"About CarbonData Table,Using CarbonData (for Versions Earlier Than MRS 3.x),Component Operation Guid",
"title":"About CarbonData Table",
"githuburl":""
},
{
"uri":"mrs_01_0388.html",
"product_code":"mrs",
"code":"8",
"des":"A CarbonData table must be created to load and query data.Users can create a table by specifying its columns and data types. For analysis clusters with Kerberos authentic",
"doc_type":"cmpntguide",
"kw":"Creating a CarbonData Table,Using CarbonData (for Versions Earlier Than MRS 3.x),Component Operation",
"title":"Creating a CarbonData Table",
"githuburl":""
},
{
"uri":"mrs_01_0389.html",
"product_code":"mrs",
"code":"9",
"des":"Unused CarbonData tables can be deleted. After a CarbonData table is deleted, its metadata and loaded data are deleted together.DROP TABLE [IF EXISTS] [db_name.]table_nam",
"doc_type":"cmpntguide",
"kw":"Deleting a CarbonData Table,Using CarbonData (for Versions Earlier Than MRS 3.x),Component Operation",
"title":"Deleting a CarbonData Table",
"githuburl":""
},
{
"uri":"mrs_01_1400.html",
"product_code":"mrs",
"code":"10",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using CarbonData (for MRS 3.x or Later)",
"title":"Using CarbonData (for MRS 3.x or Later)",
"githuburl":""
},
{
"uri":"mrs_01_1401.html",
"product_code":"mrs",
"code":"11",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Overview",
"title":"Overview",
"githuburl":""
},
{
"uri":"mrs_01_1402.html",
"product_code":"mrs",
"code":"12",
"des":"CarbonData is a new Apache Hadoop native data-store format. CarbonData allows faster interactive queries over PetaBytes of data using advanced columnar storage, index, co",
"doc_type":"cmpntguide",
"kw":"CarbonData Overview,Overview,Component Operation Guide (Normal)",
"title":"CarbonData Overview",
"githuburl":""
},
{
"uri":"mrs_01_1403.html",
"product_code":"mrs",
"code":"13",
"des":"The memory required for data loading depends on the following factors:Number of columnsColumn valuesConcurrency (configured using carbon.number.of.cores.while.loading)Sor",
"doc_type":"cmpntguide",
"kw":"Main Specifications of CarbonData,Overview,Component Operation Guide (Normal)",
"title":"Main Specifications of CarbonData",
"githuburl":""
},
{
"uri":"mrs_01_1404.html",
"product_code":"mrs",
"code":"14",
"des":"This section provides the details of all the configurations required for the CarbonData System.Configure the following parameters in the spark-defaults.conf file on the S",
"doc_type":"cmpntguide",
"kw":"limit,limit,Configuration Reference,Using CarbonData (for MRS 3.x or Later),Component Operation Guid",
"title":"Configuration Reference",
"githuburl":""
},
{
"uri":"mrs_01_1405.html",
"product_code":"mrs",
"code":"15",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"CarbonData Operation Guide",
"title":"CarbonData Operation Guide",
"githuburl":""
},
{
"uri":"mrs_01_1406.html",
"product_code":"mrs",
"code":"16",
"des":"This section describes how to create CarbonData tables, load data, and query data. This quick start provides operations based on the Spark Beeline client. If you want to ",
"doc_type":"cmpntguide",
"kw":"CarbonData Quick Start,CarbonData Operation Guide,Component Operation Guide (Normal)",
"title":"CarbonData Quick Start",
"githuburl":""
},
{
"uri":"mrs_01_1407.html",
"product_code":"mrs",
"code":"17",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"CarbonData Table Management",
"title":"CarbonData Table Management",
"githuburl":""
},
{
"uri":"mrs_01_1408.html",
"product_code":"mrs",
"code":"18",
"des":"In CarbonData, data is stored in entities called tables. CarbonData tables are similar to RDBMS tables. RDBMS data is stored in a table consisting of rows and columns. Ca",
"doc_type":"cmpntguide",
"kw":"About CarbonData Table,CarbonData Table Management,Component Operation Guide (Normal)",
"title":"About CarbonData Table",
"githuburl":""
},
{
"uri":"mrs_01_1409.html",
"product_code":"mrs",
"code":"19",
"des":"A CarbonData table must be created to load and query data. You can run the Create Table command to create a table. This command is used to create a table using custom col",
"doc_type":"cmpntguide",
"kw":"Creating a CarbonData Table,CarbonData Table Management,Component Operation Guide (Normal)",
"title":"Creating a CarbonData Table",
"githuburl":""
},
{
"uri":"mrs_01_1410.html",
"product_code":"mrs",
"code":"20",
"des":"You can run the DROP TABLE command to delete a table. After a CarbonData table is deleted, its metadata and loaded data are deleted together.Run the following command to ",
"doc_type":"cmpntguide",
"kw":"Deleting a CarbonData Table,CarbonData Table Management,Component Operation Guide (Normal)",
"title":"Deleting a CarbonData Table",
"githuburl":""
},
{
"uri":"mrs_01_1411.html",
"product_code":"mrs",
"code":"21",
"des":"When the SET command is executed, the new properties overwrite the existing ones.SORT SCOPEThe following is an example of the SET SORT SCOPE command:ALTER TABLE tablename",
"doc_type":"cmpntguide",
"kw":"Modify the CarbonData Table,CarbonData Table Management,Component Operation Guide (Normal)",
"title":"Modify the CarbonData Table",
"githuburl":""
},
{
"uri":"mrs_01_1412.html",
"product_code":"mrs",
"code":"22",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"CarbonData Table Data Management",
"title":"CarbonData Table Data Management",
"githuburl":""
},
{
"uri":"mrs_01_1413.html",
"product_code":"mrs",
"code":"23",
"des":"After a CarbonData table is created, you can run the LOAD DATA command to load data to the table for query. Once data loading is triggered, data is encoded in CarbonData ",
"doc_type":"cmpntguide",
"kw":"Loading Data,CarbonData Table Data Management,Component Operation Guide (Normal)",
"title":"Loading Data",
"githuburl":""
},
{
"uri":"mrs_01_1414.html",
"product_code":"mrs",
"code":"24",
"des":"If you want to modify and reload the data because you have loaded wrong data into a table, or there are too many bad records, you can delete specific segments by segment ",
"doc_type":"cmpntguide",
"kw":"Deleting Segments,CarbonData Table Data Management,Component Operation Guide (Normal)",
"title":"Deleting Segments",
"githuburl":""
},
{
"uri":"mrs_01_1415.html",
"product_code":"mrs",
"code":"25",
"des":"Frequent data access results in a large number of fragmented CarbonData files in the storage directory. In each data loading, data is sorted and indexing is performed. Th",
"doc_type":"cmpntguide",
"kw":"Combining Segments,CarbonData Table Data Management,Component Operation Guide (Normal)",
"title":"Combining Segments",
"githuburl":""
},
{
"uri":"mrs_01_1416.html",
"product_code":"mrs",
"code":"26",
"des":"If you want to rapidly migrate CarbonData data from a cluster to another one, you can use the CarbonData backup and restoration commands. This method does not require dat",
"doc_type":"cmpntguide",
"kw":"CarbonData Data Migration,CarbonData Operation Guide,Component Operation Guide (Normal)",
"title":"CarbonData Data Migration",
"githuburl":""
},
{
"uri":"mrs_01_2301.html",
"product_code":"mrs",
"code":"27",
"des":"This migration guides you to migrate the CarbonData table data of Spark 1.5 to that of Spark2x.Before performing this operation, you need to stop the data import service ",
"doc_type":"cmpntguide",
"kw":"Migrating Data on CarbonData from Spark 1.5 to Spark2x,CarbonData Operation Guide,Component Operatio",
"title":"Migrating Data on CarbonData from Spark 1.5 to Spark2x",
"githuburl":""
},
{
"uri":"mrs_01_1417.html",
"product_code":"mrs",
"code":"28",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"CarbonData Performance Tuning",
"title":"CarbonData Performance Tuning",
"githuburl":""
},
{
"uri":"mrs_01_1418.html",
"product_code":"mrs",
"code":"29",
"des":"There are various parameters that can be tuned to improve the query performance in CarbonData. Most of the parameters focus on increasing the parallelism in processing an",
"doc_type":"cmpntguide",
"kw":"Tuning Guidelines,CarbonData Performance Tuning,Component Operation Guide (Normal)",
"title":"Tuning Guidelines",
"githuburl":""
},
{
"uri":"mrs_01_1419.html",
"product_code":"mrs",
"code":"30",
"des":"This section provides suggestions based on more than 50 test cases to help you create CarbonData tables with higher query performance.If the to-be-created table contains ",
"doc_type":"cmpntguide",
"kw":"Suggestions for Creating CarbonData Tables,CarbonData Performance Tuning,Component Operation Guide (",
"title":"Suggestions for Creating CarbonData Tables",
"githuburl":""
},
{
"uri":"mrs_01_1421.html",
"product_code":"mrs",
"code":"31",
"des":"This section describes the configurations that can improve CarbonData performance.Table 1 and Table 2 describe the configurations about query of CarbonData.Table 3, Table",
"doc_type":"cmpntguide",
"kw":"Configurations for Performance Tuning,CarbonData Performance Tuning,Component Operation Guide (Norma",
"title":"Configurations for Performance Tuning",
"githuburl":""
},
{
"uri":"mrs_01_1422.html",
"product_code":"mrs",
"code":"32",
"des":"The following table provides details about Hive ACL permissions required for performing operations on CarbonData tables.Parameters listed in Table 5 or Table 6 have been ",
"doc_type":"cmpntguide",
"kw":"CarbonData Access Control,Using CarbonData (for MRS 3.x or Later),Component Operation Guide (Normal)",
"title":"CarbonData Access Control",
"githuburl":""
},
{
"uri":"mrs_01_1423.html",
"product_code":"mrs",
"code":"33",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"CarbonData Syntax Reference",
"title":"CarbonData Syntax Reference",
"githuburl":""
},
{
"uri":"mrs_01_1424.html",
"product_code":"mrs",
"code":"34",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"DDL",
"title":"DDL",
"githuburl":""
},
{
"uri":"mrs_01_1425.html",
"product_code":"mrs",
"code":"35",
"des":"This command is used to create a CarbonData table by specifying the list of fields along with the table properties.CREATE TABLE [IF NOT EXISTS] [db_name.]table_name[(col_",
"doc_type":"cmpntguide",
"kw":"CREATE TABLE,DDL,Component Operation Guide (Normal)",
"title":"CREATE TABLE",
"githuburl":""
},
{
"uri":"mrs_01_1426.html",
"product_code":"mrs",
"code":"36",
"des":"This command is used to create a CarbonData table by specifying the list of fields along with the table properties.CREATE TABLE[IF NOT EXISTS] [db_name.]table_name STORED",
"doc_type":"cmpntguide",
"kw":"CREATE TABLE As SELECT,DDL,Component Operation Guide (Normal)",
"title":"CREATE TABLE As SELECT",
"githuburl":""
},
{
"uri":"mrs_01_1427.html",
"product_code":"mrs",
"code":"37",
"des":"This command is used to delete an existing table.DROP TABLE [IF EXISTS] [db_name.]table_name;In this command, IF EXISTS and db_name are optional.DROP TABLE IF EXISTS prod",
"doc_type":"cmpntguide",
"kw":"DROP TABLE,DDL,Component Operation Guide (Normal)",
"title":"DROP TABLE",
"githuburl":""
},
{
"uri":"mrs_01_1428.html",
"product_code":"mrs",
"code":"38",
"des":"SHOW TABLES command is used to list all tables in the current or a specific database.SHOW TABLES [IN db_name];IN db_Name is optional.SHOW TABLES IN ProductDatabase;All ta",
"doc_type":"cmpntguide",
"kw":"SHOW TABLES,DDL,Component Operation Guide (Normal)",
"title":"SHOW TABLES",
"githuburl":""
},
{
"uri":"mrs_01_1429.html",
"product_code":"mrs",
"code":"39",
"des":"The ALTER TABLE COMPACTION command is used to merge a specified number of segments into a single segment. This improves the query performance of a table.ALTER TABLE[db_na",
"doc_type":"cmpntguide",
"kw":"ALTER TABLE COMPACTION,DDL,Component Operation Guide (Normal)",
"title":"ALTER TABLE COMPACTION",
"githuburl":""
},
{
"uri":"mrs_01_1430.html",
"product_code":"mrs",
"code":"40",
"des":"This command is used to rename an existing table.ALTER TABLE [db_name.]table_name RENAME TO new_table_name;Parallel queries (using table names to obtain paths for reading",
"doc_type":"cmpntguide",
"kw":"TABLE RENAME,DDL,Component Operation Guide (Normal)",
"title":"TABLE RENAME",
"githuburl":""
},
{
"uri":"mrs_01_1431.html",
"product_code":"mrs",
"code":"41",
"des":"This command is used to add a column to an existing table.ALTER TABLE [db_name.]table_name ADD COLUMNS (col_name data_type,...) TBLPROPERTIES(''COLUMNPROPERTIES.columnNam",
"doc_type":"cmpntguide",
"kw":"ADD COLUMNS,DDL,Component Operation Guide (Normal)",
"title":"ADD COLUMNS",
"githuburl":""
},
{
"uri":"mrs_01_1432.html",
"product_code":"mrs",
"code":"42",
"des":"This command is used to delete one or more columns from a table.ALTER TABLE [db_name.]table_name DROP COLUMNS (col_name, ...);After a column is deleted, at least one key ",
"doc_type":"cmpntguide",
"kw":"DROP COLUMNS,DDL,Component Operation Guide (Normal)",
"title":"DROP COLUMNS",
"githuburl":""
},
{
"uri":"mrs_01_1433.html",
"product_code":"mrs",
"code":"43",
"des":"This command is used to change the data type from INT to BIGINT or decimal precision from lower to higher.ALTER TABLE [db_name.]table_name CHANGE col_name col_name change",
"doc_type":"cmpntguide",
"kw":"CHANGE DATA TYPE,DDL,Component Operation Guide (Normal)",
"title":"CHANGE DATA TYPE",
"githuburl":""
},
{
"uri":"mrs_01_1434.html",
"product_code":"mrs",
"code":"44",
"des":"This command is used to register Carbon table to Hive meta store catalogue from exisiting Carbon table data.REFRESH TABLE db_name.table_name;The new database name and the",
"doc_type":"cmpntguide",
"kw":"REFRESH TABLE,DDL,Component Operation Guide (Normal)",
"title":"REFRESH TABLE",
"githuburl":""
},
{
"uri":"mrs_01_1435.html",
"product_code":"mrs",
"code":"45",
"des":"This command is used to register an index table with the primary table.REGISTER INDEX TABLE indextable_name ON db_name.maintable_name;Before running this command, run REF",
"doc_type":"cmpntguide",
"kw":"REGISTER INDEX TABLE,DDL,Component Operation Guide (Normal)",
"title":"REGISTER INDEX TABLE",
"githuburl":""
},
{
"uri":"mrs_01_1437.html",
"product_code":"mrs",
"code":"46",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"DML",
"title":"DML",
"githuburl":""
},
{
"uri":"mrs_01_1438.html",
"product_code":"mrs",
"code":"47",
"des":"This command is used to load user data of a particular type, so that CarbonData can provide good query performance.Only the raw data on HDFS can be loaded.LOAD DATA INPAT",
"doc_type":"cmpntguide",
"kw":"LOAD DATA,DML,Component Operation Guide (Normal)",
"title":"LOAD DATA",
"githuburl":""
},
{
"uri":"mrs_01_1439.html",
"product_code":"mrs",
"code":"48",
"des":"This command is used to update the CarbonData table based on the column expression and optional filtering conditions.Syntax 1:UPDATE <CARBON TABLE> SET (column_name1, col",
"doc_type":"cmpntguide",
"kw":"UPDATE CARBON TABLE,DML,Component Operation Guide (Normal)",
"title":"UPDATE CARBON TABLE",
"githuburl":""
},
{
"uri":"mrs_01_1440.html",
"product_code":"mrs",
"code":"49",
"des":"This command is used to delete records from a CarbonData table.DELETE FROM CARBON_TABLE [WHERE expression];If a segment is deleted, all secondary indexes associated with ",
"doc_type":"cmpntguide",
"kw":"DELETE RECORDS from CARBON TABLE,DML,Component Operation Guide (Normal)",
"title":"DELETE RECORDS from CARBON TABLE",
"githuburl":""
},
{
"uri":"mrs_01_1441.html",
"product_code":"mrs",
"code":"50",
"des":"This command is used to add the output of the SELECT command to a Carbon table.INSERT INTO [CARBON TABLE] [select query];A table has been created.You must belong to the d",
"doc_type":"cmpntguide",
"kw":"INSERT INTO CARBON TABLE,DML,Component Operation Guide (Normal)",
"title":"INSERT INTO CARBON TABLE",
"githuburl":""
},
{
"uri":"mrs_01_1442.html",
"product_code":"mrs",
"code":"51",
"des":"This command is used to delete segments by the ID.DELETE FROM TABLE db_name.table_name WHERE SEGMENT.ID IN (segment_id1,segment_id2);Segments cannot be deleted from the s",
"doc_type":"cmpntguide",
"kw":"DELETE SEGMENT by ID,DML,Component Operation Guide (Normal)",
"title":"DELETE SEGMENT by ID",
"githuburl":""
},
{
"uri":"mrs_01_1443.html",
"product_code":"mrs",
"code":"52",
"des":"This command is used to delete segments by loading date. Segments created before a specific date will be deleted.DELETE FROM TABLE db_name.table_name WHERE SEGMENT.STARTT",
"doc_type":"cmpntguide",
"kw":"DELETE SEGMENT by DATE,DML,Component Operation Guide (Normal)",
"title":"DELETE SEGMENT by DATE",
"githuburl":""
},
{
"uri":"mrs_01_1444.html",
"product_code":"mrs",
"code":"53",
"des":"This command is used to list the segments of a CarbonData table.SHOW SEGMENTS FOR TABLE [db_name.]table_name LIMIT number_of_loads;Nonecreate tablecarbon01(a int,b string",
"doc_type":"cmpntguide",
"kw":"SHOW SEGMENTS,DML,Component Operation Guide (Normal)",
"title":"SHOW SEGMENTS",
"githuburl":""
},
{
"uri":"mrs_01_1445.html",
"product_code":"mrs",
"code":"54",
"des":"This command is used to create secondary indexes in the CarbonData tables.CREATE INDEX index_nameON TABLE [db_name.]table_name (col_name1, col_name2)AS 'carbondata'PROPER",
"doc_type":"cmpntguide",
"kw":"CREATE SECONDARY INDEX,DML,Component Operation Guide (Normal)",
"title":"CREATE SECONDARY INDEX",
"githuburl":""
},
{
"uri":"mrs_01_1446.html",
"product_code":"mrs",
"code":"55",
"des":"This command is used to list all secondary index tables in the CarbonData table.SHOW INDEXES ON db_name.table_name;db_name is optional.create table productdb.productSales",
"doc_type":"cmpntguide",
"kw":"SHOW SECONDARY INDEXES,DML,Component Operation Guide (Normal)",
"title":"SHOW SECONDARY INDEXES",
"githuburl":""
},
{
"uri":"mrs_01_1447.html",
"product_code":"mrs",
"code":"56",
"des":"This command is used to delete the existing secondary index table in a specific table.DROP INDEX [IF EXISTS] index_nameON [db_name.]table_name;In this command, IF EXISTS ",
"doc_type":"cmpntguide",
"kw":"DROP SECONDARY INDEX,DML,Component Operation Guide (Normal)",
"title":"DROP SECONDARY INDEX",
"githuburl":""
},
{
"uri":"mrs_01_1448.html",
"product_code":"mrs",
"code":"57",
"des":"After the DELETE SEGMENT command is executed, the deleted segments are marked as the delete state. After the segments are merged, the status of the original segments chan",
"doc_type":"cmpntguide",
"kw":"CLEAN FILES,DML,Component Operation Guide (Normal)",
"title":"CLEAN FILES",
"githuburl":""
},
{
"uri":"mrs_01_1449.html",
"product_code":"mrs",
"code":"58",
"des":"This command is used to dynamically add, update, display, or reset the CarbonData properties without restarting the driver.Add or Update parameter value:SET parameter_nam",
"doc_type":"cmpntguide",
"kw":"SET/RESET,DML,Component Operation Guide (Normal)",
"title":"SET/RESET",
"githuburl":""
},
{
"uri":"mrs_01_24046.html",
"product_code":"mrs",
"code":"59",
"des":"Before performing DDL and DML operations, you need to obtain the corresponding locks. See Table 1 for details about the locks that need to be obtained for each operation.",
"doc_type":"cmpntguide",
"kw":"Operation Concurrent Execution,CarbonData Syntax Reference,Component Operation Guide (Normal)",
"title":"Operation Concurrent Execution",
"githuburl":""
},
{
"uri":"mrs_01_1450.html",
"product_code":"mrs",
"code":"60",
"des":"This section describes the APIs and usage methods of Segment. All methods are in the org.apache.spark.util.CarbonSegmentUtil class.The following methods have been abandon",
"doc_type":"cmpntguide",
"kw":"API,CarbonData Syntax Reference,Component Operation Guide (Normal)",
"title":"API",
"githuburl":""
},
{
"uri":"mrs_01_1451.html",
"product_code":"mrs",
"code":"61",
"des":"Spatial data includes multidimensional points, lines, rectangles, cubes, polygons, and other geometric objects. A spatial data object occupies a certain region of space, ",
"doc_type":"cmpntguide",
"kw":"Spatial Indexes,CarbonData Syntax Reference,Component Operation Guide (Normal)",
"title":"Spatial Indexes",
"githuburl":""
},
{
"uri":"mrs_01_1454.html",
"product_code":"mrs",
"code":"62",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"CarbonData Troubleshooting",
"title":"CarbonData Troubleshooting",
"githuburl":""
},
{
"uri":"mrs_01_1455.html",
"product_code":"mrs",
"code":"63",
"des":"When double data type values with higher precision are used in filters, incorrect values are returned by filtering results.When double data type values with higher precis",
"doc_type":"cmpntguide",
"kw":"Filter Result Is not Consistent with Hive when a Big Double Type Value Is Used in Filter,CarbonData ",
"title":"Filter Result Is not Consistent with Hive when a Big Double Type Value Is Used in Filter",
"githuburl":""
},
{
"uri":"mrs_01_1456.html",
"product_code":"mrs",
"code":"64",
"des":"The query performance fluctuates when the query is executed in different query periods.During data loading, the memory configured for each executor program instance may b",
"doc_type":"cmpntguide",
"kw":"Query Performance Deterioration,CarbonData Troubleshooting,Component Operation Guide (Normal)",
"title":"Query Performance Deterioration",
"githuburl":""
},
{
"uri":"mrs_01_1457.html",
"product_code":"mrs",
"code":"65",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"CarbonData FAQ",
"title":"CarbonData FAQ",
"githuburl":""
},
{
"uri":"mrs_01_1458.html",
"product_code":"mrs",
"code":"66",
"des":"Why is incorrect output displayed when I perform query with filter on decimal data type values?For example:select * from carbon_table where num = 1234567890123456.22;Outp",
"doc_type":"cmpntguide",
"kw":"Why Is Incorrect Output Displayed When I Perform Query with Filter on Decimal Data Type Values?,Carb",
"title":"Why Is Incorrect Output Displayed When I Perform Query with Filter on Decimal Data Type Values?",
"githuburl":""
},
{
"uri":"mrs_01_1459.html",
"product_code":"mrs",
"code":"67",
"des":"How to avoid minor compaction for historical data?If you want to load historical data first and then the incremental data, perform following steps to avoid minor compacti",
"doc_type":"cmpntguide",
"kw":"How to Avoid Minor Compaction for Historical Data?,CarbonData FAQ,Component Operation Guide (Normal)",
"title":"How to Avoid Minor Compaction for Historical Data?",
"githuburl":""
},
{
"uri":"mrs_01_1460.html",
"product_code":"mrs",
"code":"68",
"des":"How to change the default group name for CarbonData data loading?By default, the group name for CarbonData data loading is ficommon. You can perform the following operati",
"doc_type":"cmpntguide",
"kw":"How to Change the Default Group Name for CarbonData Data Loading?,CarbonData FAQ,Component Operation",
"title":"How to Change the Default Group Name for CarbonData Data Loading?",
"githuburl":""
},
{
"uri":"mrs_01_1461.html",
"product_code":"mrs",
"code":"69",
"des":"Why does the INSERT INTO CARBON TABLE command fail and the following error message is displayed?The INSERT INTO CARBON TABLE command fails in the following scenarios:If t",
"doc_type":"cmpntguide",
"kw":"Why Does INSERT INTO CARBON TABLE Command Fail?,CarbonData FAQ,Component Operation Guide (Normal)",
"title":"Why Does INSERT INTO CARBON TABLE Command Fail?",
"githuburl":""
},
{
"uri":"mrs_01_1462.html",
"product_code":"mrs",
"code":"70",
"des":"Why is the data logged in bad records different from the original input data with escaped characters?An escape character is a backslash (\\) followed by one or more charac",
"doc_type":"cmpntguide",
"kw":"Why Is the Data Logged in Bad Records Different from the Original Input Data with Escape Characters?",
"title":"Why Is the Data Logged in Bad Records Different from the Original Input Data with Escape Characters?",
"githuburl":""
},
{
"uri":"mrs_01_1463.html",
"product_code":"mrs",
"code":"71",
"des":"Why data load performance decreases due to bad records?If bad records are present in the data and BAD_RECORDS_LOGGER_ENABLE is true or BAD_RECORDS_ACTION is redirect then",
"doc_type":"cmpntguide",
"kw":"Why Data Load Performance Decreases due to Bad Records?,CarbonData FAQ,Component Operation Guide (No",
"title":"Why Data Load Performance Decreases due to Bad Records?",
"githuburl":""
},
{
"uri":"mrs_01_1464.html",
"product_code":"mrs",
"code":"72",
"des":"Why INSERT INTO or LOAD DATA task distribution is incorrect, and the openedtasks are less than the available executors when the number of initial executors is zero?In ca",
"doc_type":"cmpntguide",
"kw":"Why INSERT INTO/LOAD DATA Task Distribution Is Incorrect and the Opened Tasks Are Less Than the Avai",
"title":"Why INSERT INTO/LOAD DATA Task Distribution Is Incorrect and the Opened Tasks Are Less Than the Available Executors when the Number of Initial ExecutorsIs Zero?",
"githuburl":""
},
{
"uri":"mrs_01_1465.html",
"product_code":"mrs",
"code":"73",
"des":"Why does CarbonData require additional executors even though the parallelism is greater than the number of blocks to be processed?CarbonData block distribution optimizes ",
"doc_type":"cmpntguide",
"kw":"Why Does CarbonData Require Additional Executors Even Though the Parallelism Is Greater Than the Num",
"title":"Why Does CarbonData Require Additional Executors Even Though the Parallelism Is Greater Than the Number of Blocks to Be Processed?",
"githuburl":""
},
{
"uri":"mrs_01_1466.html",
"product_code":"mrs",
"code":"74",
"des":"Why Data Loading fails during off heap?YARN Resource Manager will consider (Java heap memory + spark.yarn.am.memoryOverhead) as memory limit, so during the off heap, the ",
"doc_type":"cmpntguide",
"kw":"Why Data loading Fails During off heap?,CarbonData FAQ,Component Operation Guide (Normal)",
"title":"Why Data loading Fails During off heap?",
"githuburl":""
},
{
"uri":"mrs_01_1467.html",
"product_code":"mrs",
"code":"75",
"des":"Why do I fail to create a hive table?Creating a Hive table fails, when source table or sub query has more number of partitions. The implementation of the query requires a",
"doc_type":"cmpntguide",
"kw":"Why Do I Fail to Create a Hive Table?,CarbonData FAQ,Component Operation Guide (Normal)",
"title":"Why Do I Fail to Create a Hive Table?",
"githuburl":""
},
{
"uri":"mrs_01_1468.html",
"product_code":"mrs",
"code":"76",
"des":"Why CarbonData tables created in V100R002C50RC1 not reflecting the privileges provided in Hive Privileges for non-owner?The Hive ACL is implemented after the version V100",
"doc_type":"cmpntguide",
"kw":"Why CarbonData tables created in V100R002C50RC1 not reflecting the privileges provided in Hive Privi",
"title":"Why CarbonData tables created in V100R002C50RC1 not reflecting the privileges provided in Hive Privileges for non-owner?",
"githuburl":""
},
{
"uri":"mrs_01_1469.html",
"product_code":"mrs",
"code":"77",
"des":"How do I logically split data across different namespaces?Configuration:To logically split data across different namespaces, you must update the following configuration i",
"doc_type":"cmpntguide",
"kw":"How Do I Logically Split Data Across Different Namespaces?,CarbonData FAQ,Component Operation Guide ",
"title":"How Do I Logically Split Data Across Different Namespaces?",
"githuburl":""
},
{
"uri":"mrs_01_1470.html",
"product_code":"mrs",
"code":"78",
"des":"Why drop database cascade is throwing the following exception?This error is thrown when the owner of the database performs drop database <database_name> cascade which con",
"doc_type":"cmpntguide",
"kw":"Why Missing Privileges Exception is Reported When I Perform Drop Operation on Databases?,CarbonData ",
"title":"Why Missing Privileges Exception is Reported When I Perform Drop Operation on Databases?",
"githuburl":""
},
{
"uri":"mrs_01_1471.html",
"product_code":"mrs",
"code":"79",
"des":"Why the UPDATE command cannot be executed in Spark Shell?The syntax and examples provided in this document are about Beeline commands instead of Spark Shell commands.To r",
"doc_type":"cmpntguide",
"kw":"Why the UPDATE Command Cannot Be Executed in Spark Shell?,CarbonData FAQ,Component Operation Guide (",
"title":"Why the UPDATE Command Cannot Be Executed in Spark Shell?",
"githuburl":""
},
{
"uri":"mrs_01_1472.html",
"product_code":"mrs",
"code":"80",
"des":"How do I configure unsafe memory in CarbonData?In the Spark configuration, the value of spark.yarn.executor.memoryOverhead must be greater than the sum of (sort.inmemory.",
"doc_type":"cmpntguide",
"kw":"How Do I Configure Unsafe Memory in CarbonData?,CarbonData FAQ,Component Operation Guide (Normal)",
"title":"How Do I Configure Unsafe Memory in CarbonData?",
"githuburl":""
},
{
"uri":"mrs_01_1473.html",
"product_code":"mrs",
"code":"81",
"des":"Why exception occurs in CarbonData when Disk Space Quota is set for the storage directory in HDFS?The data will be written to HDFS when you during create table, load tabl",
"doc_type":"cmpntguide",
"kw":"Why Exception Occurs in CarbonData When Disk Space Quota is Set for Storage Directory in HDFS?,Carbo",
"title":"Why Exception Occurs in CarbonData When Disk Space Quota is Set for Storage Directory in HDFS?",
"githuburl":""
},
{
"uri":"mrs_01_1474.html",
"product_code":"mrs",
"code":"82",
"des":"Why does data query or loading fail and \"org.apache.carbondata.core.memory.MemoryException: Not enough memory\" is displayed?This exception is thrown when the out-of-heap ",
"doc_type":"cmpntguide",
"kw":"Why Does Data Query or Loading Fail and \"org.apache.carbondata.core.memory.MemoryException: Not enou",
"title":"Why Does Data Query or Loading Fail and \"org.apache.carbondata.core.memory.MemoryException: Not enough memory\" Is Displayed?",
"githuburl":""
},
{
"uri":"mrs_01_24537.html",
"product_code":"",
"code":"83",
"des":"Why do files of a Carbon table exist in the recycle bin even if the drop table command is not executed when mis-deletion prevention is enabled?After the the mis-deletion ",
"doc_type":"",
"kw":"Why Do Files of a Carbon Table Exist in the Recycle Bin Even If the drop table Command Is Not Execut",
"title":"Why Do Files of a Carbon Table Exist in the Recycle Bin Even If the drop table Command Is Not Executed When Mis-deletion Prevention Is Enabled?",
"githuburl":""
},
{
"uri":"mrs_01_2344.html",
"product_code":"mrs",
"code":"84",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using ClickHouse",
"title":"Using ClickHouse",
"githuburl":""
},
{
"uri":"mrs_01_2345.html",
"product_code":"mrs",
"code":"85",
"des":"ClickHouse is a column-based database oriented to online analysis and processing. It supports SQL query and provides good query performance. The aggregation analysis and ",
"doc_type":"cmpntguide",
"kw":"Using ClickHouse from Scratch,Using ClickHouse,Component Operation Guide (Normal)",
"title":"Using ClickHouse from Scratch",
"githuburl":""
},
{
"uri":"mrs_01_24105.html",
"product_code":"mrs",
"code":"86",
"des":"Table engines play a key role in ClickHouse to determine:Where to write and read dataSupported query modesWhether concurrent data access is supportedWhether indexes can b",
"doc_type":"cmpntguide",
"kw":"ClickHouse Table Engine Overview,Using ClickHouse,Component Operation Guide (Normal)",
"title":"ClickHouse Table Engine Overview",
"githuburl":""
},
{
"uri":"mrs_01_2398.html",
"product_code":"mrs",
"code":"87",
"des":"ClickHouse implements the replicated table mechanism based on the ReplicatedMergeTree engine and ZooKeeper. When creating a table, you can specify an engine to determine ",
"doc_type":"cmpntguide",
"kw":"Creating a ClickHouse Table,Using ClickHouse,Component Operation Guide (Normal)",
"title":"Creating a ClickHouse Table",
"githuburl":""
},
{
"uri":"mrs_01_24199.html",
"product_code":"mrs",
"code":"88",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Common ClickHouse SQL Syntax",
"title":"Common ClickHouse SQL Syntax",
"githuburl":""
},
{
"uri":"mrs_01_24200.html",
"product_code":"mrs",
"code":"89",
"des":"This section describes the basic syntax and usage of the SQL statement for creating a ClickHouse database.CREATE DATABASE [IF NOT EXISTS] Database_name [ON CLUSTERClickHo",
"doc_type":"cmpntguide",
"kw":"CREATE DATABASE: Creating a Database,Common ClickHouse SQL Syntax,Component Operation Guide (Normal)",
"title":"CREATE DATABASE: Creating a Database",
"githuburl":""
},
{
"uri":"mrs_01_24201.html",
"product_code":"mrs",
"code":"90",
"des":"This section describes the basic syntax and usage of the SQL statement for creating a ClickHouse table.Method 1: Creating a table named table_name in the specified databa",
"doc_type":"cmpntguide",
"kw":"CREATE TABLE: Creating a Table,Common ClickHouse SQL Syntax,Component Operation Guide (Normal)",
"title":"CREATE TABLE: Creating a Table",
"githuburl":""
},
{
"uri":"mrs_01_24202.html",
"product_code":"mrs",
"code":"91",
"des":"This section describes the basic syntax and usage of the SQL statement for inserting data to a table in ClickHouse.Method 1: Inserting data in standard formatINSERT INTO ",
"doc_type":"cmpntguide",
"kw":"INSERT INTO: Inserting Data into a Table,Common ClickHouse SQL Syntax,Component Operation Guide (Nor",
"title":"INSERT INTO: Inserting Data into a Table",
"githuburl":""
},
{
"uri":"mrs_01_24203.html",
"product_code":"mrs",
"code":"92",
"des":"This section describes the basic syntax and usage of the SQL statement for querying table data in ClickHouse.SELECT [DISTINCT] expr_list[FROM[database_name.]table| (subqu",
"doc_type":"cmpntguide",
"kw":"SELECT: Querying Table Data,Common ClickHouse SQL Syntax,Component Operation Guide (Normal)",
"title":"SELECT: Querying Table Data",
"githuburl":""
},
{
"uri":"mrs_01_24204.html",
"product_code":"mrs",
"code":"93",
"des":"This section describes the basic syntax and usage of the SQL statement for modifying a table structure in ClickHouse.ALTER TABLE [database_name].name[ON CLUSTER cluster] ",
"doc_type":"cmpntguide",
"kw":"ALTER TABLE: Modifying a Table Structure,Common ClickHouse SQL Syntax,Component Operation Guide (Nor",
"title":"ALTER TABLE: Modifying a Table Structure",
"githuburl":""
},
{
"uri":"mrs_01_24205.html",
"product_code":"mrs",
"code":"94",
"des":"This section describes the basic syntax and usage of the SQL statement for querying a table structure in ClickHouse.DESC|DESCRIBETABLE[database_name.]table[INTOOUTFILE fi",
"doc_type":"cmpntguide",
"kw":"DESC: Querying a Table Structure,Common ClickHouse SQL Syntax,Component Operation Guide (Normal)",
"title":"DESC: Querying a Table Structure",
"githuburl":""
},
{
"uri":"mrs_01_24208.html",
"product_code":"mrs",
"code":"95",
"des":"This section describes the basic syntax and usage of the SQL statement for deleting a ClickHouse table.DROP[TEMPORARY] TABLE[IF EXISTS] [database_name.]name[ON CLUSTER cl",
"doc_type":"cmpntguide",
"kw":"DROP: Deleting a Table,Common ClickHouse SQL Syntax,Component Operation Guide (Normal)",
"title":"DROP: Deleting a Table",
"githuburl":""
},
{
"uri":"mrs_01_24207.html",
"product_code":"mrs",
"code":"96",
"des":"This section describes the basic syntax and usage of the SQL statement for displaying information about databases and tables in ClickHouse.show databasesshow tables",
"doc_type":"cmpntguide",
"kw":"SHOW: Displaying Information About Databases and Tables,Common ClickHouse SQL Syntax,Component Opera",
"title":"SHOW: Displaying Information About Databases and Tables",
"githuburl":""
},
{
"uri":"mrs_01_24250.html",
"product_code":"mrs",
"code":"97",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Migrating ClickHouse Data",
"title":"Migrating ClickHouse Data",
"githuburl":""
},
{
"uri":"mrs_01_24206.html",
"product_code":"mrs",
"code":"98",
"des":"This section describes the basic syntax and usage of the SQL statements for importing and exporting file data using ClickHouse.Importing data in CSV formatclickhouse clie",
"doc_type":"cmpntguide",
"kw":"Using ClickHouse to Import and Export Data,Migrating ClickHouse Data,Component Operation Guide (Norm",
"title":"Using ClickHouse to Import and Export Data",
"githuburl":""
},
{
"uri":"mrs_01_24377.html",
"product_code":"",
"code":"99",
"des":"This section describes how to create a Kafka table to automatically synchronize Kafka data to the ClickHouse cluster.You have created a Kafka cluster. The Kafka client ha",
"doc_type":"",
"kw":"Synchronizing Kafka Data to ClickHouse,Migrating ClickHouse Data,Component Operation Guide (Normal)",
"title":"Synchronizing Kafka Data to ClickHouse",
"githuburl":""
},
{
"uri":"mrs_01_24198.html",
"product_code":"mrs",
"code":"100",
"des":"The ClickHouse data migration tool can migrate some partitions of one or more partitioned MergeTree tables on several ClickHouseServer nodes to the same tables on other C",
"doc_type":"cmpntguide",
"kw":"Using the ClickHouse Data Migration Tool,Migrating ClickHouse Data,Component Operation Guide (Normal",
"title":"Using the ClickHouse Data Migration Tool",
"githuburl":""
},
{
"uri":"mrs_01_24251.html",
"product_code":"mrs",
"code":"101",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"User Management and Authentication",
"title":"User Management and Authentication",
"githuburl":""
},
{
"uri":"mrs_01_24057.html",
"product_code":"mrs",
"code":"102",
"des":"ClickHouse user permission management enables unified management of users, roles, and permissions on each ClickHouse instance in the cluster. You can use the permission m",
"doc_type":"cmpntguide",
"kw":"ClickHouse User and Permission Management,User Management and Authentication,Component Operation Gui",
"title":"ClickHouse User and Permission Management",
"githuburl":""
},
{
"uri":"mrs_01_24109.html",
"product_code":"mrs",
"code":"103",
"des":"ClickHouse can be interconnected with OpenLDAP. You can manage accounts and permissions in a centralized manner by adding the OpenLDAP server configuration and creating u",
"doc_type":"cmpntguide",
"kw":"Interconnecting ClickHouse With OpenLDAP for Authentication,User Management and Authentication,Compo",
"title":"Interconnecting ClickHouse With OpenLDAP for Authentication",
"githuburl":""
},
{
"uri":"mrs_01_24292.html",
"product_code":"",
"code":"104",
"des":"This section describes how to back up data by exporting ClickHouse data to a CSV file and restore data using the CSV file.You have installed the ClickHouse client.You hav",
"doc_type":"",
"kw":"Backing Up and Restoring ClickHouse Data Using a Data File,Using ClickHouse,Component Operation Guid",
"title":"Backing Up and Restoring ClickHouse Data Using a Data File",
"githuburl":""
},
{
"uri":"mrs_01_2399.html",
"product_code":"mrs",
"code":"105",
"des":"Log path: The default storage path of ClickHouse log files is as follows: ${BIGDATA_LOG_HOME}/clickhouseLog archive rule: The automatic ClickHouse log compression functio",
"doc_type":"cmpntguide",
"kw":"ClickHouse Log Overview,Using ClickHouse,Component Operation Guide (Normal)",
"title":"ClickHouse Log Overview",
"githuburl":""
},
{
"uri":"mrs_01_2356.html",
"product_code":"mrs",
"code":"106",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using DBService",
"title":"Using DBService",
"githuburl":""
},
{
"uri":"mrs_01_0789.html",
"product_code":"mrs",
"code":"107",
"des":"Log path: The default storage path of DBService log files is /var/log/Bigdata/dbservice.GaussDB: /var/log/Bigdata/dbservice/DB (GaussDB run log directory), /var/log/Bigda",
"doc_type":"cmpntguide",
"kw":"DBService Log Overview,Using DBService,Component Operation Guide (Normal)",
"title":"DBService Log Overview",
"githuburl":""
},
{
"uri":"mrs_01_0591.html",
"product_code":"mrs",
"code":"108",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Flink",
"title":"Using Flink",
"githuburl":""
},
{
"uri":"mrs_01_0473.html",
"product_code":"mrs",
"code":"109",
"des":"This section describes how to use Flink to run wordcount jobs.Flink has been installed in an MRS cluster.The cluster runs properly and the client has been correctly insta",
"doc_type":"cmpntguide",
"kw":"Using Flink from Scratch,Using Flink,Component Operation Guide (Normal)",
"title":"Using Flink from Scratch",
"githuburl":""
},
{
"uri":"mrs_01_0784.html",
"product_code":"mrs",
"code":"110",
"des":"You can view Flink job information on the Yarn web UI.The Flink service has been installed in a cluster.For versions earlier than MRS 1.9.2, log in to MRS Manager and cho",
"doc_type":"cmpntguide",
"kw":"Viewing Flink Job Information,Using Flink,Component Operation Guide (Normal)",
"title":"Viewing Flink Job Information",
"githuburl":""
},
{
"uri":"mrs_01_0592.html",
"product_code":"mrs",
"code":"111",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Flink Configuration Management",
"title":"Flink Configuration Management",
"githuburl":""
},
{
"uri":"mrs_01_1565.html",
"product_code":"mrs",
"code":"112",
"des":"All parameters of Flink must be set on a client. The path of a configuration file is as follows: Client installation path/Flink/flink/conf/flink-conf.yaml.You are advised",
"doc_type":"cmpntguide",
"kw":"Configuring Parameter Paths,Flink Configuration Management,Component Operation Guide (Normal)",
"title":"Configuring Parameter Paths",
"githuburl":""
},
{
"uri":"mrs_01_1566.html",
"product_code":"mrs",
"code":"113",
"des":"JobManager and TaskManager are main components of Flink. You can configure the parameters for different security and performance scenarios on the client.Main configuratio",
"doc_type":"cmpntguide",
"kw":"JobManager & TaskManager,Flink Configuration Management,Component Operation Guide (Normal)",
"title":"JobManager & TaskManager",
"githuburl":""
},
{
"uri":"mrs_01_1567.html",
"product_code":"mrs",
"code":"114",
"des":"The Blob server on the JobManager node is used to receive JAR files uploaded by users on the client, send JAR files to TaskManager, and transfer log files. Flink provides",
"doc_type":"cmpntguide",
"kw":"Blob,Flink Configuration Management,Component Operation Guide (Normal)",
"title":"Blob",
"githuburl":""
},
{
"uri":"mrs_01_1568.html",
"product_code":"mrs",
"code":"115",
"des":"The Akka actor model is the basis of communications between the Flink client and JobManager, JobManager and TaskManager, as well as TaskManager and TaskManager. Flink ena",
"doc_type":"cmpntguide",
"kw":"Distributed Coordination (via Akka),Flink Configuration Management,Component Operation Guide (Normal",
"title":"Distributed Coordination (via Akka)",
"githuburl":""
},
{
"uri":"mrs_01_1569.html",
"product_code":"mrs",
"code":"116",
"des":"When the secure Flink cluster is required, SSL-related configuration items must be set.Configuration items include the SSL switch, certificate, password, and encryption a",
"doc_type":"cmpntguide",
"kw":"SSL,Flink Configuration Management,Component Operation Guide (Normal)",
"title":"SSL",
"githuburl":""
},
{
"uri":"mrs_01_1570.html",
"product_code":"mrs",
"code":"117",
"des":"When Flink runs a job, data transmission and reverse pressure detection between tasks depend on Netty. In certain environments, Netty parameters should be configured.For ",
"doc_type":"cmpntguide",
"kw":"Network communication (via Netty),Flink Configuration Management,Component Operation Guide (Normal)",
"title":"Network communication (via Netty)",
"githuburl":""
},
{
"uri":"mrs_01_1571.html",
"product_code":"mrs",
"code":"118",
"des":"When JobManager is started, the web server in the same process is also started.You can access the web server to obtain information about the current Flink cluster, includ",
"doc_type":"cmpntguide",
"kw":"JobManager Web Frontend,Flink Configuration Management,Component Operation Guide (Normal)",
"title":"JobManager Web Frontend",
"githuburl":""
},
{
"uri":"mrs_01_1572.html",
"product_code":"mrs",
"code":"119",
"des":"Result files are created when tasks are running. Flink enables you to configure parameters for file creation.Configuration items include overwriting policy and directory ",
"doc_type":"cmpntguide",
"kw":"File Systems,Flink Configuration Management,Component Operation Guide (Normal)",
"title":"File Systems",
"githuburl":""
},
{
"uri":"mrs_01_1573.html",
"product_code":"mrs",
"code":"120",
"des":"Flink enables HA and job exception, as well as job pause and recovery during version upgrade. Flink depends on state backend to store job states and on the restart strate",
"doc_type":"cmpntguide",
"kw":"State Backend,Flink Configuration Management,Component Operation Guide (Normal)",
"title":"State Backend",
"githuburl":""
},
{
"uri":"mrs_01_1574.html",
"product_code":"mrs",
"code":"121",
"des":"Flink Kerberos configuration items must be configured in security mode.The configuration items include keytab and principal of Kerberos.",
"doc_type":"cmpntguide",
"kw":"Kerberos-based Security,Flink Configuration Management,Component Operation Guide (Normal)",
"title":"Kerberos-based Security",
"githuburl":""
},
{
"uri":"mrs_01_1575.html",
"product_code":"mrs",
"code":"122",
"des":"The Flink HA mode depends on ZooKeeper. Therefore, ZooKeeper-related configuration items must be set.Configuration items include the ZooKeeper address, path, and security",
"doc_type":"cmpntguide",
"kw":"HA,Flink Configuration Management,Component Operation Guide (Normal)",
"title":"HA",
"githuburl":""
},
{
"uri":"mrs_01_1576.html",
"product_code":"mrs",
"code":"123",
"des":"In scenarios raising special requirements on JVM configuration, users can use configuration items to transfer JVM parameters to the client, JobManager, and TaskManager.Co",
"doc_type":"cmpntguide",
"kw":"Environment,Flink Configuration Management,Component Operation Guide (Normal)",
"title":"Environment",
"githuburl":""
},
{
"uri":"mrs_01_1577.html",
"product_code":"mrs",
"code":"124",
"des":"Flink runs on a Yarn cluster and JobManager runs on ApplicationMaster. Certain configuration parameters of JobManager depend on Yarn. By setting Yarn-related configuratio",
"doc_type":"cmpntguide",
"kw":"Yarn,Flink Configuration Management,Component Operation Guide (Normal)",
"title":"Yarn",
"githuburl":""
},
{
"uri":"mrs_01_1578.html",
"product_code":"mrs",
"code":"125",
"des":"The Netty connection is used among multiple jobs to reduce latency. In this case, NettySink is used on the server and NettySource is used on the client for data transmiss",
"doc_type":"cmpntguide",
"kw":"Pipeline,Flink Configuration Management,Component Operation Guide (Normal)",
"title":"Pipeline",
"githuburl":""
},
{
"uri":"mrs_01_0593.html",
"product_code":"mrs",
"code":"126",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Security Configuration",
"title":"Security Configuration",
"githuburl":""
},
{
"uri":"mrs_01_1579.html",
"product_code":"mrs",
"code":"127",
"des":"All Flink cluster components support authentication.The Kerberos authentication is supported between Flink cluster components and external components, such as Yarn, HDFS,",
"doc_type":"cmpntguide",
"kw":"Security Features,Security Configuration,Component Operation Guide (Normal)",
"title":"Security Features",
"githuburl":""
},
{
"uri":"mrs_01_1580.html",
"product_code":"mrs",
"code":"128",
"des":"Sample project data of Flink is stored in Kafka. A user with Kafka permission can send data to Kafka and receive data from it.Run Linux command line to create a topic. Be",
"doc_type":"cmpntguide",
"kw":"Configuring Kafka,Security Configuration,Component Operation Guide (Normal)",
"title":"Configuring Kafka",
"githuburl":""
},
{
"uri":"mrs_01_1581.html",
"product_code":"mrs",
"code":"129",
"des":"This section applies to MRS 3.x or later clusters.Configure files.nettyconnector.registerserver.topic.storage: (Mandatory) Configures the path (on a third-party server) t",
"doc_type":"cmpntguide",
"kw":"Configuring Pipeline,Security Configuration,Component Operation Guide (Normal)",
"title":"Configuring Pipeline",
"githuburl":""
},
{
"uri":"mrs_01_0594.html",
"product_code":"mrs",
"code":"130",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Security Hardening",
"title":"Security Hardening",
"githuburl":""
},
{
"uri":"mrs_01_1583.html",
"product_code":"mrs",
"code":"131",
"des":"Flink uses the following three authentication modes:Kerberos authentication: It is used between the Flink Yarn client and Yarn ResourceManager, JobManager and ZooKeeper, ",
"doc_type":"cmpntguide",
"kw":"Authentication and Encryption,Security Hardening,Component Operation Guide (Normal)",
"title":"Authentication and Encryption",
"githuburl":""
},
{
"uri":"mrs_01_1584.html",
"product_code":"mrs",
"code":"132",
"des":"In HA mode of Flink, ZooKeeper can be used to manage clusters and discover services. Zookeeper supports SASL ACL control. Only users who have passed the SASL (Kerberos) a",
"doc_type":"cmpntguide",
"kw":"ACL Control,Security Hardening,Component Operation Guide (Normal)",
"title":"ACL Control",
"githuburl":""
},
{
"uri":"mrs_01_1585.html",
"product_code":"mrs",
"code":"133",
"des":"Note: The same coding mode is used on the web service client and server to prevent garbled characters and to enable input verification.Security hardening: apply UTF-8 to ",
"doc_type":"cmpntguide",
"kw":"Web Security,Security Hardening,Component Operation Guide (Normal)",
"title":"Web Security",
"githuburl":""
},
{
"uri":"mrs_01_1586.html",
"product_code":"mrs",
"code":"134",
"des":"All security functions of Flink are provided by the open source community or self-developed. Security features that need to be configured by users, such as authentication",
"doc_type":"cmpntguide",
"kw":"Security Statement,Using Flink,Component Operation Guide (Normal)",
"title":"Security Statement",
"githuburl":""
},
{
"uri":"mrs_01_24014.html",
"product_code":"mrs",
"code":"135",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using the Flink Web UI",
"title":"Using the Flink Web UI",
"githuburl":""
},
{
"uri":"mrs_01_24015.html",
"product_code":"mrs",
"code":"136",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Overview",
"title":"Overview",
"githuburl":""
},
{
"uri":"mrs_01_24016.html",
"product_code":"mrs",
"code":"137",
"des":"Flink web UI provides a web-based visual development platform. You only need to compile SQL statements to develop jobs, slashing the job development threshold. In additio",
"doc_type":"cmpntguide",
"kw":"Introduction to Flink Web UI,Overview,Component Operation Guide (Normal)",
"title":"Introduction to Flink Web UI",
"githuburl":""
},
{
"uri":"mrs_01_24017.html",
"product_code":"mrs",
"code":"138",
"des":"The Flink web UI application process is shown as follows:",
"doc_type":"cmpntguide",
"kw":"Flink Web UI Application Process,Overview,Component Operation Guide (Normal)",
"title":"Flink Web UI Application Process",
"githuburl":""
},
{
"uri":"mrs_01_24047.html",
"product_code":"mrs",
"code":"139",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"FlinkServer Permissions Management",
"title":"FlinkServer Permissions Management",
"githuburl":""
},
{
"uri":"mrs_01_24048.html",
"product_code":"mrs",
"code":"140",
"des":"User admin of Manager does not have the FlinkServer service operation permission. To perform FlinkServer service operations, you need to grant related permission to the u",
"doc_type":"cmpntguide",
"kw":"Overview,FlinkServer Permissions Management,Component Operation Guide (Normal)",
"title":"Overview",
"githuburl":""
},
{
"uri":"mrs_01_24049.html",
"product_code":"mrs",
"code":"141",
"des":"This section describes how to create and configure a FlinkServer role on Manager as the system administrator. A FlinkServer role can be configured with FlinkServer admini",
"doc_type":"cmpntguide",
"kw":"Authentication Based on Users and Roles,FlinkServer Permissions Management,Component Operation Guide",
"title":"Authentication Based on Users and Roles",
"githuburl":""
},
{
"uri":"mrs_01_24019.html",
"product_code":"mrs",
"code":"142",
"des":"After Flink is installed in an MRS cluster, you can connect to clusters and data as well as manage stream tables and jobs using the Flink web UI.This section describes ho",
"doc_type":"cmpntguide",
"kw":"Accessing the Flink Web UI,Using the Flink Web UI,Component Operation Guide (Normal)",
"title":"Accessing the Flink Web UI",
"githuburl":""
},
{
"uri":"mrs_01_24020.html",
"product_code":"mrs",
"code":"143",
"des":"Applications can be used to isolate different upper-layer services.After the application is created, you can switch to the application to be operated in the upper left co",
"doc_type":"cmpntguide",
"kw":"Creating an Application on the Flink Web UI,Using the Flink Web UI,Component Operation Guide (Normal",
"title":"Creating an Application on the Flink Web UI",
"githuburl":""
},
{
"uri":"mrs_01_24021.html",
"product_code":"mrs",
"code":"144",
"des":"Different clusters can be accessed by configuring the cluster connection.To obtain the cluster client configuration files, perform the following steps:Log in to FusionIns",
"doc_type":"cmpntguide",
"kw":"Creating a Cluster Connection on the Flink Web UI,Using the Flink Web UI,Component Operation Guide (",
"title":"Creating a Cluster Connection on the Flink Web UI",
"githuburl":""
},
{
"uri":"mrs_01_24022.html",
"product_code":"mrs",
"code":"145",
"des":"You can use data connections to access different data services. Currently, FlinkServer supports HDFS and Kafka data connections.",
"doc_type":"cmpntguide",
"kw":"Creating a Data Connection on the Flink Web UI,Using the Flink Web UI,Component Operation Guide (Nor",
"title":"Creating a Data Connection on the Flink Web UI",
"githuburl":""
},
{
"uri":"mrs_01_24023.html",
"product_code":"mrs",
"code":"146",
"des":"Data tables can be used to define basic attributes and parameters of source tables, dimension tables, and output tables.",
"doc_type":"cmpntguide",
"kw":"Managing Tables on the Flink Web UI,Using the Flink Web UI,Component Operation Guide (Normal)",
"title":"Managing Tables on the Flink Web UI",
"githuburl":""
},
{
"uri":"mrs_01_24024.html",
"product_code":"mrs",
"code":"147",
"des":"Define Flink jobs, including Flink SQL and Flink JAR jobs.Creating a Flink SQL jobDevelop the job on the job development page.Click Check Semantic to check the input cont",
"doc_type":"cmpntguide",
"kw":"Managing Jobs on the Flink Web UI,Using the Flink Web UI,Component Operation Guide (Normal)",
"title":"Managing Jobs on the Flink Web UI",
"githuburl":""
},
{
"uri":"mrs_01_0596.html",
"product_code":"mrs",
"code":"148",
"des":"Log path:Run logs of a Flink job: ${BIGDATA_DATA_HOME}/hadoop/data${i}/nm/containerlogs/application_${appid}/container_{$contid}The logs of executing tasks are stored in ",
"doc_type":"cmpntguide",
"kw":"Flink Log Overview,Using Flink,Component Operation Guide (Normal)",
"title":"Flink Log Overview",
"githuburl":""
},
{
"uri":"mrs_01_0597.html",
"product_code":"mrs",
"code":"149",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Flink Performance Tuning",
"title":"Flink Performance Tuning",
"githuburl":""
},
{
"uri":"mrs_01_1587.html",
"product_code":"mrs",
"code":"150",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Optimization DataStream",
"title":"Optimization DataStream",
"githuburl":""
},
{
"uri":"mrs_01_1588.html",
"product_code":"mrs",
"code":"151",
"des":"The computing of Flink depends on memory. If the memory is insufficient, the performance of Flink will be greatly deteriorated. One solution is to monitor garbage collect",
"doc_type":"cmpntguide",
"kw":"Memory Configuration Optimization,Optimization DataStream,Component Operation Guide (Normal)",
"title":"Memory Configuration Optimization",
"githuburl":""
},
{
"uri":"mrs_01_1589.html",
"product_code":"mrs",
"code":"152",
"des":"The degree of parallelism (DOP) indicates the number of tasks to be executed concurrently. It determines the number of data blocks after the operation. Configuring the DO",
"doc_type":"cmpntguide",
"kw":"Configuring DOP,Optimization DataStream,Component Operation Guide (Normal)",
"title":"Configuring DOP",
"githuburl":""
},
{
"uri":"mrs_01_1590.html",
"product_code":"mrs",
"code":"153",
"des":"In Flink on Yarn mode, there are JobManagers and TaskManagers. JobManagers and TaskManagers schedule and run tasks.Therefore, configuring parameters of JobManagers and Ta",
"doc_type":"cmpntguide",
"kw":"Configuring Process Parameters,Optimization DataStream,Component Operation Guide (Normal)",
"title":"Configuring Process Parameters",
"githuburl":""
},
{
"uri":"mrs_01_1591.html",
"product_code":"mrs",
"code":"154",
"des":"The divide of tasks can be optimized by optimizing the partitioning method. If data skew occurs in a certain task, the whole execution process is delayed. Therefore, when",
"doc_type":"cmpntguide",
"kw":"Optimizing the Design of Partitioning Method,Optimization DataStream,Component Operation Guide (Norm",
"title":"Optimizing the Design of Partitioning Method",
"githuburl":""
},
{
"uri":"mrs_01_1592.html",
"product_code":"mrs",
"code":"155",
"des":"The communication of Flink is based on Netty network. The network performance determines the data switching speed and task execution efficiency. Therefore, the performanc",
"doc_type":"cmpntguide",
"kw":"Configuring the Netty Network Communication,Optimization DataStream,Component Operation Guide (Norma",
"title":"Configuring the Netty Network Communication",
"githuburl":""
},
{
"uri":"mrs_01_1593.html",
"product_code":"mrs",
"code":"156",
"des":"If data skew occurs (certain data volume is extremely large), the execution time of tasks is inconsistent even though no GC is performed.Redefine keys. Use keys of smalle",
"doc_type":"cmpntguide",
"kw":"Experience Summary,Optimization DataStream,Component Operation Guide (Normal)",
"title":"Experience Summary",
"githuburl":""
},
{
"uri":"mrs_01_0598.html",
"product_code":"mrs",
"code":"157",
"des":"This section applies to MRS 3.x or later clusters.Before running the Flink shell commands, perform the following steps:source /opt/client/bigdata_envkinit Service user",
"doc_type":"cmpntguide",
"kw":"Common Flink Shell Commands,Using Flink,Component Operation Guide (Normal)",
"title":"Common Flink Shell Commands",
"githuburl":""
},
{
"uri":"mrs_01_0390.html",
"product_code":"mrs",
"code":"158",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Flume",
"title":"Using Flume",
"githuburl":""
},
{
"uri":"mrs_01_0397.html",
"product_code":"mrs",
"code":"159",
"des":"You can use Flume to import collected log information to Kafka.A streaming cluster that contains components such as Flume and Kafka and has Kerberos authentication enable",
"doc_type":"cmpntguide",
"kw":"Using Flume from Scratch,Using Flume,Component Operation Guide (Normal)",
"title":"Using Flume from Scratch",
"githuburl":""
},
{
"uri":"mrs_01_0391.html",
"product_code":"mrs",
"code":"160",
"des":"Flume is a distributed, reliable, and highly available system for aggregating massive logs, which can efficiently collect, aggregate, and move massive log data from diffe",
"doc_type":"cmpntguide",
"kw":"Overview,Using Flume,Component Operation Guide (Normal)",
"title":"Overview",
"githuburl":""
},
{
"uri":"mrs_01_0392.html",
"product_code":"mrs",
"code":"161",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Installing the Flume Client",
"title":"Installing the Flume Client",
"githuburl":""
},
{
"uri":"mrs_01_1594.html",
"product_code":"mrs",
"code":"162",
"des":"To use Flume to collect logs, you must install the Flume client on a log host. You can create an ECS and install the Flume client on it.This section applies to MRS 3.x or",
"doc_type":"cmpntguide",
"kw":"Installing the Flume Client on Clusters of Versions Earlier Than MRS 3.x,Installing the Flume Client",
"title":"Installing the Flume Client on Clusters of Versions Earlier Than MRS 3.x",
"githuburl":""
},
{
"uri":"mrs_01_1595.html",
"product_code":"mrs",
"code":"163",
"des":"To use Flume to collect logs, you must install the Flume client on a log host. You can create an ECS and install the Flume client on it.This section applies to MRS 3.x or",
"doc_type":"cmpntguide",
"kw":"Installing the Flume Client on MRS 3.x or Later Clusters,Installing the Flume Client,Component Opera",
"title":"Installing the Flume Client on MRS 3.x or Later Clusters",
"githuburl":""
},
{
"uri":"mrs_01_0393.html",
"product_code":"mrs",
"code":"164",
"des":"You can view logs to locate faults.The Flume client has been installed.ls -lR flume-client-*A log file is shown as follows:In the log file, FlumeClient.log is the run log",
"doc_type":"cmpntguide",
"kw":"Viewing Flume Client Logs,Using Flume,Component Operation Guide (Normal)",
"title":"Viewing Flume Client Logs",
"githuburl":""
},
{
"uri":"mrs_01_0394.html",
"product_code":"mrs",
"code":"165",
"des":"You can stop and start the Flume client or uninstall the Flume client when the Flume data ingestion channel is not required.Stop the Flume client of the Flume role.Assume",
"doc_type":"cmpntguide",
"kw":"Stopping or Uninstalling the Flume Client,Using Flume,Component Operation Guide (Normal)",
"title":"Stopping or Uninstalling the Flume Client",
"githuburl":""
},
{
"uri":"mrs_01_0395.html",
"product_code":"mrs",
"code":"166",
"des":"You can use the encryption tool provided by the Flume client to encrypt some parameter values in the configuration file.The Flume client has been installed.cd fusioninsig",
"doc_type":"cmpntguide",
"kw":"Using the Encryption Tool of the Flume Client,Using Flume,Component Operation Guide (Normal)",
"title":"Using the Encryption Tool of the Flume Client",
"githuburl":""
},
{
"uri":"mrs_01_1057.html",
"product_code":"mrs",
"code":"167",
"des":"This section applies to MRS 3.x or later clusters.This configuration guide describes how to configure common Flume services. For non-common Source, Channel, and Sink conf",
"doc_type":"cmpntguide",
"kw":"Flume Service Configuration Guide,Using Flume,Component Operation Guide (Normal)",
"title":"Flume Service Configuration Guide",
"githuburl":""
},
{
"uri":"mrs_01_0396.html",
"product_code":"mrs",
"code":"168",
"des":"For versions earlier than MRS 3.x, configure Flume parameters in the properties.properties file.For MRS 3.x or later, some parameters can be configured on Manager.This se",
"doc_type":"cmpntguide",
"kw":"Flume Configuration Parameter Description,Using Flume,Component Operation Guide (Normal)",
"title":"Flume Configuration Parameter Description",
"githuburl":""
},
{
"uri":"mrs_01_1058.html",
"product_code":"mrs",
"code":"169",
"des":"This section describes how to use environment variables in the properties.properties configuration file.This section applies to MRS 3.x or later clusters.The Flume servic",
"doc_type":"cmpntguide",
"kw":"Using Environment Variables in the properties.properties File,Using Flume,Component Operation Guide ",
"title":"Using Environment Variables in the properties.properties File",
"githuburl":""
},
{
"uri":"mrs_01_1059.html",
"product_code":"mrs",
"code":"170",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Non-Encrypted Transmission",
"title":"Non-Encrypted Transmission",
"githuburl":""
},
{
"uri":"mrs_01_1060.html",
"product_code":"mrs",
"code":"171",
"des":"This section describes how to configure Flume server and client parameters after the cluster and the Flume service are installed to ensure proper running of the service.T",
"doc_type":"cmpntguide",
"kw":"Configuring Non-encrypted Transmission,Non-Encrypted Transmission,Component Operation Guide (Normal)",
"title":"Configuring Non-encrypted Transmission",
"githuburl":""
},
{
"uri":"mrs_01_1061.html",
"product_code":"mrs",
"code":"172",
"des":"This section describes how to use the Flume client to collect static logs from a local host and save them to the topic list (test1) of Kafka.This section applies to MRS 3",
"doc_type":"cmpntguide",
"kw":"Typical Scenario: Collecting Local Static Logs and Uploading Them to Kafka,Non-Encrypted Transmissio",
"title":"Typical Scenario: Collecting Local Static Logs and Uploading Them to Kafka",
"githuburl":""
},
{
"uri":"mrs_01_1063.html",
"product_code":"mrs",
"code":"173",
"des":"This section describes how to use the Flume client to collect static logs from a local host and save them to the /flume/test directory on HDFS.This section applies to MRS",
"doc_type":"cmpntguide",
"kw":"Typical Scenario: Collecting Local Static Logs and Uploading Them to HDFS,Non-Encrypted Transmission",
"title":"Typical Scenario: Collecting Local Static Logs and Uploading Them to HDFS",
"githuburl":""
},
{
"uri":"mrs_01_1064.html",
"product_code":"mrs",
"code":"174",
"des":"This section describes how to use the Flume client to collect dynamic logs from a local host and save them to the /flume/test directory on HDFS.This section applies to MR",
"doc_type":"cmpntguide",
"kw":"Typical Scenario: Collecting Local Dynamic Logs and Uploading Them to HDFS,Non-Encrypted Transmissio",
"title":"Typical Scenario: Collecting Local Dynamic Logs and Uploading Them to HDFS",
"githuburl":""
},
{
"uri":"mrs_01_1065.html",
"product_code":"mrs",
"code":"175",
"des":"This section describes how to use the Flume client to collect logs from the topic list (test1) of Kafka and save them to the /flume/test directory on HDFS.This section ap",
"doc_type":"cmpntguide",
"kw":"Typical Scenario: Collecting Logs from Kafka and Uploading Them to HDFS,Non-Encrypted Transmission,C",
"title":"Typical Scenario: Collecting Logs from Kafka and Uploading Them to HDFS",
"githuburl":""
},
{
"uri":"mrs_01_1066.html",
"product_code":"mrs",
"code":"176",
"des":"This section describes how to use the Flume client to collect logs from the topic list (test1) of the Kafka client and save them to the /flume/test directory on HDFS.This",
"doc_type":"cmpntguide",
"kw":"Typical Scenario: Collecting Logs from Kafka and Uploading Them to HDFS Through the Flume Client,Non",
"title":"Typical Scenario: Collecting Logs from Kafka and Uploading Them to HDFS Through the Flume Client",
"githuburl":""
},
{
"uri":"mrs_01_1067.html",
"product_code":"mrs",
"code":"177",
"des":"This section describes how to use the Flume client to collect static logs from a local host and save them to the flume_test HBase table. In this scenario, multi-level age",
"doc_type":"cmpntguide",
"kw":"Typical Scenario: Collecting Local Static Logs and Uploading Them to HBase,Non-Encrypted Transmissio",
"title":"Typical Scenario: Collecting Local Static Logs and Uploading Them to HBase",
"githuburl":""
},
{
"uri":"mrs_01_1068.html",
"product_code":"mrs",
"code":"178",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Encrypted Transmission",
"title":"Encrypted Transmission",
"githuburl":""
},
{
"uri":"mrs_01_1069.html",
"product_code":"mrs",
"code":"179",
"des":"This section describes how to configure the server and client parameters of the Flume service (including the Flume and MonitorServer roles) after the cluster is installed",
"doc_type":"cmpntguide",
"kw":"Configuring the Encrypted Transmission,Encrypted Transmission,Component Operation Guide (Normal)",
"title":"Configuring the Encrypted Transmission",
"githuburl":""
},
{
"uri":"mrs_01_1070.html",
"product_code":"mrs",
"code":"180",
"des":"This section describes how to use Flume to collect static logs from a local host and save them to the /flume/test directory on HDFS.This section applies to MRS 3.x or lat",
"doc_type":"cmpntguide",
"kw":"Typical Scenario: Collecting Local Static Logs and Uploading Them to HDFS,Encrypted Transmission,Com",
"title":"Typical Scenario: Collecting Local Static Logs and Uploading Them to HDFS",
"githuburl":""
},
{
"uri":"mrs_01_1596.html",
"product_code":"mrs",
"code":"181",
"des":"The Flume client outside the FusionInsight cluster is a part of the end-to-end data collection. Both the Flume client outside the cluster and the Flume server in the clus",
"doc_type":"cmpntguide",
"kw":"Viewing Flume Client Monitoring Information,Using Flume,Component Operation Guide (Normal)",
"title":"Viewing Flume Client Monitoring Information",
"githuburl":""
},
{
"uri":"mrs_01_1071.html",
"product_code":"mrs",
"code":"182",
"des":"This section describes how to connect to Kafka using the Flume client in security mode.This section applies to MRS 3.x or later.Set keyTab and principal based on site req",
"doc_type":"cmpntguide",
"kw":"Connecting Flume to Kafka in Security Mode,Using Flume,Component Operation Guide (Normal)",
"title":"Connecting Flume to Kafka in Security Mode",
"githuburl":""
},
{
"uri":"mrs_01_1072.html",
"product_code":"mrs",
"code":"183",
"des":"This section describes how to use Flume to connect to Hive (version 3.1.0) in the cluster.This section applies to MRS 3.x or later.Flume and Hive have been correctly inst",
"doc_type":"cmpntguide",
"kw":"Connecting Flume with Hive in Security Mode,Using Flume,Component Operation Guide (Normal)",
"title":"Connecting Flume with Hive in Security Mode",
"githuburl":""
},
{
"uri":"mrs_01_1073.html",
"product_code":"mrs",
"code":"184",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Configuring the Flume Service Model",
"title":"Configuring the Flume Service Model",
"githuburl":""
},
{
"uri":"mrs_01_1074.html",
"product_code":"mrs",
"code":"185",
"des":"This section applies to MRS 3.x or later.Guide a reasonable Flume service configuration by providing performance differences between Flume common modules, to avoid a nons",
"doc_type":"cmpntguide",
"kw":"Overview,Configuring the Flume Service Model,Component Operation Guide (Normal)",
"title":"Overview",
"githuburl":""
},
{
"uri":"mrs_01_1075.html",
"product_code":"mrs",
"code":"186",
"des":"This section applies to MRS 3.x or later.During Flume service configuration and module selection, the ultimate throughput of a sink must be greater than the maximum throu",
"doc_type":"cmpntguide",
"kw":"Service Model Configuration Guide,Configuring the Flume Service Model,Component Operation Guide (Nor",
"title":"Service Model Configuration Guide",
"githuburl":""
},
{
"uri":"mrs_01_1081.html",
"product_code":"mrs",
"code":"187",
"des":"Log path: The default path of Flume log files is /var/log/Bigdata/Role name.FlumeServer: /var/log/Bigdata/flume/flumeFlumeClient: /var/log/Bigdata/flume-client-n/flumeMon",
"doc_type":"cmpntguide",
"kw":"Introduction to Flume Logs,Using Flume,Component Operation Guide (Normal)",
"title":"Introduction to Flume Logs",
"githuburl":""
},
{
"uri":"mrs_01_1082.html",
"product_code":"mrs",
"code":"188",
"des":"This section describes how to join and log out of a cgroup, query the cgroup status, and change the cgroup CPU threshold.This section applies to MRS 3.x or later.Join Cgr",
"doc_type":"cmpntguide",
"kw":"Flume Client Cgroup Usage Guide,Using Flume,Component Operation Guide (Normal)",
"title":"Flume Client Cgroup Usage Guide",
"githuburl":""
},
{
"uri":"mrs_01_1083.html",
"product_code":"mrs",
"code":"189",
"des":"This section describes how to perform secondary development for third-party plug-ins.This section applies to MRS 3.x or later.You have obtained the third-party JAR packag",
"doc_type":"cmpntguide",
"kw":"Secondary Development Guide for Flume Third-Party Plug-ins,Using Flume,Component Operation Guide (No",
"title":"Secondary Development Guide for Flume Third-Party Plug-ins",
"githuburl":""
},
{
"uri":"mrs_01_1598.html",
"product_code":"mrs",
"code":"190",
"des":"Flume logs are stored in /var/log/Bigdata/flume/flume/flumeServer.log. Most data transmission exceptions and data transmission failures are recorded in logs. You can run ",
"doc_type":"cmpntguide",
"kw":"Common Issues About Flume,Using Flume,Component Operation Guide (Normal)",
"title":"Common Issues About Flume",
"githuburl":""
},
{
"uri":"mrs_01_0500.html",
"product_code":"mrs",
"code":"191",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using HBase",
"title":"Using HBase",
"githuburl":""
},
{
"uri":"mrs_01_0368.html",
"product_code":"mrs",
"code":"192",
"des":"HBase is a column-based distributed storage system that features high reliability, performance, and scalability. This section describes how to use HBase from scratch, inc",
"doc_type":"cmpntguide",
"kw":"Using HBase from Scratch,Using HBase,Component Operation Guide (Normal)",
"title":"Using HBase from Scratch",
"githuburl":""
},
{
"uri":"bakmrs_01_0368.html",
"product_code":"mrs",
"code":"193",
"des":"This section describes how to use the HBase client in an O&M scenario or a service scenario.The client has been installed. For example, the installation directory is /opt",
"doc_type":"cmpntguide",
"kw":"Using an HBase Client,Using HBase,Component Operation Guide (Normal)",
"title":"Using an HBase Client",
"githuburl":""
},
{
"uri":"mrs_01_1608.html",
"product_code":"mrs",
"code":"194",
"des":"This section guides the system administrator to create and configure an HBase role on Manager. The HBase role can set HBase administrator permissions and read (R), write ",
"doc_type":"cmpntguide",
"kw":"Creating HBase Roles,Using HBase,Component Operation Guide (Normal)",
"title":"Creating HBase Roles",
"githuburl":""
},
{
"uri":"mrs_01_0501.html",
"product_code":"mrs",
"code":"195",
"des":"As a key feature to ensure high availability of the HBase cluster system, HBase cluster replication provides HBase with remote data replication in real time. It provides ",
"doc_type":"cmpntguide",
"kw":"Configuring HBase Replication,Using HBase,Component Operation Guide (Normal)",
"title":"Configuring HBase Replication",
"githuburl":""
},
{
"uri":"mrs_01_0443.html",
"product_code":"mrs",
"code":"196",
"des":"The operations described in this section apply only to clusters of versions earlier than MRS 3.x.If the default parameter settings of the MRS service cannot meet your req",
"doc_type":"cmpntguide",
"kw":"Configuring HBase Parameters,Using HBase,Component Operation Guide (Normal)",
"title":"Configuring HBase Parameters",
"githuburl":""
},
{
"uri":"mrs_01_0502.html",
"product_code":"mrs",
"code":"197",
"des":"DistCp is used to copy the data stored on HDFS from a cluster to another cluster. DistCp depends on the cross-cluster copy function, which is disabled by default. This fu",
"doc_type":"cmpntguide",
"kw":"Enabling Cross-Cluster Copy,Using HBase,Component Operation Guide (Normal)",
"title":"Enabling Cross-Cluster Copy",
"githuburl":""
},
{
"uri":"mrs_01_0510.html",
"product_code":"mrs",
"code":"198",
"des":"Active and standby clusters have been installed and started.Time is consistent between the active and standby clusters and the NTP service on the active and standby clust",
"doc_type":"cmpntguide",
"kw":"Using the ReplicationSyncUp Tool,Using HBase,Component Operation Guide (Normal)",
"title":"Using the ReplicationSyncUp Tool",
"githuburl":""
},
{
"uri":"mrs_01_24119.html",
"product_code":"mrs",
"code":"199",
"des":"This section applies only to MRS 3.1.0 or later.This section describes common GeoMesa commands. For more GeoMesa commands, visit https://www.geomesa.org/documentation/use",
"doc_type":"cmpntguide",
"kw":"GeoMesa Command Line,Using HBase,Component Operation Guide (Normal)",
"title":"GeoMesa Command Line",
"githuburl":""
},
{
"uri":"mrs_01_1609.html",
"product_code":"mrs",
"code":"200",
"des":"HBase disaster recovery (DR), a key feature that is used to ensure high availability (HA) of the HBase cluster system, provides the real-time remote DR function for HBase",
"doc_type":"cmpntguide",
"kw":"Configuring HBase DR,Using HBase,Component Operation Guide (Normal)",
"title":"Configuring HBase DR",
"githuburl":""
},
{
"uri":"mrs_01_24112.html",
"product_code":"mrs",
"code":"201",
"des":"HBase encodes data blocks in HFiles to reduce duplicate keys in KeyValues, reducing used space. Currently, the following data block encoding modes are supported: NONE, PR",
"doc_type":"cmpntguide",
"kw":"Configuring HBase Data Compression and Encoding,Using HBase,Component Operation Guide (Normal)",
"title":"Configuring HBase Data Compression and Encoding",
"githuburl":""
},
{
"uri":"mrs_01_1610.html",
"product_code":"mrs",
"code":"202",
"des":"The system administrator can configure HBase cluster DR to improve system availability. If the active cluster in the DR environment is faulty and the connection to the HB",
"doc_type":"cmpntguide",
"kw":"Performing an HBase DR Service Switchover,Using HBase,Component Operation Guide (Normal)",
"title":"Performing an HBase DR Service Switchover",
"githuburl":""
},
{
"uri":"mrs_01_1611.html",
"product_code":"mrs",
"code":"203",
"des":"The HBase cluster in the current environment is a DR cluster. Due to some reasons, the active and standby clusters need to be switched over. That is, the standby cluster ",
"doc_type":"cmpntguide",
"kw":"Performing an HBase DR Active/Standby Cluster Switchover,Using HBase,Component Operation Guide (Norm",
"title":"Performing an HBase DR Active/Standby Cluster Switchover",
"githuburl":""
},
{
"uri":"mrs_01_1612.html",
"product_code":"mrs",
"code":"204",
"des":"The Apache HBase official website provides the function of importing data in batches. For details, see the description of the Import and ImportTsv tools at http://hbase.a",
"doc_type":"cmpntguide",
"kw":"Community BulkLoad Tool,Using HBase,Component Operation Guide (Normal)",
"title":"Community BulkLoad Tool",
"githuburl":""
},
{
"uri":"mrs_01_1631.html",
"product_code":"mrs",
"code":"205",
"des":"In the actual application scenario, data in various sizes needs to be stored, for example, image data and documents. Data whose size is smaller than 10 MB can be stored i",
"doc_type":"cmpntguide",
"kw":"Configuring the MOB,Using HBase,Component Operation Guide (Normal)",
"title":"Configuring the MOB",
"githuburl":""
},
{
"uri":"mrs_01_1009.html",
"product_code":"mrs",
"code":"206",
"des":"This topic provides the procedure to configure the secure HBase replication during cross-realm Kerberos setup in security mode.Mapping for all the FQDNs to their realms s",
"doc_type":"cmpntguide",
"kw":"Configuring Secure HBase Replication,Using HBase,Component Operation Guide (Normal)",
"title":"Configuring Secure HBase Replication",
"githuburl":""
},
{
"uri":"mrs_01_1010.html",
"product_code":"mrs",
"code":"207",
"des":"In a faulty environment, there are possibilities that a region may be stuck in transition for longer duration due to various reasons like slow region server response, uns",
"doc_type":"cmpntguide",
"kw":"Configuring Region In Transition Recovery Chore Service,Using HBase,Component Operation Guide (Norma",
"title":"Configuring Region In Transition Recovery Chore Service",
"githuburl":""
},
{
"uri":"mrs_01_1056.html",
"product_code":"mrs",
"code":"208",
"des":"Log path: The default storage path of HBase logs is /var/log/Bigdata/hbase/Role name.HMaster: /var/log/Bigdata/hbase/hm (run logs) and /var/log/Bigdata/audit/hbase/hm (au",
"doc_type":"cmpntguide",
"kw":"HBase Log Overview,Using HBase,Component Operation Guide (Normal)",
"title":"HBase Log Overview",
"githuburl":""
},
{
"uri":"mrs_01_1013.html",
"product_code":"mrs",
"code":"209",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"HBase Performance Tuning",
"title":"HBase Performance Tuning",
"githuburl":""
},
{
"uri":"mrs_01_1636.html",
"product_code":"mrs",
"code":"210",
"des":"BulkLoad uses MapReduce jobs to directly generate files that comply with the internal data format of HBase, and then loads the generated StoreFiles to a running cluster. ",
"doc_type":"cmpntguide",
"kw":"Improving the BulkLoad Efficiency,HBase Performance Tuning,Component Operation Guide (Normal)",
"title":"Improving the BulkLoad Efficiency",
"githuburl":""
},
{
"uri":"mrs_01_1637.html",
"product_code":"mrs",
"code":"211",
"des":"In the scenario where a large number of requests are continuously put, setting the following two parameters to false can greatly improve the Put performance.hbase.regions",
"doc_type":"cmpntguide",
"kw":"Improving Put Performance,HBase Performance Tuning,Component Operation Guide (Normal)",
"title":"Improving Put Performance",
"githuburl":""
},
{
"uri":"mrs_01_1016.html",
"product_code":"mrs",
"code":"212",
"des":"HBase has many configuration parameters related to read and write performance. The configuration parameters need to be adjusted based on the read/write request loads. Thi",
"doc_type":"cmpntguide",
"kw":"Optimizing Put and Scan Performance,HBase Performance Tuning,Component Operation Guide (Normal)",
"title":"Optimizing Put and Scan Performance",
"githuburl":""
},
{
"uri":"mrs_01_1017.html",
"product_code":"mrs",
"code":"213",
"des":"Scenarios where data needs to be written to HBase in real time, or large-scale and consecutive put scenariosThis section applies to MRS 3.x and later versions.The HBase p",
"doc_type":"cmpntguide",
"kw":"Improving Real-time Data Write Performance,HBase Performance Tuning,Component Operation Guide (Norma",
"title":"Improving Real-time Data Write Performance",
"githuburl":""
},
{
"uri":"mrs_01_1018.html",
"product_code":"mrs",
"code":"214",
"des":"HBase data needs to be read.The get or scan interface of HBase has been invoked and data is read in real time from HBase.Data reading server tuningParameter portal:Go to ",
"doc_type":"cmpntguide",
"kw":"Improving Real-time Data Read Performance,HBase Performance Tuning,Component Operation Guide (Normal",
"title":"Improving Real-time Data Read Performance",
"githuburl":""
},
{
"uri":"mrs_01_1019.html",
"product_code":"mrs",
"code":"215",
"des":"When the number of clusters reaches a certain scale, the default settings of the Java virtual machine (JVM) cannot meet the cluster requirements. In this case, the cluste",
"doc_type":"cmpntguide",
"kw":"Optimizing JVM Parameters,HBase Performance Tuning,Component Operation Guide (Normal)",
"title":"Optimizing JVM Parameters",
"githuburl":""
},
{
"uri":"mrs_01_1638.html",
"product_code":"mrs",
"code":"216",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Common Issues About HBase",
"title":"Common Issues About HBase",
"githuburl":""
},
{
"uri":"mrs_01_1639.html",
"product_code":"mrs",
"code":"217",
"des":"A HBase server is faulty and cannot provide services. In this case, when a table operation is performed on the HBase client, why is the operation suspended and no respons",
"doc_type":"cmpntguide",
"kw":"Why Does a Client Keep Failing to Connect to a Server for a Long Time?,Common Issues About HBase,Com",
"title":"Why Does a Client Keep Failing to Connect to a Server for a Long Time?",
"githuburl":""
},
{
"uri":"mrs_01_1640.html",
"product_code":"mrs",
"code":"218",
"des":"Why submitted operations fail by stopping BulkLoad on the client during BulkLoad data importing?When BulkLoad is enabled on the client, a partitioner file is generated an",
"doc_type":"cmpntguide",
"kw":"Operation Failures Occur in Stopping BulkLoad On the Client,Common Issues About HBase,Component Oper",
"title":"Operation Failures Occur in Stopping BulkLoad On the Client",
"githuburl":""
},
{
"uri":"mrs_01_1641.html",
"product_code":"mrs",
"code":"219",
"des":"When HBase consecutively deletes and creates the same table, why may a table creation exception occur?Execution process: Disable Table > Drop Table > Create Table > Disab",
"doc_type":"cmpntguide",
"kw":"Why May a Table Creation Exception Occur When HBase Deletes or Creates the Same Table Consecutively?",
"title":"Why May a Table Creation Exception Occur When HBase Deletes or Creates the Same Table Consecutively?",
"githuburl":""
},
{
"uri":"mrs_01_1642.html",
"product_code":"mrs",
"code":"220",
"des":"Why other services become unstable if HBase sets up a large number of connections over the network port?When the OS command lsof or netstat is run, it is found that many ",
"doc_type":"cmpntguide",
"kw":"Why Other Services Become Unstable If HBase Sets up A Large Number of Connections over the Network P",
"title":"Why Other Services Become Unstable If HBase Sets up A Large Number of Connections over the Network Port?",
"githuburl":""
},
{
"uri":"mrs_01_1643.html",
"product_code":"mrs",
"code":"221",
"des":"The HBase bulkLoad task (a single table contains 26 TB data) has 210,000 maps and 10,000 reduce tasks (in MRS 3.x or later), and the task fails.ZooKeeper I/O bottleneck o",
"doc_type":"cmpntguide",
"kw":"Why Does the HBase BulkLoad Task (One Table Has 26 TB Data) Consisting of 210,000 Map Tasks and 10,0",
"title":"Why Does the HBase BulkLoad Task (One Table Has 26 TB Data) Consisting of 210,000 Map Tasks and 10,000 Reduce Tasks Fail?",
"githuburl":""
},
{
"uri":"mrs_01_1644.html",
"product_code":"mrs",
"code":"222",
"des":"How do I restore a region in the RIT state for a long time?Log in to the HMaster Web UI, choose Procedure & Locks in the navigation tree, and check whether any process ID",
"doc_type":"cmpntguide",
"kw":"How Do I Restore a Region in the RIT State for a Long Time?,Common Issues About HBase,Component Oper",
"title":"How Do I Restore a Region in the RIT State for a Long Time?",
"githuburl":""
},
{
"uri":"mrs_01_1645.html",
"product_code":"mrs",
"code":"223",
"des":"Why does HMaster exit due to timeout when waiting for the namespace table to go online?During the HMaster active/standby switchover or startup, HMaster performs WAL split",
"doc_type":"cmpntguide",
"kw":"Why Does HMaster Exits Due to Timeout When Waiting for the Namespace Table to Go Online?,Common Issu",
"title":"Why Does HMaster Exits Due to Timeout When Waiting for the Namespace Table to Go Online?",
"githuburl":""
},
{
"uri":"mrs_01_1646.html",
"product_code":"mrs",
"code":"224",
"des":"Why does the following exception occur on the client when I use the HBase client to operate table data?At the same time, the following log is displayed on RegionServer:Th",
"doc_type":"cmpntguide",
"kw":"Why Does SocketTimeoutException Occur When a Client Queries HBase?,Common Issues About HBase,Compone",
"title":"Why Does SocketTimeoutException Occur When a Client Queries HBase?",
"githuburl":""
},
{
"uri":"mrs_01_1647.html",
"product_code":"mrs",
"code":"225",
"des":"Why modified and deleted data can still be queried by using the scan command?Because of the scalability of HBase, all values specific to the versions in the queried colum",
"doc_type":"cmpntguide",
"kw":"Why Modified and Deleted Data Can Still Be Queried by Using the Scan Command?,Common Issues About HB",
"title":"Why Modified and Deleted Data Can Still Be Queried by Using the Scan Command?",
"githuburl":""
},
{
"uri":"mrs_01_1648.html",
"product_code":"mrs",
"code":"226",
"des":"Why \"java.lang.UnsatisfiedLinkError: Permission denied\" exception thrown while starting HBase shell?During HBase shell execution JRuby create temporary files under java.i",
"doc_type":"cmpntguide",
"kw":"Why \"java.lang.UnsatisfiedLinkError: Permission denied\" exception thrown while starting HBase shell?",
"title":"Why \"java.lang.UnsatisfiedLinkError: Permission denied\" exception thrown while starting HBase shell?",
"githuburl":""
},
{
"uri":"mrs_01_1649.html",
"product_code":"mrs",
"code":"227",
"des":"When does the RegionServers listed under \"Dead Region Servers\" on HMaster WebUI gets cleared?When an online RegionServer goes down abruptly, it is displayed under \"Dead R",
"doc_type":"cmpntguide",
"kw":"When does the RegionServers listed under \"Dead Region Servers\" on HMaster WebUI gets cleared?,Common",
"title":"When does the RegionServers listed under \"Dead Region Servers\" on HMaster WebUI gets cleared?",
"githuburl":""
},
{
"uri":"mrs_01_1650.html",
"product_code":"mrs",
"code":"228",
"des":"If the data to be imported by HBase bulkload has identical rowkeys, the data import is successful but identical query criteria produce different query results.Data with a",
"doc_type":"cmpntguide",
"kw":"Why Are Different Query Results Returned After I Use Same Query Criteria to Query Data Successfully ",
"title":"Why Are Different Query Results Returned After I Use Same Query Criteria to Query Data Successfully Imported by HBase bulkload?",
"githuburl":""
},
{
"uri":"mrs_01_1651.html",
"product_code":"mrs",
"code":"229",
"des":"What should I do if I fail to create tables due to the FAILED_OPEN state of Regions?If a network, HDFS, or Active HMaster fault occurs during the creation of tables, some",
"doc_type":"cmpntguide",
"kw":"What Should I Do If I Fail to Create Tables Due to the FAILED_OPEN State of Regions?,Common Issues A",
"title":"What Should I Do If I Fail to Create Tables Due to the FAILED_OPEN State of Regions?",
"githuburl":""
},
{
"uri":"mrs_01_1652.html",
"product_code":"mrs",
"code":"230",
"des":"In security mode, names of tables that failed to be created are unnecessarily retained in the table-lock node (default directory is /hbase/table-lock) of ZooKeeper. How d",
"doc_type":"cmpntguide",
"kw":"How Do I Delete Residual Table Names in the /hbase/table-lock Directory of ZooKeeper?,Common Issues ",
"title":"How Do I Delete Residual Table Names in the /hbase/table-lock Directory of ZooKeeper?",
"githuburl":""
},
{
"uri":"mrs_01_1653.html",
"product_code":"mrs",
"code":"231",
"des":"Why does HBase become faulty when I set quota for the directory used by HBase in HDFS?The flush operation of a table is to write memstore data to HDFS.If the HDFS directo",
"doc_type":"cmpntguide",
"kw":"Why Does HBase Become Faulty When I Set a Quota for the Directory Used by HBase in HDFS?,Common Issu",
"title":"Why Does HBase Become Faulty When I Set a Quota for the Directory Used by HBase in HDFS?",
"githuburl":""
},
{
"uri":"mrs_01_1654.html",
"product_code":"mrs",
"code":"232",
"des":"Why HMaster times out while waiting for namespace table to be assigned after rebuilding meta using OfflineMetaRepair tool and startups failed?HMaster abort with following",
"doc_type":"cmpntguide",
"kw":"Why HMaster Times Out While Waiting for Namespace Table to be Assigned After Rebuilding Meta Using O",
"title":"Why HMaster Times Out While Waiting for Namespace Table to be Assigned After Rebuilding Meta Using OfflineMetaRepair Tool and Startups Failed",
"githuburl":""
},
{
"uri":"mrs_01_1655.html",
"product_code":"mrs",
"code":"233",
"des":"Why messages containing FileNotFoundException and no lease are frequently displayed in the HMaster logs during the WAL splitting process?During the WAL splitting process,",
"doc_type":"cmpntguide",
"kw":"Why Messages Containing FileNotFoundException and no lease Are Frequently Displayed in the HMaster L",
"title":"Why Messages Containing FileNotFoundException and no lease Are Frequently Displayed in the HMaster Logs During the WAL Splitting Process?",
"githuburl":""
},
{
"uri":"mrs_01_1657.html",
"product_code":"mrs",
"code":"234",
"des":"When a tenant accesses Phoenix, a message is displayed indicating that the tenant has insufficient rights.You need to associate the HBase service and Yarn queues when cre",
"doc_type":"cmpntguide",
"kw":"Insufficient Rights When a Tenant Accesses Phoenix,Common Issues About HBase,Component Operation Gui",
"title":"Insufficient Rights When a Tenant Accesses Phoenix",
"githuburl":""
},
{
"uri":"mrs_01_1659.html",
"product_code":"mrs",
"code":"235",
"des":"The system automatically rolls back data after an HBase recovery task fails. If \"Rollback recovery failed\" is displayed, the rollback fails. After the rollback fails, dat",
"doc_type":"cmpntguide",
"kw":"What Can I Do When HBase Fails to Recover a Task and a Message Is Displayed Stating \"Rollback recove",
"title":"What Can I Do When HBase Fails to Recover a Task and a Message Is Displayed Stating \"Rollback recovery failed\"?",
"githuburl":""
},
{
"uri":"mrs_01_1660.html",
"product_code":"mrs",
"code":"236",
"des":"When the HBaseFsck tool is used to check the region status in MRS 3.x and later versions, if the log contains ERROR: (regions region1 and region2) There is an overlap in ",
"doc_type":"cmpntguide",
"kw":"How Do I Fix Region Overlapping?,Common Issues About HBase,Component Operation Guide (Normal)",
"title":"How Do I Fix Region Overlapping?",
"githuburl":""
},
{
"uri":"mrs_01_1661.html",
"product_code":"mrs",
"code":"237",
"des":"(MRS 3.x and later versions) Check the hbase-omm-*.out log of the node where RegionServer fails to be started. It is found that the log contains An error report file with",
"doc_type":"cmpntguide",
"kw":"Why Does RegionServer Fail to Be Started When GC Parameters Xms and Xmx of HBase RegionServer Are Se",
"title":"Why Does RegionServer Fail to Be Started When GC Parameters Xms and Xmx of HBase RegionServer Are Set to 31 GB?",
"githuburl":""
},
{
"uri":"mrs_01_0625.html",
"product_code":"mrs",
"code":"238",
"des":"Why does the LoadIncrementalHFiles tool fail to be executed and \"Permission denied\" is displayed when a Linux user is manually created in a normal cluster and DataNode in",
"doc_type":"cmpntguide",
"kw":"Why Does the LoadIncrementalHFiles Tool Fail to Be Executed and \"Permission denied\" Is Displayed Whe",
"title":"Why Does the LoadIncrementalHFiles Tool Fail to Be Executed and \"Permission denied\" Is Displayed When Nodes in a Cluster Are Used to Import Data in Batches?",
"githuburl":""
},
{
"uri":"mrs_01_2210.html",
"product_code":"mrs",
"code":"239",
"des":"When the sqlline script is used on the client, the error message \"import argparse\" is displayed.",
"doc_type":"cmpntguide",
"kw":"Why Is the Error Message \"import argparse\" Displayed When the Phoenix sqlline Script Is Used?,Common",
"title":"Why Is the Error Message \"import argparse\" Displayed When the Phoenix sqlline Script Is Used?",
"githuburl":""
},
{
"uri":"mrs_01_2211.html",
"product_code":"mrs",
"code":"240",
"des":"When the indexed field data is updated, if a batch of data exists in the user table, the BulkLoad tool cannot update the global and partial mutable indexes.Problem Analys",
"doc_type":"cmpntguide",
"kw":"How Do I Deal with the Restrictions of the Phoenix BulkLoad Tool?,Common Issues About HBase,Componen",
"title":"How Do I Deal with the Restrictions of the Phoenix BulkLoad Tool?",
"githuburl":""
},
{
"uri":"mrs_01_2212.html",
"product_code":"mrs",
"code":"241",
"des":"When CTBase accesses the HBase service with the Ranger plug-ins enabled and you are creating a cluster table, a message is displayed indicating that the permission is ins",
"doc_type":"cmpntguide",
"kw":"Why a Message Is Displayed Indicating that the Permission is Insufficient When CTBase Connects to th",
"title":"Why a Message Is Displayed Indicating that the Permission is Insufficient When CTBase Connects to the Ranger Plug-ins?",
"githuburl":""
},
{
"uri":"mrs_01_0790.html",
"product_code":"mrs",
"code":"242",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using HDFS",
"title":"Using HDFS",
"githuburl":""
},
{
"uri":"mrs_01_0791.html",
"product_code":"mrs",
"code":"243",
"des":"In HDFS, each file object needs to register corresponding information in the NameNode and occupies certain storage space. As the number of files increases, if the origina",
"doc_type":"cmpntguide",
"kw":"Configuring Memory Management,Using HDFS,Component Operation Guide (Normal)",
"title":"Configuring Memory Management",
"githuburl":""
},
{
"uri":"mrs_01_1662.html",
"product_code":"mrs",
"code":"244",
"des":"This section describes how to create and configure an HDFS role on FusionInsight Manager. The HDFS role is granted the rights to read, write, and execute HDFS directories",
"doc_type":"cmpntguide",
"kw":"Creating an HDFS Role,Using HDFS,Component Operation Guide (Normal)",
"title":"Creating an HDFS Role",
"githuburl":""
},
{
"uri":"mrs_01_1663.html",
"product_code":"mrs",
"code":"245",
"des":"This section describes how to use the HDFS client in an O&M scenario or service scenario.The client has been installed.For example, the installation directory is /opt/had",
"doc_type":"cmpntguide",
"kw":"Using the HDFS Client,Using HDFS,Component Operation Guide (Normal)",
"title":"Using the HDFS Client",
"githuburl":""
},
{
"uri":"mrs_01_0794.html",
"product_code":"mrs",
"code":"246",
"des":"DistCp is a tool used to perform large-amount data replication between clusters or in a cluster. It uses MapReduce tasks to implement distributed copy of a large amount o",
"doc_type":"cmpntguide",
"kw":"Running the DistCp Command,Using HDFS,Component Operation Guide (Normal)",
"title":"Running the DistCp Command",
"githuburl":""
},
{
"uri":"mrs_01_0795.html",
"product_code":"mrs",
"code":"247",
"des":"This section describes the directory structure in HDFS, as shown in the following table.",
"doc_type":"cmpntguide",
"kw":"Overview of HDFS File System Directories,Using HDFS,Component Operation Guide (Normal)",
"title":"Overview of HDFS File System Directories",
"githuburl":""
},
{
"uri":"mrs_01_1664.html",
"product_code":"mrs",
"code":"248",
"des":"This section applies to MRS 3.x or later clusters.If the storage directory defined by the HDFS DataNode is incorrect or the HDFS storage plan changes, the system administ",
"doc_type":"cmpntguide",
"kw":"Changing the DataNode Storage Directory,Using HDFS,Component Operation Guide (Normal)",
"title":"Changing the DataNode Storage Directory",
"githuburl":""
},
{
"uri":"mrs_01_0797.html",
"product_code":"mrs",
"code":"249",
"des":"The permission for some HDFS directories is 777 or 750 by default, which brings potential security risks. You are advised to modify the permission for the HDFS directorie",
"doc_type":"cmpntguide",
"kw":"Configuring HDFS Directory Permission,Using HDFS,Component Operation Guide (Normal)",
"title":"Configuring HDFS Directory Permission",
"githuburl":""
},
{
"uri":"mrs_01_1665.html",
"product_code":"mrs",
"code":"250",
"des":"This section applies to MRS 3.x or later.Before deploying a cluster, you can deploy a Network File System (NFS) server based on requirements to store NameNode metadata to",
"doc_type":"cmpntguide",
"kw":"Configuring NFS,Using HDFS,Component Operation Guide (Normal)",
"title":"Configuring NFS",
"githuburl":""
},
{
"uri":"mrs_01_0799.html",
"product_code":"mrs",
"code":"251",
"des":"In HDFS, DataNode stores user files and directories as blocks, and file objects are generated on the NameNode to map each file, directory, and block on the DataNode.The f",
"doc_type":"cmpntguide",
"kw":"Planning HDFS Capacity,Using HDFS,Component Operation Guide (Normal)",
"title":"Planning HDFS Capacity",
"githuburl":""
},
{
"uri":"mrs_01_0801.html",
"product_code":"mrs",
"code":"252",
"des":"When you open an HDFS file, an error occurs due to the limit on the number of file handles. Information similar to the following is displayed.You can contact the systemad",
"doc_type":"cmpntguide",
"kw":"Configuring ulimit for HBase and HDFS,Using HDFS,Component Operation Guide (Normal)",
"title":"Configuring ulimit for HBase and HDFS",
"githuburl":""
},
{
"uri":"mrs_01_1667.html",
"product_code":"mrs",
"code":"253",
"des":"This section applies to MRS 3.x or later clusters.In the HDFS cluster, unbalanced disk usage among DataNodes may occur, for example, when new DataNodes are added to the c",
"doc_type":"cmpntguide",
"kw":"Balancing DataNode Capacity,Using HDFS,Component Operation Guide (Normal)",
"title":"Balancing DataNode Capacity",
"githuburl":""
},
{
"uri":"mrs_01_0804.html",
"product_code":"mrs",
"code":"254",
"des":"By default, NameNode randomly selects a DataNode to write files. If the disk capacity of some DataNodes in a cluster is inconsistent (the total disk capacity of some node",
"doc_type":"cmpntguide",
"kw":"Configuring Replica Replacement Policy for Heterogeneous Capacity Among DataNodes,Using HDFS,Compone",
"title":"Configuring Replica Replacement Policy for Heterogeneous Capacity Among DataNodes",
"githuburl":""
},
{
"uri":"mrs_01_0805.html",
"product_code":"mrs",
"code":"255",
"des":"Generally, multiple services are deployed in a cluster, and the storage of most services depends on the HDFS file system. Different components such as Spark and Yarn or c",
"doc_type":"cmpntguide",
"kw":"Configuring the Number of Files in a Single HDFS Directory,Using HDFS,Component Operation Guide (Nor",
"title":"Configuring the Number of Files in a Single HDFS Directory",
"githuburl":""
},
{
"uri":"mrs_01_0806.html",
"product_code":"mrs",
"code":"256",
"des":"On HDFS, deleted files are moved to the recycle bin (trash can) so that the data deleted by mistake can be restored.You can set the time threshold for storing files in th",
"doc_type":"cmpntguide",
"kw":"Configuring the Recycle Bin Mechanism,Using HDFS,Component Operation Guide (Normal)",
"title":"Configuring the Recycle Bin Mechanism",
"githuburl":""
},
{
"uri":"mrs_01_0807.html",
"product_code":"mrs",
"code":"257",
"des":"HDFS allows users to modify the default permissions of files and directories. The default mask provided by the HDFS for creating file and directory permissions is 022. If",
"doc_type":"cmpntguide",
"kw":"Setting Permissions on Files and Directories,Using HDFS,Component Operation Guide (Normal)",
"title":"Setting Permissions on Files and Directories",
"githuburl":""
},
{
"uri":"mrs_01_0808.html",
"product_code":"mrs",
"code":"258",
"des":"In security mode, users can flexibly set the maximum token lifetime and token renewal interval in HDFS based on cluster requirements.Navigation path for setting parameter",
"doc_type":"cmpntguide",
"kw":"Setting the Maximum Lifetime and Renewal Interval of a Token,Using HDFS,Component Operation Guide (N",
"title":"Setting the Maximum Lifetime and Renewal Interval of a Token",
"githuburl":""
},
{
"uri":"mrs_01_1669.html",
"product_code":"mrs",
"code":"259",
"des":"In the open source version, if multiple data storage volumes are configured for a DataNode, the DataNode stops providing services by default if one of the volumes is dama",
"doc_type":"cmpntguide",
"kw":"Configuring the Damaged Disk Volume,Using HDFS,Component Operation Guide (Normal)",
"title":"Configuring the Damaged Disk Volume",
"githuburl":""
},
{
"uri":"mrs_01_0810.html",
"product_code":"mrs",
"code":"260",
"des":"Encrypted channel is an encryption protocol of remote procedure call (RPC) in HDFS. When a user invokes RPC, the user's login name will be transmitted to RPC through RPC ",
"doc_type":"cmpntguide",
"kw":"Configuring Encrypted Channels,Using HDFS,Component Operation Guide (Normal)",
"title":"Configuring Encrypted Channels",
"githuburl":""
},
{
"uri":"mrs_01_0811.html",
"product_code":"mrs",
"code":"261",
"des":"Clients probably encounter running errors when the network is not stable. Users can adjust the following parameter values to improve the running efficiency.Go to the All ",
"doc_type":"cmpntguide",
"kw":"Reducing the Probability of Abnormal Client Application Operation When the Network Is Not Stable,Usi",
"title":"Reducing the Probability of Abnormal Client Application Operation When the Network Is Not Stable",
"githuburl":""
},
{
"uri":"mrs_01_1670.html",
"product_code":"mrs",
"code":"262",
"des":"This section applies to MRS 3.x or later.In the existing default DFSclient failover proxy provider, if a NameNode in a process is faulty, all HDFS client instances in the",
"doc_type":"cmpntguide",
"kw":"Configuring the NameNode Blacklist,Using HDFS,Component Operation Guide (Normal)",
"title":"Configuring the NameNode Blacklist",
"githuburl":""
},
{
"uri":"mrs_01_1672.html",
"product_code":"mrs",
"code":"263",
"des":"This section applies to MRS 3.x or later.Several finished Hadoop clusters are faulty because the NameNode is overloaded and unresponsive.Such problem is caused by the ini",
"doc_type":"cmpntguide",
"kw":"Optimizing HDFS NameNode RPC QoS,Using HDFS,Component Operation Guide (Normal)",
"title":"Optimizing HDFS NameNode RPC QoS",
"githuburl":""
},
{
"uri":"mrs_01_1673.html",
"product_code":"mrs",
"code":"264",
"des":"When the speed at which the client writes data to the HDFS is greater than the disk bandwidth of the DataNode, the disk bandwidth is fully occupied. As a result, the Data",
"doc_type":"cmpntguide",
"kw":"Optimizing HDFS DataNode RPC QoS,Using HDFS,Component Operation Guide (Normal)",
"title":"Optimizing HDFS DataNode RPC QoS",
"githuburl":""
},
{
"uri":"mrs_01_1675.html",
"product_code":"mrs",
"code":"265",
"des":"When the Yarn local directory and DataNode directory are on the same disk, the disk with larger capacity can run more tasks. Therefore, more intermediate data is stored i",
"doc_type":"cmpntguide",
"kw":"Configuring Reserved Percentage of Disk Usage on DataNodes,Using HDFS,Component Operation Guide (Nor",
"title":"Configuring Reserved Percentage of Disk Usage on DataNodes",
"githuburl":""
},
{
"uri":"mrs_01_1676.html",
"product_code":"mrs",
"code":"266",
"des":"You need to configure the nodes for storing HDFS file data blocks based on data features. You can configure a label expression to an HDFS directory or file and assign one",
"doc_type":"cmpntguide",
"kw":"Configuring HDFS NodeLabel,Using HDFS,Component Operation Guide (Normal)",
"title":"Configuring HDFS NodeLabel",
"githuburl":""
},
{
"uri":"mrs_01_2360.html",
"product_code":"mrs",
"code":"267",
"des":"AZ Mover is a copy migration tool used to move copies to meet the new AZ policies set on the directory. It can be used to migrate copies from one AZ policy to another. AZ",
"doc_type":"cmpntguide",
"kw":"Using HDFS AZ Mover,Using HDFS,Component Operation Guide (Normal)",
"title":"Using HDFS AZ Mover",
"githuburl":""
},
{
"uri":"mrs_01_1681.html",
"product_code":"mrs",
"code":"268",
"des":"In an HDFS cluster configured with HA, the active NameNode processes all client requests, and the standby NameNode reserves the latest metadata and block location informa",
"doc_type":"cmpntguide",
"kw":"Configuring the Observer NameNode to Process Read Requests,Using HDFS,Component Operation Guide (Nor",
"title":"Configuring the Observer NameNode to Process Read Requests",
"githuburl":""
},
{
"uri":"mrs_01_1684.html",
"product_code":"mrs",
"code":"269",
"des":"Performing this operation can concurrently modify file and directory permissions and access control tools in a cluster.This section applies to MRS 3.x or later clusters.P",
"doc_type":"cmpntguide",
"kw":"Performing Concurrent Operations on HDFS Files,Using HDFS,Component Operation Guide (Normal)",
"title":"Performing Concurrent Operations on HDFS Files",
"githuburl":""
},
{
"uri":"mrs_01_0828.html",
"product_code":"mrs",
"code":"270",
"des":"Log path: The default path of HDFS logs is /var/log/Bigdata/hdfs/Role name.NameNode: /var/log/Bigdata/hdfs/nn (run logs) and /var/log/Bigdata/audit/hdfs/nn (audit logs)Da",
"doc_type":"cmpntguide",
"kw":"Introduction to HDFS Logs,Using HDFS,Component Operation Guide (Normal)",
"title":"Introduction to HDFS Logs",
"githuburl":""
},
{
"uri":"mrs_01_0829.html",
"product_code":"mrs",
"code":"271",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"HDFS Performance Tuning",
"title":"HDFS Performance Tuning",
"githuburl":""
},
{
"uri":"mrs_01_1687.html",
"product_code":"mrs",
"code":"272",
"des":"Improve the HDFS write performance by modifying the HDFS attributes.This section applies to MRS 3.x or later.Navigation path for setting parameters:On FusionInsight Manag",
"doc_type":"cmpntguide",
"kw":"Improving Write Performance,HDFS Performance Tuning,Component Operation Guide (Normal)",
"title":"Improving Write Performance",
"githuburl":""
},
{
"uri":"mrs_01_1688.html",
"product_code":"mrs",
"code":"273",
"des":"Improve the HDFS read performance by using the client to cache the metadata for block locations.This function is recommended only for reading files that are not modified ",
"doc_type":"cmpntguide",
"kw":"Improving Read Performance Using Client Metadata Cache,HDFS Performance Tuning,Component Operation G",
"title":"Improving Read Performance Using Client Metadata Cache",
"githuburl":""
},
{
"uri":"mrs_01_1689.html",
"product_code":"mrs",
"code":"274",
"des":"When HDFS is deployed in high availability (HA) mode with multiple NameNode instances, the HDFS client needs to connect to each NameNode in sequence to determine which is",
"doc_type":"cmpntguide",
"kw":"Improving the Connection Between the Client and NameNode Using Current Active Cache,HDFS Performance",
"title":"Improving the Connection Between the Client and NameNode Using Current Active Cache",
"githuburl":""
},
{
"uri":"mrs_01_1690.html",
"product_code":"mrs",
"code":"275",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"FAQ",
"title":"FAQ",
"githuburl":""
},
{
"uri":"mrs_01_1691.html",
"product_code":"mrs",
"code":"276",
"des":"The NameNode startup is slow when it is restarted immediately after a large number of files (for example, 1 million files) are deleted.It takes time for the DataNode to d",
"doc_type":"cmpntguide",
"kw":"NameNode Startup Is Slow,FAQ,Component Operation Guide (Normal)",
"title":"NameNode Startup Is Slow",
"githuburl":""
},
{
"uri":"mrs_01_1693.html",
"product_code":"mrs",
"code":"277",
"des":"The DataNode is normal, but cannot report data blocks. As a result, the existing data blocks cannot be used.This error may occur when the number of data blocks in a data ",
"doc_type":"cmpntguide",
"kw":"DataNode Is Normal but Cannot Report Data Blocks,FAQ,Component Operation Guide (Normal)",
"title":"DataNode Is Normal but Cannot Report Data Blocks",
"githuburl":""
},
{
"uri":"mrs_01_1694.html",
"product_code":"mrs",
"code":"278",
"des":"When errors occur in the dfs.datanode.data.dir directory of DataNode due to the permission or disk damage, HDFS WebUI does not display information about damaged data.Afte",
"doc_type":"cmpntguide",
"kw":"HDFS WebUI Cannot Properly Update Information About Damaged Data,FAQ,Component Operation Guide (Norm",
"title":"HDFS WebUI Cannot Properly Update Information About Damaged Data",
"githuburl":""
},
{
"uri":"mrs_01_1695.html",
"product_code":"mrs",
"code":"279",
"des":"Why distcp command fails in the secure cluster with the following error displayed?Client side exceptionServer side exceptionThe preceding error may occur if webhdfs:// is",
"doc_type":"cmpntguide",
"kw":"Why Does the Distcp Command Fail in the Secure Cluster, Causing an Exception?,FAQ,Component Operatio",
"title":"Why Does the Distcp Command Fail in the Secure Cluster, Causing an Exception?",
"githuburl":""
},
{
"uri":"mrs_01_1696.html",
"product_code":"mrs",
"code":"280",
"des":"If the number of disks specified by dfs.datanode.data.dir is equal to the value of dfs.datanode.failed.volumes.tolerated, DataNode startup will fail.By default, the failu",
"doc_type":"cmpntguide",
"kw":"Why Does DataNode Fail to Start When the Number of Disks Specified by dfs.datanode.data.dir Equals d",
"title":"Why Does DataNode Fail to Start When the Number of Disks Specified by dfs.datanode.data.dir Equals dfs.datanode.failed.volumes.tolerated?",
"githuburl":""
},
{
"uri":"mrs_01_1697.html",
"product_code":"mrs",
"code":"281",
"des":"The capacity of a DataNode fails to calculate when multiple data.dir directories are configured in a disk partition.Currently, the capacity is calculated based on disks, ",
"doc_type":"cmpntguide",
"kw":"Failed to Calculate the Capacity of a DataNode when Multiple data.dir Directories Are Configured in ",
"title":"Failed to Calculate the Capacity of a DataNode when Multiple data.dir Directories Are Configured in a Disk Partition",
"githuburl":""
},
{
"uri":"mrs_01_1698.html",
"product_code":"mrs",
"code":"282",
"des":"When the standby NameNode is powered off during metadata (namespace) storage, it fails to be started and the following error information is displayed.When the standby Nam",
"doc_type":"cmpntguide",
"kw":"Standby NameNode Fails to Be Restarted When the System Is Powered off During Metadata (Namespace) St",
"title":"Standby NameNode Fails to Be Restarted When the System Is Powered off During Metadata (Namespace) Storage",
"githuburl":""
},
{
"uri":"mrs_01_1699.html",
"product_code":"mrs",
"code":"283",
"des":"Why data in the buffer is lost if a power outage occurs during storage of small files?Because of a power outage, the blocks in the buffer are not written to the disk imme",
"doc_type":"cmpntguide",
"kw":"Why Data in the Buffer Is Lost If a Power Outage Occurs During Storage of Small Files,FAQ,Component ",
"title":"Why Data in the Buffer Is Lost If a Power Outage Occurs During Storage of Small Files",
"githuburl":""
},
{
"uri":"mrs_01_1700.html",
"product_code":"mrs",
"code":"284",
"des":"When HDFS calls the FileInputFormat getSplit method, the ArrayIndexOutOfBoundsException: 0 appears in the following log:The elements of each block correspondent frame are",
"doc_type":"cmpntguide",
"kw":"Why Does Array Border-crossing Occur During FileInputFormat Split?,FAQ,Component Operation Guide (No",
"title":"Why Does Array Border-crossing Occur During FileInputFormat Split?",
"githuburl":""
},
{
"uri":"mrs_01_1701.html",
"product_code":"mrs",
"code":"285",
"des":"When the storage policy of the file is set to LAZY_PERSIST, the storage type of the first replica should be RAM_DISK, and the storage type of other replicas should be DIS",
"doc_type":"cmpntguide",
"kw":"Why Is the Storage Type of File Copies DISK When the Tiered Storage Policy Is LAZY_PERSIST?,FAQ,Comp",
"title":"Why Is the Storage Type of File Copies DISK When the Tiered Storage Policy Is LAZY_PERSIST?",
"githuburl":""
},
{
"uri":"mrs_01_1702.html",
"product_code":"mrs",
"code":"286",
"des":"When the NameNode node is overloaded (100% of the CPU is occupied), the NameNode is unresponsive. The HDFS clients that are connected to the overloaded NameNode fail to r",
"doc_type":"cmpntguide",
"kw":"The HDFS Client Is Unresponsive When the NameNode Is Overloaded for a Long Time,FAQ,Component Operat",
"title":"The HDFS Client Is Unresponsive When the NameNode Is Overloaded for a Long Time",
"githuburl":""
},
{
"uri":"mrs_01_1703.html",
"product_code":"mrs",
"code":"287",
"des":"In DataNode, the storage directory of data blocks is specified by dfs.datanode.data.dir.Can I modify dfs.datanode.data.dir tomodify the data storage directory?Can I modif",
"doc_type":"cmpntguide",
"kw":"Can I Delete or Modify the Data Storage Directory in DataNode?,FAQ,Component Operation Guide (Normal",
"title":"Can I Delete or Modify the Data Storage Directory in DataNode?",
"githuburl":""
},
{
"uri":"mrs_01_1704.html",
"product_code":"mrs",
"code":"288",
"des":"Why are some blocks missing on the NameNode UI after the rollback is successful?This problem occurs because blocks with new IDs or genstamps may exist on the DataNode. Th",
"doc_type":"cmpntguide",
"kw":"Blocks Miss on the NameNode UI After the Successful Rollback,FAQ,Component Operation Guide (Normal)",
"title":"Blocks Miss on the NameNode UI After the Successful Rollback",
"githuburl":""
},
{
"uri":"mrs_01_1705.html",
"product_code":"mrs",
"code":"289",
"des":"Why is an \"java.net.SocketException: No buffer space available\" exception reported when data is written to HDFS?This problem occurs when files are written to the HDFS. Ch",
"doc_type":"cmpntguide",
"kw":"Why Is \"java.net.SocketException: No buffer space available\" Reported When Data Is Written to HDFS,F",
"title":"Why Is \"java.net.SocketException: No buffer space available\" Reported When Data Is Written to HDFS",
"githuburl":""
},
{
"uri":"mrs_01_1706.html",
"product_code":"mrs",
"code":"290",
"des":"Why are there two standby NameNodes after the active NameNode is restarted?When this problem occurs, check the ZooKeeper and ZooKeeper FC logs. You can find that the sess",
"doc_type":"cmpntguide",
"kw":"Why are There Two Standby NameNodes After the active NameNode Is Restarted?,FAQ,Component Operation ",
"title":"Why are There Two Standby NameNodes After the active NameNode Is Restarted?",
"githuburl":""
},
{
"uri":"mrs_01_1707.html",
"product_code":"mrs",
"code":"291",
"des":"After I start a Balance process in HDFS, the process is shut down abnormally. If I attempt to execute the Balance process again, it fails again.After a Balance process is",
"doc_type":"cmpntguide",
"kw":"When Does a Balance Process in HDFS, Shut Down and Fail to be Executed Again?,FAQ,Component Operatio",
"title":"When Does a Balance Process in HDFS, Shut Down and Fail to be Executed Again?",
"githuburl":""
},
{
"uri":"mrs_01_1708.html",
"product_code":"mrs",
"code":"292",
"des":"Occasionally, nternet Explorer 9, Explorer 10, or Explorer 11 fails to access the native HDFS UI.Internet Explorer 9, Explorer 10, or Explorer 11 fails to access the nati",
"doc_type":"cmpntguide",
"kw":"\"This page can't be displayed\" Is Displayed When Internet Explorer Fails to Access the Native HDFS U",
"title":"\"This page can't be displayed\" Is Displayed When Internet Explorer Fails to Access the Native HDFS UI",
"githuburl":""
},
{
"uri":"mrs_01_1709.html",
"product_code":"mrs",
"code":"293",
"des":"If a JournalNode server is powered off, the data directory disk is fully occupied, and the network is abnormal, the EditLog sequence number on the JournalNode is inconsec",
"doc_type":"cmpntguide",
"kw":"NameNode Fails to Be Restarted Due to EditLog Discontinuity,FAQ,Component Operation Guide (Normal)",
"title":"NameNode Fails to Be Restarted Due to EditLog Discontinuity",
"githuburl":""
},
{
"uri":"mrs_01_0581.html",
"product_code":"mrs",
"code":"294",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Hive",
"title":"Using Hive",
"githuburl":""
},
{
"uri":"mrs_01_0442.html",
"product_code":"mrs",
"code":"295",
"des":"Hive is a data warehouse framework built on Hadoop. It maps structured data files to a database table and provides SQL-like functions to analyze and process data. It also",
"doc_type":"cmpntguide",
"kw":"Using Hive from Scratch,Using Hive,Component Operation Guide (Normal)",
"title":"Using Hive from Scratch",
"githuburl":""
},
{
"uri":"mrs_01_0582.html",
"product_code":"mrs",
"code":"296",
"des":"Go to the Hive configurations page by referring to Modifying Cluster Service Configuration Parameters.",
"doc_type":"cmpntguide",
"kw":"Configuring Hive Parameters,Using Hive,Component Operation Guide (Normal)",
"title":"Configuring Hive Parameters",
"githuburl":""
},
{
"uri":"mrs_01_2330.html",
"product_code":"mrs",
"code":"297",
"des":"Hive SQL supports all features of Hive-3.1.0. For details, see https://cwiki.apache.org/confluence/display/hive/languagemanual.Table 1 describes the extended Hive stateme",
"doc_type":"cmpntguide",
"kw":"Hive SQL,Using Hive,Component Operation Guide (Normal)",
"title":"Hive SQL",
"githuburl":""
},
{
"uri":"mrs_01_0947.html",
"product_code":"mrs",
"code":"298",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Permission Management",
"title":"Permission Management",
"githuburl":""
},
{
"uri":"mrs_01_0948.html",
"product_code":"mrs",
"code":"299",
"des":"Hive is a data warehouse framework built on Hadoop. It provides basic data analysis services using the Hive query language (HQL), a language like the structured query lan",
"doc_type":"cmpntguide",
"kw":"Hive Permission,Permission Management,Component Operation Guide (Normal)",
"title":"Hive Permission",
"githuburl":""
},
{
"uri":"mrs_01_0949.html",
"product_code":"mrs",
"code":"300",
"des":"This section describes how to create and configure a Hive role on Manager as the system administrator. The Hive role can be granted the permissions of the Hive administra",
"doc_type":"cmpntguide",
"kw":"Creating a Hive Role,Permission Management,Component Operation Guide (Normal)",
"title":"Creating a Hive Role",
"githuburl":""
},
{
"uri":"mrs_01_0950.html",
"product_code":"mrs",
"code":"301",
"des":"You can configure related permissions if you need to access tables or databases created by other users. Hive supports column-based permission control. If a user needs to ",
"doc_type":"cmpntguide",
"kw":"Configuring Permissions for Hive Tables, Columns, or Databases,Permission Management,Component Opera",
"title":"Configuring Permissions for Hive Tables, Columns, or Databases",
"githuburl":""
},
{
"uri":"mrs_01_0951.html",
"product_code":"mrs",
"code":"302",
"des":"Hive may need to be associated with other components. For example, Yarn permissions are required in the scenario of using HQL statements to trigger MapReduce jobs, and HB",
"doc_type":"cmpntguide",
"kw":"Configuring Permissions to Use Other Components for Hive,Permission Management,Component Operation G",
"title":"Configuring Permissions to Use Other Components for Hive",
"githuburl":""
},
{
"uri":"mrs_01_0952.html",
"product_code":"mrs",
"code":"303",
"des":"This section guides users to use a Hive client in an O&M or service scenario.The client has been installed. For example, the client is installed in the /opt/hadoopclient ",
"doc_type":"cmpntguide",
"kw":"Using a Hive Client,Using Hive,Component Operation Guide (Normal)",
"title":"Using a Hive Client",
"githuburl":""
},
{
"uri":"mrs_01_0953.html",
"product_code":"mrs",
"code":"304",
"des":"HDFS Colocation is the data location control function provided by HDFS. The HDFS Colocation API stores associated data or data on which associated operations are performe",
"doc_type":"cmpntguide",
"kw":"Using HDFS Colocation to Store Hive Tables,Using Hive,Component Operation Guide (Normal)",
"title":"Using HDFS Colocation to Store Hive Tables",
"githuburl":""
},
{
"uri":"mrs_01_0954.html",
"product_code":"mrs",
"code":"305",
"des":"Hive supports encryption of one or multiple columns in a table. When creating a Hive table, you can specify the column to be encrypted and encryption algorithm. When data",
"doc_type":"cmpntguide",
"kw":"Using the Hive Column Encryption Function,Using Hive,Component Operation Guide (Normal)",
"title":"Using the Hive Column Encryption Function",
"githuburl":""
},
{
"uri":"mrs_01_0955.html",
"product_code":"mrs",
"code":"306",
"des":"In most cases, a carriage return character is used as the row delimiter in Hive tables stored in text files, that is, the carriage return character is used as the termina",
"doc_type":"cmpntguide",
"kw":"Customizing Row Separators,Using Hive,Component Operation Guide (Normal)",
"title":"Customizing Row Separators",
"githuburl":""
},
{
"uri":"mrs_01_24293.html",
"product_code":"",
"code":"307",
"des":"For mutually trusted Hive and HBase clusters with Kerberos authentication enabled, you can access the HBase cluster and synchronize its key configurations to HiveServer o",
"doc_type":"",
"kw":"Configuring Hive on HBase in Across Clusters with Mutual Trust Enabled,Using Hive,Component Operatio",
"title":"Configuring Hive on HBase in Across Clusters with Mutual Trust Enabled",
"githuburl":""
},
{
"uri":"mrs_01_0956.html",
"product_code":"mrs",
"code":"308",
"des":"Due to the limitations of underlying storage systems, Hive does not support the ability to delete a single piece of table data. In Hive on HBase, MRS Hive supports the ab",
"doc_type":"cmpntguide",
"kw":"Deleting Single-Row Records from Hive on HBase,Using Hive,Component Operation Guide (Normal)",
"title":"Deleting Single-Row Records from Hive on HBase",
"githuburl":""
},
{
"uri":"mrs_01_0957.html",
"product_code":"mrs",
"code":"309",
"des":"WebHCat provides external REST APIs for Hive. By default, the open-source community version uses the HTTP protocol.MRS Hive supports the HTTPS protocol that is more secur",
"doc_type":"cmpntguide",
"kw":"Configuring HTTPS/HTTP-based REST APIs,Using Hive,Component Operation Guide (Normal)",
"title":"Configuring HTTPS/HTTP-based REST APIs",
"githuburl":""
},
{
"uri":"mrs_01_0958.html",
"product_code":"mrs",
"code":"310",
"des":"The Transform function is not allowed by Hive of the open source version.MRS Hive supports the configuration of the Transform function. The function is disabled by defaul",
"doc_type":"cmpntguide",
"kw":"Enabling or Disabling the Transform Function,Using Hive,Component Operation Guide (Normal)",
"title":"Enabling or Disabling the Transform Function",
"githuburl":""
},
{
"uri":"mrs_01_0959.html",
"product_code":"mrs",
"code":"311",
"des":"This section describes how to create a view on Hive when MRS is configured in security mode, authorize access permissions to different users, and specify that different u",
"doc_type":"cmpntguide",
"kw":"Access Control of a Dynamic Table View on Hive,Using Hive,Component Operation Guide (Normal)",
"title":"Access Control of a Dynamic Table View on Hive",
"githuburl":""
},
{
"uri":"mrs_01_0960.html",
"product_code":"mrs",
"code":"312",
"des":"You must have ADMIN permission when creating temporary functions on Hive of the open source community version.MRS Hive supports the configuration of the function for crea",
"doc_type":"cmpntguide",
"kw":"Specifying Whether the ADMIN Permissions Is Required for Creating Temporary Functions,Using Hive,Com",
"title":"Specifying Whether the ADMIN Permissions Is Required for Creating Temporary Functions",
"githuburl":""
},
{
"uri":"mrs_01_0961.html",
"product_code":"mrs",
"code":"313",
"des":"Hive allows users to create external tables to associate with other relational databases. External tables read data from associated relational databases and support Join ",
"doc_type":"cmpntguide",
"kw":"Using Hive to Read Data in a Relational Database,Using Hive,Component Operation Guide (Normal)",
"title":"Using Hive to Read Data in a Relational Database",
"githuburl":""
},
{
"uri":"mrs_01_0962.html",
"product_code":"mrs",
"code":"314",
"des":"Hive supports the following types of traditional relational database syntax:GroupingEXCEPT and INTERSECTSyntax description:Grouping takes effect only when the Group by st",
"doc_type":"cmpntguide",
"kw":"Supporting Traditional Relational Database Syntax in Hive,Using Hive,Component Operation Guide (Norm",
"title":"Supporting Traditional Relational Database Syntax in Hive",
"githuburl":""
},
{
"uri":"mrs_01_0966.html",
"product_code":"mrs",
"code":"315",
"des":"This function is applicable to Hive and Spark2x in MRS 3.x and later.With this function enabled, if the select permission is granted to a user during Hive table creation,",
"doc_type":"cmpntguide",
"kw":"Viewing Table Structures Using the show create Statement as Users with the select Permission,Using H",
"title":"Viewing Table Structures Using the show create Statement as Users with the select Permission",
"githuburl":""
},
{
"uri":"mrs_01_0967.html",
"product_code":"mrs",
"code":"316",
"des":"This function applies to Hive.After this function is enabled, run the following command to write a directory into Hive: insert overwrite directory \"/path1\".... After the ",
"doc_type":"cmpntguide",
"kw":"Writing a Directory into Hive with the Old Data Removed to the Recycle Bin,Using Hive,Component Oper",
"title":"Writing a Directory into Hive with the Old Data Removed to the Recycle Bin",
"githuburl":""
},
{
"uri":"mrs_01_0968.html",
"product_code":"mrs",
"code":"317",
"des":"This function applies to Hive.With this function enabled, run the insert overwrite directory/path1/path2/path3... command to write a subdirectory. The permission of the /",
"doc_type":"cmpntguide",
"kw":"Inserting Data to a Directory That Does Not Exist,Using Hive,Component Operation Guide (Normal)",
"title":"Inserting Data to a Directory That Does Not Exist",
"githuburl":""
},
{
"uri":"mrs_01_0969.html",
"product_code":"mrs",
"code":"318",
"des":"This function is applicable to Hive and Spark2x for MRS 3.x or later, or Hive and Spark for versions earlier than MRS 3.x.After this function is enabled, only the Hive ad",
"doc_type":"cmpntguide",
"kw":"Creating Databases and Creating Tables in the Default Database Only as the Hive Administrator,Using ",
"title":"Creating Databases and Creating Tables in the Default Database Only as the Hive Administrator",
"githuburl":""
},
{
"uri":"mrs_01_0970.html",
"product_code":"mrs",
"code":"319",
"des":"This function is applicable to Hive and Spark2x for MRS 3.x or later, or Hive and Spark for versions earlier than MRS 3.x.After this function is enabled, the location key",
"doc_type":"cmpntguide",
"kw":"Disabling of Specifying the location Keyword When Creating an Internal Hive Table,Using Hive,Compone",
"title":"Disabling of Specifying the location Keyword When Creating an Internal Hive Table",
"githuburl":""
},
{
"uri":"mrs_01_0971.html",
"product_code":"mrs",
"code":"320",
"des":"This function is applicable to Hive and Spark2x for MRS 3.x or later, or Hive and Spark for versions earlier than MRS 3.x.After this function is enabled, the user or user",
"doc_type":"cmpntguide",
"kw":"Enabling the Function of Creating a Foreign Table in a Directory That Can Only Be Read,Using Hive,Co",
"title":"Enabling the Function of Creating a Foreign Table in a Directory That Can Only Be Read",
"githuburl":""
},
{
"uri":"mrs_01_0972.html",
"product_code":"mrs",
"code":"321",
"des":"This function applies to Hive.The number of OS user groups is limited, and the number of roles that can be created in Hive cannot exceed 32. After this function is enable",
"doc_type":"cmpntguide",
"kw":"Authorizing Over 32 Roles in Hive,Using Hive,Component Operation Guide (Normal)",
"title":"Authorizing Over 32 Roles in Hive",
"githuburl":""
},
{
"uri":"mrs_01_0973.html",
"product_code":"mrs",
"code":"322",
"des":"This function applies to Hive.This function is used to limit the maximum number of maps for Hive tasks on the server to avoid performance deterioration caused by overload",
"doc_type":"cmpntguide",
"kw":"Restricting the Maximum Number of Maps for Hive Tasks,Using Hive,Component Operation Guide (Normal)",
"title":"Restricting the Maximum Number of Maps for Hive Tasks",
"githuburl":""
},
{
"uri":"mrs_01_0974.html",
"product_code":"mrs",
"code":"323",
"des":"This function applies to Hive.This function can be enabled to specify specific users to access HiveServer services on specific nodes, achieving HiveServer resource isolat",
"doc_type":"cmpntguide",
"kw":"HiveServer Lease Isolation,Using Hive,Component Operation Guide (Normal)",
"title":"HiveServer Lease Isolation",
"githuburl":""
},
{
"uri":"mrs_01_0975.html",
"product_code":"mrs",
"code":"324",
"des":"Hive supports transactions at the table and partition levels. When the transaction mode is enabled, transaction tables can be incrementally updated, deleted, and read, im",
"doc_type":"cmpntguide",
"kw":"Hive Supporting Transactions,Using Hive,Component Operation Guide (Normal)",
"title":"Hive Supporting Transactions",
"githuburl":""
},
{
"uri":"mrs_01_1750.html",
"product_code":"mrs",
"code":"325",
"des":"Hive can use the Tez engine to process data computing tasks. Before executing a task, you can manually switch the execution engine to Tez.The TimelineServer role of the Y",
"doc_type":"cmpntguide",
"kw":"Switching the Hive Execution Engine to Tez,Using Hive,Component Operation Guide (Normal)",
"title":"Switching the Hive Execution Engine to Tez",
"githuburl":""
},
{
"uri":"mrs_01_2311.html",
"product_code":"mrs",
"code":"326",
"des":"A Hive materialized view is a special table obtained based on the query results of Hive internal tables. A materialized view can be considered as an intermediate table th",
"doc_type":"cmpntguide",
"kw":"Hive Materialized View,Using Hive,Component Operation Guide (Normal)",
"title":"Hive Materialized View",
"githuburl":""
},
{
"uri":"mrs_01_0976.html",
"product_code":"mrs",
"code":"327",
"des":"Log path: The default save path of Hive logs is /var/log/Bigdata/hive/role name, the default save path of Hive1 logs is /var/log/Bigdata/hive1/role name, and the others f",
"doc_type":"cmpntguide",
"kw":"Hive Log Overview,Using Hive,Component Operation Guide (Normal)",
"title":"Hive Log Overview",
"githuburl":""
},
{
"uri":"mrs_01_0977.html",
"product_code":"mrs",
"code":"328",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Hive Performance Tuning",
"title":"Hive Performance Tuning",
"githuburl":""
},
{
"uri":"mrs_01_0978.html",
"product_code":"mrs",
"code":"329",
"des":"During the Select query, Hive generally scans the entire table, which is time-consuming. To improve query efficiency, create table partitions based on service requirement",
"doc_type":"cmpntguide",
"kw":"Creating Table Partitions,Hive Performance Tuning,Component Operation Guide (Normal)",
"title":"Creating Table Partitions",
"githuburl":""
},
{
"uri":"mrs_01_0979.html",
"product_code":"mrs",
"code":"330",
"des":"When the Join statement is used, the command execution speed and query speed may be slow in case of large data volume. To resolve this problem, you can optimize Join.Join",
"doc_type":"cmpntguide",
"kw":"Optimizing Join,Hive Performance Tuning,Component Operation Guide (Normal)",
"title":"Optimizing Join",
"githuburl":""
},
{
"uri":"mrs_01_0980.html",
"product_code":"mrs",
"code":"331",
"des":"Optimize the Group by statement to accelerate the command execution and query speed.During the Group by operation, Map performs grouping and distributes the groups to Red",
"doc_type":"cmpntguide",
"kw":"Optimizing Group By,Hive Performance Tuning,Component Operation Guide (Normal)",
"title":"Optimizing Group By",
"githuburl":""
},
{
"uri":"mrs_01_0981.html",
"product_code":"mrs",
"code":"332",
"des":"ORC is an efficient column storage format and has higher compression ratio and reading efficiency than other file formats.You are advised to use ORC as the default Hive t",
"doc_type":"cmpntguide",
"kw":"Optimizing Data Storage,Hive Performance Tuning,Component Operation Guide (Normal)",
"title":"Optimizing Data Storage",
"githuburl":""
},
{
"uri":"mrs_01_0982.html",
"product_code":"mrs",
"code":"333",
"des":"When SQL statements are executed on Hive, if the (a&b) or (a&c) logic exists in the statements, you are advised to change the logic to a & (b or c).If condition a is p_pa",
"doc_type":"cmpntguide",
"kw":"Optimizing SQL Statements,Hive Performance Tuning,Component Operation Guide (Normal)",
"title":"Optimizing SQL Statements",
"githuburl":""
},
{
"uri":"mrs_01_0983.html",
"product_code":"mrs",
"code":"334",
"des":"When joining multiple tables in Hive, Hive supports Cost-Based Optimization (CBO). The system automatically selects the optimal plan based on the table statistics, such a",
"doc_type":"cmpntguide",
"kw":"Optimizing the Query Function Using Hive CBO,Hive Performance Tuning,Component Operation Guide (Norm",
"title":"Optimizing the Query Function Using Hive CBO",
"githuburl":""
},
{
"uri":"mrs_01_1752.html",
"product_code":"mrs",
"code":"335",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Common Issues About Hive",
"title":"Common Issues About Hive",
"githuburl":""
},
{
"uri":"mrs_01_1753.html",
"product_code":"mrs",
"code":"336",
"des":"How can I delete permanent user-defined functions (UDFs) on multiple HiveServers at the same time?Multiple HiveServers share one MetaStore database. Therefore, there is a",
"doc_type":"cmpntguide",
"kw":"How Do I Delete UDFs on Multiple HiveServers at the Same Time?,Common Issues About Hive,Component Op",
"title":"How Do I Delete UDFs on Multiple HiveServers at the Same Time?",
"githuburl":""
},
{
"uri":"mrs_01_1754.html",
"product_code":"mrs",
"code":"337",
"des":"Why cannot the DROP operation be performed for a backed up Hive table?Snapshots have been created for an HDFS directory mapping to the backed up Hive table, so the HDFS d",
"doc_type":"cmpntguide",
"kw":"Why Cannot the DROP operation Be Performed on a Backed-up Hive Table?,Common Issues About Hive,Compo",
"title":"Why Cannot the DROP operation Be Performed on a Backed-up Hive Table?",
"githuburl":""
},
{
"uri":"mrs_01_1755.html",
"product_code":"mrs",
"code":"338",
"des":"How to perform operations on local files (such as reading the content of a file) with Hive user-defined functions?By default, you can perform operations on local files wi",
"doc_type":"cmpntguide",
"kw":"How to Perform Operations on Local Files with Hive User-Defined Functions,Common Issues About Hive,C",
"title":"How to Perform Operations on Local Files with Hive User-Defined Functions",
"githuburl":""
},
{
"uri":"mrs_01_1756.html",
"product_code":"mrs",
"code":"339",
"des":"How do I stop a MapReduce task manually if the task is suspended for a long time?",
"doc_type":"cmpntguide",
"kw":"How Do I Forcibly Stop MapReduce Jobs Executed by Hive?,Common Issues About Hive,Component Operation",
"title":"How Do I Forcibly Stop MapReduce Jobs Executed by Hive?",
"githuburl":""
},
{
"uri":"mrs_01_1758.html",
"product_code":"mrs",
"code":"340",
"des":"How do I monitor the Hive table size?The HDFS refined monitoring function allows you to monitor the size of a specified table directory.The Hive and HDFS components are r",
"doc_type":"cmpntguide",
"kw":"How Do I Monitor the Hive Table Size?,Common Issues About Hive,Component Operation Guide (Normal)",
"title":"How Do I Monitor the Hive Table Size?",
"githuburl":""
},
{
"uri":"mrs_01_1759.html",
"product_code":"mrs",
"code":"341",
"des":"How do I prevent key directories from data loss caused by misoperations of the insert overwrite statement?During monitoring of key Hive databases, tables, or directories,",
"doc_type":"cmpntguide",
"kw":"How Do I Prevent Key Directories from Data Loss Caused by Misoperations of the insert overwrite Stat",
"title":"How Do I Prevent Key Directories from Data Loss Caused by Misoperations of the insert overwrite Statement?",
"githuburl":""
},
{
"uri":"mrs_01_1760.html",
"product_code":"mrs",
"code":"342",
"des":"This function applies to Hive.Perform the following operations to configure parameters. When Hive on Spark tasks are executed in the environment where the HBase is not in",
"doc_type":"cmpntguide",
"kw":"Why Is Hive on Spark Task Freezing When HBase Is Not Installed?,Common Issues About Hive,Component O",
"title":"Why Is Hive on Spark Task Freezing When HBase Is Not Installed?",
"githuburl":""
},
{
"uri":"mrs_01_1761.html",
"product_code":"mrs",
"code":"343",
"des":"When a table with more than 32,000 partitions is created in Hive, an exception occurs during the query with the WHERE partition. In addition, the exception information pr",
"doc_type":"cmpntguide",
"kw":"Error Reported When the WHERE Condition Is Used to Query Tables with Excessive Partitions in FusionI",
"title":"Error Reported When the WHERE Condition Is Used to Query Tables with Excessive Partitions in FusionInsight Hive",
"githuburl":""
},
{
"uri":"mrs_01_1762.html",
"product_code":"mrs",
"code":"344",
"des":"When users check the JDK version used by the client, if the JDK version is IBM JDK, the Beeline client needs to be reconstructed. Otherwise, the client will fail to conne",
"doc_type":"cmpntguide",
"kw":"Why Cannot I Connect to HiveServer When I Use IBM JDK to Access the Beeline Client?,Common Issues Ab",
"title":"Why Cannot I Connect to HiveServer When I Use IBM JDK to Access the Beeline Client?",
"githuburl":""
},
{
"uri":"mrs_01_1763.html",
"product_code":"mrs",
"code":"345",
"des":"Can Hive tables be stored in OBS or HDFS?The location of a common Hive table stored on OBS can be set to an HDFS path.In the same Hive service, you can create tables stor",
"doc_type":"cmpntguide",
"kw":"Description of Hive Table Location (Either Be an OBS or HDFS Path),Common Issues About Hive,Componen",
"title":"Description of Hive Table Location (Either Be an OBS or HDFS Path)",
"githuburl":""
},
{
"uri":"mrs_01_2309.html",
"product_code":"mrs",
"code":"346",
"des":"Hive uses the Tez engine to execute union-related statements to write data. After Hive is switched to the MapReduce engine for query, no data is found.When Hive uses the ",
"doc_type":"cmpntguide",
"kw":"Why Cannot Data Be Queried After the MapReduce Engine Is Switched After the Tez Engine Is Used to Ex",
"title":"Why Cannot Data Be Queried After the MapReduce Engine Is Switched After the Tez Engine Is Used to Execute Union-related Statements?",
"githuburl":""
},
{
"uri":"mrs_01_2310.html",
"product_code":"mrs",
"code":"347",
"des":"Why Does Data Inconsistency Occur When Data Is Concurrently Written to a Hive Table Through an API?Hive does not support concurrent data insertion for the same table or p",
"doc_type":"cmpntguide",
"kw":"Why Does Hive Not Support Concurrent Data Writing to the Same Table or Partition?,Common Issues Abou",
"title":"Why Does Hive Not Support Concurrent Data Writing to the Same Table or Partition?",
"githuburl":""
},
{
"uri":"mrs_01_2325.html",
"product_code":"mrs",
"code":"348",
"des":"When the vectorized parameterhive.vectorized.execution.enabled is set to true, why do some null pointers or type conversion exceptions occur occasionally when Hive on Tez",
"doc_type":"cmpntguide",
"kw":"Why Does Hive Not Support Vectorized Query?,Common Issues About Hive,Component Operation Guide (Norm",
"title":"Why Does Hive Not Support Vectorized Query?",
"githuburl":""
},
{
"uri":"mrs_01_2343.html",
"product_code":"mrs",
"code":"349",
"des":"The HDFS data directory of the Hive table is deleted by mistake, but the metadata still exists. As a result, an error is reported during task execution.This is a exceptio",
"doc_type":"cmpntguide",
"kw":"Why Does Metadata Still Exist When the HDFS Data Directory of the Hive Table Is Deleted by Mistake?,",
"title":"Why Does Metadata Still Exist When the HDFS Data Directory of the Hive Table Is Deleted by Mistake?",
"githuburl":""
},
{
"uri":"mrs_01_24482.html",
"product_code":"",
"code":"350",
"des":"How do I disable the logging function of Hive?cd/opt/Bigdata/clientsource bigdata_envIn security mode, run the following command to complete user authentication and log i",
"doc_type":"",
"kw":"How Do I Disable the Logging Function of Hive?,Common Issues About Hive,Component Operation Guide (N",
"title":"How Do I Disable the Logging Function of Hive?",
"githuburl":""
},
{
"uri":"mrs_01_24486.html",
"product_code":"",
"code":"351",
"des":"In the scenario where the fine-grained permission is configured for multiple MRS users to access OBS, after the permission for deleting Hive tables in the OBS directory i",
"doc_type":"",
"kw":"Why Hive Tables in the OBS Directory Fail to Be Deleted?,Common Issues About Hive,Component Operatio",
"title":"Why Hive Tables in the OBS Directory Fail to Be Deleted?",
"githuburl":""
},
{
"uri":"mrs_01_24117.html",
"product_code":"mrs",
"code":"352",
"des":"The error message \"java.lang.OutOfMemoryError: Java heap space.\" is displayed during Hive SQL execution.Solution:For MapReduce tasks, increase the values of the following",
"doc_type":"cmpntguide",
"kw":"Hive Configuration Problems,Common Issues About Hive,Component Operation Guide (Normal)",
"title":"Hive Configuration Problems",
"githuburl":""
},
{
"uri":"mrs_01_24025.html",
"product_code":"mrs",
"code":"353",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Hudi",
"title":"Using Hudi",
"githuburl":""
},
{
"uri":"mrs_01_24033.html",
"product_code":"mrs",
"code":"354",
"des":"This section describes capabilities of Hudi using spark-shell. Using the Spark data source, this section describes how to insert and update a Hudi dataset of the default ",
"doc_type":"cmpntguide",
"kw":"Getting Started,Using Hudi,Component Operation Guide (Normal)",
"title":"Getting Started",
"githuburl":""
},
{
"uri":"mrs_01_24062.html",
"product_code":"mrs",
"code":"355",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Basic Operations",
"title":"Basic Operations",
"githuburl":""
},
{
"uri":"mrs_01_24103.html",
"product_code":"mrs",
"code":"356",
"des":"When writing data, Hudi generates a Hudi table based on attributes such as the storage path, table name, and partition structure.Hudi table data files can be stored in th",
"doc_type":"cmpntguide",
"kw":"Hudi Table Schema,Basic Operations,Component Operation Guide (Normal)",
"title":"Hudi Table Schema",
"githuburl":""
},
{
"uri":"mrs_01_24034.html",
"product_code":"mrs",
"code":"357",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Write",
"title":"Write",
"githuburl":""
},
{
"uri":"mrs_01_24035.html",
"product_code":"mrs",
"code":"358",
"des":"Hudi provides multiple write modes. For details, see the configuration item hoodie.datasource.write.operation. This section describes upsert, insert, and bulk_insert.inse",
"doc_type":"cmpntguide",
"kw":"Batch Write,Write,Component Operation Guide (Normal)",
"title":"Batch Write",
"githuburl":""
},
{
"uri":"mrs_01_24064.html",
"product_code":"mrs",
"code":"359",
"des":"You can run run_hive_sync_tool.sh to synchronize data in the Hudi table to Hive.For example, run the following command to synchronize the Hudi table in the hdfs://haclust",
"doc_type":"cmpntguide",
"kw":"Synchronizing Hudi Table Data to Hive,Write,Component Operation Guide (Normal)",
"title":"Synchronizing Hudi Table Data to Hive",
"githuburl":""
},
{
"uri":"mrs_01_24037.html",
"product_code":"mrs",
"code":"360",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Read",
"title":"Read",
"githuburl":""
},
{
"uri":"mrs_01_24098.html",
"product_code":"mrs",
"code":"361",
"des":"Reading the real-time view (using Hive and SparkSQL as an example): Directly read the Hudi table stored in Hive.select count(*) from test;Reading the real-time view (usin",
"doc_type":"cmpntguide",
"kw":"Reading COW Table Views,Read,Component Operation Guide (Normal)",
"title":"Reading COW Table Views",
"githuburl":""
},
{
"uri":"mrs_01_24099.html",
"product_code":"mrs",
"code":"362",
"des":"After the MOR table is synchronized to Hive, the following two tables are synchronized to Hive: Table name_rt and Table name_ro. The table suffixed with rt indicates the ",
"doc_type":"cmpntguide",
"kw":"Reading MOR Table Views,Read,Component Operation Guide (Normal)",
"title":"Reading MOR Table Views",
"githuburl":""
},
{
"uri":"mrs_01_24038.html",
"product_code":"mrs",
"code":"363",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Data Management and Maintenance",
"title":"Data Management and Maintenance",
"githuburl":""
},
{
"uri":"mrs_01_24088.html",
"product_code":"mrs",
"code":"364",
"des":"Clustering reorganizes data layout to improve query performance without affecting the ingestion speed.Hudi provides different operations, such as insert, upsert, and bulk",
"doc_type":"cmpntguide",
"kw":"Clustering,Data Management and Maintenance,Component Operation Guide (Normal)",
"title":"Clustering",
"githuburl":""
},
{
"uri":"mrs_01_24089.html",
"product_code":"mrs",
"code":"365",
"des":"Cleaning is used to delete data of versions that are no longer required.Hudi uses the cleaner working in the background to continuously delete unnecessary data of old ver",
"doc_type":"cmpntguide",
"kw":"Cleaning,Data Management and Maintenance,Component Operation Guide (Normal)",
"title":"Cleaning",
"githuburl":""
},
{
"uri":"mrs_01_24090.html",
"product_code":"mrs",
"code":"366",
"des":"A compaction merges base and log files of MOR tables.For MOR tables, data is stored in columnar Parquet files and row-based Avro files, updates are recorded in incrementa",
"doc_type":"cmpntguide",
"kw":"Compaction,Data Management and Maintenance,Component Operation Guide (Normal)",
"title":"Compaction",
"githuburl":""
},
{
"uri":"mrs_01_24091.html",
"product_code":"mrs",
"code":"367",
"des":"Savepoints are used to save and restore data of the customized version.Savepoints provided by Hudi can save different commits so that the cleaner program does not delete ",
"doc_type":"cmpntguide",
"kw":"Savepoint,Data Management and Maintenance,Component Operation Guide (Normal)",
"title":"Savepoint",
"githuburl":""
},
{
"uri":"mrs_01_24165.html",
"product_code":"mrs",
"code":"368",
"des":"Uses an external service (ZooKeeper or Hive MetaStore) as the distributed mutex lock service.Files can be concurrently written, but commits cannot be concurrent. The comm",
"doc_type":"cmpntguide",
"kw":"Single-Table Concurrent Write,Data Management and Maintenance,Component Operation Guide (Normal)",
"title":"Single-Table Concurrent Write",
"githuburl":""
},
{
"uri":"mrs_01_24100.html",
"product_code":"mrs",
"code":"369",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using the Hudi Client",
"title":"Using the Hudi Client",
"githuburl":""
},
{
"uri":"mrs_01_24063.html",
"product_code":"mrs",
"code":"370",
"des":"For a cluster with Kerberos authentication enabled, a user has been created on FusionInsight Manager of the cluster and associated with user groups hadoop and hive.The Hu",
"doc_type":"cmpntguide",
"kw":"Operating a Hudi Table Using hudi-cli.sh,Using the Hudi Client,Component Operation Guide (Normal)",
"title":"Operating a Hudi Table Using hudi-cli.sh",
"githuburl":""
},
{
"uri":"mrs_01_24032.html",
"product_code":"mrs",
"code":"371",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Configuration Reference",
"title":"Configuration Reference",
"githuburl":""
},
{
"uri":"mrs_01_24093.html",
"product_code":"mrs",
"code":"372",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Write Configuration,Configuration Reference,Component Operation Guide (Normal)",
"title":"Write Configuration",
"githuburl":""
},
{
"uri":"mrs_01_24094.html",
"product_code":"mrs",
"code":"373",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Configuration of Hive Table Synchronization,Configuration Reference,Component Operation Guide (Norma",
"title":"Configuration of Hive Table Synchronization",
"githuburl":""
},
{
"uri":"mrs_01_24095.html",
"product_code":"mrs",
"code":"374",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Index Configuration,Configuration Reference,Component Operation Guide (Normal)",
"title":"Index Configuration",
"githuburl":""
},
{
"uri":"mrs_01_24096.html",
"product_code":"mrs",
"code":"375",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Storage Configuration,Configuration Reference,Component Operation Guide (Normal)",
"title":"Storage Configuration",
"githuburl":""
},
{
"uri":"mrs_01_24097.html",
"product_code":"mrs",
"code":"376",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Compaction and Cleaning Configurations,Configuration Reference,Component Operation Guide (Normal)",
"title":"Compaction and Cleaning Configurations",
"githuburl":""
},
{
"uri":"mrs_01_24167.html",
"product_code":"mrs",
"code":"377",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Single-Table Concurrent Write Configuration,Configuration Reference,Component Operation Guide (Norma",
"title":"Single-Table Concurrent Write Configuration",
"githuburl":""
},
{
"uri":"mrs_01_24039.html",
"product_code":"mrs",
"code":"378",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Hudi Performance Tuning",
"title":"Hudi Performance Tuning",
"githuburl":""
},
{
"uri":"mrs_01_24101.html",
"product_code":"mrs",
"code":"379",
"des":"In the current version, Spark is recommended for Hudi write operations. Therefore, the tuning methods of Hudi are similar to those of Spark. For details, see Spark2x Perf",
"doc_type":"cmpntguide",
"kw":"Performance Tuning Methods,Hudi Performance Tuning,Component Operation Guide (Normal)",
"title":"Performance Tuning Methods",
"githuburl":""
},
{
"uri":"mrs_01_24102.html",
"product_code":"mrs",
"code":"380",
"des":"For MOR tables:The essence of MOR tables is to write incremental files, so the tuning is based on the data size (dataSize) of Hudi.If dataSize is only several GBs, you ar",
"doc_type":"cmpntguide",
"kw":"Recommended Resource Configuration,Hudi Performance Tuning,Component Operation Guide (Normal)",
"title":"Recommended Resource Configuration",
"githuburl":""
},
{
"uri":"mrs_01_24065.html",
"product_code":"mrs",
"code":"381",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Common Issues About Hudi",
"title":"Common Issues About Hudi",
"githuburl":""
},
{
"uri":"mrs_01_24070.html",
"product_code":"mrs",
"code":"382",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Data Write",
"title":"Data Write",
"githuburl":""
},
{
"uri":"mrs_01_24071.html",
"product_code":"mrs",
"code":"383",
"des":"The following error is reported when data is written:You are advised to evolve schemas in backward compatible mode while using Hudi. This error usually occurs when you de",
"doc_type":"cmpntguide",
"kw":"Parquet/Avro schema Is Reported When Updated Data Is Written,Data Write,Component Operation Guide (N",
"title":"Parquet/Avro schema Is Reported When Updated Data Is Written",
"githuburl":""
},
{
"uri":"mrs_01_24072.html",
"product_code":"mrs",
"code":"384",
"des":"The following error is reported when data is written:This error will occur again because schema evolutions are in non-backwards compatible mode. Basically, there is some ",
"doc_type":"cmpntguide",
"kw":"UnsupportedOperationException Is Reported When Updated Data Is Written,Data Write,Component Operatio",
"title":"UnsupportedOperationException Is Reported When Updated Data Is Written",
"githuburl":""
},
{
"uri":"mrs_01_24073.html",
"product_code":"mrs",
"code":"385",
"des":"The following error is reported when data is written:This error may occur if a schema contains some non-nullable field whose value is not present or is null.You are advis",
"doc_type":"cmpntguide",
"kw":"SchemaCompatabilityException Is Reported When Updated Data Is Written,Data Write,Component Operation",
"title":"SchemaCompatabilityException Is Reported When Updated Data Is Written",
"githuburl":""
},
{
"uri":"mrs_01_24074.html",
"product_code":"mrs",
"code":"386",
"des":"Hudi consumes much space in a temporary folder during upsert.Hudi will spill part of input data to disk if the maximum memory for merge is reached when much input data is",
"doc_type":"cmpntguide",
"kw":"What Should I Do If Hudi Consumes Much Space in a Temporary Folder During Upsert?,Data Write,Compone",
"title":"What Should I Do If Hudi Consumes Much Space in a Temporary Folder During Upsert?",
"githuburl":""
},
{
"uri":"mrs_01_24504.html",
"product_code":"",
"code":"387",
"des":"Decimal data is initially written to a Hudi table using the BULK_INSERT command. Then when data is subsequently written using UPSERT, the following error is reported:Caus",
"doc_type":"",
"kw":"Hudi Fails to Write Decimal Data with Lower Precision,Data Write,Component Operation Guide (Normal)",
"title":"Hudi Fails to Write Decimal Data with Lower Precision",
"githuburl":""
},
{
"uri":"mrs_01_24075.html",
"product_code":"mrs",
"code":"388",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Data Collection",
"title":"Data Collection",
"githuburl":""
},
{
"uri":"mrs_01_24077.html",
"product_code":"mrs",
"code":"389",
"des":"The error \"org.apache.kafka.common.KafkaException: Failed to construct kafka consumer\" is reported in the main thread, and the following error is reported.This error may ",
"doc_type":"cmpntguide",
"kw":"IllegalArgumentException Is Reported When Kafka Is Used to Collect Data,Data Collection,Component Op",
"title":"IllegalArgumentException Is Reported When Kafka Is Used to Collect Data",
"githuburl":""
},
{
"uri":"mrs_01_24078.html",
"product_code":"mrs",
"code":"390",
"des":"The following error is reported when data is collected:This error usually occurs when a field marked as recordKey or partitionKey is not present in the input record. Cros",
"doc_type":"cmpntguide",
"kw":"HoodieException Is Reported When Data Is Collected,Data Collection,Component Operation Guide (Normal",
"title":"HoodieException Is Reported When Data Is Collected",
"githuburl":""
},
{
"uri":"mrs_01_24079.html",
"product_code":"mrs",
"code":"391",
"des":"Is it possible to use a nullable field that contains null records as a primary key when creating a Hudi table?No. HoodieKeyException will be thrown.",
"doc_type":"cmpntguide",
"kw":"HoodieKeyException Is Reported When Data Is Collected,Data Collection,Component Operation Guide (Nor",
"title":"HoodieKeyException Is Reported When Data Is Collected",
"githuburl":""
},
{
"uri":"mrs_01_24080.html",
"product_code":"mrs",
"code":"392",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Hive Synchronization",
"title":"Hive Synchronization",
"githuburl":""
},
{
"uri":"mrs_01_24081.html",
"product_code":"mrs",
"code":"393",
"des":"The following error is reported during Hive data synchronization:This error usually occurs when you try to add a new column to an existing Hive table using the HiveSyncTo",
"doc_type":"cmpntguide",
"kw":"SQLException Is Reported During Hive Data Synchronization,Hive Synchronization,Component Operation G",
"title":"SQLException Is Reported During Hive Data Synchronization",
"githuburl":""
},
{
"uri":"mrs_01_24082.html",
"product_code":"mrs",
"code":"394",
"des":"The following error is reported during Hive data synchronization:This error occurs because HiveSyncTool currently supports only few compatible data type conversions. The ",
"doc_type":"cmpntguide",
"kw":"HoodieHiveSyncException Is Reported During Hive Data Synchronization,Hive Synchronization,Component ",
"title":"HoodieHiveSyncException Is Reported During Hive Data Synchronization",
"githuburl":""
},
{
"uri":"mrs_01_24083.html",
"product_code":"mrs",
"code":"395",
"des":"The following error is reported during Hive data synchronization:This error usually occurs when Hive synchronization is performed on the Hudi dataset but the configured h",
"doc_type":"cmpntguide",
"kw":"SemanticException Is Reported During Hive Data Synchronization,Hive Synchronization,Component Operat",
"title":"SemanticException Is Reported During Hive Data Synchronization",
"githuburl":""
},
{
"uri":"mrs_01_0369.html",
"product_code":"mrs",
"code":"396",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Hue (Versions Earlier Than MRS 3.x)",
"title":"Using Hue (Versions Earlier Than MRS 3.x)",
"githuburl":""
},
{
"uri":"mrs_01_1020.html",
"product_code":"mrs",
"code":"397",
"des":"Hue provides the file browser function using a graphical user interface (GUI) so that you can view files and directories on Hive.You have installed Hive and Hue, and the ",
"doc_type":"cmpntguide",
"kw":"Using Hue from Scratch,Using Hue (Versions Earlier Than MRS 3.x),Component Operation Guide (Normal)",
"title":"Using Hue from Scratch",
"githuburl":""
},
{
"uri":"mrs_01_0370.html",
"product_code":"mrs",
"code":"398",
"des":"After Hue is installed in an MRS cluster, users can use Hadoop and Hive on the Hue web UI.For versions earlier than MRS 1.9.2, MRS clusters with Kerberos authentication e",
"doc_type":"cmpntguide",
"kw":"Accessing the Hue Web UI,Using Hue (Versions Earlier Than MRS 3.x),Component Operation Guide (Normal",
"title":"Accessing the Hue Web UI",
"githuburl":""
},
{
"uri":"mrs_01_1021.html",
"product_code":"mrs",
"code":"399",
"des":"For details about how to set parameters, see Modifying Cluster Service Configuration Parameters.",
"doc_type":"cmpntguide",
"kw":"Hue Common Parameters,Using Hue (Versions Earlier Than MRS 3.x),Component Operation Guide (Normal)",
"title":"Hue Common Parameters",
"githuburl":""
},
{
"uri":"mrs_01_0371.html",
"product_code":"mrs",
"code":"400",
"des":"Users can use the Hue web UI to execute HiveQL statements in a cluster.For versions earlier than MRS 1.9.2, MRS clusters with Kerberos authentication enabled support this",
"doc_type":"cmpntguide",
"kw":"Using HiveQL Editor on the Hue Web UI,Using Hue (Versions Earlier Than MRS 3.x),Component Operation ",
"title":"Using HiveQL Editor on the Hue Web UI",
"githuburl":""
},
{
"uri":"mrs_01_0372.html",
"product_code":"mrs",
"code":"401",
"des":"Users can use the Hue web UI to manage Hive metadata in an MRS cluster.For versions earlier than MRS 1.9.2, MRS clusters with Kerberos authentication enabled support this",
"doc_type":"cmpntguide",
"kw":"Using the Metadata Browser on the Hue Web UI,Using Hue (Versions Earlier Than MRS 3.x),Component Ope",
"title":"Using the Metadata Browser on the Hue Web UI",
"githuburl":""
},
{
"uri":"mrs_01_0373.html",
"product_code":"mrs",
"code":"402",
"des":"Users can use the Hue web UI to manage files in HDFS in a cluster.For versions earlier than MRS 1.9.2, MRS clusters with Kerberos authentication enabled support this func",
"doc_type":"cmpntguide",
"kw":"Using File Browser on the Hue Web UI,Using Hue (Versions Earlier Than MRS 3.x),Component Operation G",
"title":"Using File Browser on the Hue Web UI",
"githuburl":""
},
{
"uri":"mrs_01_0374.html",
"product_code":"mrs",
"code":"403",
"des":"You can use the Hue web UI to query all jobs in the cluster.For versions earlier than MRS 1.9.2, MRS clusters with Kerberos authentication enabled support this function.V",
"doc_type":"cmpntguide",
"kw":"Using Job Browser on the Hue Web UI,Using Hue (Versions Earlier Than MRS 3.x),Component Operation Gu",
"title":"Using Job Browser on the Hue Web UI",
"githuburl":""
},
{
"uri":"mrs_01_0130.html",
"product_code":"mrs",
"code":"404",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Hue (MRS 3.x or Later)",
"title":"Using Hue (MRS 3.x or Later)",
"githuburl":""
},
{
"uri":"mrs_01_0131.html",
"product_code":"mrs",
"code":"405",
"des":"Hue aggregates interfaces which interact with most Apache Hadoop components and enables you to use Hadoop components with ease on a web UI. You can operate components suc",
"doc_type":"cmpntguide",
"kw":"Using Hue from Scratch,Using Hue (MRS 3.x or Later),Component Operation Guide (Normal)",
"title":"Using Hue from Scratch",
"githuburl":""
},
{
"uri":"mrs_01_0132.html",
"product_code":"mrs",
"code":"406",
"des":"After Hue is installed in an MRS cluster, users can use Hadoop-related components on the Hue web UI.This section describes how to open the Hue web UI on the MRS cluster.T",
"doc_type":"cmpntguide",
"kw":"Accessing the Hue Web UI,Using Hue (MRS 3.x or Later),Component Operation Guide (Normal)",
"title":"Accessing the Hue Web UI",
"githuburl":""
},
{
"uri":"mrs_01_0133.html",
"product_code":"mrs",
"code":"407",
"des":"Go to the All Configurations page of the Hue service by referring to Modifying Cluster Service Configuration Parameters.For details about Hue common parameters, see Table",
"doc_type":"cmpntguide",
"kw":"Hue Common Parameters,Using Hue (MRS 3.x or Later),Component Operation Guide (Normal)",
"title":"Hue Common Parameters",
"githuburl":""
},
{
"uri":"mrs_01_0134.html",
"product_code":"mrs",
"code":"408",
"des":"Users can use the Hue web UI to execute HiveQL statements in an MRS cluster.Hive supports the following functions:Executes and manages HiveQL statements.Views the HiveQL ",
"doc_type":"cmpntguide",
"kw":"Using HiveQL Editor on the Hue Web UI,Using Hue (MRS 3.x or Later),Component Operation Guide (Normal",
"title":"Using HiveQL Editor on the Hue Web UI",
"githuburl":""
},
{
"uri":"mrs_01_2370.html",
"product_code":"mrs",
"code":"409",
"des":"You can use Hue to execute SparkSql statements in a cluster on a graphical user interface (GUI).Before using the SparkSql editor, you need to modify the Spark2x configura",
"doc_type":"cmpntguide",
"kw":"Using the SparkSql Editor on the Hue Web UI,Using Hue (MRS 3.x or Later),Component Operation Guide (",
"title":"Using the SparkSql Editor on the Hue Web UI",
"githuburl":""
},
{
"uri":"mrs_01_0135.html",
"product_code":"mrs",
"code":"410",
"des":"Users can use the Hue web UI to manage Hive metadata in an MRS cluster.Access the Hue web UI. For details, see Accessing the Hue Web UI.Viewing metadata of Hive tablesCli",
"doc_type":"cmpntguide",
"kw":"Using the Metadata Browser on the Hue Web UI,Using Hue (MRS 3.x or Later),Component Operation Guide ",
"title":"Using the Metadata Browser on the Hue Web UI",
"githuburl":""
},
{
"uri":"mrs_01_0136.html",
"product_code":"mrs",
"code":"411",
"des":"Users can use the Hue web UI to manage files in HDFS.The Hue page is used to view and analyze data such as files and tables. Do not perform high-risk management operation",
"doc_type":"cmpntguide",
"kw":"Using File Browser on the Hue Web UI,Using Hue (MRS 3.x or Later),Component Operation Guide (Normal)",
"title":"Using File Browser on the Hue Web UI",
"githuburl":""
},
{
"uri":"mrs_01_0137.html",
"product_code":"mrs",
"code":"412",
"des":"Users can use the Hue web UI to query all jobs in an MRS cluster.View the jobs in the current cluster.The number on Job Browser indicates the total number of jobs in the ",
"doc_type":"cmpntguide",
"kw":"Using Job Browser on the Hue Web UI,Using Hue (MRS 3.x or Later),Component Operation Guide (Normal)",
"title":"Using Job Browser on the Hue Web UI",
"githuburl":""
},
{
"uri":"mrs_01_2371.html",
"product_code":"mrs",
"code":"413",
"des":"You can use Hue to create or query HBase tables in a cluster and run tasks on the Hue web UI.Make sure that the HBase component has been installed in the MRS cluster and ",
"doc_type":"cmpntguide",
"kw":"Using HBase on the Hue Web UI,Using Hue (MRS 3.x or Later),Component Operation Guide (Normal)",
"title":"Using HBase on the Hue Web UI",
"githuburl":""
},
{
"uri":"mrs_01_0138.html",
"product_code":"mrs",
"code":"414",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Typical Scenarios",
"title":"Typical Scenarios",
"githuburl":""
},
{
"uri":"mrs_01_0139.html",
"product_code":"mrs",
"code":"415",
"des":"Hue provides the file browser function for users to use HDFS in GUI mode.The Hue page is used to view and analyze data such as files and tables. Do not perform high-risk ",
"doc_type":"cmpntguide",
"kw":"HDFS on Hue,Typical Scenarios,Component Operation Guide (Normal)",
"title":"HDFS on Hue",
"githuburl":""
},
{
"uri":"mrs_01_0141.html",
"product_code":"mrs",
"code":"416",
"des":"Hue provides the Hive GUI management function so that users can query Hive data in GUI mode.Access the Hue web UI. For details, see Accessing the Hue Web UI.In the naviga",
"doc_type":"cmpntguide",
"kw":"Hive on Hue,Typical Scenarios,Component Operation Guide (Normal)",
"title":"Hive on Hue",
"githuburl":""
},
{
"uri":"mrs_01_0144.html",
"product_code":"mrs",
"code":"417",
"des":"Hue provides the Oozie job manager function, in this case, you can use Oozie in GUI mode.The Hue page is used to view and analyze data such as files and tables. Do not pe",
"doc_type":"cmpntguide",
"kw":"Oozie on Hue,Typical Scenarios,Component Operation Guide (Normal)",
"title":"Oozie on Hue",
"githuburl":""
},
{
"uri":"mrs_01_0147.html",
"product_code":"mrs",
"code":"418",
"des":"Log paths: The default paths of Hue logs are /var/log/Bigdata/hue (for storing run logs) and /var/log/Bigdata/audit/hue (for storing audit logs).Log archive rules: The au",
"doc_type":"cmpntguide",
"kw":"Hue Log Overview,Using Hue (MRS 3.x or Later),Component Operation Guide (Normal)",
"title":"Hue Log Overview",
"githuburl":""
},
{
"uri":"mrs_01_1764.html",
"product_code":"mrs",
"code":"419",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Common Issues About Hue",
"title":"Common Issues About Hue",
"githuburl":""
},
{
"uri":"mrs_01_1765.html",
"product_code":"mrs",
"code":"420",
"des":"What do I do if all HQL statements fail to be executed when I use Internet Explorer to access Hive Editor in Hue and the message \"There was an error with your query\" is d",
"doc_type":"cmpntguide",
"kw":"How Do I Solve the Problem that HQL Fails to Be Executed in Hue Using Internet Explorer?,Common Issu",
"title":"How Do I Solve the Problem that HQL Fails to Be Executed in Hue Using Internet Explorer?",
"githuburl":""
},
{
"uri":"mrs_01_1766.html",
"product_code":"mrs",
"code":"421",
"des":"When Hive is used, the use database statement is entered in the text box to switch the database, and other statements are also entered, why does the database fail to be s",
"doc_type":"cmpntguide",
"kw":"Why Does the use database Statement Become Invalid When Hive Is Used?,Common Issues About Hue,Compon",
"title":"Why Does the use database Statement Become Invalid When Hive Is Used?",
"githuburl":""
},
{
"uri":"mrs_01_0156.html",
"product_code":"mrs",
"code":"422",
"des":"What can I do if an error message shown in the following figure is displayed, indicating that the HDFS file cannot be accessed when I use Hue web UI to access the HDFS fi",
"doc_type":"cmpntguide",
"kw":"What Can I Do If HDFS Files Fail to Be Accessed Using Hue WebUI?,Common Issues About Hue,Component O",
"title":"What Can I Do If HDFS Files Fail to Be Accessed Using Hue WebUI?",
"githuburl":""
},
{
"uri":"mrs_01_2367.html",
"product_code":"mrs",
"code":"423",
"des":"What can I do when a large file fails to be uploaded on the Hue page?You are advised to run commands on the client to upload large files instead of using the Hue file bro",
"doc_type":"cmpntguide",
"kw":"How Do I Do If a Large File Fails to Upload on the Hue Page?,Common Issues About Hue,Component Opera",
"title":"How Do I Do If a Large File Fails to Upload on the Hue Page?",
"githuburl":""
},
{
"uri":"mrs_01_2368.html",
"product_code":"mrs",
"code":"424",
"des":"Why is the native Hue page blank if the Hive service is not installed in a cluster?In MRS 3.x, Hue depends on Hive. If this problem occurs, check whether the Hive compone",
"doc_type":"cmpntguide",
"kw":"Why Is the Hue Native Page Cannot Be Properly Displayed If the Hive Service Is Not Installed in a Cl",
"title":"Why Is the Hue Native Page Cannot Be Properly Displayed If the Hive Service Is Not Installed in a Cluster?",
"githuburl":""
},
{
"uri":"mrs_01_0375.html",
"product_code":"mrs",
"code":"425",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Kafka",
"title":"Using Kafka",
"githuburl":""
},
{
"uri":"mrs_01_1031.html",
"product_code":"mrs",
"code":"426",
"des":"You can create, query, and delete topics on a cluster client.The client has been installed. For example, the client is installed in the /opt/hadoopclient directory. The c",
"doc_type":"cmpntguide",
"kw":"Using Kafka from Scratch,Using Kafka,Component Operation Guide (Normal)",
"title":"Using Kafka from Scratch",
"githuburl":""
},
{
"uri":"mrs_01_0376.html",
"product_code":"mrs",
"code":"427",
"des":"You can manage Kafka topics on a cluster client based on service requirements. Management permission is required for clusters with Kerberos authentication enabled.You hav",
"doc_type":"cmpntguide",
"kw":"Managing Kafka Topics,Using Kafka,Component Operation Guide (Normal)",
"title":"Managing Kafka Topics",
"githuburl":""
},
{
"uri":"mrs_01_0377.html",
"product_code":"mrs",
"code":"428",
"des":"You can query existing Kafka topics on MRS.For versions earlier than MRS 1.9.2, log in to MRS Manager and choose Services > Kafka.For MRS 1.9.2 or later, click the cluste",
"doc_type":"cmpntguide",
"kw":"Querying Kafka Topics,Using Kafka,Component Operation Guide (Normal)",
"title":"Querying Kafka Topics",
"githuburl":""
},
{
"uri":"mrs_01_0378.html",
"product_code":"mrs",
"code":"429",
"des":"For clusters with Kerberos authentication enabled, using Kafka requires relevant permissions. MRS clusters can grant the use permission of Kafka to different users.Table ",
"doc_type":"cmpntguide",
"kw":"Managing Kafka User Permissions,Using Kafka,Component Operation Guide (Normal)",
"title":"Managing Kafka User Permissions",
"githuburl":""
},
{
"uri":"mrs_01_0379.html",
"product_code":"mrs",
"code":"430",
"des":"You can produce or consume messages in Kafka topics using the MRS cluster client. For clusters with Kerberos authentication enabled, you must have the permission to perfo",
"doc_type":"cmpntguide",
"kw":"Managing Messages in Kafka Topics,Using Kafka,Component Operation Guide (Normal)",
"title":"Managing Messages in Kafka Topics",
"githuburl":""
},
{
"uri":"mrs_01_0441.html",
"product_code":"mrs",
"code":"431",
"des":"This section describes how to use the Maxwell data synchronization tool to migrate offline binlog-based data to an MRS Kafka cluster.Maxwell is an open source application",
"doc_type":"cmpntguide",
"kw":"Synchronizing Binlog-based MySQL Data to the MRS Cluster,Using Kafka,Component Operation Guide (Norm",
"title":"Synchronizing Binlog-based MySQL Data to the MRS Cluster",
"githuburl":""
},
{
"uri":"mrs_01_1032.html",
"product_code":"mrs",
"code":"432",
"des":"This section describes how to create and configure a Kafka role.This section applies to MRS 3.x or later.Users can create Kafka roles only in security mode.If the current",
"doc_type":"cmpntguide",
"kw":"Creating a Kafka Role,Using Kafka,Component Operation Guide (Normal)",
"title":"Creating a Kafka Role",
"githuburl":""
},
{
"uri":"mrs_01_1033.html",
"product_code":"mrs",
"code":"433",
"des":"This section applies to MRS 3.x or later.For details about how to set parameters, see Modifying Cluster Service Configuration Parameters.",
"doc_type":"cmpntguide",
"kw":"Kafka Common Parameters,Using Kafka,Component Operation Guide (Normal)",
"title":"Kafka Common Parameters",
"githuburl":""
},
{
"uri":"mrs_01_1035.html",
"product_code":"mrs",
"code":"434",
"des":"This section applies to MRS 3.x or later.Producer APIIndicates the API defined in org.apache.kafka.clients.producer.KafkaProducer. When kafka-console-producer.sh is used,",
"doc_type":"cmpntguide",
"kw":"Safety Instructions on Using Kafka,Using Kafka,Component Operation Guide (Normal)",
"title":"Safety Instructions on Using Kafka",
"githuburl":""
},
{
"uri":"mrs_01_1036.html",
"product_code":"mrs",
"code":"435",
"des":"This section applies to MRS 3.x or later.The maximum number of topics depends on the number of file handles (mainly used by data and index files on site) opened in the pr",
"doc_type":"cmpntguide",
"kw":"Kafka Specifications,Using Kafka,Component Operation Guide (Normal)",
"title":"Kafka Specifications",
"githuburl":""
},
{
"uri":"mrs_01_1767.html",
"product_code":"mrs",
"code":"436",
"des":"This section guides users to use a Kafka client in an O&M or service scenario.This section applies to MRS 3.x or later clusters.The client has been installed. For example",
"doc_type":"cmpntguide",
"kw":"Using the Kafka Client,Using Kafka,Component Operation Guide (Normal)",
"title":"Using the Kafka Client",
"githuburl":""
},
{
"uri":"mrs_01_1037.html",
"product_code":"mrs",
"code":"437",
"des":"For the Kafka message transmission assurance mechanism, different parameters are available for meeting different performance and reliability requirements. This section de",
"doc_type":"cmpntguide",
"kw":"Configuring Kafka HA and High Reliability Parameters,Using Kafka,Component Operation Guide (Normal)",
"title":"Configuring Kafka HA and High Reliability Parameters",
"githuburl":""
},
{
"uri":"mrs_01_1038.html",
"product_code":"mrs",
"code":"438",
"des":"This section applies to MRS 3.x or later.When a broker storage directory is added, the system administrator needs to change the broker storage directory on FusionInsight ",
"doc_type":"cmpntguide",
"kw":"Changing the Broker Storage Directory,Using Kafka,Component Operation Guide (Normal)",
"title":"Changing the Broker Storage Directory",
"githuburl":""
},
{
"uri":"mrs_01_1039.html",
"product_code":"mrs",
"code":"439",
"des":"This section describes how to view the current expenditure on the client based on service requirements.This section applies to MRS 3.x or later.The system administrator h",
"doc_type":"cmpntguide",
"kw":"Checking the Consumption Status of Consumer Group,Using Kafka,Component Operation Guide (Normal)",
"title":"Checking the Consumption Status of Consumer Group",
"githuburl":""
},
{
"uri":"mrs_01_1040.html",
"product_code":"mrs",
"code":"440",
"des":"This section describes how to use the Kafka balancing tool on a client to balance the load of the Kafka cluster based on service requirements in scenarios such as node de",
"doc_type":"cmpntguide",
"kw":"Kafka Balancing Tool Instructions,Using Kafka,Component Operation Guide (Normal)",
"title":"Kafka Balancing Tool Instructions",
"githuburl":""
},
{
"uri":"mrs_01_24299.html",
"product_code":"",
"code":"441",
"des":"This section describes how to use the Kafka balancing tool on the client to balance the load of the Kafka cluster after Kafka nodes are scaled out.This section applies to",
"doc_type":"",
"kw":"Balancing Data After Kafka Node Scale-Out,Using Kafka,Component Operation Guide (Normal)",
"title":"Balancing Data After Kafka Node Scale-Out",
"githuburl":""
},
{
"uri":"mrs_01_1041.html",
"product_code":"mrs",
"code":"442",
"des":"Operations need to be performed on tokens when the token authentication mechanism is used.This section applies to security clusters of MRS 3.x or later.The system adminis",
"doc_type":"cmpntguide",
"kw":"Kafka Token Authentication Mechanism Tool Usage,Using Kafka,Component Operation Guide (Normal)",
"title":"Kafka Token Authentication Mechanism Tool Usage",
"githuburl":""
},
{
"uri":"mrs_01_1042.html",
"product_code":"mrs",
"code":"443",
"des":"This section applies to MRS 3.x or later.Log paths: The default storage path of Kafka logs is /var/log/Bigdata/kafka. The default storage path of audit logs is /var/log/B",
"doc_type":"cmpntguide",
"kw":"Introduction to Kafka Logs,Using Kafka,Component Operation Guide (Normal)",
"title":"Introduction to Kafka Logs",
"githuburl":""
},
{
"uri":"mrs_01_1043.html",
"product_code":"mrs",
"code":"444",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Performance Tuning",
"title":"Performance Tuning",
"githuburl":""
},
{
"uri":"mrs_01_1044.html",
"product_code":"mrs",
"code":"445",
"des":"You can modify Kafka server parameters to improve Kafka processing capabilities in specific service scenarios.Modify the service configuration parameters. For details, se",
"doc_type":"cmpntguide",
"kw":"Kafka Performance Tuning,Performance Tuning,Component Operation Guide (Normal)",
"title":"Kafka Performance Tuning",
"githuburl":""
},
{
"uri":"mrs_01_2312.html",
"product_code":"mrs",
"code":"446",
"des":"Feature description: The function of creating idempotent producers is introduced in Kafka 0.11.0.0. After this function is enabled, producers are automatically upgraded t",
"doc_type":"cmpntguide",
"kw":"Kafka Feature Description,Using Kafka,Component Operation Guide (Normal)",
"title":"Kafka Feature Description",
"githuburl":""
},
{
"uri":"mrs_01_24534.html",
"product_code":"",
"code":"447",
"des":"This section describes how to use Kafka client commands to migrate partition data between disks on a node without stopping the Kafka service.The system administrator has ",
"doc_type":"",
"kw":"Migrating Data Between Kafka Nodes,Using Kafka,Component Operation Guide (Normal)",
"title":"Migrating Data Between Kafka Nodes",
"githuburl":""
},
{
"uri":"mrs_01_1768.html",
"product_code":"mrs",
"code":"448",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Common Issues About Kafka",
"title":"Common Issues About Kafka",
"githuburl":""
},
{
"uri":"mrs_01_1769.html",
"product_code":"mrs",
"code":"449",
"des":"How do I delete a Kafka topic if it fails to be deleted?Possible cause 1: The delete.topic.enable configuration item is not set to true. The deletion can be performed onl",
"doc_type":"cmpntguide",
"kw":"How Do I Solve the Problem that Kafka Topics Cannot Be Deleted?,Common Issues About Kafka,Component ",
"title":"How Do I Solve the Problem that Kafka Topics Cannot Be Deleted?",
"githuburl":""
},
{
"uri":"mrs_01_0435.html",
"product_code":"mrs",
"code":"450",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using KafkaManager",
"title":"Using KafkaManager",
"githuburl":""
},
{
"uri":"mrs_01_0436.html",
"product_code":"mrs",
"code":"451",
"des":"KafkaManager is a tool for managing Apache Kafka and provides GUI-based metric monitoring and management of Kafka clusters. This section applies to MRS 1.9.2 clusters.Kaf",
"doc_type":"cmpntguide",
"kw":"Introduction to KafkaManager,Using KafkaManager,Component Operation Guide (Normal)",
"title":"Introduction to KafkaManager",
"githuburl":""
},
{
"uri":"mrs_01_0437.html",
"product_code":"mrs",
"code":"452",
"des":"You can monitor and manage Kafka clusters on the graphical KafkaManager web UI.This section applies to MRS 1.9.2 clusters.KafkaManager has been installed in a cluster.The",
"doc_type":"cmpntguide",
"kw":"Accessing the KafkaManager Web UI,Using KafkaManager,Component Operation Guide (Normal)",
"title":"Accessing the KafkaManager Web UI",
"githuburl":""
},
{
"uri":"mrs_01_0438.html",
"product_code":"mrs",
"code":"453",
"des":"This section applies to MRS 1.9.2 clusters.Kafka cluster management includes the following operations:Adding a Cluster on the KafkaManager Web UIUpdating Cluster Paramete",
"doc_type":"cmpntguide",
"kw":"Managing Kafka Clusters,Using KafkaManager,Component Operation Guide (Normal)",
"title":"Managing Kafka Clusters",
"githuburl":""
},
{
"uri":"mrs_01_0439.html",
"product_code":"mrs",
"code":"454",
"des":"This section applies to MRS 1.9.2 clusters.The Kafka cluster monitoring management includes the following operations:Viewing Broker InformationViewing Topic InformationVi",
"doc_type":"cmpntguide",
"kw":"Kafka Cluster Monitoring Management,Using KafkaManager,Component Operation Guide (Normal)",
"title":"Kafka Cluster Monitoring Management",
"githuburl":""
},
{
"uri":"mrs_01_0400.html",
"product_code":"mrs",
"code":"455",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Loader",
"title":"Using Loader",
"githuburl":""
},
{
"uri":"mrs_01_1084.html",
"product_code":"mrs",
"code":"456",
"des":"You can use Loader to import data from the SFTP server to HDFS.This section applies to MRS clusters earlier than 3.x.You have prepared service data.You have created an an",
"doc_type":"cmpntguide",
"kw":"Using Loader from Scratch,Using Loader,Component Operation Guide (Normal)",
"title":"Using Loader from Scratch",
"githuburl":""
},
{
"uri":"mrs_01_0401.html",
"product_code":"mrs",
"code":"457",
"des":"This section applies to MRS clusters earlier than 3.x.The process for migrating user data with Loader is as follows:Access the Loader page of the Hue web UI.Manage Loader",
"doc_type":"cmpntguide",
"kw":"How to Use Loader,Using Loader,Component Operation Guide (Normal)",
"title":"How to Use Loader",
"githuburl":""
},
{
"uri":"mrs_01_0402.html",
"product_code":"mrs",
"code":"458",
"des":"This section applies to versions earlier than MRS 3.x.Loader supports the following links. This section describes configurations of each link.obs-connectorgeneric-jdbc-co",
"doc_type":"cmpntguide",
"kw":"Loader Link Configuration,Using Loader,Component Operation Guide (Normal)",
"title":"Loader Link Configuration",
"githuburl":""
},
{
"uri":"mrs_01_0403.html",
"product_code":"mrs",
"code":"459",
"des":"You can create, view, edit, and delete links on the Loader page.This section applies to versions earlier than MRS 3.x.You have accessed the Loader page. For details, see ",
"doc_type":"cmpntguide",
"kw":"Managing Loader Links (Versions Earlier Than MRS 3.x),Using Loader,Component Operation Guide (Normal",
"title":"Managing Loader Links (Versions Earlier Than MRS 3.x)",
"githuburl":""
},
{
"uri":"mrs_01_0404.html",
"product_code":"mrs",
"code":"460",
"des":"When Loader jobs obtain data from different data sources, a link corresponding to a data source type needs to be selected and the link properties need to be configured.Th",
"doc_type":"cmpntguide",
"kw":"Source Link Configurations of Loader Jobs,Using Loader,Component Operation Guide (Normal)",
"title":"Source Link Configurations of Loader Jobs",
"githuburl":""
},
{
"uri":"mrs_01_0405.html",
"product_code":"mrs",
"code":"461",
"des":"When Loader jobs save data to different storage locations, a destination link needs to be selected and the link properties need to be configured.",
"doc_type":"cmpntguide",
"kw":"Destination Link Configurations of Loader Jobs,Using Loader,Component Operation Guide (Normal)",
"title":"Destination Link Configurations of Loader Jobs",
"githuburl":""
},
{
"uri":"mrs_01_0406.html",
"product_code":"mrs",
"code":"462",
"des":"You can create, view, edit, and delete jobs on the Loader page.This section applies to versions earlier than MRS 3.x.You have accessed the Loader page. For details, see L",
"doc_type":"cmpntguide",
"kw":"Managing Loader Jobs,Using Loader,Component Operation Guide (Normal)",
"title":"Managing Loader Jobs",
"githuburl":""
},
{
"uri":"mrs_01_0407.html",
"product_code":"mrs",
"code":"463",
"des":"As a component for batch data export, Loader can import and export data using a relational database.You have prepared service data.Procedure for MRS clusters earlier than",
"doc_type":"cmpntguide",
"kw":"Preparing a Driver for MySQL Database Link,Using Loader,Component Operation Guide (Normal)",
"title":"Preparing a Driver for MySQL Database Link",
"githuburl":""
},
{
"uri":"mrs_01_1165.html",
"product_code":"mrs",
"code":"464",
"des":"Log path: The default storage path of Loader log files is /var/log/Bigdata/loader/Log category.runlog: /var/log/Bigdata/loader/runlog (run logs)scriptlog: /var/log/Bigdat",
"doc_type":"cmpntguide",
"kw":"Loader Log Overview,Using Loader,Component Operation Guide (Normal)",
"title":"Loader Log Overview",
"githuburl":""
},
{
"uri":"mrs_01_0408.html",
"product_code":"mrs",
"code":"465",
"des":"If you need to import a large volume of data from the external cluster to the internal cluster, import it from OBS to HDFS.You have prepared service data.You have created",
"doc_type":"cmpntguide",
"kw":"Example: Using Loader to Import Data from OBS to HDFS,Using Loader,Component Operation Guide (Normal",
"title":"Example: Using Loader to Import Data from OBS to HDFS",
"githuburl":""
},
{
"uri":"mrs_01_1785.html",
"product_code":"mrs",
"code":"466",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Common Issues About Loader",
"title":"Common Issues About Loader",
"githuburl":""
},
{
"uri":"mrs_01_1786.html",
"product_code":"mrs",
"code":"467",
"des":"Internet Explorer 11 or Internet Explorer 10 is used to access the web UI of Loader. After data is submitted, an error occurs.SymptomWhen the submitted data is saved, a s",
"doc_type":"cmpntguide",
"kw":"How to Resolve the Problem that Failed to Save Data When Using Internet Explorer 10 or Internet Expl",
"title":"How to Resolve the Problem that Failed to Save Data When Using Internet Explorer 10 or Internet Explorer 11 ?",
"githuburl":""
},
{
"uri":"mrs_01_1787.html",
"product_code":"mrs",
"code":"468",
"des":"Three types of connectors are available for importing data from the Oracle database to HDFS using Loader. That is, generic-jdbc-connector, oracle-connector, and oracle-pa",
"doc_type":"cmpntguide",
"kw":"Differences Among Connectors Used During the Process of Importing Data from the Oracle Database to H",
"title":"Differences Among Connectors Used During the Process of Importing Data from the Oracle Database to HDFS",
"githuburl":""
},
{
"uri":"mrs_01_0834.html",
"product_code":"mrs",
"code":"469",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using MapReduce",
"title":"Using MapReduce",
"githuburl":""
},
{
"uri":"mrs_01_0836.html",
"product_code":"mrs",
"code":"470",
"des":"Job and task logs are generated during execution of a MapReduce application.Job logs are generated by the MRApplicationMaster, which record details about the start and ru",
"doc_type":"cmpntguide",
"kw":"Configuring the Log Archiving and Clearing Mechanism,Using MapReduce,Component Operation Guide (Norm",
"title":"Configuring the Log Archiving and Clearing Mechanism",
"githuburl":""
},
{
"uri":"mrs_01_0837.html",
"product_code":"mrs",
"code":"471",
"des":"When the network is unstable or the cluster I/O and CPU are overloaded, client applications might encounter running failures.Adjust the following parameters in the mapred",
"doc_type":"cmpntguide",
"kw":"Reducing Client Application Failure Rate,Using MapReduce,Component Operation Guide (Normal)",
"title":"Reducing Client Application Failure Rate",
"githuburl":""
},
{
"uri":"mrs_01_0838.html",
"product_code":"mrs",
"code":"472",
"des":"If you want to transmit a job from Windows to Linux, set mapreduce.app-submission.cross-platform to true. If this parameter is unavailable for a cluster or its value is f",
"doc_type":"cmpntguide",
"kw":"Transmitting MapReduce Tasks from Windows to Linux,Using MapReduce,Component Operation Guide (Normal",
"title":"Transmitting MapReduce Tasks from Windows to Linux",
"githuburl":""
},
{
"uri":"mrs_01_0839.html",
"product_code":"mrs",
"code":"473",
"des":"This section applies to MRS 3.x or later.Distributed caching is useful in the following scenarios:Rolling UpgradeDuring the upgrade, applications must keep the text conte",
"doc_type":"cmpntguide",
"kw":"Configuring the Distributed Cache,Using MapReduce,Component Operation Guide (Normal)",
"title":"Configuring the Distributed Cache",
"githuburl":""
},
{
"uri":"mrs_01_0840.html",
"product_code":"mrs",
"code":"474",
"des":"When the MapReduce shuffle service is started, it attempts to bind an IP address based on local host. If the MapReduce shuffle service is required to connect to a specifi",
"doc_type":"cmpntguide",
"kw":"Configuring the MapReduce Shuffle Address,Using MapReduce,Component Operation Guide (Normal)",
"title":"Configuring the MapReduce Shuffle Address",
"githuburl":""
},
{
"uri":"mrs_01_0841.html",
"product_code":"mrs",
"code":"475",
"des":"This function is used to specify the MapReduce cluster administrator.The systemadministrator list is specified by mapreduce.cluster.administrators. The cluster administra",
"doc_type":"cmpntguide",
"kw":"Configuring the Cluster Administrator List,Using MapReduce,Component Operation Guide (Normal)",
"title":"Configuring the Cluster Administrator List",
"githuburl":""
},
{
"uri":"mrs_01_0842.html",
"product_code":"mrs",
"code":"476",
"des":"Log paths:JobhistoryServer: /var/log/Bigdata/mapreduce/jobhistory (run log) and /var/log/Bigdata/audit/mapreduce/jobhistory (audit log)Container: /srv/BigData/hadoop/data",
"doc_type":"cmpntguide",
"kw":"Introduction to MapReduce Logs,Using MapReduce,Component Operation Guide (Normal)",
"title":"Introduction to MapReduce Logs",
"githuburl":""
},
{
"uri":"mrs_01_0843.html",
"product_code":"mrs",
"code":"477",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"MapReduce Performance Tuning",
"title":"MapReduce Performance Tuning",
"githuburl":""
},
{
"uri":"mrs_01_0844.html",
"product_code":"mrs",
"code":"478",
"des":"Optimization can be performed when the number of CPU cores is large, for example, the number of CPU cores is three times the number of disks.You can set the following par",
"doc_type":"cmpntguide",
"kw":"Optimization Configuration for Multiple CPU Cores,MapReduce Performance Tuning,Component Operation G",
"title":"Optimization Configuration for Multiple CPU Cores",
"githuburl":""
},
{
"uri":"mrs_01_0845.html",
"product_code":"mrs",
"code":"479",
"des":"The performance optimization effect is verified by comparing actual values with the baseline data. Therefore, determining optimal job baseline is critical to performance ",
"doc_type":"cmpntguide",
"kw":"Determining the Job Baseline,MapReduce Performance Tuning,Component Operation Guide (Normal)",
"title":"Determining the Job Baseline",
"githuburl":""
},
{
"uri":"mrs_01_0846.html",
"product_code":"mrs",
"code":"480",
"des":"During the shuffle procedure of MapReduce, the Map task writes intermediate data into disks, and the Reduce task copies and adds the data to the reduce function. Hadoop p",
"doc_type":"cmpntguide",
"kw":"Streamlining Shuffle,MapReduce Performance Tuning,Component Operation Guide (Normal)",
"title":"Streamlining Shuffle",
"githuburl":""
},
{
"uri":"mrs_01_0847.html",
"product_code":"mrs",
"code":"481",
"des":"A big job containing 100,000 Map tasks fails. It is found that the failure is triggered by the slow response of ApplicationMaster (AM).When the number of tasks increases,",
"doc_type":"cmpntguide",
"kw":"AM Optimization for Big Tasks,MapReduce Performance Tuning,Component Operation Guide (Normal)",
"title":"AM Optimization for Big Tasks",
"githuburl":""
},
{
"uri":"mrs_01_0848.html",
"product_code":"mrs",
"code":"482",
"des":"If a cluster has hundreds or thousands of nodes, the hardware or software fault of a node may prolong the execution time of the entire task (as most tasks are already com",
"doc_type":"cmpntguide",
"kw":"Speculative Execution,MapReduce Performance Tuning,Component Operation Guide (Normal)",
"title":"Speculative Execution",
"githuburl":""
},
{
"uri":"mrs_01_0849.html",
"product_code":"mrs",
"code":"483",
"des":"The Slow Start feature specifies the proportion of Map tasks to be completed before Reduce tasks are started. If the Reduce tasks are started too early, resources will be",
"doc_type":"cmpntguide",
"kw":"Using Slow Start,MapReduce Performance Tuning,Component Operation Guide (Normal)",
"title":"Using Slow Start",
"githuburl":""
},
{
"uri":"mrs_01_0850.html",
"product_code":"mrs",
"code":"484",
"des":"By default, if an MR job generates a large number of output files, it takes a long time for the job to commit the temporary outputs of a task to the final output director",
"doc_type":"cmpntguide",
"kw":"Optimizing Performance for Committing MR Jobs,MapReduce Performance Tuning,Component Operation Guide",
"title":"Optimizing Performance for Committing MR Jobs",
"githuburl":""
},
{
"uri":"mrs_01_1788.html",
"product_code":"mrs",
"code":"485",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Common Issues About MapReduce",
"title":"Common Issues About MapReduce",
"githuburl":""
},
{
"uri":"mrs_01_1789.html",
"product_code":"mrs",
"code":"486",
"des":"MapReduce job takes a very long time (more than 10minutes) when the ResourceManager switch while the job is running.This is because, ResorceManager HA is enabled but the ",
"doc_type":"cmpntguide",
"kw":"Why Does It Take a Long Time to Run a Task Upon ResourceManager Active/Standby Switchover?,Common Is",
"title":"Why Does It Take a Long Time to Run a Task Upon ResourceManager Active/Standby Switchover?",
"githuburl":""
},
{
"uri":"mrs_01_1790.html",
"product_code":"mrs",
"code":"487",
"des":"MapReduce job is not progressing for long timeThis is because of less memory. When the memory is less, the time taken by the job to copy the map output increases signific",
"doc_type":"cmpntguide",
"kw":"Why Does a MapReduce Task Stay Unchanged for a Long Time?,Common Issues About MapReduce,Component Op",
"title":"Why Does a MapReduce Task Stay Unchanged for a Long Time?",
"githuburl":""
},
{
"uri":"mrs_01_1791.html",
"product_code":"mrs",
"code":"488",
"des":"Why is the client unavailable when the MR ApplicationMaster or ResourceManager is moved to the D state during job running?When a task is running, the MR ApplicationMaster",
"doc_type":"cmpntguide",
"kw":"Why the Client Hangs During Job Running?,Common Issues About MapReduce,Component Operation Guide (No",
"title":"Why the Client Hangs During Job Running?",
"githuburl":""
},
{
"uri":"mrs_01_1792.html",
"product_code":"mrs",
"code":"489",
"des":"In security mode, why delegation token HDFS_DELEGATION_TOKEN is not found in the cache?In MapReduce, by default HDFS_DELEGATION_TOKEN will be canceled after the job compl",
"doc_type":"cmpntguide",
"kw":"Why Cannot HDFS_DELEGATION_TOKEN Be Found in the Cache?,Common Issues About MapReduce,Component Oper",
"title":"Why Cannot HDFS_DELEGATION_TOKEN Be Found in the Cache?",
"githuburl":""
},
{
"uri":"mrs_01_1793.html",
"product_code":"mrs",
"code":"490",
"des":"How do I set the job priority when submitting a MapReduce task?You can add the parameter -Dmapreduce.job.priority=<priority> in the command to set task priority when subm",
"doc_type":"cmpntguide",
"kw":"How Do I Set the Task Priority When Submitting a MapReduce Task?,Common Issues About MapReduce,Compo",
"title":"How Do I Set the Task Priority When Submitting a MapReduce Task?",
"githuburl":""
},
{
"uri":"mrs_01_1797.html",
"product_code":"mrs",
"code":"491",
"des":"After the address of MapReduce JobHistoryServer is changed, why the wrong page is displayed when I click the tracking URL on the ResourceManager WebUI?JobHistoryServer ad",
"doc_type":"cmpntguide",
"kw":"After the Address of MapReduce JobHistoryServer Is Changed, Why the Wrong Page is Displayed When I C",
"title":"After the Address of MapReduce JobHistoryServer Is Changed, Why the Wrong Page is Displayed When I Click the Tracking URL on the ResourceManager WebUI?",
"githuburl":""
},
{
"uri":"mrs_01_1799.html",
"product_code":"mrs",
"code":"492",
"des":"MapReduce or Yarn job fails in multiple nameService environment using viewFS.When using viewFS only the mount directories are accessible, so the most possible cause is th",
"doc_type":"cmpntguide",
"kw":"MapReduce Job Failed in Multiple NameService Environment,Common Issues About MapReduce,Component Ope",
"title":"MapReduce Job Failed in Multiple NameService Environment",
"githuburl":""
},
{
"uri":"mrs_01_1800.html",
"product_code":"mrs",
"code":"493",
"des":"MapReduce task fails and the ratio of fault nodes to all nodes is smaller than the blacklist threshold configured by yarn.resourcemanager.am-scheduling.node-blacklisting-",
"doc_type":"cmpntguide",
"kw":"Why a Fault MapReduce Node Is Not Blacklisted?,Common Issues About MapReduce,Component Operation Gui",
"title":"Why a Fault MapReduce Node Is Not Blacklisted?",
"githuburl":""
},
{
"uri":"mrs_01_1807.html",
"product_code":"mrs",
"code":"494",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Oozie",
"title":"Using Oozie",
"githuburl":""
},
{
"uri":"mrs_01_1808.html",
"product_code":"mrs",
"code":"495",
"des":"Oozie is an open-source workflow engine that is used to schedule and coordinate Hadoop jobs.Oozie can be used to submit a wide array of jobs, such as Hive, Spark2x, Loade",
"doc_type":"cmpntguide",
"kw":"Using Oozie from Scratch,Using Oozie,Component Operation Guide (Normal)",
"title":"Using Oozie from Scratch",
"githuburl":""
},
{
"uri":"mrs_01_1810.html",
"product_code":"mrs",
"code":"496",
"des":"This section describes how to use the Oozie client in an O&M scenario or service scenario.The client has been installed. For example, the installation directory is /opt/c",
"doc_type":"cmpntguide",
"kw":"Using the Oozie Client,Using Oozie,Component Operation Guide (Normal)",
"title":"Using the Oozie Client",
"githuburl":""
},
{
"uri":"mrs_01_1812.html",
"product_code":"mrs",
"code":"497",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Oozie Client to Submit an Oozie Job",
"title":"Using Oozie Client to Submit an Oozie Job",
"githuburl":""
},
{
"uri":"mrs_01_1813.html",
"product_code":"mrs",
"code":"498",
"des":"This section describes how to use the Oozie client to submit a Hive job.Hive jobs are divided into the following types:Hive jobHive job that is connected in JDBC modeHive",
"doc_type":"cmpntguide",
"kw":"Submitting a Hive Job,Using Oozie Client to Submit an Oozie Job,Component Operation Guide (Normal)",
"title":"Submitting a Hive Job",
"githuburl":""
},
{
"uri":"mrs_01_1814.html",
"product_code":"mrs",
"code":"499",
"des":"This section describes how to submit a Spark2x job using the Oozie client.You are advised to download the latest client.The Spark2x and Oozie components and clients have ",
"doc_type":"cmpntguide",
"kw":"Submitting a Spark2x Job,Using Oozie Client to Submit an Oozie Job,Component Operation Guide (Normal",
"title":"Submitting a Spark2x Job",
"githuburl":""
},
{
"uri":"mrs_01_1815.html",
"product_code":"mrs",
"code":"500",
"des":"This section describes how to submit a Loader job using the Oozie client.You are advised to download the latest client.The Hive and Oozie components and clients have been",
"doc_type":"cmpntguide",
"kw":"Submitting a Loader Job,Using Oozie Client to Submit an Oozie Job,Component Operation Guide (Normal)",
"title":"Submitting a Loader Job",
"githuburl":""
},
{
"uri":"mrs_01_2392.html",
"product_code":"mrs",
"code":"501",
"des":"This section describes how to submit a DistCp job using the Oozie client.You are advised to download the latest client.The HDFS and Oozie components and clients have been",
"doc_type":"cmpntguide",
"kw":"Submitting a DistCp Job,Using Oozie Client to Submit an Oozie Job,Component Operation Guide (Normal)",
"title":"Submitting a DistCp Job",
"githuburl":""
},
{
"uri":"mrs_01_1816.html",
"product_code":"mrs",
"code":"502",
"des":"In addition to Hive, Spark2x, and Loader jobs, MapReduce, Java, Shell, HDFS, SSH, SubWorkflow, Streaming, and scheduled jobs can be submitted using the Oozie client.You a",
"doc_type":"cmpntguide",
"kw":"Submitting Other Jobs,Using Oozie Client to Submit an Oozie Job,Component Operation Guide (Normal)",
"title":"Submitting Other Jobs",
"githuburl":""
},
{
"uri":"mrs_01_1817.html",
"product_code":"mrs",
"code":"503",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Hue to Submit an Oozie Job",
"title":"Using Hue to Submit an Oozie Job",
"githuburl":""
},
{
"uri":"mrs_01_1818.html",
"product_code":"mrs",
"code":"504",
"des":"You can submit an Oozie job on the Hue management page, but a workflow must be created before the job is submitted.Before using Hue to submit an Oozie job, configure the ",
"doc_type":"cmpntguide",
"kw":"Creating a Workflow,Using Hue to Submit an Oozie Job,Component Operation Guide (Normal)",
"title":"Creating a Workflow",
"githuburl":""
},
{
"uri":"mrs_01_1819.html",
"product_code":"mrs",
"code":"505",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Submitting a Workflow Job",
"title":"Submitting a Workflow Job",
"githuburl":""
},
{
"uri":"mrs_01_1820.html",
"product_code":"mrs",
"code":"506",
"des":"This section describes how to submit an Oozie job of the Hive2 type on the Hue web UI.For example, if the input parameter is INPUT=/user/admin/examples/input-data/table, ",
"doc_type":"cmpntguide",
"kw":"Submitting a Hive2 Job,Submitting a Workflow Job,Component Operation Guide (Normal)",
"title":"Submitting a Hive2 Job",
"githuburl":""
},
{
"uri":"mrs_01_1821.html",
"product_code":"mrs",
"code":"507",
"des":"This section describes how to submit an Oozie job of the Spark2x type on Hue.For example, add the following parameters:hdfs://hacluster/user/admin/examples/input-data/tex",
"doc_type":"cmpntguide",
"kw":"Submitting a Spark2x Job,Submitting a Workflow Job,Component Operation Guide (Normal)",
"title":"Submitting a Spark2x Job",
"githuburl":""
},
{
"uri":"mrs_01_1822.html",
"product_code":"mrs",
"code":"508",
"des":"This section describes how to submit an Oozie job of the Java type on the Hue web UI.If you need to modify the job name before saving the job (default value: My Workflow)",
"doc_type":"cmpntguide",
"kw":"Submitting a Java Job,Submitting a Workflow Job,Component Operation Guide (Normal)",
"title":"Submitting a Java Job",
"githuburl":""
},
{
"uri":"mrs_01_1823.html",
"product_code":"mrs",
"code":"509",
"des":"This section describes how to submit an Oozie job of the Loader type on the Hue web UI.Job id is the ID of the Loader job to be orchestrated and can be obtained from the ",
"doc_type":"cmpntguide",
"kw":"Submitting a Loader Job,Submitting a Workflow Job,Component Operation Guide (Normal)",
"title":"Submitting a Loader Job",
"githuburl":""
},
{
"uri":"mrs_01_1824.html",
"product_code":"mrs",
"code":"510",
"des":"This section describes how to submit an Oozie job of the MapReduce type on the Hue web UI.For example, set the value of mapred.input.dir to /user/admin/examples/input-dat",
"doc_type":"cmpntguide",
"kw":"Submitting a MapReduce Job,Submitting a Workflow Job,Component Operation Guide (Normal)",
"title":"Submitting a MapReduce Job",
"githuburl":""
},
{
"uri":"mrs_01_1825.html",
"product_code":"mrs",
"code":"511",
"des":"This section describes how to submit an Oozie job of the Sub-workflow type on the Hue web UI.If you need to modify the job name before saving the job (default value: My W",
"doc_type":"cmpntguide",
"kw":"Submitting a Sub-workflow Job,Submitting a Workflow Job,Component Operation Guide (Normal)",
"title":"Submitting a Sub-workflow Job",
"githuburl":""
},
{
"uri":"mrs_01_1826.html",
"product_code":"mrs",
"code":"512",
"des":"This section describes how to submit an Oozie job of the Shell type on the Hue web UI.If the file is stored in HDFS, select the path of the .sh file, for example, user/hu",
"doc_type":"cmpntguide",
"kw":"Submitting a Shell Job,Submitting a Workflow Job,Component Operation Guide (Normal)",
"title":"Submitting a Shell Job",
"githuburl":""
},
{
"uri":"mrs_01_1827.html",
"product_code":"mrs",
"code":"513",
"des":"This section describes how to submit an Oozie job of the HDFS type on the Hue web UI.If you need to modify the job name before saving the job (default value: My Workflow)",
"doc_type":"cmpntguide",
"kw":"Submitting an HDFS Job,Submitting a Workflow Job,Component Operation Guide (Normal)",
"title":"Submitting an HDFS Job",
"githuburl":""
},
{
"uri":"mrs_01_1828.html",
"product_code":"mrs",
"code":"514",
"des":"This section describes how to submit an Oozie job of the Streaming type on the Hue web UI.for example, /user/oozie/share/lib/mapreduce-streaming/hadoop-streaming-3.1.1.ja",
"doc_type":"cmpntguide",
"kw":"Submitting a Streaming Job,Submitting a Workflow Job,Component Operation Guide (Normal)",
"title":"Submitting a Streaming Job",
"githuburl":""
},
{
"uri":"mrs_01_1829.html",
"product_code":"mrs",
"code":"515",
"des":"This section describes how to submit an Oozie job of the DistCp type on the Hue web UI.If yes, go to 4.If no, go to 7.source_ip: service address of the HDFS NameNode in t",
"doc_type":"cmpntguide",
"kw":"Submitting a DistCp Job,Submitting a Workflow Job,Component Operation Guide (Normal)",
"title":"Submitting a DistCp Job",
"githuburl":""
},
{
"uri":"mrs_01_1830.html",
"product_code":"mrs",
"code":"516",
"des":"This section guides you to enable unidirectional password-free mutual trust when Oozie nodes are used to execute shell scripts of external nodes through SSH jobs.You have",
"doc_type":"cmpntguide",
"kw":"Example of Mutual Trust Operations,Submitting a Workflow Job,Component Operation Guide (Normal)",
"title":"Example of Mutual Trust Operations",
"githuburl":""
},
{
"uri":"mrs_01_1831.html",
"product_code":"mrs",
"code":"517",
"des":"This section guides you to submit an Oozie job of the SSH type on the Hue web UI.Due to security risks, SSH jobs cannot be submitted by default. To use the SSH function, ",
"doc_type":"cmpntguide",
"kw":"Submitting an SSH Job,Submitting a Workflow Job,Component Operation Guide (Normal)",
"title":"Submitting an SSH Job",
"githuburl":""
},
{
"uri":"mrs_01_2372.html",
"product_code":"mrs",
"code":"518",
"des":"This section describes how to submit a Hive job on the Hue web UI.After the job is submitted, you can view the related contents of the job, such as the detailed informati",
"doc_type":"cmpntguide",
"kw":"Submitting a Hive Script,Submitting a Workflow Job,Component Operation Guide (Normal)",
"title":"Submitting a Hive Script",
"githuburl":""
},
{
"uri":"mrs_01_1840.html",
"product_code":"mrs",
"code":"519",
"des":"This section describes how to submit a job of the periodic scheduling type on the Hue web UI.Required workflow jobs have been configured before the coordinator task is su",
"doc_type":"cmpntguide",
"kw":"Submitting a Coordinator Periodic Scheduling Job,Using Hue to Submit an Oozie Job,Component Operatio",
"title":"Submitting a Coordinator Periodic Scheduling Job",
"githuburl":""
},
{
"uri":"mrs_01_1841.html",
"product_code":"mrs",
"code":"520",
"des":"In the case that multiple scheduled jobs exist at the same time, you can manage the jobs in batches over the Bundle task. This section describes how to submit a job of th",
"doc_type":"cmpntguide",
"kw":"Submitting a Bundle Batch Processing Job,Using Hue to Submit an Oozie Job,Component Operation Guide ",
"title":"Submitting a Bundle Batch Processing Job",
"githuburl":""
},
{
"uri":"mrs_01_1842.html",
"product_code":"mrs",
"code":"521",
"des":"After the jobs are submitted, you can view the execution status of a specific job on Hue.",
"doc_type":"cmpntguide",
"kw":"Querying the Operation Results,Using Hue to Submit an Oozie Job,Component Operation Guide (Normal)",
"title":"Querying the Operation Results",
"githuburl":""
},
{
"uri":"mrs_01_1843.html",
"product_code":"mrs",
"code":"522",
"des":"Log path: The default storage paths of Oozie log files are as follows:Run log: /var/log/Bigdata/oozieAudit log: /var/log/Bigdata/audit/oozieLog archiving rule: Oozie logs",
"doc_type":"cmpntguide",
"kw":"Oozie Log Overview,Using Oozie,Component Operation Guide (Normal)",
"title":"Oozie Log Overview",
"githuburl":""
},
{
"uri":"mrs_01_1844.html",
"product_code":"mrs",
"code":"523",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Common Issues About Oozie",
"title":"Common Issues About Oozie",
"githuburl":""
},
{
"uri":"mrs_01_1846.html",
"product_code":"mrs",
"code":"524",
"des":"Why are not Coordinator scheduled jobs executed on time on the Hue or Oozie client?Use UTC time. For example, set start=2016-12-20T09:00Z in job.properties file.",
"doc_type":"cmpntguide",
"kw":"Oozie Scheduled Tasks Are Not Executed on Time,Common Issues About Oozie,Component Operation Guide (",
"title":"Oozie Scheduled Tasks Are Not Executed on Time",
"githuburl":""
},
{
"uri":"mrs_01_1847.html",
"product_code":"mrs",
"code":"525",
"des":"A new JAR package is uploaded to the /user/oozie/share/lib directory on HDFS. However, an error indicating that the class cannot be found is reported during task executio",
"doc_type":"cmpntguide",
"kw":"Why Update of the share lib Directory of Oozie on HDFS Does Not Take Effect?,Common Issues About Ooz",
"title":"Why Update of the share lib Directory of Oozie on HDFS Does Not Take Effect?",
"githuburl":""
},
{
"uri":"mrs_01_24479.html",
"product_code":"mrs",
"code":"526",
"des":"Check the job logs on Yarn. Run the command executed through Hive SQL using beeline to ensure that Hive is running properly.If error information such as \"classnotfoundExc",
"doc_type":"cmpntguide",
"kw":"Common Oozie Troubleshooting Methods,Common Issues About Oozie,Component Operation Guide (Normal)",
"title":"Common Oozie Troubleshooting Methods",
"githuburl":""
},
{
"uri":"mrs_01_0599.html",
"product_code":"mrs",
"code":"527",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using OpenTSDB",
"title":"Using OpenTSDB",
"githuburl":""
},
{
"uri":"mrs_01_0471.html",
"product_code":"mrs",
"code":"528",
"des":"You can perform an interactive operation on an MRS cluster client. For a cluster with Kerberos authentication enabled, the user must belong to the opentsdb, hbase, opents",
"doc_type":"cmpntguide",
"kw":"Using an MRS Client to Operate OpenTSDB Metric Data,Using OpenTSDB,Component Operation Guide (Normal",
"title":"Using an MRS Client to Operate OpenTSDB Metric Data",
"githuburl":""
},
{
"uri":"mrs_01_0472.html",
"product_code":"mrs",
"code":"529",
"des":"For example, to write data of a metric named testdata, whose timestamp is 1524900185, value is true, tag is key and value, run the following command:<tsd_ip>: indicates t",
"doc_type":"cmpntguide",
"kw":"Running the curl Command to Operate OpenTSDB,Using OpenTSDB,Component Operation Guide (Normal)",
"title":"Running the curl Command to Operate OpenTSDB",
"githuburl":""
},
{
"uri":"mrs_01_0432.html",
"product_code":"mrs",
"code":"530",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Presto",
"title":"Using Presto",
"githuburl":""
},
{
"uri":"mrs_01_0433.html",
"product_code":"mrs",
"code":"531",
"des":"You can view the Presto statistics on the graphical Presto web UI. You are advised to use Google Chrome to access the Presto web UI because it cannot be accessed using In",
"doc_type":"cmpntguide",
"kw":"Accessing the Presto Web UI,Using Presto,Component Operation Guide (Normal)",
"title":"Accessing the Presto Web UI",
"githuburl":""
},
{
"uri":"mrs_01_0434.html",
"product_code":"mrs",
"code":"532",
"des":"You can perform an interactive query on an MRS cluster client. For clusters with Kerberos authentication enabled, users who submit topologies must belong to the presto gr",
"doc_type":"cmpntguide",
"kw":"Using a Client to Execute Query Statements,Using Presto,Component Operation Guide (Normal)",
"title":"Using a Client to Execute Query Statements",
"githuburl":""
},
{
"uri":"mrs_01_0635.html",
"product_code":"mrs",
"code":"533",
"des":"The Presto component has been installed in an MRS cluster.You have synchronized IAM users. (On the Dashboard page, click Synchronize on the right side of IAM User Sync to",
"doc_type":"cmpntguide",
"kw":"Using Presto to Dump Data in DLF,Using Presto,Component Operation Guide (Normal)",
"title":"Using Presto to Dump Data in DLF",
"githuburl":""
},
{
"uri":"mrs_01_0636.html",
"product_code":"mrs",
"code":"534",
"des":"MRS 3.x does not enable you to configure Presto permissions.By default, the Hive Catalog authorization of the Presto component is enabled in a security cluster. The Prest",
"doc_type":"cmpntguide",
"kw":"Configuring Presto Permissions,Using Presto,Component Operation Guide (Normal)",
"title":"Configuring Presto Permissions",
"githuburl":""
},
{
"uri":"mrs_01_0761.html",
"product_code":"mrs",
"code":"535",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Ranger (MRS 1.9.2)",
"title":"Using Ranger (MRS 1.9.2)",
"githuburl":""
},
{
"uri":"mrs_01_0763.html",
"product_code":"mrs",
"code":"536",
"des":"Currently, only normal MRS 1.9.2 clusters support Ranger. Security clusters with Kerberos authentication enabled do not support Ranger.After the cluster is created, Range",
"doc_type":"cmpntguide",
"kw":"Creating a Ranger Cluster,Using Ranger (MRS 1.9.2),Component Operation Guide (Normal)",
"title":"Creating a Ranger Cluster",
"githuburl":""
},
{
"uri":"mrs_01_0764.html",
"product_code":"mrs",
"code":"537",
"des":"You can manage Ranger on the Ranger web UI.After logging in to the Ranger Web UI for the first time, change the password and keep it secure.Ranger UserSync is an importan",
"doc_type":"cmpntguide",
"kw":"Accessing the Ranger Web UI and Synchronizing Unix Users to the Ranger Web UI,Using Ranger (MRS 1.9.",
"title":"Accessing the Ranger Web UI and Synchronizing Unix Users to the Ranger Web UI",
"githuburl":""
},
{
"uri":"mrs_01_0765.html",
"product_code":"mrs",
"code":"538",
"des":"After an MRS cluster with Ranger installed is created, Hive and Impala access control is not integrated into Ranger. This section describes how to integrate Hive into Ran",
"doc_type":"cmpntguide",
"kw":"Configuring Hive/Impala Access Permissions in Ranger,Using Ranger (MRS 1.9.2),Component Operation Gu",
"title":"Configuring Hive/Impala Access Permissions in Ranger",
"githuburl":""
},
{
"uri":"mrs_01_0766.html",
"product_code":"mrs",
"code":"539",
"des":"After an MRS cluster with Ranger installed is created, HBase access control is not integrated into Ranger. This section describes how to integrate HBase into Ranger.Addin",
"doc_type":"cmpntguide",
"kw":"Configuring HBase Access Permissions in Ranger,Using Ranger (MRS 1.9.2),Component Operation Guide (N",
"title":"Configuring HBase Access Permissions in Ranger",
"githuburl":""
},
{
"uri":"mrs_01_1849.html",
"product_code":"mrs",
"code":"540",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Ranger (MRS 3.x)",
"title":"Using Ranger (MRS 3.x)",
"githuburl":""
},
{
"uri":"mrs_01_1850.html",
"product_code":"mrs",
"code":"541",
"des":"Ranger provides a centralized permission management framework to implement fine-grained permission control on components such as HDFS, HBase, Hive, and Yarn. In addition,",
"doc_type":"cmpntguide",
"kw":"Logging In to the Ranger Web UI,Using Ranger (MRS 3.x),Component Operation Guide (Normal)",
"title":"Logging In to the Ranger Web UI",
"githuburl":""
},
{
"uri":"mrs_01_2393.html",
"product_code":"mrs",
"code":"542",
"des":"This section guides you how to enable Ranger authentication. Ranger authentication is enabled by default in security mode and disabled by default in normal mode.If Enable",
"doc_type":"cmpntguide",
"kw":"Enabling Ranger Authentication,Using Ranger (MRS 3.x),Component Operation Guide (Normal)",
"title":"Enabling Ranger Authentication",
"githuburl":""
},
{
"uri":"mrs_01_1851.html",
"product_code":"mrs",
"code":"543",
"des":"In the newly installed MRS cluster, Ranger is installed by default, with the Ranger authentication model enabled. The systemadministrator can set fine-grained security po",
"doc_type":"cmpntguide",
"kw":"Configuring Component Permission Policies,Using Ranger (MRS 3.x),Component Operation Guide (Normal)",
"title":"Configuring Component Permission Policies",
"githuburl":""
},
{
"uri":"mrs_01_1852.html",
"product_code":"mrs",
"code":"544",
"des":"The systemadministrator can view audit logs of the Ranger running and the permission control after Ranger authentication is enabled on the Ranger web UI.",
"doc_type":"cmpntguide",
"kw":"Viewing Ranger Audit Information,Using Ranger (MRS 3.x),Component Operation Guide (Normal)",
"title":"Viewing Ranger Audit Information",
"githuburl":""
},
{
"uri":"mrs_01_1853.html",
"product_code":"mrs",
"code":"545",
"des":"Security zone can be configured using Ranger. Rangeradministrators can divide resources of each component into multiple security zones where administrators set security p",
"doc_type":"cmpntguide",
"kw":"Configuring a Security Zone,Using Ranger (MRS 3.x),Component Operation Guide (Normal)",
"title":"Configuring a Security Zone",
"githuburl":""
},
{
"uri":"mrs_01_2394.html",
"product_code":"mrs",
"code":"546",
"des":"By default, the Ranger data source of the security cluster can be accessed by FusionInsight Manager LDAP users. By default, the Ranger data source of a common cluster can",
"doc_type":"cmpntguide",
"kw":"Changing the Ranger Data Source to LDAP for a Normal Cluster,Using Ranger (MRS 3.x),Component Operat",
"title":"Changing the Ranger Data Source to LDAP for a Normal Cluster",
"githuburl":""
},
{
"uri":"mrs_01_1854.html",
"product_code":"mrs",
"code":"547",
"des":"You can view Ranger permission settings, such as users, user groups, and roles.Users: displays all user information synchronized from LDAP or OS to Ranger.Groups: display",
"doc_type":"cmpntguide",
"kw":"Viewing Ranger Permission Information,Using Ranger (MRS 3.x),Component Operation Guide (Normal)",
"title":"Viewing Ranger Permission Information",
"githuburl":""
},
{
"uri":"mrs_01_1856.html",
"product_code":"mrs",
"code":"548",
"des":"The Rangeradministrator can use Ranger to configure the read, write, and execution permissions on HDFS directories or files for HDFS users.The Ranger service has been ins",
"doc_type":"cmpntguide",
"kw":"Adding a Ranger Access Permission Policy for HDFS,Using Ranger (MRS 3.x),Component Operation Guide (",
"title":"Adding a Ranger Access Permission Policy for HDFS",
"githuburl":""
},
{
"uri":"mrs_01_1857.html",
"product_code":"mrs",
"code":"549",
"des":"Rangeradministrators can use Ranger to configure permissions on HBase tables, column families, and columns for HBase users.The Ranger service has been installed and is ru",
"doc_type":"cmpntguide",
"kw":"Adding a Ranger Access Permission Policy for HBase,Using Ranger (MRS 3.x),Component Operation Guide ",
"title":"Adding a Ranger Access Permission Policy for HBase",
"githuburl":""
},
{
"uri":"mrs_01_1858.html",
"product_code":"mrs",
"code":"550",
"des":"The Rangeradministrator can use Ranger to set permissions for Hive users. The default administrator account of Hive is hive and the initial password is Hive@123.The Range",
"doc_type":"cmpntguide",
"kw":"Adding a Ranger Access Permission Policy for Hive,Using Ranger (MRS 3.x),Component Operation Guide (",
"title":"Adding a Ranger Access Permission Policy for Hive",
"githuburl":""
},
{
"uri":"mrs_01_1859.html",
"product_code":"mrs",
"code":"551",
"des":"The Rangeradministrator can use Ranger to configure Yarn administrator permissions for Yarn users, allowing them to manage Yarn queue resources.The Ranger service has bee",
"doc_type":"cmpntguide",
"kw":"Adding a Ranger Access Permission Policy for Yarn,Using Ranger (MRS 3.x),Component Operation Guide (",
"title":"Adding a Ranger Access Permission Policy for Yarn",
"githuburl":""
},
{
"uri":"mrs_01_1860.html",
"product_code":"mrs",
"code":"552",
"des":"The Rangeradministrator can use Ranger to set permissions for Spark2x users.After Ranger authentication is enabled or disabled on Spark2x, you need to restart Spark2x.Dow",
"doc_type":"cmpntguide",
"kw":"Adding a Ranger Access Permission Policy for Spark2x,Using Ranger (MRS 3.x),Component Operation Guid",
"title":"Adding a Ranger Access Permission Policy for Spark2x",
"githuburl":""
},
{
"uri":"mrs_01_1861.html",
"product_code":"mrs",
"code":"553",
"des":"The Rangeradministrator can use Ranger to configure the read, write, and management permissions of the Kafka topic and the management permission of the cluster for the Ka",
"doc_type":"cmpntguide",
"kw":"Adding a Ranger Access Permission Policy for Kafka,Using Ranger (MRS 3.x),Component Operation Guide ",
"title":"Adding a Ranger Access Permission Policy for Kafka",
"githuburl":""
},
{
"uri":"mrs_01_1863.html",
"product_code":"mrs",
"code":"554",
"des":"The Rangeradministrator can use Ranger to set permissions for Storm users.The Ranger service has been installed and is running properly.You have created users, user group",
"doc_type":"cmpntguide",
"kw":"Adding a Ranger Access Permission Policy for Storm,Using Ranger (MRS 3.x),Component Operation Guide ",
"title":"Adding a Ranger Access Permission Policy for Storm",
"githuburl":""
},
{
"uri":"mrs_01_1865.html",
"product_code":"mrs",
"code":"555",
"des":"Log path: The default storage path of Ranger logs is /var/log/Bigdata/ranger/Role name.RangerAdmin: /var/log/Bigdata/ranger/rangeradmin (run logs)TagSync: /var/log/Bigdat",
"doc_type":"cmpntguide",
"kw":"Ranger Log Overview,Using Ranger (MRS 3.x),Component Operation Guide (Normal)",
"title":"Ranger Log Overview",
"githuburl":""
},
{
"uri":"mrs_01_1866.html",
"product_code":"mrs",
"code":"556",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Common Issues About Ranger",
"title":"Common Issues About Ranger",
"githuburl":""
},
{
"uri":"mrs_01_1867.html",
"product_code":"mrs",
"code":"557",
"des":"During cluster installation, Ranger fails to be started, and the error message \"ERROR: cannot drop sequence X_POLICY_REF_ACCESS_TYPE_SEQ \" is displayed in the task list o",
"doc_type":"cmpntguide",
"kw":"Why Ranger Startup Fails During the Cluster Installation?,Common Issues About Ranger,Component Opera",
"title":"Why Ranger Startup Fails During the Cluster Installation?",
"githuburl":""
},
{
"uri":"mrs_01_1868.html",
"product_code":"mrs",
"code":"558",
"des":"How do I determine whether the Ranger authentication is enabled for a service that supports the authentication?Log in to FusionInsight Manager and choose Cluster > Servic",
"doc_type":"cmpntguide",
"kw":"How Do I Determine Whether the Ranger Authentication Is Used for a Service?,Common Issues About Rang",
"title":"How Do I Determine Whether the Ranger Authentication Is Used for a Service?",
"githuburl":""
},
{
"uri":"mrs_01_2300.html",
"product_code":"mrs",
"code":"559",
"des":"When a new user logs in to Ranger, why is the 401 error reported after the password is changed?The UserSync synchronizes user data at an interval of 5 minutes by default.",
"doc_type":"cmpntguide",
"kw":"Why Cannot a New User Log In to Ranger After Changing the Password?,Common Issues About Ranger,Compo",
"title":"Why Cannot a New User Log In to Ranger After Changing the Password?",
"githuburl":""
},
{
"uri":"mrs_01_2355.html",
"product_code":"mrs",
"code":"560",
"des":"When a Ranger access permission policy is added for HBase and wildcard characters are used to search for an existing HBase table in the policy, the table cannot be found.",
"doc_type":"cmpntguide",
"kw":"When an HBase Policy Is Added or Modified on Ranger, Wildcard Characters Cannot Be Used to Search fo",
"title":"When an HBase Policy Is Added or Modified on Ranger, Wildcard Characters Cannot Be Used to Search for Existing HBase Tables",
"githuburl":""
},
{
"uri":"mrs_01_0589.html",
"product_code":"mrs",
"code":"561",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Spark",
"title":"Using Spark",
"githuburl":""
},
{
"uri":"mrs_01_1925.html",
"product_code":"mrs",
"code":"562",
"des":"This section applies to versions earlier than MRS 3.x.",
"doc_type":"cmpntguide",
"kw":"Precautions,Using Spark,Component Operation Guide (Normal)",
"title":"Precautions",
"githuburl":""
},
{
"uri":"mrs_01_0366.html",
"product_code":"mrs",
"code":"563",
"des":"This section describes how to use Spark to submit a SparkPi job. SparkPi, a typical Spark job, is used to calculate the value of Pi (π).Multiple open-source Spark sample ",
"doc_type":"cmpntguide",
"kw":"Getting Started with Spark,Using Spark,Component Operation Guide (Normal)",
"title":"Getting Started with Spark",
"githuburl":""
},
{
"uri":"mrs_01_0367.html",
"product_code":"mrs",
"code":"564",
"des":"Spark provides the Spark SQL language that is similar to SQL to perform operations on structured data. This section describes how to use Spark SQL from scratch. Create a ",
"doc_type":"cmpntguide",
"kw":"Getting Started with Spark SQL,Using Spark,Component Operation Guide (Normal)",
"title":"Getting Started with Spark SQL",
"githuburl":""
},
{
"uri":"mrs_01_1183.html",
"product_code":"mrs",
"code":"565",
"des":"After an MRS cluster is created, you can create and submit jobs on the client. The client can be installed on nodes inside or outside the cluster.Nodes inside the cluster",
"doc_type":"cmpntguide",
"kw":"Using the Spark Client,Using Spark,Component Operation Guide (Normal)",
"title":"Using the Spark Client",
"githuburl":""
},
{
"uri":"mrs_01_0767.html",
"product_code":"mrs",
"code":"566",
"des":"The Spark web UI is used to view the running status of Spark applications. Google Chrome is recommended for better user experience.Spark has two web UIs.Spark UI: used to",
"doc_type":"cmpntguide",
"kw":"Accessing the Spark Web UI,Using Spark,Component Operation Guide (Normal)",
"title":"Accessing the Spark Web UI",
"githuburl":""
},
{
"uri":"mrs_01_0584.html",
"product_code":"mrs",
"code":"567",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Interconnecting Spark with OpenTSDB",
"title":"Interconnecting Spark with OpenTSDB",
"githuburl":""
},
{
"uri":"mrs_01_0585.html",
"product_code":"mrs",
"code":"568",
"des":"MRS Spark can be used to access the data source of OpenTSDB, create and associate tables in the Spark, and query and insert the OpenTSDB data.Use the CREATE TABLE command",
"doc_type":"cmpntguide",
"kw":"Creating a Table and Associating It with OpenTSDB,Interconnecting Spark with OpenTSDB,Component Oper",
"title":"Creating a Table and Associating It with OpenTSDB",
"githuburl":""
},
{
"uri":"mrs_01_0586.html",
"product_code":"mrs",
"code":"569",
"des":"Run the INSERT INTO statement to insert the data in the table to the associated OpenTSDB metric.The inserted data cannot be null. If the inserted data is the same as the ",
"doc_type":"cmpntguide",
"kw":"Inserting Data to the OpenTSDB Table,Interconnecting Spark with OpenTSDB,Component Operation Guide (",
"title":"Inserting Data to the OpenTSDB Table",
"githuburl":""
},
{
"uri":"mrs_01_0587.html",
"product_code":"mrs",
"code":"570",
"des":"This SELECT command is used to query data in an OpenTSDB table.The to-be-queried table must exist. Otherwise, an error is reported.The value of tagv must exist. Otherwise",
"doc_type":"cmpntguide",
"kw":"Querying an OpenTSDB Table,Interconnecting Spark with OpenTSDB,Component Operation Guide (Normal)",
"title":"Querying an OpenTSDB Table",
"githuburl":""
},
{
"uri":"mrs_01_0588.html",
"product_code":"mrs",
"code":"571",
"des":"By default, OpenTSDB connects to the local TSD process of the node where the Spark executor resides. In MRS, use the default configuration.Run the set statement in spark-",
"doc_type":"cmpntguide",
"kw":"Modifying the Default Configuration Data,Interconnecting Spark with OpenTSDB,Component Operation Gui",
"title":"Modifying the Default Configuration Data",
"githuburl":""
},
{
"uri":"mrs_01_1926.html",
"product_code":"mrs",
"code":"572",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Spark2x",
"title":"Using Spark2x",
"githuburl":""
},
{
"uri":"mrs_01_1927.html",
"product_code":"mrs",
"code":"573",
"des":"This section applies to MRS 3.x or later clusters.",
"doc_type":"cmpntguide",
"kw":"Precautions,Using Spark2x,Component Operation Guide (Normal)",
"title":"Precautions",
"githuburl":""
},
{
"uri":"mrs_01_1928.html",
"product_code":"mrs",
"code":"574",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Basic Operation",
"title":"Basic Operation",
"githuburl":""
},
{
"uri":"mrs_01_1929.html",
"product_code":"mrs",
"code":"575",
"des":"This section describes how to use Spark2x to submit Spark applications, including Spark Core and Spark SQL. Spark Core is the kernel module of Spark. It executes tasks an",
"doc_type":"cmpntguide",
"kw":"Getting Started,Basic Operation,Component Operation Guide (Normal)",
"title":"Getting Started",
"githuburl":""
},
{
"uri":"mrs_01_1930.html",
"product_code":"mrs",
"code":"576",
"des":"This section describes how to quickly configure common parameters and lists parameters that are not recommended to be modified when Spark2x is used.Some parameters have b",
"doc_type":"cmpntguide",
"kw":"Configuring Parameters Rapidly,Basic Operation,Component Operation Guide (Normal)",
"title":"Configuring Parameters Rapidly",
"githuburl":""
},
{
"uri":"mrs_01_1931.html",
"product_code":"mrs",
"code":"577",
"des":"This section describes common configuration items used in Spark. Subsections are divided by feature so that you can quickly find required configuration items. If you use ",
"doc_type":"cmpntguide",
"kw":"Common Parameters,Basic Operation,Component Operation Guide (Normal)",
"title":"Common Parameters",
"githuburl":""
},
{
"uri":"mrs_01_1933.html",
"product_code":"mrs",
"code":"578",
"des":"Spark on HBase allows users to query HBase tables in Spark SQL and to store data for HBase tables by using the Beeline tool. You can use HBase APIs to create, read data f",
"doc_type":"cmpntguide",
"kw":"Spark on HBase Overview and Basic Applications,Basic Operation,Component Operation Guide (Normal)",
"title":"Spark on HBase Overview and Basic Applications",
"githuburl":""
},
{
"uri":"mrs_01_1934.html",
"product_code":"mrs",
"code":"579",
"des":"Spark on HBase V2 allows users to query HBase tables in Spark SQL and to store data for HBase tables by using the Beeline tool. You can use HBase APIs to create, read dat",
"doc_type":"cmpntguide",
"kw":"Spark on HBase V2 Overview and Basic Applications,Basic Operation,Component Operation Guide (Normal)",
"title":"Spark on HBase V2 Overview and Basic Applications",
"githuburl":""
},
{
"uri":"mrs_01_1935.html",
"product_code":"mrs",
"code":"580",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"SparkSQL Permission Management(Security Mode)",
"title":"SparkSQL Permission Management(Security Mode)",
"githuburl":""
},
{
"uri":"mrs_01_1936.html",
"product_code":"mrs",
"code":"581",
"des":"Similar to Hive, Spark SQL is a data warehouse framework built on Hadoop, providing storage of structured data like structured query language (SQL).MRS supports users, us",
"doc_type":"cmpntguide",
"kw":"Spark SQL Permissions,SparkSQL Permission Management(Security Mode),Component Operation Guide (Norma",
"title":"Spark SQL Permissions",
"githuburl":""
},
{
"uri":"mrs_01_1937.html",
"product_code":"mrs",
"code":"582",
"des":"This section describes how to create and configure a SparkSQL role on Manager as the system administrator. The Spark SQL role can be configured with the Sparkadministrato",
"doc_type":"cmpntguide",
"kw":"Creating a Spark SQL Role,SparkSQL Permission Management(Security Mode),Component Operation Guide (N",
"title":"Creating a Spark SQL Role",
"githuburl":""
},
{
"uri":"mrs_01_1938.html",
"product_code":"mrs",
"code":"583",
"des":"You can configure related permissions if you need to access tables or databases created by other users. SparkSQL supports column-based permission control. If a user needs",
"doc_type":"cmpntguide",
"kw":"Configuring Permissions for SparkSQL Tables, Columns, and Databases,SparkSQL Permission Management(S",
"title":"Configuring Permissions for SparkSQL Tables, Columns, and Databases",
"githuburl":""
},
{
"uri":"mrs_01_1939.html",
"product_code":"mrs",
"code":"584",
"des":"SparkSQL may need to be associated with other components. For example, Spark on HBase requires HBase permissions. The following describes how to associate SparkSQL with H",
"doc_type":"cmpntguide",
"kw":"Configuring Permissions for SparkSQL to Use Other Components,SparkSQL Permission Management(Security",
"title":"Configuring Permissions for SparkSQL to Use Other Components",
"githuburl":""
},
{
"uri":"mrs_01_1940.html",
"product_code":"mrs",
"code":"585",
"des":"This section describes how to configure SparkSQL permission management functions (client configuration is similar to server configuration). To enable table permission, ad",
"doc_type":"cmpntguide",
"kw":"Configuring the Client and Server,SparkSQL Permission Management(Security Mode),Component Operation ",
"title":"Configuring the Client and Server",
"githuburl":""
},
{
"uri":"mrs_01_1941.html",
"product_code":"mrs",
"code":"586",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Scenario-Specific Configuration",
"title":"Scenario-Specific Configuration",
"githuburl":""
},
{
"uri":"mrs_01_1942.html",
"product_code":"mrs",
"code":"587",
"des":"In this mode, multiple ThriftServers coexist in the cluster and the client can randomly connect any ThriftServer to perform service operations. When one or multiple Thrif",
"doc_type":"cmpntguide",
"kw":"Configuring Multi-active Instance Mode,Scenario-Specific Configuration,Component Operation Guide (No",
"title":"Configuring Multi-active Instance Mode",
"githuburl":""
},
{
"uri":"mrs_01_1943.html",
"product_code":"mrs",
"code":"588",
"des":"In multi-tenant mode, JDBCServers are bound with tenants. Each tenant corresponds to one or more JDBCServers, and a JDBCServer provides services for only one tenant. Diff",
"doc_type":"cmpntguide",
"kw":"Configuring the Multi-tenant Mode,Scenario-Specific Configuration,Component Operation Guide (Normal)",
"title":"Configuring the Multi-tenant Mode",
"githuburl":""
},
{
"uri":"mrs_01_1944.html",
"product_code":"mrs",
"code":"589",
"des":"When using a cluster, if you want to switch between multi-active instance mode and multi-tenant mode, the following configurations are required.Switch from multi-tenant m",
"doc_type":"cmpntguide",
"kw":"Configuring the Switchover Between the Multi-active Instance Mode and the Multi-tenant Mode,Scenario",
"title":"Configuring the Switchover Between the Multi-active Instance Mode and the Multi-tenant Mode",
"githuburl":""
},
{
"uri":"mrs_01_1945.html",
"product_code":"mrs",
"code":"590",
"des":"Functions such as UI, EventLog, and dynamic resource scheduling in Spark are implemented through event transfer. Events include SparkListenerJobStart and SparkListenerJob",
"doc_type":"cmpntguide",
"kw":"Configuring the Size of the Event Queue,Scenario-Specific Configuration,Component Operation Guide (N",
"title":"Configuring the Size of the Event Queue",
"githuburl":""
},
{
"uri":"mrs_01_1947.html",
"product_code":"mrs",
"code":"591",
"des":"When the executor off-heap memory is too small, or processes with higher priority preempt resources, the physical memory usage will exceed the maximal value. To prevent t",
"doc_type":"cmpntguide",
"kw":"Configuring Executor Off-Heap Memory,Scenario-Specific Configuration,Component Operation Guide (Norm",
"title":"Configuring Executor Off-Heap Memory",
"githuburl":""
},
{
"uri":"mrs_01_1948.html",
"product_code":"mrs",
"code":"592",
"des":"A large amount of memory is required when Spark SQL executes a query, especially during Aggregate and Join operations. If the memory is limited, OutOfMemoryError may occu",
"doc_type":"cmpntguide",
"kw":"Enhancing Stability in a Limited Memory Condition,Scenario-Specific Configuration,Component Operatio",
"title":"Enhancing Stability in a Limited Memory Condition",
"githuburl":""
},
{
"uri":"mrs_01_1949.html",
"product_code":"mrs",
"code":"593",
"des":"When yarn.log-aggregation-enable of Yarn is set to true, the container log aggregation function is enabled. Log aggregation indicates that after applications are run on Y",
"doc_type":"cmpntguide",
"kw":"Viewing Aggregated Container Logs on the Web UI,Scenario-Specific Configuration,Component Operation ",
"title":"Viewing Aggregated Container Logs on the Web UI",
"githuburl":""
},
{
"uri":"mrs_01_1951.html",
"product_code":"mrs",
"code":"594",
"des":"Values of some configuration parameters of Spark client vary depending on its work mode (YARN-Client or YARN-Cluster). If you switch Spark client between different modes ",
"doc_type":"cmpntguide",
"kw":"Configuring Environment Variables in Yarn-Client and Yarn-Cluster Modes,Scenario-Specific Configurat",
"title":"Configuring Environment Variables in Yarn-Client and Yarn-Cluster Modes",
"githuburl":""
},
{
"uri":"mrs_01_1952.html",
"product_code":"mrs",
"code":"595",
"des":"By default, SparkSQL divides data into 200 data blocks during shuffle. In data-intensive scenarios, each data block may have excessive size. If a single data block of a t",
"doc_type":"cmpntguide",
"kw":"Configuring the Default Number of Data Blocks Divided by SparkSQL,Scenario-Specific Configuration,Co",
"title":"Configuring the Default Number of Data Blocks Divided by SparkSQL",
"githuburl":""
},
{
"uri":"mrs_01_1953.html",
"product_code":"mrs",
"code":"596",
"des":"The compression format of a Parquet table can be configured as follows:If the Parquet table is a partitioned one, set the parquet.compression parameter of the Parquet tab",
"doc_type":"cmpntguide",
"kw":"Configuring the Compression Format of a Parquet Table,Scenario-Specific Configuration,Component Oper",
"title":"Configuring the Compression Format of a Parquet Table",
"githuburl":""
},
{
"uri":"mrs_01_1954.html",
"product_code":"mrs",
"code":"597",
"des":"In Spark WebUI, the Executor page can display information about Lost Executor. Executors are dynamically recycled. If the JDBCServer tasks are large, there may be too man",
"doc_type":"cmpntguide",
"kw":"Configuring the Number of Lost Executors Displayed in WebUI,Scenario-Specific Configuration,Componen",
"title":"Configuring the Number of Lost Executors Displayed in WebUI",
"githuburl":""
},
{
"uri":"mrs_01_1957.html",
"product_code":"mrs",
"code":"598",
"des":"In some scenarios, to locate problems or check information by changing the log level,you can add the -Dlog4j.configuration.watch=true parameter to the JVM parameter of a ",
"doc_type":"cmpntguide",
"kw":"Setting the Log Level Dynamically,Scenario-Specific Configuration,Component Operation Guide (Normal)",
"title":"Setting the Log Level Dynamically",
"githuburl":""
},
{
"uri":"mrs_01_1958.html",
"product_code":"mrs",
"code":"599",
"des":"When Spark is used to submit tasks, the driver obtains tokens from HBase by default. To access HBase, you need to configure the jaas.conf file for security authentication",
"doc_type":"cmpntguide",
"kw":"Configuring Whether Spark Obtains HBase Tokens,Scenario-Specific Configuration,Component Operation G",
"title":"Configuring Whether Spark Obtains HBase Tokens",
"githuburl":""
},
{
"uri":"mrs_01_1959.html",
"product_code":"mrs",
"code":"600",
"des":"If the Spark Streaming application is connected to Kafka, after the Spark Streaming application is terminated abnormally and restarted from the checkpoint, the system pre",
"doc_type":"cmpntguide",
"kw":"Configuring LIFO for Kafka,Scenario-Specific Configuration,Component Operation Guide (Normal)",
"title":"Configuring LIFO for Kafka",
"githuburl":""
},
{
"uri":"mrs_01_1960.html",
"product_code":"mrs",
"code":"601",
"des":"When the Spark Streaming application is connected to Kafka and the application is restarted, the application reads data from Kafka based on the last read topic offset and",
"doc_type":"cmpntguide",
"kw":"Configuring Reliability for Connected Kafka,Scenario-Specific Configuration,Component Operation Guid",
"title":"Configuring Reliability for Connected Kafka",
"githuburl":""
},
{
"uri":"mrs_01_1961.html",
"product_code":"mrs",
"code":"602",
"des":"When a query statement is executed, the returned result may be large (containing more than 100,000 records). In this case, JDBCServer out of memory (OOM) may occur. There",
"doc_type":"cmpntguide",
"kw":"Configuring Streaming Reading of Driver Execution Results,Scenario-Specific Configuration,Component ",
"title":"Configuring Streaming Reading of Driver Execution Results",
"githuburl":""
},
{
"uri":"mrs_01_1962.html",
"product_code":"mrs",
"code":"603",
"des":"When you perform the select query in Hive partitioned tables, the FileNotFoundException exception is displayed if a specified partition path does not exist in HDFS. To av",
"doc_type":"cmpntguide",
"kw":"Filtering Partitions without Paths in Partitioned Tables,Scenario-Specific Configuration,Component O",
"title":"Filtering Partitions without Paths in Partitioned Tables",
"githuburl":""
},
{
"uri":"mrs_01_1963.html",
"product_code":"mrs",
"code":"604",
"des":"Users need to implement security protection for Spark2x web UI when some data on the UI cannot be viewed by other users. Once a user attempts to log in to the UI, Spark2x",
"doc_type":"cmpntguide",
"kw":"Configuring Spark2x Web UI ACLs,Scenario-Specific Configuration,Component Operation Guide (Normal)",
"title":"Configuring Spark2x Web UI ACLs",
"githuburl":""
},
{
"uri":"mrs_01_1964.html",
"product_code":"mrs",
"code":"605",
"des":"ORC is a column-based storage format in the Hadoop ecosystem. It originates from Apache Hive and is used to reduce the Hadoop data storage space and accelerate the Hive q",
"doc_type":"cmpntguide",
"kw":"Configuring Vector-based ORC Data Reading,Scenario-Specific Configuration,Component Operation Guide ",
"title":"Configuring Vector-based ORC Data Reading",
"githuburl":""
},
{
"uri":"mrs_01_1965.html",
"product_code":"mrs",
"code":"606",
"des":"In earlier versions, the predicate for pruning Hive table partitions is pushed down. Only comparison expressions between column names and integers or character strings ca",
"doc_type":"cmpntguide",
"kw":"Broaden Support for Hive Partition Pruning Predicate Pushdown,Scenario-Specific Configuration,Compon",
"title":"Broaden Support for Hive Partition Pruning Predicate Pushdown",
"githuburl":""
},
{
"uri":"mrs_01_1966.html",
"product_code":"mrs",
"code":"607",
"des":"In earlier versions, when the insert overwrite syntax is used to overwrite partition tables, only partitions with specified expressions are matched, and partitions withou",
"doc_type":"cmpntguide",
"kw":"Hive Dynamic Partition Overwriting Syntax,Scenario-Specific Configuration,Component Operation Guide ",
"title":"Hive Dynamic Partition Overwriting Syntax",
"githuburl":""
},
{
"uri":"mrs_01_1967.html",
"product_code":"mrs",
"code":"608",
"des":"The execution plan for SQL statements is optimized in Spark. Common optimization rules are heuristic optimization rules. Heuristic optimization rules are provided based o",
"doc_type":"cmpntguide",
"kw":"Configuring the Column Statistics Histogram to Enhance the CBO Accuracy,Scenario-Specific Configurat",
"title":"Configuring the Column Statistics Histogram to Enhance the CBO Accuracy",
"githuburl":""
},
{
"uri":"mrs_01_1969.html",
"product_code":"mrs",
"code":"609",
"des":"JobHistory can use local disks to cache the historical data of Spark applications to prevent the JobHistory memory from loading a large amount of application data, reduci",
"doc_type":"cmpntguide",
"kw":"Configuring Local Disk Cache for JobHistory,Scenario-Specific Configuration,Component Operation Guid",
"title":"Configuring Local Disk Cache for JobHistory",
"githuburl":""
},
{
"uri":"mrs_01_1970.html",
"product_code":"mrs",
"code":"610",
"des":"The Spark SQL adaptive execution feature enables Spark SQL to optimize subsequent execution processes based on intermediate results to improve overall execution efficienc",
"doc_type":"cmpntguide",
"kw":"Configuring Spark SQL to Enable the Adaptive Execution Feature,Scenario-Specific Configuration,Compo",
"title":"Configuring Spark SQL to Enable the Adaptive Execution Feature",
"githuburl":""
},
{
"uri":"mrs_01_24170.html",
"product_code":"mrs",
"code":"611",
"des":"When the event log mode is enabled for Spark, that is, spark.eventLog.enabled is set to true, events are written to a configured log file to record the program running pr",
"doc_type":"cmpntguide",
"kw":"Configuring Event Log Rollover,Scenario-Specific Configuration,Component Operation Guide (Normal)",
"title":"Configuring Event Log Rollover",
"githuburl":""
},
{
"uri":"mrs_01_2317.html",
"product_code":"mrs",
"code":"612",
"des":"When Ranger is used as the permission management service of Spark SQL, the certificate in the cluster is required for accessing RangerAdmin. If you use a third-party JDK ",
"doc_type":"cmpntguide",
"kw":"Adapting to the Third-party JDK When Ranger Is Used,Basic Operation,Component Operation Guide (Norma",
"title":"Adapting to the Third-party JDK When Ranger Is Used",
"githuburl":""
},
{
"uri":"mrs_01_1971.html",
"product_code":"mrs",
"code":"613",
"des":"Log paths:Executor run log: ${BIGDATA_DATA_HOME}/hadoop/data${i}/nm/containerlogs/application_${appid}/container_{$contid}The logs of running tasks are stored in the prec",
"doc_type":"cmpntguide",
"kw":"Spark2x Logs,Using Spark2x,Component Operation Guide (Normal)",
"title":"Spark2x Logs",
"githuburl":""
},
{
"uri":"mrs_01_1972.html",
"product_code":"mrs",
"code":"614",
"des":"Container logs of running Spark applications are distributed on multiple nodes. This section describes how to quickly obtain container logs.You can run the yarn logs comm",
"doc_type":"cmpntguide",
"kw":"Obtaining Container Logs of a Running Spark Application,Using Spark2x,Component Operation Guide (Nor",
"title":"Obtaining Container Logs of a Running Spark Application",
"githuburl":""
},
{
"uri":"mrs_01_1973.html",
"product_code":"mrs",
"code":"615",
"des":"In a large-scale Hadoop production cluster, HDFS metadata is stored in the NameNode memory, and the cluster scale is restricted by the memory limitation of each NameNode.",
"doc_type":"cmpntguide",
"kw":"Small File Combination Tools,Using Spark2x,Component Operation Guide (Normal)",
"title":"Small File Combination Tools",
"githuburl":""
},
{
"uri":"mrs_01_2362.html",
"product_code":"mrs",
"code":"616",
"des":"The first query of CarbonData is slow, which may cause a delay for nodes that have high requirements on real-time performance.The tool provides the following functions:Pr",
"doc_type":"cmpntguide",
"kw":"Using CarbonData for First Query,Using Spark2x,Component Operation Guide (Normal)",
"title":"Using CarbonData for First Query",
"githuburl":""
},
{
"uri":"mrs_01_1974.html",
"product_code":"mrs",
"code":"617",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Spark2x Performance Tuning",
"title":"Spark2x Performance Tuning",
"githuburl":""
},
{
"uri":"mrs_01_1975.html",
"product_code":"mrs",
"code":"618",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Spark Core Tuning",
"title":"Spark Core Tuning",
"githuburl":""
},
{
"uri":"mrs_01_1976.html",
"product_code":"mrs",
"code":"619",
"des":"Spark supports the following types of serialization:JavaSerializerKryoSerializerData serialization affects the Spark application performance. In specific data format, Kry",
"doc_type":"cmpntguide",
"kw":"Data Serialization,Spark Core Tuning,Component Operation Guide (Normal)",
"title":"Data Serialization",
"githuburl":""
},
{
"uri":"mrs_01_1977.html",
"product_code":"mrs",
"code":"620",
"des":"Spark is a memory-based computing frame. If the memory is insufficient during computing, the Spark execution efficiency will be adversely affected. You can determine whet",
"doc_type":"cmpntguide",
"kw":"Optimizing Memory Configuration,Spark Core Tuning,Component Operation Guide (Normal)",
"title":"Optimizing Memory Configuration",
"githuburl":""
},
{
"uri":"mrs_01_1978.html",
"product_code":"mrs",
"code":"621",
"des":"The degree of parallelism (DOP) specifies the number of tasks to be executed concurrently. It determines the number of data blocks after the shuffle operation. Configure ",
"doc_type":"cmpntguide",
"kw":"Setting the DOP,Spark Core Tuning,Component Operation Guide (Normal)",
"title":"Setting the DOP",
"githuburl":""
},
{
"uri":"mrs_01_1979.html",
"product_code":"mrs",
"code":"622",
"des":"Broadcast distributes data sets to each node. It allows data to be obtained locally when a data set is needed during a Spark task. If broadcast is not used, data serializ",
"doc_type":"cmpntguide",
"kw":"Using Broadcast Variables,Spark Core Tuning,Component Operation Guide (Normal)",
"title":"Using Broadcast Variables",
"githuburl":""
},
{
"uri":"mrs_01_1980.html",
"product_code":"mrs",
"code":"623",
"des":"When the Spark system runs applications that contain a shuffle process, an executor process also writes shuffle data and provides shuffle data for other executors in addi",
"doc_type":"cmpntguide",
"kw":"Using the external shuffle service to improve performance,Spark Core Tuning,Component Operation Guid",
"title":"Using the external shuffle service to improve performance",
"githuburl":""
},
{
"uri":"mrs_01_1981.html",
"product_code":"mrs",
"code":"624",
"des":"Resources are a key factor that affects Spark execution efficiency. When a long-running service (such as the JDBCServer) is allocated with multiple executors without task",
"doc_type":"cmpntguide",
"kw":"Configuring Dynamic Resource Scheduling in Yarn Mode,Spark Core Tuning,Component Operation Guide (No",
"title":"Configuring Dynamic Resource Scheduling in Yarn Mode",
"githuburl":""
},
{
"uri":"mrs_01_1982.html",
"product_code":"mrs",
"code":"625",
"des":"There are three processes in Spark on Yarn mode: driver, ApplicationMaster, and executor. The Driver and Executor handle the scheduling and running of the task. The Appli",
"doc_type":"cmpntguide",
"kw":"Configuring Process Parameters,Spark Core Tuning,Component Operation Guide (Normal)",
"title":"Configuring Process Parameters",
"githuburl":""
},
{
"uri":"mrs_01_1983.html",
"product_code":"mrs",
"code":"626",
"des":"Optimal program structure helps increase execution efficiency. During application programming, avoid shuffle operations and combine narrow-dependency operations.This topi",
"doc_type":"cmpntguide",
"kw":"Designing the Direction Acyclic Graph (DAG),Spark Core Tuning,Component Operation Guide (Normal)",
"title":"Designing the Direction Acyclic Graph (DAG)",
"githuburl":""
},
{
"uri":"mrs_01_1984.html",
"product_code":"mrs",
"code":"627",
"des":"If the overhead of each record is high, for example:Use mapPartitions to calculate data by partition.Use mapPartitions to flexibly operate data. For example, to calculate",
"doc_type":"cmpntguide",
"kw":"Experience,Spark Core Tuning,Component Operation Guide (Normal)",
"title":"Experience",
"githuburl":""
},
{
"uri":"mrs_01_1985.html",
"product_code":"mrs",
"code":"628",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Spark SQL and DataFrame Tuning",
"title":"Spark SQL and DataFrame Tuning",
"githuburl":""
},
{
"uri":"mrs_01_1986.html",
"product_code":"mrs",
"code":"629",
"des":"When two tables are joined in Spark SQL, the broadcast function (see section \"Using Broadcast Variables\") can be used to broadcast tables to each node. This minimizes shu",
"doc_type":"cmpntguide",
"kw":"Optimizing the Spark SQL Join Operation,Spark SQL and DataFrame Tuning,Component Operation Guide (No",
"title":"Optimizing the Spark SQL Join Operation",
"githuburl":""
},
{
"uri":"mrs_01_1987.html",
"product_code":"mrs",
"code":"630",
"des":"When multiple tables are joined in Spark SQL, skew occurs in join keys and the data volume in some Hash buckets is much higher than that in other buckets. As a result, so",
"doc_type":"cmpntguide",
"kw":"Improving Spark SQL Calculation Performance Under Data Skew,Spark SQL and DataFrame Tuning,Component",
"title":"Improving Spark SQL Calculation Performance Under Data Skew",
"githuburl":""
},
{
"uri":"mrs_01_1988.html",
"product_code":"mrs",
"code":"631",
"des":"A Spark SQL table may have many small files (far smaller than an HDFS block), each of which maps to a partition on the Spark by default. In other words, each small file i",
"doc_type":"cmpntguide",
"kw":"Optimizing Spark SQL Performance in the Small File Scenario,Spark SQL and DataFrame Tuning,Component",
"title":"Optimizing Spark SQL Performance in the Small File Scenario",
"githuburl":""
},
{
"uri":"mrs_01_1989.html",
"product_code":"mrs",
"code":"632",
"des":"The INSERT...SELECT operation needs to be optimized if any of the following conditions is true:Many small files need to be queried.A few large files need to be queried.Th",
"doc_type":"cmpntguide",
"kw":"Optimizing the INSERT...SELECT Operation,Spark SQL and DataFrame Tuning,Component Operation Guide (N",
"title":"Optimizing the INSERT...SELECT Operation",
"githuburl":""
},
{
"uri":"mrs_01_1990.html",
"product_code":"mrs",
"code":"633",
"des":"Multiple clients can be connected to JDBCServer at the same time. However, if the number of concurrent tasks is too large, the default configuration of JDBCServer must be",
"doc_type":"cmpntguide",
"kw":"Multiple JDBC Clients Concurrently Connecting to JDBCServer,Spark SQL and DataFrame Tuning,Component",
"title":"Multiple JDBC Clients Concurrently Connecting to JDBCServer",
"githuburl":""
},
{
"uri":"mrs_01_1992.html",
"product_code":"mrs",
"code":"634",
"des":"When SparkSQL inserts data to dynamic partitioned tables, the more partitions there are, the more HDFS files a single task generates and the more memory metadata occupies",
"doc_type":"cmpntguide",
"kw":"Optimizing Memory when Data Is Inserted into Dynamic Partitioned Tables,Spark SQL and DataFrame Tuni",
"title":"Optimizing Memory when Data Is Inserted into Dynamic Partitioned Tables",
"githuburl":""
},
{
"uri":"mrs_01_1995.html",
"product_code":"mrs",
"code":"635",
"des":"A Spark SQL table may have many small files (far smaller than an HDFS block), each of which maps to a partition on the Spark by default. In other words, each small file i",
"doc_type":"cmpntguide",
"kw":"Optimizing Small Files,Spark SQL and DataFrame Tuning,Component Operation Guide (Normal)",
"title":"Optimizing Small Files",
"githuburl":""
},
{
"uri":"mrs_01_1996.html",
"product_code":"mrs",
"code":"636",
"des":"Spark SQL supports hash aggregate algorithm. Namely, use fast aggregate hashmap as cache to improve aggregate performance. The hashmap replaces the previous ColumnarBatch",
"doc_type":"cmpntguide",
"kw":"Optimizing the Aggregate Algorithms,Spark SQL and DataFrame Tuning,Component Operation Guide (Normal",
"title":"Optimizing the Aggregate Algorithms",
"githuburl":""
},
{
"uri":"mrs_01_1997.html",
"product_code":"mrs",
"code":"637",
"des":"Save the partition information about the datasource table to the Metastore and process partition information in the Metastore.Optimize the datasource tables, support synt",
"doc_type":"cmpntguide",
"kw":"Optimizing Datasource Tables,Spark SQL and DataFrame Tuning,Component Operation Guide (Normal)",
"title":"Optimizing Datasource Tables",
"githuburl":""
},
{
"uri":"mrs_01_1998.html",
"product_code":"mrs",
"code":"638",
"des":"Spark SQL supports rule-based optimization by default. However, the rule-based optimization cannot ensure that Spark selects the optimal query plan. Cost-Based Optimizer ",
"doc_type":"cmpntguide",
"kw":"Merging CBO,Spark SQL and DataFrame Tuning,Component Operation Guide (Normal)",
"title":"Merging CBO",
"githuburl":""
},
{
"uri":"mrs_01_1999.html",
"product_code":"mrs",
"code":"639",
"des":"This section describes how to enable or disable the query optimization for inter-source complex SQL.(Optional) Prepare for connecting to the MPPDB data source.If the data",
"doc_type":"cmpntguide",
"kw":"Optimizing SQL Query of Data of Multiple Sources,Spark SQL and DataFrame Tuning,Component Operation ",
"title":"Optimizing SQL Query of Data of Multiple Sources",
"githuburl":""
},
{
"uri":"mrs_01_2000.html",
"product_code":"mrs",
"code":"640",
"des":"This section describes the optimization suggestions for SQL statements in multi-level nesting and hybrid join scenarios.The following provides an example of complex query",
"doc_type":"cmpntguide",
"kw":"SQL Optimization for Multi-level Nesting and Hybrid Join,Spark SQL and DataFrame Tuning,Component Op",
"title":"SQL Optimization for Multi-level Nesting and Hybrid Join",
"githuburl":""
},
{
"uri":"mrs_01_2001.html",
"product_code":"mrs",
"code":"641",
"des":"Streaming is a mini-batch streaming processing framework that features second-level delay and high throughput. To optimize Streaming is to improve its throughput while ma",
"doc_type":"cmpntguide",
"kw":"Spark Streaming Tuning,Spark2x Performance Tuning,Component Operation Guide (Normal)",
"title":"Spark Streaming Tuning",
"githuburl":""
},
{
"uri":"mrs_01_2002.html",
"product_code":"mrs",
"code":"642",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Common Issues About Spark2x",
"title":"Common Issues About Spark2x",
"githuburl":""
},
{
"uri":"mrs_01_2003.html",
"product_code":"mrs",
"code":"643",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Spark Core",
"title":"Spark Core",
"githuburl":""
},
{
"uri":"mrs_01_2004.html",
"product_code":"mrs",
"code":"644",
"des":"How do I view the aggregated container logs on the page when the log aggregation function is enabled on YARN?For details, see Viewing Aggregated Container Logs on the Web",
"doc_type":"cmpntguide",
"kw":"How Do I View Aggregated Spark Application Logs?,Spark Core,Component Operation Guide (Normal)",
"title":"How Do I View Aggregated Spark Application Logs?",
"githuburl":""
},
{
"uri":"mrs_01_2005.html",
"product_code":"mrs",
"code":"645",
"des":"Communication between ApplicationMaster and ResourceManager remains abnormal for a long time. Why is the driver return code inconsistent with application status on Resour",
"doc_type":"cmpntguide",
"kw":"Why Is the Return Code of Driver Inconsistent with Application State Displayed on ResourceManager We",
"title":"Why Is the Return Code of Driver Inconsistent with Application State Displayed on ResourceManager WebUI?",
"githuburl":""
},
{
"uri":"mrs_01_2006.html",
"product_code":"mrs",
"code":"646",
"des":"Why cannot exit the Driver process after running the yarn application -kill applicationID command to stop the Spark Streaming application?Running the yarn application -ki",
"doc_type":"cmpntguide",
"kw":"Why Cannot Exit the Driver Process?,Spark Core,Component Operation Guide (Normal)",
"title":"Why Cannot Exit the Driver Process?",
"githuburl":""
},
{
"uri":"mrs_01_2007.html",
"product_code":"mrs",
"code":"647",
"des":"On a large cluster of 380 nodes, run the ScalaSort test case in the HiBench test that runs the 29T data, and configure Executor as --executor-cores 4. The following abnor",
"doc_type":"cmpntguide",
"kw":"Why Does FetchFailedException Occur When the Network Connection Is Timed out,Spark Core,Component Op",
"title":"Why Does FetchFailedException Occur When the Network Connection Is Timed out",
"githuburl":""
},
{
"uri":"mrs_01_2008.html",
"product_code":"mrs",
"code":"648",
"des":"How to configure the event queue size if the following Driver log information is displayed indicating that the event queue overflows?Common applicationsDropping SparkList",
"doc_type":"cmpntguide",
"kw":"How to Configure Event Queue Size If Event Queue Overflows?,Spark Core,Component Operation Guide (No",
"title":"How to Configure Event Queue Size If Event Queue Overflows?",
"githuburl":""
},
{
"uri":"mrs_01_2009.html",
"product_code":"mrs",
"code":"649",
"des":"During Spark application execution, if the driver fails to connect to ResourceManager, the following error is reported and it does not exit for a long time. What can I do",
"doc_type":"cmpntguide",
"kw":"What Can I Do If the getApplicationReport Exception Is Recorded in Logs During Spark Application Exe",
"title":"What Can I Do If the getApplicationReport Exception Is Recorded in Logs During Spark Application Execution and the Application Does Not Exit for a Long Time?",
"githuburl":""
},
{
"uri":"mrs_01_2010.html",
"product_code":"mrs",
"code":"650",
"des":"When Spark executes an application, an error similar to the following is reported and the application ends. What can I do?Symptom: The value of spark.rpc.io.connectionTim",
"doc_type":"cmpntguide",
"kw":"What Can I Do If \"Connection to ip:port has been quiet for xxx ms while there are outstanding reques",
"title":"What Can I Do If \"Connection to ip:port has been quiet for xxx ms while there are outstanding requests\" Is Reported When Spark Executes an Application and the Application Ends?",
"githuburl":""
},
{
"uri":"mrs_01_2011.html",
"product_code":"mrs",
"code":"651",
"des":"If the NodeManager is shut down with the Executor dynamic allocation enabled, the Executors on the node where the NodeManeger is shut down fail to be removed from the dri",
"doc_type":"cmpntguide",
"kw":"Why Do Executors Fail to be Removed After the NodeManeger Is Shut Down?,Spark Core,Component Operati",
"title":"Why Do Executors Fail to be Removed After the NodeManeger Is Shut Down?",
"githuburl":""
},
{
"uri":"mrs_01_2012.html",
"product_code":"mrs",
"code":"652",
"des":"ExternalShuffle is enabled for the application that runs Spark. Task loss occurs in the application because the message \"java.lang.NullPointerException: Password cannot b",
"doc_type":"cmpntguide",
"kw":"What Can I Do If the Message \"Password cannot be null if SASL is enabled\" Is Displayed?,Spark Core,C",
"title":"What Can I Do If the Message \"Password cannot be null if SASL is enabled\" Is Displayed?",
"githuburl":""
},
{
"uri":"mrs_01_2013.html",
"product_code":"mrs",
"code":"653",
"des":"When inserting data into the dynamic partition table, a large number of shuffle files are damaged due to the disk disconnection, node error, and the like. In this case, w",
"doc_type":"cmpntguide",
"kw":"What Should I Do If the Message \"Failed to CREATE_FILE\" Is Displayed in the Restarted Tasks When Dat",
"title":"What Should I Do If the Message \"Failed to CREATE_FILE\" Is Displayed in the Restarted Tasks When Data Is Inserted Into the Dynamic Partition Table?",
"githuburl":""
},
{
"uri":"mrs_01_2014.html",
"product_code":"mrs",
"code":"654",
"des":"When Hash shuffle is used to run a job that consists of 1000000 map tasks x 100000 reduce tasks, run logs report many message failures and Executor heartbeat timeout, lea",
"doc_type":"cmpntguide",
"kw":"Why Tasks Fail When Hash Shuffle Is Used?,Spark Core,Component Operation Guide (Normal)",
"title":"Why Tasks Fail When Hash Shuffle Is Used?",
"githuburl":""
},
{
"uri":"mrs_01_2015.html",
"product_code":"mrs",
"code":"655",
"des":"When the http(s)://<spark ip>:<spark port> mode is used to access the Spark JobHistory page, if the displayed Spark JobHistory page is not the page of FusionInsight Manag",
"doc_type":"cmpntguide",
"kw":"What Can I Do If the Error Message \"DNS query failed\" Is Displayed When I Access the Aggregated Logs",
"title":"What Can I Do If the Error Message \"DNS query failed\" Is Displayed When I Access the Aggregated Logs Page of Spark Applications?",
"githuburl":""
},
{
"uri":"mrs_01_2016.html",
"product_code":"mrs",
"code":"656",
"des":"When I execute a 100 TB TPC-DS test suite in the JDBCServer mode, the \"Timeout waiting for task\" is displayed. As a result, shuffle fetch fails, the stage keeps retrying,",
"doc_type":"cmpntguide",
"kw":"What Can I Do If Shuffle Fetch Fails Due to the \"Timeout Waiting for Task\" Exception?,Spark Core,Com",
"title":"What Can I Do If Shuffle Fetch Fails Due to the \"Timeout Waiting for Task\" Exception?",
"githuburl":""
},
{
"uri":"mrs_01_2017.html",
"product_code":"mrs",
"code":"657",
"des":"When I run Spark tasks with a large data volume, for example, 100 TB TPCDS test suite, why does the Stage retry due to Executor loss sometimes? The message \"Executor 532 ",
"doc_type":"cmpntguide",
"kw":"Why Does the Stage Retry due to the Crash of the Executor?,Spark Core,Component Operation Guide (Nor",
"title":"Why Does the Stage Retry due to the Crash of the Executor?",
"githuburl":""
},
{
"uri":"mrs_01_2018.html",
"product_code":"mrs",
"code":"658",
"des":"When more than 50 terabytes of data is shuffled, some executors fail to register shuffle services due to timeout. The shuffle tasks then fail. Why? The error log is as fo",
"doc_type":"cmpntguide",
"kw":"Why Do the Executors Fail to Register Shuffle Services During the Shuffle of a Large Amount of Data?",
"title":"Why Do the Executors Fail to Register Shuffle Services During the Shuffle of a Large Amount of Data?",
"githuburl":""
},
{
"uri":"mrs_01_2019.html",
"product_code":"mrs",
"code":"659",
"des":"During the execution of Spark applications, if the YARN External Shuffle service is enabled and there are too many shuffle tasks, the java.lang.OutofMemoryError: Direct b",
"doc_type":"cmpntguide",
"kw":"Why Does the Out of Memory Error Occur in NodeManager During the Execution of Spark Applications,Spa",
"title":"Why Does the Out of Memory Error Occur in NodeManager During the Execution of Spark Applications",
"githuburl":""
},
{
"uri":"mrs_01_2021.html",
"product_code":"mrs",
"code":"660",
"des":"Execution of the sparkbench task (for example, Wordcount) of HiBench6 fails. The bench.log indicates that the Yarn task fails to be executed. The failure information disp",
"doc_type":"cmpntguide",
"kw":"Why Does the Realm Information Fail to Be Obtained When SparkBench is Run on HiBench for the Cluster",
"title":"Why Does the Realm Information Fail to Be Obtained When SparkBench is Run on HiBench for the Cluster in Security Mode?",
"githuburl":""
},
{
"uri":"mrs_01_2022.html",
"product_code":"mrs",
"code":"661",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Spark SQL and DataFrame",
"title":"Spark SQL and DataFrame",
"githuburl":""
},
{
"uri":"mrs_01_2023.html",
"product_code":"mrs",
"code":"662",
"des":"Suppose that there is a table src(d1, d2, m) with the following data:The results for statement \"select d1, sum(d1) from src group by d1, d2 with rollup\" are shown as belo",
"doc_type":"cmpntguide",
"kw":"What Do I have to Note When Using Spark SQL ROLLUP and CUBE?,Spark SQL and DataFrame,Component Opera",
"title":"What Do I have to Note When Using Spark SQL ROLLUP and CUBE?",
"githuburl":""
},
{
"uri":"mrs_01_2024.html",
"product_code":"mrs",
"code":"663",
"des":"Why temporary tables of the previous database are displayed after the database is switched?Create a temporary DataSource table, for example:create temporary table ds_parq",
"doc_type":"cmpntguide",
"kw":"Why Spark SQL Is Displayed as a Temporary Table in Different Databases?,Spark SQL and DataFrame,Comp",
"title":"Why Spark SQL Is Displayed as a Temporary Table in Different Databases?",
"githuburl":""
},
{
"uri":"mrs_01_2025.html",
"product_code":"mrs",
"code":"664",
"des":"Is it possible to assign parameter values through Spark commands, in addition to through a user interface or a configuration file?Spark configuration options can be defin",
"doc_type":"cmpntguide",
"kw":"How to Assign a Parameter Value in a Spark Command?,Spark SQL and DataFrame,Component Operation Guid",
"title":"How to Assign a Parameter Value in a Spark Command?",
"githuburl":""
},
{
"uri":"mrs_01_2026.html",
"product_code":"mrs",
"code":"665",
"des":"The following error information is displayed when a new user creates a table using SparkSQL:When you create a table using Spark SQL, the interface of Hive is called by th",
"doc_type":"cmpntguide",
"kw":"What Directory Permissions Do I Need to Create a Table Using SparkSQL?,Spark SQL and DataFrame,Compo",
"title":"What Directory Permissions Do I Need to Create a Table Using SparkSQL?",
"githuburl":""
},
{
"uri":"mrs_01_2027.html",
"product_code":"mrs",
"code":"666",
"des":"Why do I fail to delete the UDF using another service, for example, delete the UDF created by Hive using Spark SQL.The UDF can be created using any of the following servi",
"doc_type":"cmpntguide",
"kw":"Why Do I Fail to Delete the UDF Using Another Service?,Spark SQL and DataFrame,Component Operation G",
"title":"Why Do I Fail to Delete the UDF Using Another Service?",
"githuburl":""
},
{
"uri":"mrs_01_2028.html",
"product_code":"mrs",
"code":"667",
"des":"Why cannot I query newly inserted data in a parquet Hive table using SparkSQL? This problem occurs in the following scenarios:For partitioned tables and non-partitioned t",
"doc_type":"cmpntguide",
"kw":"Why Cannot I Query Newly Inserted Data in a Parquet Hive Table Using SparkSQL?,Spark SQL and DataFra",
"title":"Why Cannot I Query Newly Inserted Data in a Parquet Hive Table Using SparkSQL?",
"githuburl":""
},
{
"uri":"mrs_01_2029.html",
"product_code":"mrs",
"code":"668",
"des":"What is cache table used for? Which point should I pay attention to while using cache table?Spark SQL caches tables into memory so that data can be directly read from mem",
"doc_type":"cmpntguide",
"kw":"How to Use Cache Table?,Spark SQL and DataFrame,Component Operation Guide (Normal)",
"title":"How to Use Cache Table?",
"githuburl":""
},
{
"uri":"mrs_01_2030.html",
"product_code":"mrs",
"code":"669",
"des":"During the repartition operation, the number of blocks (spark.sql.shuffle.partitions) is set to 4,500, and the number of keys used by repartition exceeds 4,000. It is exp",
"doc_type":"cmpntguide",
"kw":"Why Are Some Partitions Empty During Repartition?,Spark SQL and DataFrame,Component Operation Guide ",
"title":"Why Are Some Partitions Empty During Repartition?",
"githuburl":""
},
{
"uri":"mrs_01_2031.html",
"product_code":"mrs",
"code":"670",
"des":"When the default configuration is used, 16 terabytes of text data fails to be converted into 4 terabytes of parquet data, and the error information below is displayed. Wh",
"doc_type":"cmpntguide",
"kw":"Why Does 16 Terabytes of Text Data Fails to Be Converted into 4 Terabytes of Parquet Data?,Spark SQL",
"title":"Why Does 16 Terabytes of Text Data Fails to Be Converted into 4 Terabytes of Parquet Data?",
"githuburl":""
},
{
"uri":"mrs_01_2033.html",
"product_code":"mrs",
"code":"671",
"des":"When the table name is set to table, why the error information similar to the following is displayed after the drop table table command or other command is run?The word t",
"doc_type":"cmpntguide",
"kw":"Why the Operation Fails When the Table Name Is TABLE?,Spark SQL and DataFrame,Component Operation Gu",
"title":"Why the Operation Fails When the Table Name Is TABLE?",
"githuburl":""
},
{
"uri":"mrs_01_2034.html",
"product_code":"mrs",
"code":"672",
"des":"When the analyze table statement is executed using spark-sql, the task is suspended and the information below is displayed. Why?When the statement is executed, the SQL st",
"doc_type":"cmpntguide",
"kw":"Why Is a Task Suspended When the ANALYZE TABLE Statement Is Executed and Resources Are Insufficient?",
"title":"Why Is a Task Suspended When the ANALYZE TABLE Statement Is Executed and Resources Are Insufficient?",
"githuburl":""
},
{
"uri":"mrs_01_2035.html",
"product_code":"mrs",
"code":"673",
"des":"If I access a parquet table on which I do not have permission, why a job is run before \"Missing Privileges\" is displayed?The execution sequence of Spark SQL statement par",
"doc_type":"cmpntguide",
"kw":"If I Access a parquet Table on Which I Do not Have Permission, Why a Job Is Run Before \"Missing Priv",
"title":"If I Access a parquet Table on Which I Do not Have Permission, Why a Job Is Run Before \"Missing Privileges\" Is Displayed?",
"githuburl":""
},
{
"uri":"mrs_01_2036.html",
"product_code":"mrs",
"code":"674",
"des":"When do I fail to modify the metadata in the datasource and Spark on HBase table by running the Hive command?The current Spark version does not support modifying the meta",
"doc_type":"cmpntguide",
"kw":"Why Do I Fail to Modify MetaData by Running the Hive Command?,Spark SQL and DataFrame,Component Oper",
"title":"Why Do I Fail to Modify MetaData by Running the Hive Command?",
"githuburl":""
},
{
"uri":"mrs_01_2037.html",
"product_code":"mrs",
"code":"675",
"des":"After successfully running Spark tasks with large data volume, for example, 2-TB TPCDS test suite, why is the abnormal stack information \"RejectedExecutionException\" disp",
"doc_type":"cmpntguide",
"kw":"Why Is \"RejectedExecutionException\" Displayed When I Exit Spark SQL?,Spark SQL and DataFrame,Compone",
"title":"Why Is \"RejectedExecutionException\" Displayed When I Exit Spark SQL?",
"githuburl":""
},
{
"uri":"mrs_01_2038.html",
"product_code":"mrs",
"code":"676",
"des":"During a health check, if the concurrent statements exceed the threshold of the thread pool, the health check statements fail to be executed, the health check program tim",
"doc_type":"cmpntguide",
"kw":"What Should I Do If the JDBCServer Process is Mistakenly Killed During a Health Check?,Spark SQL and",
"title":"What Should I Do If the JDBCServer Process is Mistakenly Killed During a Health Check?",
"githuburl":""
},
{
"uri":"mrs_01_2039.html",
"product_code":"mrs",
"code":"677",
"des":"Why no result is found when 2016-6-30 is set in the date field as the filter condition?As shown in the following figure, trx_dte_par in the select count (*) from trxfintr",
"doc_type":"cmpntguide",
"kw":"Why No Result Is found When 2016-6-30 Is Set in the Date Field as the Filter Condition?,Spark SQL an",
"title":"Why No Result Is found When 2016-6-30 Is Set in the Date Field as the Filter Condition?",
"githuburl":""
},
{
"uri":"mrs_01_2040.html",
"product_code":"mrs",
"code":"678",
"des":"Why does the --hivevaroption I specified in the command for starting spark-beeline fail to take effect?In the V100R002C60 version, if I use the --hivevar <VAR_NAME>=<var_",
"doc_type":"cmpntguide",
"kw":"Why Does the \"--hivevar\" Option I Specified in the Command for Starting spark-beeline Fail to Take E",
"title":"Why Does the \"--hivevar\" Option I Specified in the Command for Starting spark-beeline Fail to Take Effect?",
"githuburl":""
},
{
"uri":"mrs_01_2041.html",
"product_code":"mrs",
"code":"679",
"des":"In normal mode, when I create a temporary table or view in spark-beeline, the error message \"Permission denied\" is displayed, indicating that I have no permissions on the",
"doc_type":"cmpntguide",
"kw":"Why Does the \"Permission denied\" Exception Occur When I Create a Temporary Table or View in Spark-be",
"title":"Why Does the \"Permission denied\" Exception Occur When I Create a Temporary Table or View in Spark-beeline?",
"githuburl":""
},
{
"uri":"mrs_01_2042.html",
"product_code":"mrs",
"code":"680",
"des":"When I run a complex SQL statement, for example, SQL statements with multiple layers of nesting statements and a single layer statement contains a large number of logic c",
"doc_type":"cmpntguide",
"kw":"Why Is the \"Code of method ... grows beyond 64 KB\" Error Message Displayed When I Run Complex SQL St",
"title":"Why Is the \"Code of method ... grows beyond 64 KB\" Error Message Displayed When I Run Complex SQL Statements?",
"githuburl":""
},
{
"uri":"mrs_01_2043.html",
"product_code":"mrs",
"code":"681",
"des":"When the driver memory is set to 10 GB and the 10 TB TPCDS test suites are continuously run in Beeline/JDBCServer mode, SQL statements fail to be executed due to insuffic",
"doc_type":"cmpntguide",
"kw":"Why Is Memory Insufficient if 10 Terabytes of TPCDS Test Suites Are Consecutively Run in Beeline/JDB",
"title":"Why Is Memory Insufficient if 10 Terabytes of TPCDS Test Suites Are Consecutively Run in Beeline/JDBCServer Mode?",
"githuburl":""
},
{
"uri":"mrs_01_2044.html",
"product_code":"mrs",
"code":"682",
"des":"Scenario 1I set up permanent functions using the add jar statement. After Beeline connects to different JDBCServer or  JDBCServer is restarted, I have to run the add jar ",
"doc_type":"cmpntguide",
"kw":"Why Are Some Functions Not Available when Another JDBCServer Is Connected?,Spark SQL and DataFrame,C",
"title":"Why Are Some Functions Not Available when Another JDBCServer Is Connected?",
"githuburl":""
},
{
"uri":"mrs_01_2046.html",
"product_code":"mrs",
"code":"683",
"des":"When Spark2x accesses the DataSource table created by Spark1.5, a message is displayed indicating that schema information cannot be obtained. As a result, the table canno",
"doc_type":"cmpntguide",
"kw":"Why Does Spark2x Have No Access to DataSource Tables Created by Spark1.5?,Spark SQL and DataFrame,Co",
"title":"Why Does Spark2x Have No Access to DataSource Tables Created by Spark1.5?",
"githuburl":""
},
{
"uri":"mrs_01_2047.html",
"product_code":"mrs",
"code":"684",
"des":"Why does \"Failed to create ThriftService instance\" occur when spark beeline fails to run?Beeline logs are as follows:In addition, the \"Timed out waiting for client to con",
"doc_type":"cmpntguide",
"kw":"Why Does Spark-beeline Fail to Run and Error Message \"Failed to create ThriftService instance\" Is Di",
"title":"Why Does Spark-beeline Fail to Run and Error Message \"Failed to create ThriftService instance\" Is Displayed?",
"githuburl":""
},
{
"uri":"mrs_01_24491.html",
"product_code":"",
"code":"685",
"des":"Why cannot I query newly inserted data in an ORC Hive table using Spark SQL? This problem occurs in the following scenarios:For partitioned tables and non-partitioned tab",
"doc_type":"",
"kw":"Why Cannot I Query Newly Inserted Data in an ORC Hive Table Using Spark SQL?,Spark SQL and DataFrame",
"title":"Why Cannot I Query Newly Inserted Data in an ORC Hive Table Using Spark SQL?",
"githuburl":""
},
{
"uri":"mrs_01_2048.html",
"product_code":"mrs",
"code":"686",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Spark Streaming",
"title":"Spark Streaming",
"githuburl":""
},
{
"uri":"mrs_01_2050.html",
"product_code":"mrs",
"code":"687",
"des":"After a Spark Streaming task is run and data is input, no processing result is displayed. Open the web page to view the Spark job execution status. The following figure s",
"doc_type":"cmpntguide",
"kw":"What Can I Do If Spark Streaming Tasks Are Blocked?,Spark Streaming,Component Operation Guide (Norma",
"title":"What Can I Do If Spark Streaming Tasks Are Blocked?",
"githuburl":""
},
{
"uri":"mrs_01_2051.html",
"product_code":"mrs",
"code":"688",
"des":"When Spark Streaming tasks are running, the data processing performance does not improve significantly as the number of executors increases. What should I pay attention t",
"doc_type":"cmpntguide",
"kw":"What Should I Pay Attention to When Optimizing Spark Streaming Task Parameters?,Spark Streaming,Comp",
"title":"What Should I Pay Attention to When Optimizing Spark Streaming Task Parameters?",
"githuburl":""
},
{
"uri":"mrs_01_2052.html",
"product_code":"mrs",
"code":"689",
"des":"Change the validity period of the Kerberos ticket and HDFS token to 5 minutes, set dfs.namenode.delegation.token.renew-interval to a value less than 60 seconds, and submi",
"doc_type":"cmpntguide",
"kw":"Why Does the Spark Streaming Application Fail to Be Submitted After the Token Validity Period Expire",
"title":"Why Does the Spark Streaming Application Fail to Be Submitted After the Token Validity Period Expires?",
"githuburl":""
},
{
"uri":"mrs_01_2053.html",
"product_code":"mrs",
"code":"690",
"des":"Spark Streaming application creates one input stream without output logic. The application fails to restart from checkpoint and an error will be shown like below:When Str",
"doc_type":"cmpntguide",
"kw":"Why does Spark Streaming Application Fail to Restart from Checkpoint When It Creates an Input Stream",
"title":"Why does Spark Streaming Application Fail to Restart from Checkpoint When It Creates an Input Stream Without Output Logic?",
"githuburl":""
},
{
"uri":"mrs_01_2054.html",
"product_code":"mrs",
"code":"691",
"des":"When the Kafka is restarted during the execution of the Spark Streaming application, the application cannot obtain the topic offset from the Kafka. As a result, the job f",
"doc_type":"cmpntguide",
"kw":"Why Is the Input Size Corresponding to Batch Time on the Web UI Set to 0 Records When Kafka Is Resta",
"title":"Why Is the Input Size Corresponding to Batch Time on the Web UI Set to 0 Records When Kafka Is Restarted During Spark Streaming Running?",
"githuburl":""
},
{
"uri":"mrs_01_2055.html",
"product_code":"mrs",
"code":"692",
"des":"The job information obtained from the restful interface of an ended Spark application is incorrect: the value of numActiveTasks is negative, as shown in Figure 1:numActiv",
"doc_type":"cmpntguide",
"kw":"Why the Job Information Obtained from the restful Interface of an Ended Spark Application Is Incorre",
"title":"Why the Job Information Obtained from the restful Interface of an Ended Spark Application Is Incorrect?",
"githuburl":""
},
{
"uri":"mrs_01_2056.html",
"product_code":"mrs",
"code":"693",
"des":"In FusionInsight, the Spark application is run in yarn-client mode on the client. The following error occurs during the switch from the Yarn web UI to the application web",
"doc_type":"cmpntguide",
"kw":"Why Cannot I Switch from the Yarn Web UI to the Spark Web UI?,Common Issues About Spark2x,Component ",
"title":"Why Cannot I Switch from the Yarn Web UI to the Spark Web UI?",
"githuburl":""
},
{
"uri":"mrs_01_2057.html",
"product_code":"mrs",
"code":"694",
"des":"An error occurs when I access a Spark application page on the HistoryServer page.Check the HistoryServer logs. The \"FileNotFound\" exception is found. The related logs are",
"doc_type":"cmpntguide",
"kw":"What Can I Do If an Error Occurs when I Access the Application Page Because the Application Cached b",
"title":"What Can I Do If an Error Occurs when I Access the Application Page Because the Application Cached by HistoryServer Is Recycled?",
"githuburl":""
},
{
"uri":"mrs_01_2058.html",
"product_code":"mrs",
"code":"695",
"des":"When I run an application with an empty part file in HDFS with the log grouping function enabled, why is not the application displayed on the homepage of JobHistory?On th",
"doc_type":"cmpntguide",
"kw":"Why Is not an Application Displayed When I Run the Application with the Empty Part File?,Common Issu",
"title":"Why Is not an Application Displayed When I Run the Application with the Empty Part File?",
"githuburl":""
},
{
"uri":"mrs_01_2059.html",
"product_code":"mrs",
"code":"696",
"des":"The following code fails to be executed on spark-shell of Spark2x:In Spark2x, the duplicate field name of the join statement is checked. You need to modify the code to en",
"doc_type":"cmpntguide",
"kw":"Why Does Spark2x Fail to Export a Table with the Same Field Name?,Common Issues About Spark2x,Compon",
"title":"Why Does Spark2x Fail to Export a Table with the Same Field Name?",
"githuburl":""
},
{
"uri":"mrs_01_2060.html",
"product_code":"mrs",
"code":"697",
"des":"Why JRE fatal error after running Spark application multiple times?When you run Spark application multiple times, JRE fatal error occurs and this is due to the problem wi",
"doc_type":"cmpntguide",
"kw":"Why JRE fatal error after running Spark application multiple times?,Common Issues About Spark2x,Comp",
"title":"Why JRE fatal error after running Spark application multiple times?",
"githuburl":""
},
{
"uri":"mrs_01_2061.html",
"product_code":"mrs",
"code":"698",
"des":"Occasionally, Internet Explorer 9, Explorer 10, or Explorer 11 fails to access the native Spark2x UI.Internet Explorer 9, Explorer 10, or Explorer 11 fails to access the ",
"doc_type":"cmpntguide",
"kw":"\"This page can't be displayed\" Is Displayed When Internet Explorer Fails to Access the Native Spark2",
"title":"\"This page can't be displayed\" Is Displayed When Internet Explorer Fails to Access the Native Spark2x UI",
"githuburl":""
},
{
"uri":"mrs_01_2062.html",
"product_code":"mrs",
"code":"699",
"des":"There are two clusters, cluster 1 and cluster 2. How do I use Spark2x in cluster 1 to access HDFS, Hive, HBase, and Kafka components in cluster 2?Components in two cluste",
"doc_type":"cmpntguide",
"kw":"How Does Spark2x Access External Cluster Components?,Common Issues About Spark2x,Component Operation",
"title":"How Does Spark2x Access External Cluster Components?",
"githuburl":""
},
{
"uri":"mrs_01_2063.html",
"product_code":"mrs",
"code":"700",
"des":"Assume there is a data file path named /test_data_path. User A creates a foreign table named tableA for the directory, and user B creates a foreign table named tableB for",
"doc_type":"cmpntguide",
"kw":"Why Does the Foreign Table Query Fail When Multiple Foreign Tables Are Created in the Same Directory",
"title":"Why Does the Foreign Table Query Fail When Multiple Foreign Tables Are Created in the Same Directory?",
"githuburl":""
},
{
"uri":"mrs_01_2064.html",
"product_code":"mrs",
"code":"701",
"des":"After a Spark application that contains a job with millions of tasks. After the application creation is complete, if you access the native page of the application in JobH",
"doc_type":"cmpntguide",
"kw":"What Should I Do If the Native Page of an Application of Spark2x JobHistory Fails to Display During ",
"title":"What Should I Do If the Native Page of an Application of Spark2x JobHistory Fails to Display During Access to the Page",
"githuburl":""
},
{
"uri":"mrs_01_2340.html",
"product_code":"mrs",
"code":"702",
"des":"When the OBS ECS/BMS image cluster is connected, after spark-beeline is logged in, an error is reported when a location is specified to create a table on OBS.The permissi",
"doc_type":"cmpntguide",
"kw":"Why Do I Fail to Create a Table in the Specified Location on OBS After Logging to spark-beeline?,Com",
"title":"Why Do I Fail to Create a Table in the Specified Location on OBS After Logging to spark-beeline?",
"githuburl":""
},
{
"uri":"mrs_01_24176.html",
"product_code":"mrs",
"code":"703",
"des":"In some scenarios, the following exception occurs in the Spark shuffle phase:For JDBC:Log in to FusionInsight Manager, change the value of the JDBCServer parameter spark.",
"doc_type":"cmpntguide",
"kw":"Spark Shuffle Exception Handling,Common Issues About Spark2x,Component Operation Guide (Normal)",
"title":"Spark Shuffle Exception Handling",
"githuburl":""
},
{
"uri":"mrs_01_24453.html",
"product_code":"mrs",
"code":"704",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Sqoop",
"title":"Using Sqoop",
"githuburl":""
},
{
"uri":"mrs_01_24454.html",
"product_code":"mrs",
"code":"705",
"des":"Sqoop is an open-source tool for transferring data between Hadoop (Hive) and traditional databases (such as MySQL and PostgreSQL). It can transfer data from a relational ",
"doc_type":"cmpntguide",
"kw":"Using Sqoop from Scratch,Using Sqoop,Component Operation Guide (Normal)",
"title":"Using Sqoop from Scratch",
"githuburl":""
},
{
"uri":"mrs_01_24455.html",
"product_code":"mrs",
"code":"706",
"des":"Sqoop is a tool designed for efficiently transmitting a large amount of data between Apache Hadoop and structured databases (such as relational databases). Customers need",
"doc_type":"cmpntguide",
"kw":"Adapting Sqoop 1.4.7 to MRS 3.x Clusters,Using Sqoop,Component Operation Guide (Normal)",
"title":"Adapting Sqoop 1.4.7 to MRS 3.x Clusters",
"githuburl":""
},
{
"uri":"mrs_01_24456.html",
"product_code":"mrs",
"code":"707",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Common Sqoop Commands and Parameters,Using Sqoop,Component Operation Guide (Normal)",
"title":"Common Sqoop Commands and Parameters",
"githuburl":""
},
{
"uri":"mrs_01_24457.html",
"product_code":"mrs",
"code":"708",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Common Issues About Sqoop",
"title":"Common Issues About Sqoop",
"githuburl":""
},
{
"uri":"mrs_01_24458.html",
"product_code":"mrs",
"code":"709",
"des":"What should I do if the QueryProvider class is unavailable?Search for the MRS client directory and save the following JAR packages to the lib directory of Sqoop.",
"doc_type":"cmpntguide",
"kw":"What Should I Do If Class QueryProvider Is Unavailable?,Common Issues About Sqoop,Component Operatio",
"title":"What Should I Do If Class QueryProvider Is Unavailable?",
"githuburl":""
},
{
"uri":"mrs_01_24460.html",
"product_code":"",
"code":"710",
"des":"Scenario 1: (import scenarios) Run the sqoop import command to extract the open source PostgreSQL to MRS HDFS or Hive.SymptomThe sqoop command can be executed to query Po",
"doc_type":"",
"kw":"How Do I Do If PostgreSQL or GaussDB Fails to Connect?,Common Issues About Sqoop,Component Operation",
"title":"How Do I Do If PostgreSQL or GaussDB Fails to Connect?",
"githuburl":""
},
{
"uri":"mrs_01_24461.html",
"product_code":"",
"code":"711",
"des":"What should I do if data failed to be synchronized to a Hive table on the OBS using hive-table?Change -hive-table to -hcatalog-table.",
"doc_type":"",
"kw":"What Should I Do If Data Failed to Be Synchronized to a Hive Table on the OBS Using hive-table?,Comm",
"title":"What Should I Do If Data Failed to Be Synchronized to a Hive Table on the OBS Using hive-table?",
"githuburl":""
},
{
"uri":"mrs_01_24462.html",
"product_code":"",
"code":"712",
"des":"What should I do if data failed to be synchronized to the ORC or parquet table using hive-table and error message that contains the kite-sdk package name is displayed?Cha",
"doc_type":"",
"kw":"What Should I Do If Data Failed to Be Synchronized to an ORC or Parquet Table Using hive-table?,Comm",
"title":"What Should I Do If Data Failed to Be Synchronized to an ORC or Parquet Table Using hive-table?",
"githuburl":""
},
{
"uri":"mrs_01_24463.html",
"product_code":"",
"code":"713",
"des":"What should I do if data failed to be synchronized using hive-table?Add the following content to the hive-site.xml file.",
"doc_type":"",
"kw":"What Should I Do If Data Failed to Be Synchronized Using hive-table?,Common Issues About Sqoop,Compo",
"title":"What Should I Do If Data Failed to Be Synchronized Using hive-table?",
"githuburl":""
},
{
"uri":"mrs_01_24464.html",
"product_code":"",
"code":"714",
"des":"When the partition fields in a Hive parquet table are not of the string type, data in the table can be synchronized only using HCatalog. What should I do if the following",
"doc_type":"",
"kw":"What Should I Do If Data Failed to Be Synchronized to a Hive Parquet Table Using HCatalog?,Common Is",
"title":"What Should I Do If Data Failed to Be Synchronized to a Hive Parquet Table Using HCatalog?",
"githuburl":""
},
{
"uri":"mrs_01_24465.html",
"product_code":"",
"code":"715",
"des":"What should I do if the data type of fields timestamp and data is incorrect during data synchronization between Hive and MySQL?Forcibly convert the data type of the times",
"doc_type":"",
"kw":"What Should I Do If the Data Type of Fields timestamp and data Is Incorrect During Data Synchronizat",
"title":"What Should I Do If the Data Type of Fields timestamp and data Is Incorrect During Data Synchronization Between Hive and MySQL?",
"githuburl":""
},
{
"uri":"mrs_01_0380.html",
"product_code":"mrs",
"code":"716",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Storm",
"title":"Using Storm",
"githuburl":""
},
{
"uri":"mrs_01_1045.html",
"product_code":"mrs",
"code":"717",
"des":"You can submit and delete Storm topologies on the MRS cluster client.The MRS cluster client has been installed, for example, in the /opt/hadoopclient directory. The clien",
"doc_type":"cmpntguide",
"kw":"Using Storm from Scratch,Using Storm,Component Operation Guide (Normal)",
"title":"Using Storm from Scratch",
"githuburl":""
},
{
"uri":"mrs_01_2065.html",
"product_code":"mrs",
"code":"718",
"des":"This section describes how to use the Storm client in an O&M scenario or service scenario.You have installed the client. For example, the installation directory is /opt/h",
"doc_type":"cmpntguide",
"kw":"Using the Storm Client,Using Storm,Component Operation Guide (Normal)",
"title":"Using the Storm Client",
"githuburl":""
},
{
"uri":"mrs_01_0381.html",
"product_code":"mrs",
"code":"719",
"des":"You can submit Storm topologies on the cluster client to continuously process stream data. For clusters with Kerberos authentication enabled, users who submit topologies ",
"doc_type":"cmpntguide",
"kw":"Submitting Storm Topologies on the Client,Using Storm,Component Operation Guide (Normal)",
"title":"Submitting Storm Topologies on the Client",
"githuburl":""
},
{
"uri":"mrs_01_0382.html",
"product_code":"mrs",
"code":"720",
"des":"The Storm web UI provides a graphical interface for using Storm.The following information can be queried on the Storm web UI:Storm cluster summaryNimbus summaryTopology s",
"doc_type":"cmpntguide",
"kw":"Accessing the Storm Web UI,Using Storm,Component Operation Guide (Normal)",
"title":"Accessing the Storm Web UI",
"githuburl":""
},
{
"uri":"mrs_01_0383.html",
"product_code":"mrs",
"code":"721",
"des":"You can manage Storm topologies on the Storm web UI. Users in the storm group can manage only the topology tasks submitted by themselves, while users in the stormadmin gr",
"doc_type":"cmpntguide",
"kw":"Managing Storm Topologies,Using Storm,Component Operation Guide (Normal)",
"title":"Managing Storm Topologies",
"githuburl":""
},
{
"uri":"mrs_01_0384.html",
"product_code":"mrs",
"code":"722",
"des":"You can query topology logs to check the execution of a Storm topology in a worker process. To query the data processing logs of a topology, enable the Debug function whe",
"doc_type":"cmpntguide",
"kw":"Querying Storm Topology Logs,Using Storm,Component Operation Guide (Normal)",
"title":"Querying Storm Topology Logs",
"githuburl":""
},
{
"uri":"mrs_01_1046.html",
"product_code":"mrs",
"code":"723",
"des":"This section applies to MRS 3.x or later.For details about how to set parameters, see Modifying Cluster Service Configuration Parameters.",
"doc_type":"cmpntguide",
"kw":"Storm Common Parameters,Using Storm,Component Operation Guide (Normal)",
"title":"Storm Common Parameters",
"githuburl":""
},
{
"uri":"mrs_01_1047.html",
"product_code":"mrs",
"code":"724",
"des":"This section applies to MRS 3.x or later.After submitting a topology task, a Storm service user must ensure that the task continuously runs. During topology running, the ",
"doc_type":"cmpntguide",
"kw":"Configuring a Storm Service User Password Policy,Using Storm,Component Operation Guide (Normal)",
"title":"Configuring a Storm Service User Password Policy",
"githuburl":""
},
{
"uri":"mrs_01_1048.html",
"product_code":"mrs",
"code":"725",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Migrating Storm Services to Flink",
"title":"Migrating Storm Services to Flink",
"githuburl":""
},
{
"uri":"mrs_01_1049.html",
"product_code":"mrs",
"code":"726",
"des":"This section applies to MRS 3.x or later.From 0.10.0, Flink provides a set of APIs to smoothly migrate services compiled using Storm APIs to the Flink platform. This can ",
"doc_type":"cmpntguide",
"kw":"Overview,Migrating Storm Services to Flink,Component Operation Guide (Normal)",
"title":"Overview",
"githuburl":""
},
{
"uri":"mrs_01_1050.html",
"product_code":"mrs",
"code":"727",
"des":"This section describes how to convert and run a complete Storm topology developed using Storm API.<dependency>\n <groupId>org.apache.flink</groupId>\n <artifactId>fli",
"doc_type":"cmpntguide",
"kw":"Completely Migrating Storm Services,Migrating Storm Services to Flink,Component Operation Guide (Nor",
"title":"Completely Migrating Storm Services",
"githuburl":""
},
{
"uri":"mrs_01_1051.html",
"product_code":"mrs",
"code":"728",
"des":"This section describes how to embed Storm code in DataStream of Flink in embedded migration mode. For example, the code of Spout or Bolt compiled using Storm API is embed",
"doc_type":"cmpntguide",
"kw":"Performing Embedded Service Migration,Migrating Storm Services to Flink,Component Operation Guide (N",
"title":"Performing Embedded Service Migration",
"githuburl":""
},
{
"uri":"mrs_01_1052.html",
"product_code":"mrs",
"code":"729",
"des":"If the Storm services use the storm-hdfs or storm-hbase plug-in package for interconnection, you need to specify the following security parameters when migrating Storm se",
"doc_type":"cmpntguide",
"kw":"Migrating Services of External Security Components Interconnected with Storm,Migrating Storm Service",
"title":"Migrating Services of External Security Components Interconnected with Storm",
"githuburl":""
},
{
"uri":"mrs_01_1053.html",
"product_code":"mrs",
"code":"730",
"des":"This section applies to MRS 3.x or later.Log paths: The default paths of Storm log files are /var/log/Bigdata/storm/Role name (run logs) and /var/log/Bigdata/audit/storm/",
"doc_type":"cmpntguide",
"kw":"Storm Log Introduction,Using Storm,Component Operation Guide (Normal)",
"title":"Storm Log Introduction",
"githuburl":""
},
{
"uri":"mrs_01_1054.html",
"product_code":"mrs",
"code":"731",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Performance Tuning",
"title":"Performance Tuning",
"githuburl":""
},
{
"uri":"mrs_01_1055.html",
"product_code":"mrs",
"code":"732",
"des":"You can modify Storm parameters to improve Storm performance in specific service scenarios.This section applies to MRS 3.x or later.Modify the service configuration param",
"doc_type":"cmpntguide",
"kw":"Storm Performance Tuning,Performance Tuning,Component Operation Guide (Normal)",
"title":"Storm Performance Tuning",
"githuburl":""
},
{
"uri":"mrs_01_2067.html",
"product_code":"mrs",
"code":"733",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Tez",
"title":"Using Tez",
"githuburl":""
},
{
"uri":"mrs_01_2068.html",
"product_code":"mrs",
"code":"734",
"des":"This section applies to MRS 3.x or later clusters.",
"doc_type":"cmpntguide",
"kw":"Precautions,Using Tez,Component Operation Guide (Normal)",
"title":"Precautions",
"githuburl":""
},
{
"uri":"mrs_01_2069.html",
"product_code":"mrs",
"code":"735",
"des":"On Manager, choose Cluster > Service > Tez > Configuration > All Configurations. Enter a parameter name in the search box.",
"doc_type":"cmpntguide",
"kw":"Common Tez Parameters,Using Tez,Component Operation Guide (Normal)",
"title":"Common Tez Parameters",
"githuburl":""
},
{
"uri":"mrs_01_2070.html",
"product_code":"mrs",
"code":"736",
"des":"Tez displays the Tez task execution process on a GUI. You can view the task execution details on the GUI.The TimelineServer instance of the Yarn service has been installe",
"doc_type":"cmpntguide",
"kw":"Accessing TezUI,Using Tez,Component Operation Guide (Normal)",
"title":"Accessing TezUI",
"githuburl":""
},
{
"uri":"mrs_01_2071.html",
"product_code":"mrs",
"code":"737",
"des":"Log path: The default save path of Tez logs is /var/log/Bigdata/tez/role name.TezUI: /var/log/Bigdata/tez/tezui (run logs) and /var/log/Bigdata/audit/tez/tezui (audit log",
"doc_type":"cmpntguide",
"kw":"Log Overview,Using Tez,Component Operation Guide (Normal)",
"title":"Log Overview",
"githuburl":""
},
{
"uri":"mrs_01_2072.html",
"product_code":"mrs",
"code":"738",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Common Issues",
"title":"Common Issues",
"githuburl":""
},
{
"uri":"mrs_01_2073.html",
"product_code":"mrs",
"code":"739",
"des":"After a user logs in to Manager and switches to the Tez web UI, the submitted Tez tasks are not displayed.The Tez task data displayed on the Tez WebUI requires the suppor",
"doc_type":"cmpntguide",
"kw":"TezUI Cannot Display Tez Task Execution Details,Common Issues,Component Operation Guide (Normal)",
"title":"TezUI Cannot Display Tez Task Execution Details",
"githuburl":""
},
{
"uri":"mrs_01_2074.html",
"product_code":"mrs",
"code":"740",
"des":"When a user logs in to Manager and switches to the Tez web UI, error 404 or 503 is displayed.The Tez web UI depends on the TimelineServer instance of Yarn. Therefore, Tim",
"doc_type":"cmpntguide",
"kw":"Error Occurs When a User Switches to the Tez Web UI,Common Issues,Component Operation Guide (Normal)",
"title":"Error Occurs When a User Switches to the Tez Web UI",
"githuburl":""
},
{
"uri":"mrs_01_2075.html",
"product_code":"mrs",
"code":"741",
"des":"A user logs in to the Tez web UI and clicks Logs, but the Yarn log page fails to be displayed and data cannot be loaded.Currently, the hostname is used for the access to ",
"doc_type":"cmpntguide",
"kw":"Yarn Logs Cannot Be Viewed on the TezUI Page,Common Issues,Component Operation Guide (Normal)",
"title":"Yarn Logs Cannot Be Viewed on the TezUI Page",
"githuburl":""
},
{
"uri":"mrs_01_2076.html",
"product_code":"mrs",
"code":"742",
"des":"A user logs in to Manager and switches to the Tez web UI page, but no data for the submitted task is displayed on the Hive Queries page.To display task data on the Hive Q",
"doc_type":"cmpntguide",
"kw":"Table Data Is Empty on the TezUI HiveQueries Page,Common Issues,Component Operation Guide (Normal)",
"title":"Table Data Is Empty on the TezUI HiveQueries Page",
"githuburl":""
},
{
"uri":"mrs_01_0851.html",
"product_code":"mrs",
"code":"743",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using Yarn",
"title":"Using Yarn",
"githuburl":""
},
{
"uri":"mrs_01_0852.html",
"product_code":"mrs",
"code":"744",
"des":"The Yarn service provides queues for users. Users allocate system resources to each queue. After the configuration is complete, you can click Refresh Queue or restart the",
"doc_type":"cmpntguide",
"kw":"Common YARN Parameters,Using Yarn,Component Operation Guide (Normal)",
"title":"Common YARN Parameters",
"githuburl":""
},
{
"uri":"mrs_01_0853.html",
"product_code":"mrs",
"code":"745",
"des":"This section describes how to create and configure a Yarn role. The Yarn role can be assigned with Yarn administrator permission and manage Yarn queue resources.If the cu",
"doc_type":"cmpntguide",
"kw":"Creating Yarn Roles,Using Yarn,Component Operation Guide (Normal)",
"title":"Creating Yarn Roles",
"githuburl":""
},
{
"uri":"mrs_01_0854.html",
"product_code":"mrs",
"code":"746",
"des":"This section guides users to use a Yarn client in an O&M or service scenario.The client has been installed.For example, the installation directory is /opt/hadoopclient. T",
"doc_type":"cmpntguide",
"kw":"Using the YARN Client,Using Yarn,Component Operation Guide (Normal)",
"title":"Using the YARN Client",
"githuburl":""
},
{
"uri":"mrs_01_0855.html",
"product_code":"mrs",
"code":"747",
"des":"If the hardware resources (such as the number of CPU cores and memory size) of the nodes for deploying NodeManagers are different but the NodeManager available hardware r",
"doc_type":"cmpntguide",
"kw":"Configuring Resources for a NodeManager Role Instance,Using Yarn,Component Operation Guide (Normal)",
"title":"Configuring Resources for a NodeManager Role Instance",
"githuburl":""
},
{
"uri":"mrs_01_0856.html",
"product_code":"mrs",
"code":"748",
"des":"If the storage directories defined by the Yarn NodeManager are incorrect or the Yarn storage plan changes, the system administrator needs to modify the NodeManager storag",
"doc_type":"cmpntguide",
"kw":"Changing NodeManager Storage Directories,Using Yarn,Component Operation Guide (Normal)",
"title":"Changing NodeManager Storage Directories",
"githuburl":""
},
{
"uri":"mrs_01_0857.html",
"product_code":"mrs",
"code":"749",
"des":"In the multi-tenant scenario in security mode, a cluster can be used by multiple users, and tasks of multiple users can be submitted and executed. Users are invisible to ",
"doc_type":"cmpntguide",
"kw":"Configuring Strict Permission Control for Yarn,Using Yarn,Component Operation Guide (Normal)",
"title":"Configuring Strict Permission Control for Yarn",
"githuburl":""
},
{
"uri":"mrs_01_0858.html",
"product_code":"mrs",
"code":"750",
"des":"Yarn provides the container log aggregation function to collect logs generated by containers on each node to HDFS to release local disk space. You can collect logs in eit",
"doc_type":"cmpntguide",
"kw":"Configuring Container Log Aggregation,Using Yarn,Component Operation Guide (Normal)",
"title":"Configuring Container Log Aggregation",
"githuburl":""
},
{
"uri":"mrs_01_0859.html",
"product_code":"mrs",
"code":"751",
"des":"This section applies to MRS 3.x or later clusters.CGroups is a Linux kernel feature. In YARN this feature allows containers to be limited in their resource usage (example",
"doc_type":"cmpntguide",
"kw":"Using CGroups with YARN,Using Yarn,Component Operation Guide (Normal)",
"title":"Using CGroups with YARN",
"githuburl":""
},
{
"uri":"mrs_01_0860.html",
"product_code":"mrs",
"code":"752",
"des":"When resources are insufficient or ApplicationMaster fails to start, a client probably encounters running errors.Go to the All Configurations page of Yarn and enter a par",
"doc_type":"cmpntguide",
"kw":"Configuring the Number of ApplicationMaster Retries,Using Yarn,Component Operation Guide (Normal)",
"title":"Configuring the Number of ApplicationMaster Retries",
"githuburl":""
},
{
"uri":"mrs_01_0861.html",
"product_code":"mrs",
"code":"753",
"des":"This section applies to clusters of MRS 3.x or later.During the process of starting the configuration, when the ApplicationMaster creates a container, the allocated memor",
"doc_type":"cmpntguide",
"kw":"Configure the ApplicationMaster to Automatically Adjust the Allocated Memory,Using Yarn,Component Op",
"title":"Configure the ApplicationMaster to Automatically Adjust the Allocated Memory",
"githuburl":""
},
{
"uri":"mrs_01_0862.html",
"product_code":"mrs",
"code":"754",
"des":"The value of the yarn.http.policy parameter must be consistent on both the server and clients. Web UIs on clients will be garbled if an inconsistency exists, for example,",
"doc_type":"cmpntguide",
"kw":"Configuring the Access Channel Protocol,Using Yarn,Component Operation Guide (Normal)",
"title":"Configuring the Access Channel Protocol",
"githuburl":""
},
{
"uri":"mrs_01_0863.html",
"product_code":"mrs",
"code":"755",
"des":"If memory usage of the submitted application cannot be estimated, you can modify the configuration on the server to determine whether to check the memory usage.If the mem",
"doc_type":"cmpntguide",
"kw":"Configuring Memory Usage Detection,Using Yarn,Component Operation Guide (Normal)",
"title":"Configuring Memory Usage Detection",
"githuburl":""
},
{
"uri":"mrs_01_0864.html",
"product_code":"mrs",
"code":"756",
"des":"If the custom scheduler is set in ResourceManager, you can set the corresponding web page and other Web applications for the custom scheduler.Go to the All Configurations",
"doc_type":"cmpntguide",
"kw":"Configuring the Additional Scheduler WebUI,Using Yarn,Component Operation Guide (Normal)",
"title":"Configuring the Additional Scheduler WebUI",
"githuburl":""
},
{
"uri":"mrs_01_0865.html",
"product_code":"mrs",
"code":"757",
"des":"The Yarn Restart feature includes ResourceManager Restart and NodeManager Restart.When ResourceManager Restart is enabled, the new active ResourceManager node loads the i",
"doc_type":"cmpntguide",
"kw":"Configuring Yarn Restart,Using Yarn,Component Operation Guide (Normal)",
"title":"Configuring Yarn Restart",
"githuburl":""
},
{
"uri":"mrs_01_0866.html",
"product_code":"mrs",
"code":"758",
"des":"This section applies to clusters of MRS 3.x or later.In YARN, ApplicationMasters run on NodeManagers just like every other container (ignoring unmanaged ApplicationMaster",
"doc_type":"cmpntguide",
"kw":"Configuring ApplicationMaster Work Preserving,Using Yarn,Component Operation Guide (Normal)",
"title":"Configuring ApplicationMaster Work Preserving",
"githuburl":""
},
{
"uri":"mrs_01_0867.html",
"product_code":"mrs",
"code":"759",
"des":"This section applies to clusters of MRS 3.x or later.The default log level of localized container is INFO. You can change the log level by configuring yarn.nodemanager.co",
"doc_type":"cmpntguide",
"kw":"Configuring the Localized Log Levels,Using Yarn,Component Operation Guide (Normal)",
"title":"Configuring the Localized Log Levels",
"githuburl":""
},
{
"uri":"mrs_01_0868.html",
"product_code":"mrs",
"code":"760",
"des":"This section applies to clusters of MRS 3.x or later.Currently, YARN allows the user that starts the NodeManager to run the task submitted by all other users, or the user",
"doc_type":"cmpntguide",
"kw":"Configuring Users That Run Tasks,Using Yarn,Component Operation Guide (Normal)",
"title":"Configuring Users That Run Tasks",
"githuburl":""
},
{
"uri":"mrs_01_0870.html",
"product_code":"mrs",
"code":"761",
"des":"The default paths for saving Yarn logs are as follows:ResourceManager: /var/log/Bigdata/yarn/rm (run logs) and /var/log/Bigdata/audit/yarn/rm (audit logs)NodeManager: /va",
"doc_type":"cmpntguide",
"kw":"Yarn Log Overview,Using Yarn,Component Operation Guide (Normal)",
"title":"Yarn Log Overview",
"githuburl":""
},
{
"uri":"mrs_01_0871.html",
"product_code":"mrs",
"code":"762",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Yarn Performance Tuning",
"title":"Yarn Performance Tuning",
"githuburl":""
},
{
"uri":"mrs_01_0872.html",
"product_code":"mrs",
"code":"763",
"des":"The capacity scheduler of ResourceManager implements job preemption to simplify job running in queues and improve resource utilization. The process is as follows:Assume t",
"doc_type":"cmpntguide",
"kw":"Preempting a Task,Yarn Performance Tuning,Component Operation Guide (Normal)",
"title":"Preempting a Task",
"githuburl":""
},
{
"uri":"mrs_01_0873.html",
"product_code":"mrs",
"code":"764",
"des":"The resource contention scenarios of a cluster are as follows:Submit two jobs (Job 1 and Job 2) with lower priorities.Some tasks of running Job 1 and Job 2 are in the run",
"doc_type":"cmpntguide",
"kw":"Setting the Task Priority,Yarn Performance Tuning,Component Operation Guide (Normal)",
"title":"Setting the Task Priority",
"githuburl":""
},
{
"uri":"mrs_01_0874.html",
"product_code":"mrs",
"code":"765",
"des":"After the scheduler of a big data cluster is properly configured, you can adjust the available memory, CPU resources, and local disk of each node to optimize the performa",
"doc_type":"cmpntguide",
"kw":"Optimizing Node Configuration,Yarn Performance Tuning,Component Operation Guide (Normal)",
"title":"Optimizing Node Configuration",
"githuburl":""
},
{
"uri":"mrs_01_2077.html",
"product_code":"mrs",
"code":"766",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Common Issues About Yarn",
"title":"Common Issues About Yarn",
"githuburl":""
},
{
"uri":"mrs_01_2078.html",
"product_code":"mrs",
"code":"767",
"des":"Why mounted directory for Container is not cleared after the completion of the job while using CGroups?The mounted path for the Container should be cleared even if job is",
"doc_type":"cmpntguide",
"kw":"Why Mounted Directory for Container is Not Cleared After the Completion of the Job While Using CGrou",
"title":"Why Mounted Directory for Container is Not Cleared After the Completion of the Job While Using CGroups?",
"githuburl":""
},
{
"uri":"mrs_01_2079.html",
"product_code":"mrs",
"code":"768",
"des":"Why is the HDFS_DELEGATION_TOKEN expired exception reported when a job fails in security mode?HDFS_DELEGATION_TOKEN expires because the token is not updated or it is acce",
"doc_type":"cmpntguide",
"kw":"Why the Job Fails with HDFS_DELEGATION_TOKEN Expired Exception?,Common Issues About Yarn,Component O",
"title":"Why the Job Fails with HDFS_DELEGATION_TOKEN Expired Exception?",
"githuburl":""
},
{
"uri":"mrs_01_2080.html",
"product_code":"mrs",
"code":"769",
"des":"If Yarn is restarted in either of the following scenarios, local logs will not be deleted as scheduled and will be retained permanently:When Yarn is restarted during task",
"doc_type":"cmpntguide",
"kw":"Why Are Local Logs Not Deleted After YARN Is Restarted?,Common Issues About Yarn,Component Operation",
"title":"Why Are Local Logs Not Deleted After YARN Is Restarted?",
"githuburl":""
},
{
"uri":"mrs_01_2081.html",
"product_code":"mrs",
"code":"770",
"des":"Why the task does not fail even though AppAttempts restarts due to failure for more than two times?During the task execution process, if the ContainerExitStatus returns v",
"doc_type":"cmpntguide",
"kw":"Why the Task Does Not Fail Even Though AppAttempts Restarts for More Than Two Times?,Common Issues A",
"title":"Why the Task Does Not Fail Even Though AppAttempts Restarts for More Than Two Times?",
"githuburl":""
},
{
"uri":"mrs_01_2082.html",
"product_code":"mrs",
"code":"771",
"des":"After I moved an application from one queue to another, why is it moved back to the original queue after ResourceManager restarts?This problem is caused by the constraint",
"doc_type":"cmpntguide",
"kw":"Why Is an Application Moved Back to the Original Queue After ResourceManager Restarts?,Common Issues",
"title":"Why Is an Application Moved Back to the Original Queue After ResourceManager Restarts?",
"githuburl":""
},
{
"uri":"mrs_01_2083.html",
"product_code":"mrs",
"code":"772",
"des":"Why does Yarn not release the blacklist even all nodes are added to the blacklist?In Yarn, when the number of application nodes added to the blacklist by ApplicationMaste",
"doc_type":"cmpntguide",
"kw":"Why Does Yarn Not Release the Blacklist Even All Nodes Are Added to the Blacklist?,Common Issues Abo",
"title":"Why Does Yarn Not Release the Blacklist Even All Nodes Are Added to the Blacklist?",
"githuburl":""
},
{
"uri":"mrs_01_2084.html",
"product_code":"mrs",
"code":"773",
"des":"The switchover of ResourceManager occurs continuously when multiple, for example 2,000, tasks are running concurrently, causing the Yarn service unavailable.The cause is ",
"doc_type":"cmpntguide",
"kw":"Why Does the Switchover of ResourceManager Occur Continuously?,Common Issues About Yarn,Component Op",
"title":"Why Does the Switchover of ResourceManager Occur Continuously?",
"githuburl":""
},
{
"uri":"mrs_01_2085.html",
"product_code":"mrs",
"code":"774",
"des":"Why does a new application fail if a NodeManager has been in unhealthy status for 10 minutes?When nodeSelectPolicy is set to SEQUENCE and the first NodeManager connected ",
"doc_type":"cmpntguide",
"kw":"Why Does a New Application Fail If a NodeManager Has Been in Unhealthy Status for 10 Minutes?,Common",
"title":"Why Does a New Application Fail If a NodeManager Has Been in Unhealthy Status for 10 Minutes?",
"githuburl":""
},
{
"uri":"mrs_01_2087.html",
"product_code":"mrs",
"code":"775",
"des":"Why does an error occur when I query the applicationID of a completed or non-existing application using the RESTful APIs?The Superior scheduler only stores the applicatio",
"doc_type":"cmpntguide",
"kw":"Why Does an Error Occur When I Query the ApplicationID of a Completed or Non-existing Application Us",
"title":"Why Does an Error Occur When I Query the ApplicationID of a Completed or Non-existing Application Using the RESTful APIs?",
"githuburl":""
},
{
"uri":"mrs_01_2088.html",
"product_code":"mrs",
"code":"776",
"des":"In Superior scheduling mode, if a single NodeManager is faulty, why may the MapReduce tasks fail?In normal cases, when the attempt of a single task of an application fail",
"doc_type":"cmpntguide",
"kw":"Why May A Single NodeManager Fault Cause MapReduce Task Failures in the Superior Scheduling Mode?,Co",
"title":"Why May A Single NodeManager Fault Cause MapReduce Task Failures in the Superior Scheduling Mode?",
"githuburl":""
},
{
"uri":"mrs_01_2089.html",
"product_code":"mrs",
"code":"777",
"des":"When a queue is deleted when there are applications running in it, these applications are moved to the \"lost_and_found\" queue. When these applications are moved back to a",
"doc_type":"cmpntguide",
"kw":"Why Are Applications Suspended After They Are Moved From Lost_and_Found Queue to Another Queue?,Comm",
"title":"Why Are Applications Suspended After They Are Moved From Lost_and_Found Queue to Another Queue?",
"githuburl":""
},
{
"uri":"mrs_01_2090.html",
"product_code":"mrs",
"code":"778",
"des":"How do I limit the size of application diagnostic messages stored in the ZKstore?In some cases, it has been observed that diagnostic messages may grow infinitely. Because",
"doc_type":"cmpntguide",
"kw":"How Do I Limit the Size of Application Diagnostic Messages Stored in the ZKstore?,Common Issues Abou",
"title":"How Do I Limit the Size of Application Diagnostic Messages Stored in the ZKstore?",
"githuburl":""
},
{
"uri":"mrs_01_2091.html",
"product_code":"mrs",
"code":"779",
"des":"Why does a MapReduce job fail to run when a non-ViewFS file system is configured as ViewFS?When a non-ViewFS file system is configured as a ViewFS using cluster, the user",
"doc_type":"cmpntguide",
"kw":"Why Does a MapReduce Job Fail to Run When a Non-ViewFS File System Is Configured as ViewFS?,Common I",
"title":"Why Does a MapReduce Job Fail to Run When a Non-ViewFS File System Is Configured as ViewFS?",
"githuburl":""
},
{
"uri":"mrs_01_24051.html",
"product_code":"mrs",
"code":"780",
"des":"After the Native Task feature is enabled, Reduce tasks fail to run in some OSs.When -Dmapreduce.job.map.output.collector.class=org.apache.hadoop.mapred.nativetask.NativeM",
"doc_type":"cmpntguide",
"kw":"Why Do Reduce Tasks Fail to Run in Some OSs After the Native Task Feature is Enabled?,Common Issues ",
"title":"Why Do Reduce Tasks Fail to Run in Some OSs After the Native Task Feature is Enabled?",
"githuburl":""
},
{
"uri":"mrs_01_2092.html",
"product_code":"mrs",
"code":"781",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using ZooKeeper",
"title":"Using ZooKeeper",
"githuburl":""
},
{
"uri":"mrs_01_2093.html",
"product_code":"mrs",
"code":"782",
"des":"ZooKeeper is an open-source, highly reliable, and distributed consistency coordination service. ZooKeeper is designed to solve the problem that data consistency cannot be",
"doc_type":"cmpntguide",
"kw":"Using ZooKeeper from Scratch,Using ZooKeeper,Component Operation Guide (Normal)",
"title":"Using ZooKeeper from Scratch",
"githuburl":""
},
{
"uri":"mrs_01_2094.html",
"product_code":"mrs",
"code":"783",
"des":"Navigation path for setting parameters:Go to the All Configurations page of ZooKeeper by referring to Modifying Cluster Service Configuration Parameters. Enter a paramete",
"doc_type":"cmpntguide",
"kw":"Common ZooKeeper Parameters,Using ZooKeeper,Component Operation Guide (Normal)",
"title":"Common ZooKeeper Parameters",
"githuburl":""
},
{
"uri":"mrs_01_2095.html",
"product_code":"mrs",
"code":"784",
"des":"Use a ZooKeeper client in an O&M scenario or service scenario.You have installed the client. For example, the installation directory is /opt/client. The client directory ",
"doc_type":"cmpntguide",
"kw":"Using a ZooKeeper Client,Using ZooKeeper,Component Operation Guide (Normal)",
"title":"Using a ZooKeeper Client",
"githuburl":""
},
{
"uri":"mrs_01_2097.html",
"product_code":"mrs",
"code":"785",
"des":"Configure znode permission of ZooKeeper.ZooKeeper uses an access control list (ACL) to implement znode access control. The ZooKeeper client specifies a znode ACL, and the",
"doc_type":"cmpntguide",
"kw":"Configuring the ZooKeeper Permissions,Using ZooKeeper,Component Operation Guide (Normal)",
"title":"Configuring the ZooKeeper Permissions",
"githuburl":""
},
{
"uri":"mrs_01_2106.html",
"product_code":"mrs",
"code":"786",
"des":"Log path: /var/log/Bigdata/zookeeper/quorumpeer (Run log), /var/log/Bigdata/audit/zookeeper/quorumpeer (Audit log)Log archive rule: The automatic ZooKeeper log compressio",
"doc_type":"cmpntguide",
"kw":"ZooKeeper Log Overview,Using ZooKeeper,Component Operation Guide (Normal)",
"title":"ZooKeeper Log Overview",
"githuburl":""
},
{
"uri":"mrs_01_2107.html",
"product_code":"mrs",
"code":"787",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Common Issues About ZooKeeper",
"title":"Common Issues About ZooKeeper",
"githuburl":""
},
{
"uri":"mrs_01_2108.html",
"product_code":"mrs",
"code":"788",
"des":"After a large number of znodes are created, ZooKeeper servers in the ZooKeeper cluster become faulty and cannot be automatically recovered or restarted.Logs of followers:",
"doc_type":"cmpntguide",
"kw":"Why Do ZooKeeper Servers Fail to Start After Many znodes Are Created?,Common Issues About ZooKeeper,",
"title":"Why Do ZooKeeper Servers Fail to Start After Many znodes Are Created?",
"githuburl":""
},
{
"uri":"mrs_01_2109.html",
"product_code":"mrs",
"code":"789",
"des":"After a large number of znodes are created in a parent directory, the ZooKeeper client will fail to fetch all child nodes of this parent directory in a single request.Log",
"doc_type":"cmpntguide",
"kw":"Why Does the ZooKeeper Server Display the java.io.IOException: Len Error Log?,Common Issues About Zo",
"title":"Why Does the ZooKeeper Server Display the java.io.IOException: Len Error Log?",
"githuburl":""
},
{
"uri":"mrs_01_2110.html",
"product_code":"mrs",
"code":"790",
"des":"Why four letter commands do not work with linux netcat command when secure netty configurations are enabled at Zookeeper server?For example,echo stat |netcat host portLin",
"doc_type":"cmpntguide",
"kw":"Why Four Letter Commands Don't Work With Linux netcat Command When Secure Netty Configurations Are E",
"title":"Why Four Letter Commands Don't Work With Linux netcat Command When Secure Netty Configurations Are Enabled at Zookeeper Server?",
"githuburl":""
},
{
"uri":"mrs_01_2111.html",
"product_code":"mrs",
"code":"791",
"des":"How to check whether the role of a ZooKeeper instance is a leader or follower.Log in to Manager and choose Cluster > Name of the desired cluster > Service > ZooKeeper > I",
"doc_type":"cmpntguide",
"kw":"How Do I Check Which ZooKeeper Instance Is a Leader?,Common Issues About ZooKeeper,Component Operati",
"title":"How Do I Check Which ZooKeeper Instance Is a Leader?",
"githuburl":""
},
{
"uri":"mrs_01_2112.html",
"product_code":"mrs",
"code":"792",
"des":"When the IBM JDK is used, the client fails to connect to ZooKeeper.The possible cause is that the jaas.conf file format of the IBM JDK is different from that of the commo",
"doc_type":"cmpntguide",
"kw":"Why Cannot the Client Connect to ZooKeeper using the IBM JDK?,Common Issues About ZooKeeper,Componen",
"title":"Why Cannot the Client Connect to ZooKeeper using the IBM JDK?",
"githuburl":""
},
{
"uri":"mrs_01_2113.html",
"product_code":"mrs",
"code":"793",
"des":"The ZooKeeper client fails to refresh a TGT and therefore ZooKeeper cannot be accessed. The error message is as follows:ZooKeeper uses the system command kinit – R to ref",
"doc_type":"cmpntguide",
"kw":"What Should I Do When the ZooKeeper Client Fails to Refresh a TGT?,Common Issues About ZooKeeper,Com",
"title":"What Should I Do When the ZooKeeper Client Fails to Refresh a TGT?",
"githuburl":""
},
{
"uri":"mrs_01_2114.html",
"product_code":"mrs",
"code":"794",
"des":"When the client connects to a non-leader instance, run the deleteall command to delete a large number of znodes, the error message \"Node does not exist\" is displayed, but",
"doc_type":"cmpntguide",
"kw":"Why Is Message \"Node does not exist\" Displayed when A Large Number of Znodes Are Deleted Using the d",
"title":"Why Is Message \"Node does not exist\" Displayed when A Large Number of Znodes Are Deleted Using the deleteallCommand",
"githuburl":""
},
{
"uri":"mrs_01_2122.html",
"product_code":"mrs",
"code":"795",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Appendix",
"title":"Appendix",
"githuburl":""
},
{
"uri":"mrs_01_2125.html",
"product_code":"mrs",
"code":"796",
"des":"For MRS 1.9.2 or later: You can modify service configuration parameters on the cluster management page of the MRS management console.Log in to the MRS console. In the lef",
"doc_type":"cmpntguide",
"kw":"Modifying Cluster Service Configuration Parameters,Appendix,Component Operation Guide (Normal)",
"title":"Modifying Cluster Service Configuration Parameters",
"githuburl":""
},
{
"uri":"mrs_01_2123.html",
"product_code":"mrs",
"code":"797",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Accessing Manager",
"title":"Accessing Manager",
"githuburl":""
},
{
"uri":"mrs_01_0102.html",
"product_code":"mrs",
"code":"798",
"des":"Clusters of versions earlier than MRS 3.x use MRS Manager to monitor, configure, and manage clusters. You can open the MRS Manager page on the MRS console.If you have bou",
"doc_type":"cmpntguide",
"kw":"Accessing MRS Manager (Versions Earlier Than MRS 3.x),Accessing Manager,Component Operation Guide (N",
"title":"Accessing MRS Manager (Versions Earlier Than MRS 3.x)",
"githuburl":""
},
{
"uri":"mrs_01_2124.html",
"product_code":"mrs",
"code":"799",
"des":"In MRS 3.x or later, FusionInsight Manager is used to monitor, configure, and manage clusters. After the cluster is installed, you can use the account to log in to Fusion",
"doc_type":"cmpntguide",
"kw":"Accessing FusionInsight Manager (MRS 3.x or Later),Accessing Manager,Component Operation Guide (Norm",
"title":"Accessing FusionInsight Manager (MRS 3.x or Later)",
"githuburl":""
},
{
"uri":"mrs_01_2126.html",
"product_code":"mrs",
"code":"800",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"cmpntguide",
"kw":"Using an MRS Client",
"title":"Using an MRS Client",
"githuburl":""
},
{
"uri":"mrs_01_2127.html",
"product_code":"mrs",
"code":"801",
"des":"This section describes how to install clients of all services (excluding Flume) in an MRS cluster. For details about how to install the Flume client, see Installing the F",
"doc_type":"cmpntguide",
"kw":"Installing a Client (Version 3.x or Later),Using an MRS Client,Component Operation Guide (Normal)",
"title":"Installing a Client (Version 3.x or Later)",
"githuburl":""
},
{
"uri":"mrs_01_2128.html",
"product_code":"mrs",
"code":"802",
"des":"An MRS client is required. The MRS cluster client can be installed on the Master or Core node in the cluster or on a node outside the cluster.After a cluster of versions ",
"doc_type":"cmpntguide",
"kw":"Installing a Client (Versions Earlier Than 3.x),Using an MRS Client,Component Operation Guide (Norma",
"title":"Installing a Client (Versions Earlier Than 3.x)",
"githuburl":""
},
{
"uri":"mrs_01_2129.html",
"product_code":"mrs",
"code":"803",
"des":"A cluster provides a client for you to connect to a server, view task results, or manage data. If you modify service configuration parameters on Manager and restart the s",
"doc_type":"cmpntguide",
"kw":"Updating a Client (Version 3.x or Later),Using an MRS Client,Component Operation Guide (Normal)",
"title":"Updating a Client (Version 3.x or Later)",
"githuburl":""
},
{
"uri":"mrs_01_2130.html",
"product_code":"mrs",
"code":"804",
"des":"This section applies to clusters of versions earlier than MRS 3.x. For MRS 3.x or later, see Updating a Client (Version 3.x or Later).ScenarioAn MRS cluster provides a cl",
"doc_type":"cmpntguide",
"kw":"Updating a Client (Versions Earlier Than 3.x),Using an MRS Client,Component Operation Guide (Normal)",
"title":"Updating a Client (Versions Earlier Than 3.x)",
"githuburl":""
},
{
"uri":"en-us_topic_0000001351362309.html",
"product_code":"",
"code":"805",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"",
"kw":"Change History,Component Operation Guide (Normal)",
"title":"Change History",
"githuburl":""
}
]
View Git Blame Copy Permalink