diff --git a/doc/component-operation-guide-lts/source/change_history.rst b/doc/component-operation-guide-lts/source/change_history.rst index 94c4a98..b52bb7c 100644 --- a/doc/component-operation-guide-lts/source/change_history.rst +++ b/doc/component-operation-guide-lts/source/change_history.rst @@ -1,58 +1,63 @@ -:original_name: en-us_topic_0000001298722056.html +:original_name: mrs_01_17512.html -.. _en-us_topic_0000001298722056: +.. _mrs_01_17512: Change History ============== -+-----------------------------------+-----------------------------------------------------------------------------------------------------+ -| Released On | What's New | -+===================================+=====================================================================================================+ -| 2023-05-04 | Modified the feature documentation of MRS 3.2.0-LTS.1. | -| | | -| | - Added the following content: | -| | | -| | - :ref:`Using CDL ` | -| | - :ref:`Enabling the Read-Only Mode of the ClickHouse Table ` | -| | - :ref:`Configuring the Password of the Default Account of a ClickHouse Cluster ` | -| | - :ref:`ClickHouse Multi-Tenancy ` | -| | - :ref:`Synchronizing Kafka Data to ClickHouse ` | -| | - :ref:`Using the Migration Tool to Quickly Migrate ClickHouse Cluster Data ` | -| | - :ref:`ClickHouse Performance Tuning ` | -| | - :ref:`ClickHouse FAQ ` | -| | - :ref:`Importing and Exporting Jobs ` | -| | - :ref:`Flink Restart Policy ` | -| | - :ref:`Closing HDFS Files ` | -| | - :ref:`Configuring an IoTDB Data Source ` | -| | - :ref:`Using HetuEngine Materialized Views ` | -| | - :ref:`Using HetuEngine SQL Diagnosis ` | -| | - :ref:`Locating Abnormal Hive Files ` | -| | - :ref:`Data Import and Export in Hive ` | -| | - :ref:`Clustering Configuration ` | -| | - :ref:`ARCHIVELOG ` | -| | - :ref:`CLEAN ` | -| | - :ref:`CALL COMMAND ` | -| | - :ref:`Hudi Schema Evolution ` | -| | - :ref:`Using IoTDB ` | -| | - :ref:`Migrating Data Between Kafka Nodes ` | -| | - :ref:`Configuring Intranet and Extranet Access for Kafka ` | -| | - :ref:`Purging Historical Loader Data ` | -| | - :ref:`Adding a Ranger Access Permission Policy for CDL ` | -| | - :ref:`Configuring Ranger Specifications ` | -| | - :ref:`Configuring the Drop Partition Command to Support Batch Deletion ` | -| | - :ref:`Enabling an Executor to Execute Custom Code When Exiting ` | -| | | -| | - Modified the following content: | -| | | -| | - :ref:`Configuring the Password of the Default Account of a ClickHouse Cluster ` | -| | - :ref:`Interconnecting FlinkServer with ClickHouse ` | -| | - :ref:`Interconnecting FlinkServer with Hudi ` | -| | - :ref:`Introduction to Flume Logs ` | -| | - :ref:`Configuring Encrypted Channels ` | -| | - :ref:`Using DBeaver to Access HetuEngine ` | -| | - :ref:`Hive Supporting Transactions ` | -| | - :ref:`Stream Write ` | -| | - :ref:`Introduction to Kafka Logs ` | -+-----------------------------------+-----------------------------------------------------------------------------------------------------+ -| 2022-11-01 | This issue is the first official release. | -+-----------------------------------+-----------------------------------------------------------------------------------------------------+ ++-----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +| Released On | What's New | ++===================================+=====================================================================================================================================================================================================================================================================================================================================================+ +| 2023-11-01 | - Deleted the description of some parameters that are not applicable to Flink. For details, see :ref:`JobManager & TaskManager `. | +| | - Modified the description of the digital display identifier in the Ranger anonymization policy. For details, see :ref:`Adding a Ranger Access Permission Policy for Hive `, :ref:`Adding a Ranger Access Permission Policy for Spark2x `, :ref:`Adding a Ranger Access Permission Policy for HetuEngine `. | +| | - Deleted related content because Hive materialized views are no longer recommended. | +| | - The titles of some sections are optimized to avoid repeated content in the sections where components are not connected. | ++-----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +| 2023-05-04 | Modified the feature documentation of MRS 3.2.0-LTS.1. | +| | | +| | - Added the following content: | +| | | +| | - :ref:`Using CDL ` | +| | - :ref:`Enabling the Read-Only Mode of the ClickHouse Table ` | +| | - :ref:`Configuring the Password of the Default Account of a ClickHouse Cluster ` | +| | - :ref:`ClickHouse Multi-Tenancy ` | +| | - :ref:`Synchronizing Kafka Data to ClickHouse ` | +| | - :ref:`Using the Migration Tool to Quickly Migrate ClickHouse Cluster Data ` | +| | - :ref:`ClickHouse Performance Tuning ` | +| | - :ref:`ClickHouse FAQ ` | +| | - :ref:`Importing and Exporting Jobs ` | +| | - :ref:`Flink Restart Policy ` | +| | - :ref:`Closing HDFS Files ` | +| | - :ref:`Configuring an IoTDB Data Source ` | +| | - :ref:`Using HetuEngine Materialized Views ` | +| | - :ref:`Using HetuEngine SQL Diagnosis ` | +| | - :ref:`Locating Abnormal Hive Files ` | +| | - :ref:`Data Import and Export in Hive ` | +| | - :ref:`Clustering Configuration ` | +| | - :ref:`ARCHIVELOG ` | +| | - :ref:`CLEAN ` | +| | - :ref:`CALL COMMAND ` | +| | - :ref:`Hudi Schema Evolution ` | +| | - :ref:`Using IoTDB ` | +| | - :ref:`Migrating Data Between Kafka Nodes ` | +| | - :ref:`Configuring Intranet and Extranet Access for Kafka ` | +| | - :ref:`Purging Historical Loader Data ` | +| | - :ref:`Adding a Ranger Access Permission Policy for CDL ` | +| | - :ref:`Configuring Ranger Specifications ` | +| | - :ref:`Configuring the Drop Partition Command to Support Batch Deletion ` | +| | - :ref:`Enabling an Executor to Execute Custom Code When Exiting ` | +| | | +| | - Modified the following content: | +| | | +| | - :ref:`Configuring the Password of the Default Account of a ClickHouse Cluster(for MRS 3.1.2) ` | +| | - :ref:`Interconnecting FlinkServer with ClickHouse ` | +| | - :ref:`Interconnecting FlinkServer with Hudi ` | +| | - :ref:`Introduction to Flume Logs ` | +| | - :ref:`Configuring Encrypted Channels ` | +| | - :ref:`Using DBeaver to Access HetuEngine ` | +| | - :ref:`Hive Supporting Transactions ` | +| | - :ref:`Stream Write ` | +| | - :ref:`Introduction to Kafka Logs ` | ++-----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +| 2022-11-01 | This issue is the first official release. | ++-----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ diff --git a/doc/component-operation-guide-lts/source/using_carbondata/index.rst b/doc/component-operation-guide-lts/source/using_carbondata/index.rst index 0950137..e49f39f 100644 --- a/doc/component-operation-guide-lts/source/using_carbondata/index.rst +++ b/doc/component-operation-guide-lts/source/using_carbondata/index.rst @@ -5,7 +5,7 @@ Using CarbonData ================ -- :ref:`Overview ` +- :ref:`Spark CarbonData Overview ` - :ref:`Configuration Reference ` - :ref:`CarbonData Operation Guide ` - :ref:`CarbonData Performance Tuning ` @@ -18,7 +18,7 @@ Using CarbonData :maxdepth: 1 :hidden: - overview/index + spark_carbondata_overview/index configuration_reference carbondata_operation_guide/index carbondata_performance_tuning/index diff --git a/doc/component-operation-guide-lts/source/using_carbondata/overview/carbondata_overview.rst b/doc/component-operation-guide-lts/source/using_carbondata/spark_carbondata_overview/carbondata_overview.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_carbondata/overview/carbondata_overview.rst rename to doc/component-operation-guide-lts/source/using_carbondata/spark_carbondata_overview/carbondata_overview.rst diff --git a/doc/component-operation-guide-lts/source/using_carbondata/overview/index.rst b/doc/component-operation-guide-lts/source/using_carbondata/spark_carbondata_overview/index.rst similarity index 83% rename from doc/component-operation-guide-lts/source/using_carbondata/overview/index.rst rename to doc/component-operation-guide-lts/source/using_carbondata/spark_carbondata_overview/index.rst index e0cc8c5..ac6c97b 100644 --- a/doc/component-operation-guide-lts/source/using_carbondata/overview/index.rst +++ b/doc/component-operation-guide-lts/source/using_carbondata/spark_carbondata_overview/index.rst @@ -2,8 +2,8 @@ .. _mrs_01_1401: -Overview -======== +Spark CarbonData Overview +========================= - :ref:`CarbonData Overview ` - :ref:`Main Specifications of CarbonData ` diff --git a/doc/component-operation-guide-lts/source/using_carbondata/overview/main_specifications_of_carbondata.rst b/doc/component-operation-guide-lts/source/using_carbondata/spark_carbondata_overview/main_specifications_of_carbondata.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_carbondata/overview/main_specifications_of_carbondata.rst rename to doc/component-operation-guide-lts/source/using_carbondata/spark_carbondata_overview/main_specifications_of_carbondata.rst diff --git a/doc/component-operation-guide-lts/source/using_clickhouse/clickhouse_multi-tenancy/overview.rst b/doc/component-operation-guide-lts/source/using_clickhouse/clickhouse_multi-tenancy/clickhouse_multi-tenancy_overview.rst similarity index 98% rename from doc/component-operation-guide-lts/source/using_clickhouse/clickhouse_multi-tenancy/overview.rst rename to doc/component-operation-guide-lts/source/using_clickhouse/clickhouse_multi-tenancy/clickhouse_multi-tenancy_overview.rst index fa8d813..87b770c 100644 --- a/doc/component-operation-guide-lts/source/using_clickhouse/clickhouse_multi-tenancy/overview.rst +++ b/doc/component-operation-guide-lts/source/using_clickhouse/clickhouse_multi-tenancy/clickhouse_multi-tenancy_overview.rst @@ -2,8 +2,8 @@ .. _mrs_01_24790: -Overview -======== +ClickHouse Multi-Tenancy Overview +================================= .. note:: diff --git a/doc/component-operation-guide-lts/source/using_clickhouse/clickhouse_multi-tenancy/index.rst b/doc/component-operation-guide-lts/source/using_clickhouse/clickhouse_multi-tenancy/index.rst index 6bde09e..e35f9ed 100644 --- a/doc/component-operation-guide-lts/source/using_clickhouse/clickhouse_multi-tenancy/index.rst +++ b/doc/component-operation-guide-lts/source/using_clickhouse/clickhouse_multi-tenancy/index.rst @@ -5,7 +5,7 @@ ClickHouse Multi-Tenancy ======================== -- :ref:`Overview ` +- :ref:`ClickHouse Multi-Tenancy Overview ` - :ref:`Enabling the CPU Priority Feature ` - :ref:`Managing ClickHouse Tenants ` - :ref:`Modifying the Memory Limit of ClickHouse on a ClickHouseServer Node ` @@ -14,7 +14,7 @@ ClickHouse Multi-Tenancy :maxdepth: 1 :hidden: - overview + clickhouse_multi-tenancy_overview enabling_the_cpu_priority_feature managing_clickhouse_tenants modifying_the_memory_limit_of_clickhouse_on_a_clickhouseserver_node diff --git a/doc/component-operation-guide-lts/source/using_clickhouse/user_management_and_authentication/configuring_the_password_of_the_default_account_of_a_clickhouse_cluster.rst b/doc/component-operation-guide-lts/source/using_clickhouse/user_management_and_authentication/configuring_the_password_of_the_default_account_of_a_clickhouse_cluster.rst index 0ae9dee..4a1f6fc 100644 --- a/doc/component-operation-guide-lts/source/using_clickhouse/user_management_and_authentication/configuring_the_password_of_the_default_account_of_a_clickhouse_cluster.rst +++ b/doc/component-operation-guide-lts/source/using_clickhouse/user_management_and_authentication/configuring_the_password_of_the_default_account_of_a_clickhouse_cluster.rst @@ -1,45 +1,118 @@ -:original_name: mrs_01_2395.html +:original_name: mrs_01_24575.html -.. _mrs_01_2395: +.. _mrs_01_24575: Configuring the Password of the Default Account of a ClickHouse Cluster ======================================================================= -After a ClickHouse cluster is created, you can use the ClickHouse client to connect to the ClickHouse server. The default username is **default**. +After a ClickHouse cluster is created, you can use the ClickHouse client to connect to the ClickHouse server. -This section describes how to set ClickHouse username and password after a ClickHouse cluster is successfully created. +Configure the passwords of the default accounts **default** and **clickhouse** of a ClickHouse cluster. .. note:: - - This section applies to MRS 3.1.2. - - **default** is the default internal user of ClickHouse. It is an administrator user available only in normal mode (kerberos authentication disabled). + - This section applies to MRS 3.2.0 or later. + - **default** and **clickhouse** is the default internal administrator of a ClickHouse cluster in normal mode (with Kerberos authentication disabled). -Setting the ClickHouse Username and Password --------------------------------------------- -#. Log in to Manager and choose **Cluster** > **Services** > **ClickHouse**. Click the **Configurations** tab and then **All Configurations**. +Configuring the Password of the Default Account of a ClickHouse Cluster +----------------------------------------------------------------------- -#. Search for the **users.default.password** parameter in the search box and change its password, as shown in :ref:`Figure 1 `. +#. Install the ClickHouse client. - .. _mrs_01_2395__fig42238424419: +#. Log in to the ClickHouse client node as user **root**, go to *Client installation directory*\ **/ClickHouse/clickhouse/config**, and check whether the **metrika.xml** file contains information about all ClickHouseServer nodes. If information of any nodes is missing, add it. - .. figure:: /_static/images/en-us_image_0000001296059672.png - :alt: **Figure 1** Changing the default user password + For example, there are four ClickHouseServer nodes: **192-168-43-125**, **192-168-43-165**, **192-168-43-175**, and **192-168-43-249**. - **Figure 1** Changing the default user password + .. code-block:: -#. Log in to the node where the client is installed and run the following command to switch to the client installation directory. + + true + + 192-168-43-125 + 21423 + clickhouse + + + + 192-168-43-165 + 21423 + clickhouse + + + + + true + + 192-168-43-175 + 21423 + clickhouse + + + + 192-168-43-249 + 21423 + clickhouse + + + - **cd**\ *Cluster client installation directory* +#. Go to *Client installation directory*\ **/ClickHouse/clickhouse/config** and check whether the values of **CLICKHOUSE_CONF_DIR** and **CLICKHOUSE_INSTALL_HOME** in the **clickhouse-env.sh** file is **$BIGDATA_HOME/FusionInsight_ClickHouse_xxx/*_ClickHouseServer/etc** and **$BIGDATA_HOME/FusionInsight_ClickHouse_xxx/install/FusionInsight-ClickHouse-*-lts/**, respectively. -#. Run the following command to configure environment variables: + |image1| - **source bigdata_env** +#. Switch to user **omm** and go to the *Client installation directory*\ **/ClickHouse/clickhouse_change_password** directory. -#. Log in to ClickHouse using the new password. + **su - omm** - **clickhouse client --host** *IP address of the ClickHouse instance* **--user** *default* **--password** *xxx* + **cd** *Client installation directory*\ **/ClickHouse/clickhouse_change_password** + +#. Run the following command to change the password of the **default** or **clickhouse** user: + + **./change_password.sh** + + In the following figure, user **clickhouse** is used as an example. Enter **clickhouse** and its password as prompted, and wait until the password is changed. + + |image2| .. note:: - To obtain the service IP address of the ClickHouse instance, choose **Components** > **ClickHouse** > **Instances** on the cluster details page. + The password complexity requirements are as follows: + + - The password contains 8 to 64 characters. + - The password must contain at least one lowercase letter, one uppercase letter, one digit, and one special character, and the following special characters are supported: ``-%;[]{}@_`` + +#. Check the password change result. + + a. Run the following commands to check the value of **CLICKHOUSE_CONF_DIR** in the *Client installation directory*\ **/ClickHouse/clickhouse/config/clickhouse-env.sh** file: + + **cd** *Client installation directory*\ **/ClickHouse/clickhouse/config/** + + **vi clickhouse-env.sh** + + The following is an example: + + .. code-block:: + + LICKHOUSE_CONF_DIR="${BIGDATA_HOME}/FusionInsight_ClickHouse_*/*_ClickHouseServer/etc" + CLICKHOUSE_SECURITY_ENABLED="true" + CLICKHOUSE_BALANCER_LIST="192.168.42.14,192.168.67.89" + CLICKHOUSE_STARTUP_PRINCIPAL="clickhouse/hadoop.hadoop.com@HADOOP.COM" + USER_REALM="HADOOP.COM" + OM_DECOMMISSION_HOSTNAME_LIST="" + CLICKHOUSE_INSTALL_HOME="${BIGDATA_HOME}/FusionInsight_ClickHouse_8.2.0/install/FusionInsight-ClickHouse-v22.3.2.2-lts" + CK_BALANCER_LIST="server-2110081635-0003,server-2110082001-0019" + + b. Log in to the ClickHouse Server node and check the value of **password_sha256_hex** in the **${BIGDATA_HOME}/FusionInsight_ClickHouse_*/*_ClickHouseServer/etc/users.xml** file. The value is the new password. + + **cd ${BIGDATA_HOME}/**\ ``FusionInsight_ClickHouse_*``\ **/**\ ``*_ClickHouseServer``\ **/etc/** + + **vi** **users.xml** + + As shown in the following figure, the new password is stored in the **password_sha256_hex** file. + + |image3| + +.. |image1| image:: /_static/images/en-us_image_0000001583316949.png +.. |image2| image:: /_static/images/en-us_image_0000001532677010.png +.. |image3| image:: /_static/images/en-us_image_0000001583436657.png diff --git a/doc/component-operation-guide-lts/source/using_clickhouse/user_management_and_authentication/configuring_the_password_of_the_default_account_of_a_clickhouse_clusterfor_mrs_3.1.2.rst b/doc/component-operation-guide-lts/source/using_clickhouse/user_management_and_authentication/configuring_the_password_of_the_default_account_of_a_clickhouse_clusterfor_mrs_3.1.2.rst new file mode 100644 index 0000000..355aa5a --- /dev/null +++ b/doc/component-operation-guide-lts/source/using_clickhouse/user_management_and_authentication/configuring_the_password_of_the_default_account_of_a_clickhouse_clusterfor_mrs_3.1.2.rst @@ -0,0 +1,45 @@ +:original_name: mrs_01_2395.html + +.. _mrs_01_2395: + +Configuring the Password of the Default Account of a ClickHouse Cluster(for MRS 3.1.2) +====================================================================================== + +After a ClickHouse cluster is created, you can use the ClickHouse client to connect to the ClickHouse server. The default username is **default**. + +This section describes how to set ClickHouse username and password after a ClickHouse cluster is successfully created. + +.. note:: + + - This section applies to MRS 3.1.2. + - **default** is the default internal user of ClickHouse. It is an administrator user available only in normal mode (kerberos authentication disabled). + +Setting the ClickHouse Username and Password +-------------------------------------------- + +#. Log in to Manager and choose **Cluster** > **Services** > **ClickHouse**. Click the **Configurations** tab and then **All Configurations**. + +#. Search for the **users.default.password** parameter in the search box and change its password, as shown in :ref:`Figure 1 `. + + .. _mrs_01_2395__fig42238424419: + + .. figure:: /_static/images/en-us_image_0000001296059672.png + :alt: **Figure 1** Changing the default user password + + **Figure 1** Changing the default user password + +#. Log in to the node where the client is installed and run the following command to switch to the client installation directory. + + **cd**\ *Cluster client installation directory* + +#. Run the following command to configure environment variables: + + **source bigdata_env** + +#. Log in to ClickHouse using the new password. + + **clickhouse client --host** *IP address of the ClickHouse instance* **--user** *default* **--password** *xxx* + + .. note:: + + To obtain the service IP address of the ClickHouse instance, choose **Components** > **ClickHouse** > **Instances** on the cluster details page. diff --git a/doc/component-operation-guide-lts/source/using_clickhouse/user_management_and_authentication/index.rst b/doc/component-operation-guide-lts/source/using_clickhouse/user_management_and_authentication/index.rst index 6942681..1cb84ec 100644 --- a/doc/component-operation-guide-lts/source/using_clickhouse/user_management_and_authentication/index.rst +++ b/doc/component-operation-guide-lts/source/using_clickhouse/user_management_and_authentication/index.rst @@ -6,7 +6,7 @@ User Management and Authentication ================================== - :ref:`ClickHouse User and Permission Management ` -- :ref:`Configuring the Password of the Default Account of a ClickHouse Cluster ` +- :ref:`Configuring the Password of the Default Account of a ClickHouse Cluster(for MRS 3.1.2) ` - :ref:`Configuring the Password of the Default Account of a ClickHouse Cluster ` .. toctree:: @@ -14,5 +14,5 @@ User Management and Authentication :hidden: clickhouse_user_and_permission_management - configuring_the_password_of_the_default_account_of_a_clickhouse_cluster + configuring_the_password_of_the_default_account_of_a_clickhouse_clusterfor_mrs_3.1.2 configuring_the_password_of_the_default_account_of_a_clickhouse_cluster diff --git a/doc/component-operation-guide-lts/source/using_flink/flink_configuration_management/jobmanager_and_taskmanager.rst b/doc/component-operation-guide-lts/source/using_flink/flink_configuration_management/jobmanager_and_taskmanager.rst index 42e5051..87e68d6 100644 --- a/doc/component-operation-guide-lts/source/using_flink/flink_configuration_management/jobmanager_and_taskmanager.rst +++ b/doc/component-operation-guide-lts/source/using_flink/flink_configuration_management/jobmanager_and_taskmanager.rst @@ -38,14 +38,8 @@ Main configuration items include communication port, memory management, connecti +------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------+-----------------+ | taskmanager.network.numberOfBuffers | Number of TaskManager network transmission buffer stacks. If an error indicates insufficient system buffer, increase the parameter value. | 2048 | No | +------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------+-----------------+ - | taskmanager.memory.fraction | Ratio of JVM heap memory that TaskManager reserves for sorting, hash tables, and caching of intermediate results. | 0.7 | No | - +------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------+-----------------+ - | taskmanager.memory.off-heap | Whether TaskManager uses off-heap memory for sorting, hash tables and intermediate status. You are advised to enable this item for large memory needs to improve memory operation efficiency. | false | Yes | - +------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------+-----------------+ | taskmanager.memory.segment-size | Size of the memory buffer used by the memory manager and network stack The unit is bytes. | 32768 | No | +------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------+-----------------+ - | taskmanager.memory.preallocate | Whether TaskManager allocates reserved memory space upon startup. You are advised to enable this item when off-heap memory is used. | false | No | - +------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------+-----------------+ | taskmanager.debug.memory.startLogThread | Enable this item for debugging Flink memory and garbage collection (GC)-related problems. TaskManager periodically collects memory and GC statistics, including the current utilization of heap and off-heap memory pools and GC time. | false | No | +------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------+-----------------+ | taskmanager.debug.memory.logIntervalMs | Interval at which TaskManager periodically collects memory and GC statistics. | 0 | No | diff --git a/doc/component-operation-guide-lts/source/using_flink/flink_performance_tuning/optimization_datastream/configuring_process_parameters.rst b/doc/component-operation-guide-lts/source/using_flink/flink_performance_tuning/optimization_datastream/configuring_flink_process_parameters.rst similarity index 96% rename from doc/component-operation-guide-lts/source/using_flink/flink_performance_tuning/optimization_datastream/configuring_process_parameters.rst rename to doc/component-operation-guide-lts/source/using_flink/flink_performance_tuning/optimization_datastream/configuring_flink_process_parameters.rst index 5e37b84..1df80af 100644 --- a/doc/component-operation-guide-lts/source/using_flink/flink_performance_tuning/optimization_datastream/configuring_process_parameters.rst +++ b/doc/component-operation-guide-lts/source/using_flink/flink_performance_tuning/optimization_datastream/configuring_flink_process_parameters.rst @@ -2,8 +2,8 @@ .. _mrs_01_1590: -Configuring Process Parameters -============================== +Configuring Flink Process Parameters +==================================== Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_flink/flink_performance_tuning/optimization_datastream/index.rst b/doc/component-operation-guide-lts/source/using_flink/flink_performance_tuning/optimization_datastream/index.rst index 03ff67a..8b37be7 100644 --- a/doc/component-operation-guide-lts/source/using_flink/flink_performance_tuning/optimization_datastream/index.rst +++ b/doc/component-operation-guide-lts/source/using_flink/flink_performance_tuning/optimization_datastream/index.rst @@ -7,7 +7,7 @@ Optimization DataStream - :ref:`Memory Configuration Optimization ` - :ref:`Configuring DOP ` -- :ref:`Configuring Process Parameters ` +- :ref:`Configuring Flink Process Parameters ` - :ref:`Optimizing the Design of Partitioning Method ` - :ref:`Configuring the Netty Network Communication ` - :ref:`Summarization ` @@ -18,7 +18,7 @@ Optimization DataStream memory_configuration_optimization configuring_dop - configuring_process_parameters + configuring_flink_process_parameters optimizing_the_design_of_partitioning_method configuring_the_netty_network_communication summarization diff --git a/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/overview/flink_web_ui_application_process.rst b/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/flink_web_ui_overview/flink_web_ui_application_process.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/overview/flink_web_ui_application_process.rst rename to doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/flink_web_ui_overview/flink_web_ui_application_process.rst diff --git a/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/overview/index.rst b/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/flink_web_ui_overview/index.rst similarity index 86% rename from doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/overview/index.rst rename to doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/flink_web_ui_overview/index.rst index 4766f91..d631df3 100644 --- a/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/overview/index.rst +++ b/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/flink_web_ui_overview/index.rst @@ -2,8 +2,8 @@ .. _mrs_01_24015: -Overview -======== +Flink Web UI Overview +===================== - :ref:`Introduction to Flink Web UI ` - :ref:`Flink Web UI Application Process ` diff --git a/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/overview/introduction_to_flink_web_ui.rst b/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/flink_web_ui_overview/introduction_to_flink_web_ui.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/overview/introduction_to_flink_web_ui.rst rename to doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/flink_web_ui_overview/introduction_to_flink_web_ui.rst diff --git a/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/flinkserver_permissions_management/overview.rst b/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/flinkserver_permissions_management/flinkserver_permissions_overview.rst similarity index 98% rename from doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/flinkserver_permissions_management/overview.rst rename to doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/flinkserver_permissions_management/flinkserver_permissions_overview.rst index 18af61c..99bd878 100644 --- a/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/flinkserver_permissions_management/overview.rst +++ b/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/flinkserver_permissions_management/flinkserver_permissions_overview.rst @@ -2,8 +2,8 @@ .. _mrs_01_24048: -Overview -======== +FlinkServer Permissions Overview +================================ User **admin** of Manager does not have the FlinkServer service operation permission. To perform FlinkServer service operations, you need to grant related permission to the user. diff --git a/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/flinkserver_permissions_management/index.rst b/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/flinkserver_permissions_management/index.rst index cad4bc7..64b08b7 100644 --- a/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/flinkserver_permissions_management/index.rst +++ b/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/flinkserver_permissions_management/index.rst @@ -5,12 +5,12 @@ FlinkServer Permissions Management ================================== -- :ref:`Overview ` +- :ref:`FlinkServer Permissions Overview ` - :ref:`Authentication Based on Users and Roles ` .. toctree:: :maxdepth: 1 :hidden: - overview + flinkserver_permissions_overview authentication_based_on_users_and_roles diff --git a/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/index.rst b/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/index.rst index da87350..9ea8ba3 100644 --- a/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/index.rst +++ b/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/index.rst @@ -5,7 +5,7 @@ Using the Flink Web UI ====================== -- :ref:`Overview ` +- :ref:`Flink Web UI Overview ` - :ref:`FlinkServer Permissions Management ` - :ref:`Accessing the Flink Web UI ` - :ref:`Creating an Application on the Flink Web UI ` @@ -14,14 +14,14 @@ Using the Flink Web UI - :ref:`Managing Tables on the Flink Web UI ` - :ref:`Managing Jobs on the Flink Web UI ` - :ref:`Importing and Exporting Jobs ` -- :ref:`Managing UDFs on the Flink Web UI ` +- :ref:`Managing UDFs ` - :ref:`Interconnecting FlinkServer with External Components ` .. toctree:: :maxdepth: 1 :hidden: - overview/index + flink_web_ui_overview/index flinkserver_permissions_management/index accessing_the_flink_web_ui creating_an_application_on_the_flink_web_ui @@ -30,5 +30,5 @@ Using the Flink Web UI managing_tables_on_the_flink_web_ui managing_jobs_on_the_flink_web_ui importing_and_exporting_jobs - managing_udfs_on_the_flink_web_ui/index + managing_udfs/index interconnecting_flinkserver_with_external_components/index diff --git a/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs_on_the_flink_web_ui/index.rst b/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs/index.rst similarity index 86% rename from doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs_on_the_flink_web_ui/index.rst rename to doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs/index.rst index bcccb93..923fb1b 100644 --- a/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs_on_the_flink_web_ui/index.rst +++ b/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs/index.rst @@ -2,8 +2,8 @@ .. _mrs_01_24223: -Managing UDFs on the Flink Web UI -================================= +Managing UDFs +============= - :ref:`Managing UDFs on the Flink Web UI ` - :ref:`UDF Java and SQL Examples ` diff --git a/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs_on_the_flink_web_ui/managing_udfs_on_the_flink_web_ui.rst b/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs/managing_udfs_on_the_flink_web_ui.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs_on_the_flink_web_ui/managing_udfs_on_the_flink_web_ui.rst rename to doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs/managing_udfs_on_the_flink_web_ui.rst diff --git a/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs_on_the_flink_web_ui/udaf_java_and_sql_examples.rst b/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs/udaf_java_and_sql_examples.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs_on_the_flink_web_ui/udaf_java_and_sql_examples.rst rename to doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs/udaf_java_and_sql_examples.rst diff --git a/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs_on_the_flink_web_ui/udf_java_and_sql_examples.rst b/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs/udf_java_and_sql_examples.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs_on_the_flink_web_ui/udf_java_and_sql_examples.rst rename to doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs/udf_java_and_sql_examples.rst diff --git a/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs_on_the_flink_web_ui/udtf_java_and_sql_examples.rst b/doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs/udtf_java_and_sql_examples.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs_on_the_flink_web_ui/udtf_java_and_sql_examples.rst rename to doc/component-operation-guide-lts/source/using_flink/using_the_flink_web_ui/managing_udfs/udtf_java_and_sql_examples.rst diff --git a/doc/component-operation-guide-lts/source/using_flume/configuring_the_flume_service_model/overview.rst b/doc/component-operation-guide-lts/source/using_flume/configuring_the_flume_service_model/flume_service_model_overview.rst similarity index 85% rename from doc/component-operation-guide-lts/source/using_flume/configuring_the_flume_service_model/overview.rst rename to doc/component-operation-guide-lts/source/using_flume/configuring_the_flume_service_model/flume_service_model_overview.rst index f76e1ba..9c3ba83 100644 --- a/doc/component-operation-guide-lts/source/using_flume/configuring_the_flume_service_model/overview.rst +++ b/doc/component-operation-guide-lts/source/using_flume/configuring_the_flume_service_model/flume_service_model_overview.rst @@ -2,8 +2,8 @@ .. _mrs_01_1074: -Overview -======== +Flume Service Model Overview +============================ Guide a reasonable Flume service configuration by providing performance differences between Flume common modules, to avoid a nonstandard overall service performance caused when a frontend Source and a backend Sink do not match in performance. diff --git a/doc/component-operation-guide-lts/source/using_flume/configuring_the_flume_service_model/index.rst b/doc/component-operation-guide-lts/source/using_flume/configuring_the_flume_service_model/index.rst index 39976b5..3020349 100644 --- a/doc/component-operation-guide-lts/source/using_flume/configuring_the_flume_service_model/index.rst +++ b/doc/component-operation-guide-lts/source/using_flume/configuring_the_flume_service_model/index.rst @@ -5,12 +5,12 @@ Configuring the Flume Service Model =================================== -- :ref:`Overview ` +- :ref:`Flume Service Model Overview ` - :ref:`Service Model Configuration Guide ` .. toctree:: :maxdepth: 1 :hidden: - overview + flume_service_model_overview service_model_configuration_guide diff --git a/doc/component-operation-guide-lts/source/using_flume/encrypted_transmission/index.rst b/doc/component-operation-guide-lts/source/using_flume/encrypted_transmission/index.rst index dff45c0..fb20182 100644 --- a/doc/component-operation-guide-lts/source/using_flume/encrypted_transmission/index.rst +++ b/doc/component-operation-guide-lts/source/using_flume/encrypted_transmission/index.rst @@ -6,11 +6,11 @@ Encrypted Transmission ====================== - :ref:`Configuring the Encrypted Transmission ` -- :ref:`Typical Scenario: Collecting Local Static Logs and Uploading Them to HDFS ` +- :ref:`Typical Scenario: Collecting Local Static Logs and Uploading Them to HDFS Encrypted Transmission ` .. toctree:: :maxdepth: 1 :hidden: configuring_the_encrypted_transmission - typical_scenario_collecting_local_static_logs_and_uploading_them_to_hdfs + typical_scenario_collecting_local_static_logs_and_uploading_them_to_hdfs_encrypted_transmission diff --git a/doc/component-operation-guide-lts/source/using_flume/encrypted_transmission/typical_scenario_collecting_local_static_logs_and_uploading_them_to_hdfs.rst b/doc/component-operation-guide-lts/source/using_flume/encrypted_transmission/typical_scenario_collecting_local_static_logs_and_uploading_them_to_hdfs_encrypted_transmission.rst similarity index 99% rename from doc/component-operation-guide-lts/source/using_flume/encrypted_transmission/typical_scenario_collecting_local_static_logs_and_uploading_them_to_hdfs.rst rename to doc/component-operation-guide-lts/source/using_flume/encrypted_transmission/typical_scenario_collecting_local_static_logs_and_uploading_them_to_hdfs_encrypted_transmission.rst index 0c811fb..c63cd8a 100644 --- a/doc/component-operation-guide-lts/source/using_flume/encrypted_transmission/typical_scenario_collecting_local_static_logs_and_uploading_them_to_hdfs.rst +++ b/doc/component-operation-guide-lts/source/using_flume/encrypted_transmission/typical_scenario_collecting_local_static_logs_and_uploading_them_to_hdfs_encrypted_transmission.rst @@ -2,8 +2,8 @@ .. _mrs_01_1070: -Typical Scenario: Collecting Local Static Logs and Uploading Them to HDFS -========================================================================= +Typical Scenario: Collecting Local Static Logs and Uploading Them to HDFS Encrypted Transmission +================================================================================================ Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_flume/overview.rst b/doc/component-operation-guide-lts/source/using_flume/flume_overview.rst similarity index 99% rename from doc/component-operation-guide-lts/source/using_flume/overview.rst rename to doc/component-operation-guide-lts/source/using_flume/flume_overview.rst index 47e69f0..fc56f10 100644 --- a/doc/component-operation-guide-lts/source/using_flume/overview.rst +++ b/doc/component-operation-guide-lts/source/using_flume/flume_overview.rst @@ -2,8 +2,8 @@ .. _mrs_01_0391: -Overview -======== +Flume Overview +============== Flume is a distributed, reliable, and highly available system for aggregating massive logs, which can efficiently collect, aggregate, and move massive log data from different data sources and store the data in a centralized data storage system. Various data senders can be customized in the system to collect data. Additionally, Flume provides simple data processes capabilities and writes data to data receivers (which is customizable). diff --git a/doc/component-operation-guide-lts/source/using_flume/index.rst b/doc/component-operation-guide-lts/source/using_flume/index.rst index a396eb9..76510cc 100644 --- a/doc/component-operation-guide-lts/source/using_flume/index.rst +++ b/doc/component-operation-guide-lts/source/using_flume/index.rst @@ -6,7 +6,7 @@ Using Flume =========== - :ref:`Using Flume from Scratch ` -- :ref:`Overview ` +- :ref:`Flume Overview ` - :ref:`Installing the Flume Client on Clusters ` - :ref:`Viewing Flume Client Logs ` - :ref:`Stopping or Uninstalling the Flume Client ` @@ -30,7 +30,7 @@ Using Flume :hidden: using_flume_from_scratch - overview + flume_overview installing_the_flume_client_on_clusters viewing_flume_client_logs stopping_or_uninstalling_the_flume_client diff --git a/doc/component-operation-guide-lts/source/using_hbase/configuring_hbase_data_compression_and_encoding.rst b/doc/component-operation-guide-lts/source/using_hbase/configuring_hbase_data_compression_and_encoding.rst index 6da6c3b..5fb02cf 100644 --- a/doc/component-operation-guide-lts/source/using_hbase/configuring_hbase_data_compression_and_encoding.rst +++ b/doc/component-operation-guide-lts/source/using_hbase/configuring_hbase_data_compression_and_encoding.rst @@ -1,6 +1,6 @@ -:original_name: en-us_topic_0000001295898904.html +:original_name: mrs_01_24112.html -.. _en-us_topic_0000001295898904: +.. _mrs_01_24112: Configuring HBase Data Compression and Encoding =============================================== diff --git a/doc/component-operation-guide-lts/source/using_hbase/hbase_performance_tuning/index.rst b/doc/component-operation-guide-lts/source/using_hbase/hbase_performance_tuning/index.rst index d8dad88..edeb608 100644 --- a/doc/component-operation-guide-lts/source/using_hbase/hbase_performance_tuning/index.rst +++ b/doc/component-operation-guide-lts/source/using_hbase/hbase_performance_tuning/index.rst @@ -10,7 +10,7 @@ HBase Performance Tuning - :ref:`Optimizing Put and Scan Performance ` - :ref:`Improving Real-time Data Write Performance ` - :ref:`Improving Real-time Data Read Performance ` -- :ref:`Optimizing JVM Parameters ` +- :ref:`Optimizing HBase JVM Parameters ` .. toctree:: :maxdepth: 1 @@ -21,4 +21,4 @@ HBase Performance Tuning optimizing_put_and_scan_performance improving_real-time_data_write_performance improving_real-time_data_read_performance - optimizing_jvm_parameters + optimizing_hbase_jvm_parameters diff --git a/doc/component-operation-guide-lts/source/using_hbase/hbase_performance_tuning/optimizing_jvm_parameters.rst b/doc/component-operation-guide-lts/source/using_hbase/hbase_performance_tuning/optimizing_hbase_jvm_parameters.rst similarity index 97% rename from doc/component-operation-guide-lts/source/using_hbase/hbase_performance_tuning/optimizing_jvm_parameters.rst rename to doc/component-operation-guide-lts/source/using_hbase/hbase_performance_tuning/optimizing_hbase_jvm_parameters.rst index 247ac48..aa59970 100644 --- a/doc/component-operation-guide-lts/source/using_hbase/hbase_performance_tuning/optimizing_jvm_parameters.rst +++ b/doc/component-operation-guide-lts/source/using_hbase/hbase_performance_tuning/optimizing_hbase_jvm_parameters.rst @@ -2,8 +2,8 @@ .. _mrs_01_1019: -Optimizing JVM Parameters -========================= +Optimizing HBase JVM Parameters +=============================== Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_hbase/index.rst b/doc/component-operation-guide-lts/source/using_hbase/index.rst index 647f335..7a1cfa5 100644 --- a/doc/component-operation-guide-lts/source/using_hbase/index.rst +++ b/doc/component-operation-guide-lts/source/using_hbase/index.rst @@ -15,7 +15,7 @@ Using HBase - :ref:`In-House Enhanced Phoenix ` - :ref:`Configuring HBase DR ` - :ref:`Performing an HBase DR Service Switchover ` -- :ref:`Configuring HBase Data Compression and Encoding ` +- :ref:`Configuring HBase Data Compression and Encoding ` - :ref:`Performing an HBase DR Active/Standby Cluster Switchover ` - :ref:`Community BulkLoad Tool ` - :ref:`Configuring the MOB ` diff --git a/doc/component-operation-guide-lts/source/using_hetuengine/configuring_data_sources/before_you_start.rst b/doc/component-operation-guide-lts/source/using_hetuengine/configuring_data_sources/before_you_start.rst index 6c785d2..2f37222 100644 --- a/doc/component-operation-guide-lts/source/using_hetuengine/configuring_data_sources/before_you_start.rst +++ b/doc/component-operation-guide-lts/source/using_hetuengine/configuring_data_sources/before_you_start.rst @@ -26,7 +26,7 @@ HetuEngine supports quick joint query of multiple data sources and GUI-based dat +-----------------+---------------+------------------+---------------------------------------------------------------+ | | GaussDB | | GaussDB 200 and GaussDB A 8.0.0 | +-----------------+---------------+------------------+---------------------------------------------------------------+ - | | Hudi | | MRS 3.1.1 or later | + | | Hudi | | MRS 3.1.2 or later | +-----------------+---------------+------------------+---------------------------------------------------------------+ | | ClickHouse | | MRS 3.1.1 or later | +-----------------+---------------+------------------+---------------------------------------------------------------+ @@ -36,7 +36,7 @@ HetuEngine supports quick joint query of multiple data sources and GUI-based dat +-----------------+---------------+------------------+---------------------------------------------------------------+ | | Elasticsearch | | Elasticsearch of the current cluster | +-----------------+---------------+------------------+---------------------------------------------------------------+ - | | Hudi | | MRS 3.1.1 or later | + | | Hudi | | MRS 3.1.2 or later | +-----------------+---------------+------------------+---------------------------------------------------------------+ | | ClickHouse | | MRS 3.1.1 or later | +-----------------+---------------+------------------+---------------------------------------------------------------+ diff --git a/doc/component-operation-guide-lts/source/using_hetuengine/hetuengine_permission_management/hetuengine_metastore-based_permission_control/configuring_permissions_for_tables_columns_and_databases.rst b/doc/component-operation-guide-lts/source/using_hetuengine/hetuengine_permission_management/hetuengine_metastore-based_permission_control/configuring_permissions_for_tables_columns_and_databases.rst index cd3354c..b1d1c64 100644 --- a/doc/component-operation-guide-lts/source/using_hetuengine/hetuengine_permission_management/hetuengine_metastore-based_permission_control/configuring_permissions_for_tables_columns_and_databases.rst +++ b/doc/component-operation-guide-lts/source/using_hetuengine/hetuengine_permission_management/hetuengine_metastore-based_permission_control/configuring_permissions_for_tables_columns_and_databases.rst @@ -27,38 +27,34 @@ Concepts .. table:: **Table 1** Using HetuEngine tables, columns, or data - +-----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ - | Scenario | Required Permission | - +===================================+=============================================================================================================================================+ - | DESCRIBE TABLE | Select | - +-----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ - | ANALYZE TABLE | Select and Insert | - +-----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ - | SHOW COLUMNS | Select | - +-----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ - | SHOW TABLE STATUS | Select | - +-----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ - | SHOW TABLE PROPERTIES | Select | - +-----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ - | SELECT | Select | - | | | - | | .. note:: | - | | | - | | To perform the SELECT operation on a view, you must have the **Select** permission on the view and the tables corresponding to the view. | - +-----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ - | EXPLAIN | Select | - +-----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ - | CREATE VIEW | Select, Grant Of Select, and Create | - +-----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ - | CREATE TABLE | Create | - +-----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ - | ALTER TABLE ADD PARTITION | Insert | - +-----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ - | INSERT | Insert | - +-----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ - | INSERT OVERWRITE | Insert and Delete | - +-----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ - | ALTER TABLE DROP PARTITION | The table-level Alter and Delete, and column-level Select permissions need to be granted. | - +-----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ - | ALTER DATABASE | Hive Admin Privilege | - +-----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ + +----------------------------+-------------------------------------------------------------------------------------------+ + | Scenario | Required Permission | + +============================+===========================================================================================+ + | DESCRIBE TABLE | Select | + +----------------------------+-------------------------------------------------------------------------------------------+ + | ANALYZE TABLE | Select and Insert | + +----------------------------+-------------------------------------------------------------------------------------------+ + | SHOW COLUMNS | Select | + +----------------------------+-------------------------------------------------------------------------------------------+ + | SHOW TABLE STATUS | Select | + +----------------------------+-------------------------------------------------------------------------------------------+ + | SHOW TABLE PROPERTIES | Select | + +----------------------------+-------------------------------------------------------------------------------------------+ + | SELECT | Select | + +----------------------------+-------------------------------------------------------------------------------------------+ + | EXPLAIN | Select | + +----------------------------+-------------------------------------------------------------------------------------------+ + | CREATE VIEW | Select, Grant Of Select, and Create | + +----------------------------+-------------------------------------------------------------------------------------------+ + | CREATE TABLE | Create | + +----------------------------+-------------------------------------------------------------------------------------------+ + | ALTER TABLE ADD PARTITION | Insert | + +----------------------------+-------------------------------------------------------------------------------------------+ + | INSERT | Insert | + +----------------------------+-------------------------------------------------------------------------------------------+ + | INSERT OVERWRITE | Insert and Delete | + +----------------------------+-------------------------------------------------------------------------------------------+ + | ALTER TABLE DROP PARTITION | The table-level Alter and Delete, and column-level Select permissions need to be granted. | + +----------------------------+-------------------------------------------------------------------------------------------+ + | ALTER DATABASE | Hive Admin Privilege | + +----------------------------+-------------------------------------------------------------------------------------------+ diff --git a/doc/component-operation-guide-lts/source/using_hetuengine/hetuengine_permission_management/hetuengine_metastore-based_permission_control/index.rst b/doc/component-operation-guide-lts/source/using_hetuengine/hetuengine_permission_management/hetuengine_metastore-based_permission_control/index.rst index 1e48dce..a0aa9a9 100644 --- a/doc/component-operation-guide-lts/source/using_hetuengine/hetuengine_permission_management/hetuengine_metastore-based_permission_control/index.rst +++ b/doc/component-operation-guide-lts/source/using_hetuengine/hetuengine_permission_management/hetuengine_metastore-based_permission_control/index.rst @@ -5,7 +5,7 @@ HetuEngine MetaStore-based Permission Control ============================================= -- :ref:`Overview ` +- :ref:`MetaStore Permission Overview ` - :ref:`Creating a HetuEngine Role ` - :ref:`Configuring Permissions for Tables, Columns, and Databases ` @@ -13,6 +13,6 @@ HetuEngine MetaStore-based Permission Control :maxdepth: 1 :hidden: - overview + metastore_permission_overview creating_a_hetuengine_role configuring_permissions_for_tables_columns_and_databases diff --git a/doc/component-operation-guide-lts/source/using_hetuengine/hetuengine_permission_management/hetuengine_metastore-based_permission_control/overview.rst b/doc/component-operation-guide-lts/source/using_hetuengine/hetuengine_permission_management/hetuengine_metastore-based_permission_control/metastore_permission_overview.rst similarity index 99% rename from doc/component-operation-guide-lts/source/using_hetuengine/hetuengine_permission_management/hetuengine_metastore-based_permission_control/overview.rst rename to doc/component-operation-guide-lts/source/using_hetuengine/hetuengine_permission_management/hetuengine_metastore-based_permission_control/metastore_permission_overview.rst index 28e7245..3465b53 100644 --- a/doc/component-operation-guide-lts/source/using_hetuengine/hetuengine_permission_management/hetuengine_metastore-based_permission_control/overview.rst +++ b/doc/component-operation-guide-lts/source/using_hetuengine/hetuengine_permission_management/hetuengine_metastore-based_permission_control/metastore_permission_overview.rst @@ -2,8 +2,8 @@ .. _mrs_01_1725: -Overview -======== +MetaStore Permission Overview +============================= Constraints: This parameter applies only to the Hive data source. diff --git a/doc/component-operation-guide-lts/source/using_hetuengine/using_hetuengine_cross-domain_function/index.rst b/doc/component-operation-guide-lts/source/using_hetuengine/using_hetuengine_cross-domain_function/index.rst index ebd3047..6914c4a 100644 --- a/doc/component-operation-guide-lts/source/using_hetuengine/using_hetuengine_cross-domain_function/index.rst +++ b/doc/component-operation-guide-lts/source/using_hetuengine/using_hetuengine_cross-domain_function/index.rst @@ -5,7 +5,7 @@ Using HetuEngine Cross-Domain Function ====================================== -- :ref:`Introduction to HetuEngine Cross-Source Function ` +- :ref:`Introduction to HetuEngine Cross-Domain Function ` - :ref:`HetuEngine Cross-Domain Function Usage ` - :ref:`HetuEngine Cross-Domain Rate Limit Function ` @@ -13,6 +13,6 @@ Using HetuEngine Cross-Domain Function :maxdepth: 1 :hidden: - introduction_to_hetuengine_cross-source_function + introduction_to_hetuengine_cross-domain_function hetuengine_cross-domain_function_usage hetuengine_cross-domain_rate_limit_function diff --git a/doc/component-operation-guide-lts/source/using_hetuengine/using_hetuengine_cross-domain_function/introduction_to_hetuengine_cross-source_function.rst b/doc/component-operation-guide-lts/source/using_hetuengine/using_hetuengine_cross-domain_function/introduction_to_hetuengine_cross-domain_function.rst similarity index 97% rename from doc/component-operation-guide-lts/source/using_hetuengine/using_hetuengine_cross-domain_function/introduction_to_hetuengine_cross-source_function.rst rename to doc/component-operation-guide-lts/source/using_hetuengine/using_hetuengine_cross-domain_function/introduction_to_hetuengine_cross-domain_function.rst index 960e3e7..5f3720d 100644 --- a/doc/component-operation-guide-lts/source/using_hetuengine/using_hetuengine_cross-domain_function/introduction_to_hetuengine_cross-source_function.rst +++ b/doc/component-operation-guide-lts/source/using_hetuengine/using_hetuengine_cross-domain_function/introduction_to_hetuengine_cross-domain_function.rst @@ -2,7 +2,7 @@ .. _mrs_01_2334: -Introduction to HetuEngine Cross-Source Function +Introduction to HetuEngine Cross-Domain Function ================================================ HetuEngine provide unified standard SQL to implement efficient access to multiple data sources distributed in multiple regions (or data centers), shields data differences in the structure, storage, and region, and decouples data and applications. diff --git a/doc/component-operation-guide-lts/source/using_hetuengine/using_hetuengine_materialized_views/sql_statement_example_of_materialized_views.rst b/doc/component-operation-guide-lts/source/using_hetuengine/using_hetuengine_materialized_views/sql_statement_example_of_materialized_views.rst index dc5c897..2c1eab1 100644 --- a/doc/component-operation-guide-lts/source/using_hetuengine/using_hetuengine_materialized_views/sql_statement_example_of_materialized_views.rst +++ b/doc/component-operation-guide-lts/source/using_hetuengine/using_hetuengine_materialized_views/sql_statement_example_of_materialized_views.rst @@ -53,9 +53,9 @@ For details about the SQL statements for materialized views, see :ref:`Table 1 < +-----------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Verifying whether SQL statements can be optimized by rewriting a query to a materialized view | Verify whether the SELECT statement can be rewritten and optimized by **mv.default.mv1**. | verify materialized view mvname(mv.default.mv1) originalsql select id from hive.mvschema.t1; | ``-`` | +-----------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ - | Enabling the specified materialized view at the SQL level to optimize the SQL statements | Forcibly use **mv.default.mv1** for SQL statement optimization in queries. | ``/*+ REWRITE(mv.default.mv1) */`` select id from hive.mvschema.t1; | ``-`` | + | Enabling the specified materialized view at the SQL level to optimize the SQL statements | Forcibly use **mv.default.mv1** for SQL statement optimization in queries. | /``*+`` REWRITE(mv.default.mv1) \*/ select id from hive.mvschema.t1; | ``-`` | +-----------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ - | Disabling materialized views at the SQL level to optimize the SQL statements | Do not use materialized views for SQL statement optimization in queries. | ``/*+ NOREWRITE */`` select id from hive.mvschema.t1; | ``-`` | + | Disabling materialized views at the SQL level to optimize the SQL statements | Do not use materialized views for SQL statement optimization in queries. | /``*+`` NOREWRITE \*/ select id from hive.mvschema.t1; | ``-`` | +-----------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Refreshing the metadata cache of materialized views | Synchronize the metadata cache of materialized views between tenants. | refresh catalog mv; | ``-`` | +-----------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ diff --git a/doc/component-operation-guide-lts/source/using_hive/connecting_hive_with_external_rds.rst b/doc/component-operation-guide-lts/source/using_hive/connecting_hive_with_external_rds.rst index eaaebb4..7768053 100644 --- a/doc/component-operation-guide-lts/source/using_hive/connecting_hive_with_external_rds.rst +++ b/doc/component-operation-guide-lts/source/using_hive/connecting_hive_with_external_rds.rst @@ -1,6 +1,6 @@ -:original_name: en-us_topic_0000001295738648.html +:original_name: mrs_01_17511.html -.. _en-us_topic_0000001295738648: +.. _mrs_01_17511: Connecting Hive with External RDS ================================= @@ -105,7 +105,7 @@ Connecting Hive with External RDS #. Log in to each MetaStore background node and check whether the local directory **/opt/Bigdata/tmp** exists. - - If yes, go to :ref:`8 `. + - If yes, go to :ref:`8 `. - If no, run the following commands to create one: @@ -113,6 +113,6 @@ Connecting Hive with External RDS **chmod 755 /opt/Bigdata/tmp** -#. .. _en-us_topic_0000001295738648__en-us_topic_0000001219350615_li24241321154318: +#. .. _mrs_01_17511__en-us_topic_0000001219350615_li24241321154318: Save the configuration. Choose **Dashboard** > **More** > **Restart Service**, and enter the password to restart the Hive service. diff --git a/doc/component-operation-guide-lts/source/using_hive/hive_materialized_view.rst b/doc/component-operation-guide-lts/source/using_hive/hive_materialized_view.rst deleted file mode 100644 index 0c39b76..0000000 --- a/doc/component-operation-guide-lts/source/using_hive/hive_materialized_view.rst +++ /dev/null @@ -1,154 +0,0 @@ -:original_name: mrs_01_2311.html - -.. _mrs_01_2311: - -Hive Materialized View -====================== - -Introduction ------------- - -A Hive materialized view is a special table obtained based on the query results of Hive internal tables. A materialized view can be considered as an intermediate table that stores actual data and occupies physical space. The tables on which a materialized view depends are called the base tables of the materialized view. - -Materialized views are used to pre-compute and save the results of time-consuming operations such as table joining or aggregation. When executing a query, you can rewrite the query statement based on the base tables to the query statement based on materialized views. In this way, you do not need to perform time-consuming operations such as join and group by, thereby quickly obtaining the query result. - -.. note:: - - - A materialized view is a special table that stores actual data and occupies physical space. - - Before deleting a base table, you must delete the materialized view created based on the base table. - - The materialized view creation statement is atomic, which means that other users cannot see the materialized view until all query results are populated. - - A materialized view cannot be created based on the query results of another materialized view. - - A materialized view cannot be created based on the results of a tableless query. - - You cannot insert, update, delete, load, or merge materialized views. - - You can perform complex query operations on materialized views, because they are special tables in nature. - - When the data of a base table is updated, you need to manually update the materialized view. Otherwise, the materialized view will retain the old data. That is, the materialized view expires. - - You can use the describe syntax to check whether the materialized view created based on ACID tables has expired. - - The describe statement cannot be used to check whether a materialized view created based on non-ACID tables has expired. - -Creating a Materialized View ----------------------------- - -**Syntax** - -.. code-block:: - - CREATE MATERIALIZED VIEW [IF NOT EXISTS] [db_name.]materialized_view_name - [COMMENT materialized_view_comment] - DISABLE REWRITE - [ROW FORMAT row_format] - [STORED AS file_format] - | STORED BY 'storage.handler.class.name' [WITH SERDEPROPERTIES (...)] - ] - [LOCATION hdfs_path] - [TBLPROPERTIES (property_name=property_value, ...)] - AS - ; - -.. note:: - - - Currently, the following materialized view file formats are supported: PARQUET, TextFile, SequenceFile, RCfile, and ORC. If **STORED AS** is not specified in the creation statement, the default file format is ORC. - - Names of materialized views must be unique in the same database. Otherwise, you cannot create a new materialized view, and data files of the original materialized view will be overwritten by the data files queried based on the base table in the new one. As a result, data may be tampered with. (After being tampered with, the materialized view can be restored by re-creating the materialized view.). - -**Cases** - -#. Log in to the Hive client and run the following command to enable the following parameters. For details, see :ref:`Using a Hive Client `. - - **set hive.support.concurrency=true;** - - **set hive.exec.dynamic.partition.mode=nonstrict;** - - **set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;** - -#. Create a base table and insert data. - - .. code-block:: - - create table tb_emp( - empno int,ename string,job string,mgr int,hiredate TIMESTAMP,sal float,comm float,deptno int - )stored as orc - tblproperties('transactional'='true'); - - insert into tb_emp values(7369, 'SMITH', 'CLERK',7902, '1980-12-17 08:30:09',800.00,NULL,20), - (7499, 'ALLEN', 'SALESMAN',7698, '1981-02-20 17:12:00',1600.00,300.00,30), - (7521, 'WARD', 'SALESMAN',7698, '1981-02-22 09:05:34',1250.00,500.00,30), - (7566, 'JONES', 'MANAGER', 7839, '1981-04-02 10:14:13',2975.00,NULL,20), - (7654, 'MARTIN', 'SALESMAN',7698, '1981-09-28 08:36:17',1250.00,1400.00,30), - (7698, 'BLAKE', 'MANAGER',7839, '1981-05-01 11:12:55',2850.00,NULL,30), - (7782, 'CLARK', 'MANAGER',7839, '1981-06-09 15:45:28',2450.00,NULL,10), - (7788, 'SCOTT', 'ANALYST',7566, '1987-04-19 14:05:34',3000.00,NULL,20), - (7839, 'KING', 'PRESIDENT',NULL, '1981-11-17 10:18:25',5000.00,NULL,10), - (7844, 'TURNER', 'SALESMAN',7698, '1981-09-08 09:05:34',1500.00,0.00,30), - (7876, 'ADAMS', 'CLERK',7788, '1987-05-23 15:07:44',1100.00,NULL,20), - (7900, 'JAMES', 'CLERK',7698, '1981-12-03 16:23:56',950.00,NULL,30), - (7902, 'FORD', 'ANALYST',7566, '1981-12-03 08:48:17',3000.00,NULL,20), - (7934, 'MILLER', 'CLERK',7782, '1982-01-23 11:45:29',1300.00,NULL,10); - -#. Create a materialized view based on the results of the **tb_emp** query. - - .. code-block:: - - create materialized view group_mv disable rewrite - row format serde 'org.apache.hadoop.hive.serde2.JsonSerDe' - stored as textfile - tblproperties('mv_content'='Total compensation of each department') - as select deptno,sum(sal) sum_sal from tb_emp group by deptno; - -Applying a Materialized View ----------------------------- - -Rewrite the query statement based on base tables to the query statement based on materialized views to improve the query efficiency. - -**Cases** - -Execute the following query statement: - -**select deptno,sum(sal) from tb_emp group by deptno having sum(sal)>10000;** - -Based on the created materialized view, rewrite the query statement: - -**select deptno, sum_sal from group_mv where sum_sal>10000;** - -Checking a Materialized View ----------------------------- - -**Syntax** - -**SHOW MATERIALIZED VIEWS [IN database_name] ['identifier_with_wildcards'];** - -**DESCRIBE [EXTENDED \| FORMATTED] [db_name.]materialized_view_name;** - -**Cases** - -**show materialized views;** - -**describe formatted group_mv;** - -Deleting a Materialized View ----------------------------- - -**Syntax** - -**DROP MATERIALIZED VIEW [db_name.]materialized_view_name;** - -**Cases** - -**drop materialized view group_mv;** - -Rebuilding a Materialized View ------------------------------- - -When a materialized view is created, the base table data is filled in the materialized view. However, the data that is added, deleted, or modified in the base table is not automatically synchronized to the materialized view. Therefore, you need to manually rebuild the view after updating the data. - -**Syntax** - -**ALTER MATERIALIZED VIEW [db_name.]materialized_view_name REBUILD;** - -**Cases** - -**alter materialized view group_mv rebuild;** - -.. note:: - - When the base table data is updated but the materialized view data is not updated, the materialized view is in the expired state by default. - - The describe statement can be used to check whether a materialized view created based on transaction tables has expired. If the value of **Outdated for Rewriting** is **Yes**, the license has expired. If the value of **Outdated for Rewriting** is **No**, the license has not expired. diff --git a/doc/component-operation-guide-lts/source/using_hive/index.rst b/doc/component-operation-guide-lts/source/using_hive/index.rst index d3ad153..e1f261b 100644 --- a/doc/component-operation-guide-lts/source/using_hive/index.rst +++ b/doc/component-operation-guide-lts/source/using_hive/index.rst @@ -34,10 +34,9 @@ Using Hive - :ref:`Hive Supports Isolation of Metastore instances Based on Components ` - :ref:`Hive Supporting Transactions ` - :ref:`Switching the Hive Execution Engine to Tez ` -- :ref:`Connecting Hive with External RDS ` +- :ref:`Connecting Hive with External RDS ` - :ref:`Interconnecting Hive with External Self-Built Relational Databases ` - :ref:`Redis-based CacheStore of HiveMetaStore ` -- :ref:`Hive Materialized View ` - :ref:`Hive Supporting Reading Hudi Tables ` - :ref:`Hive Supporting Cold and Hot Storage of Partitioned Metadata ` - :ref:`Hive Supporting ZSTD Compression Formats ` @@ -85,7 +84,6 @@ Using Hive connecting_hive_with_external_rds interconnecting_hive_with_external_self-built_relational_databases redis-based_cachestore_of_hivemetastore - hive_materialized_view hive_supporting_reading_hudi_tables hive_supporting_cold_and_hot_storage_of_partitioned_metadata hive_supporting_zstd_compression_formats diff --git a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/data_management_and_maintenance/cleaning.rst b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/data_management_and_maintenance/cleaning.rst index c8e3659..c4fbbfe 100644 --- a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/data_management_and_maintenance/cleaning.rst +++ b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/data_management_and_maintenance/cleaning.rst @@ -19,4 +19,4 @@ You can use either of the following methods to perform cleaning: **spark-submit --master yarn --jars /opt/client/Hudi/hudi/lib/hudi-client-common-**\ *xxx*\ **.jar --class org.apache.hudi.utilities.HoodieCleaner /opt/client/Hudi/hudi/lib/hudi-utilities\_**\ *xxx*\ **.jar --target-base-path /tmp/default/tb_test_mor** -For details about more cleaning parameters, see :ref:`Configuration Reference `. +For details about more cleaning parameters, see :ref:`Hudi Configuration Reference `. diff --git a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/data_management_and_maintenance/clustering.rst b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/data_management_and_maintenance/clustering.rst index 350fb73..3556f97 100644 --- a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/data_management_and_maintenance/clustering.rst +++ b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/data_management_and_maintenance/clustering.rst @@ -82,7 +82,7 @@ How to Execute Clustering hoodie.clustering.inline.max.commits=4 -For details, see :ref:`Configuration Reference `. +For details, see :ref:`Hudi Configuration Reference `. .. caution:: diff --git a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/data_management_and_maintenance/metadata_table.rst b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/data_management_and_maintenance/metadata_table.rst index 03b8ba8..bd5021a 100644 --- a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/data_management_and_maintenance/metadata_table.rst +++ b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/data_management_and_maintenance/metadata_table.rst @@ -31,7 +31,7 @@ Metadata Table When using Spark to write data, set **hoodie.metadata.enable** in the **option** parameter to **true**. - For details about more parameters, see :ref:`Configuration Reference ` or visit Hudi official website http://hudi.apache.org/docs/configurations.html#metadata-config. + For details about more parameters, see :ref:`Hudi Configuration Reference ` or visit Hudi official website http://hudi.apache.org/docs/configurations.html#metadata-config. - **Performance improvement** diff --git a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/data_management_and_maintenance/single-table_concurrent_write.rst b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/data_management_and_maintenance/single-table_concurrent_write.rst index bfc8804..109e7d1 100644 --- a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/data_management_and_maintenance/single-table_concurrent_write.rst +++ b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/data_management_and_maintenance/single-table_concurrent_write.rst @@ -54,7 +54,7 @@ How to Use the Concurrency Mechanism **hoodie.write.lock.zookeeper.base_path**\ =\ ** -For details about more parameters, see :ref:`Configuration Reference `. +For details about more parameters, see :ref:`Hudi Configuration Reference `. .. caution:: diff --git a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/clustering_configuration.rst b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/clustering_configuration.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/clustering_configuration.rst rename to doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/clustering_configuration.rst diff --git a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/compaction_and_cleaning_configurations.rst b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/compaction_and_cleaning_configurations.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/compaction_and_cleaning_configurations.rst rename to doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/compaction_and_cleaning_configurations.rst diff --git a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/configuration_of_hive_table_synchronization.rst b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/configuration_of_hive_table_synchronization.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/configuration_of_hive_table_synchronization.rst rename to doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/configuration_of_hive_table_synchronization.rst diff --git a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/index.rst b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/index.rst similarity index 94% rename from doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/index.rst rename to doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/index.rst index f29604d..2e9dd4f 100644 --- a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/index.rst +++ b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/index.rst @@ -2,8 +2,8 @@ .. _mrs_01_24032: -Configuration Reference -======================= +Hudi Configuration Reference +============================ This section describes important Hudi configurations. For details, visit the Hudi official website https://hudi.apache.org/docs/configurations.html. diff --git a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/index_configuration.rst b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/index_configuration.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/index_configuration.rst rename to doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/index_configuration.rst diff --git a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/metadata_table_configuration.rst b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/metadata_table_configuration.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/metadata_table_configuration.rst rename to doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/metadata_table_configuration.rst diff --git a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/single-table_concurrent_write_configuration.rst b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/single-table_concurrent_write_configuration.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/single-table_concurrent_write_configuration.rst rename to doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/single-table_concurrent_write_configuration.rst diff --git a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/storage_configuration.rst b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/storage_configuration.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/storage_configuration.rst rename to doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/storage_configuration.rst diff --git a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/write_configuration.rst b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/write_configuration.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_hudi/basic_operations/configuration_reference/write_configuration.rst rename to doc/component-operation-guide-lts/source/using_hudi/basic_operations/hudi_configuration_reference/write_configuration.rst diff --git a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/index.rst b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/index.rst index 34a7b76..b513086 100644 --- a/doc/component-operation-guide-lts/source/using_hudi/basic_operations/index.rst +++ b/doc/component-operation-guide-lts/source/using_hudi/basic_operations/index.rst @@ -10,7 +10,7 @@ Basic Operations - :ref:`Read ` - :ref:`Data Management and Maintenance ` - :ref:`Using the Hudi Client ` -- :ref:`Configuration Reference ` +- :ref:`Hudi Configuration Reference ` .. toctree:: :maxdepth: 1 @@ -21,4 +21,4 @@ Basic Operations read/index data_management_and_maintenance/index using_the_hudi_client/index - configuration_reference/index + hudi_configuration_reference/index diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/call_command/clustering.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/call_command/hudi_clustering.rst similarity index 98% rename from doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/call_command/clustering.rst rename to doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/call_command/hudi_clustering.rst index 53c0463..2a75018 100644 --- a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/call_command/clustering.rst +++ b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/call_command/hudi_clustering.rst @@ -2,8 +2,8 @@ .. _mrs_01_24802: -CLUSTERING -========== +Hudi CLUSTERING +=============== Function -------- diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/call_command/index.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/call_command/index.rst index 63e97fd..936cd6d 100644 --- a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/call_command/index.rst +++ b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/call_command/index.rst @@ -15,7 +15,7 @@ CALL COMMAND - :ref:`SHOW_HOODIE_PROPERTIES ` - :ref:`SAVE_POINT ` - :ref:`ROLL_BACK ` -- :ref:`CLUSTERING ` +- :ref:`Hudi CLUSTERING ` .. toctree:: :maxdepth: 1 @@ -27,4 +27,4 @@ CALL COMMAND show_hoodie_properties save_point roll_back - clustering + hudi_clustering diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/index.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/index.rst deleted file mode 100644 index de720bf..0000000 --- a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/index.rst +++ /dev/null @@ -1,26 +0,0 @@ -:original_name: mrs_01_24263.html - -.. _mrs_01_24263: - -DDL -=== - -- :ref:`CREATE TABLE ` -- :ref:`CREATE TABLE AS SELECT ` -- :ref:`DROP TABLE ` -- :ref:`SHOW TABLE ` -- :ref:`ALTER RENAME TABLE ` -- :ref:`ALTER ADD COLUMNS ` -- :ref:`TRUNCATE TABLE ` - -.. toctree:: - :maxdepth: 1 - :hidden: - - create_table - create_table_as_select - drop_table - show_table - alter_rename_table - alter_add_columns - truncate_table diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/alter_add_columns.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/alter_add_columns.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/alter_add_columns.rst rename to doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/alter_add_columns.rst diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/alter_rename_table.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/alter_rename_table.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/alter_rename_table.rst rename to doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/alter_rename_table.rst diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/create_table.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/create_hudi_table.rst similarity index 99% rename from doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/create_table.rst rename to doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/create_hudi_table.rst index 0d68624..ed15d08 100644 --- a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/create_table.rst +++ b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/create_hudi_table.rst @@ -2,8 +2,8 @@ .. _mrs_01_24264: -CREATE TABLE -============ +CREATE Hudi TABLE +================= Function -------- diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/create_table_as_select.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/create_hudi_table_as_select.rst similarity index 98% rename from doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/create_table_as_select.rst rename to doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/create_hudi_table_as_select.rst index 61c2c84..d60be98 100644 --- a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/create_table_as_select.rst +++ b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/create_hudi_table_as_select.rst @@ -2,8 +2,8 @@ .. _mrs_01_24265: -CREATE TABLE AS SELECT -====================== +CREATE Hudi TABLE AS SELECT +=========================== Function -------- diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/drop_table.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/drop_hudi_table.rst similarity index 97% rename from doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/drop_table.rst rename to doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/drop_hudi_table.rst index f789d29..6f51398 100644 --- a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/drop_table.rst +++ b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/drop_hudi_table.rst @@ -2,8 +2,8 @@ .. _mrs_01_24266: -DROP TABLE -========== +DROP Hudi TABLE +=============== Function -------- diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/index.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/index.rst new file mode 100644 index 0000000..1ab2da1 --- /dev/null +++ b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/index.rst @@ -0,0 +1,26 @@ +:original_name: mrs_01_24263.html + +.. _mrs_01_24263: + +Hudi DDL +======== + +- :ref:`CREATE Hudi TABLE ` +- :ref:`CREATE Hudi TABLE AS SELECT ` +- :ref:`DROP Hudi TABLE ` +- :ref:`SHOW TABLE ` +- :ref:`ALTER RENAME TABLE ` +- :ref:`ALTER ADD COLUMNS ` +- :ref:`TRUNCATE Hudi TABLE ` + +.. toctree:: + :maxdepth: 1 + :hidden: + + create_hudi_table + create_hudi_table_as_select + drop_hudi_table + show_table + alter_rename_table + alter_add_columns + truncate_hudi_table diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/show_table.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/show_table.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/show_table.rst rename to doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/show_table.rst diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/truncate_table.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/truncate_hudi_table.rst similarity index 94% rename from doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/truncate_table.rst rename to doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/truncate_hudi_table.rst index cf9fdbc..5d10857 100644 --- a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/ddl/truncate_table.rst +++ b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_ddl/truncate_hudi_table.rst @@ -2,8 +2,8 @@ .. _mrs_01_24271: -TRUNCATE TABLE -============== +TRUNCATE Hudi TABLE +=================== Function -------- diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/archivelog.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/archivelog.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/archivelog.rst rename to doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/archivelog.rst diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/clean.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/clean.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/clean.rst rename to doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/clean.rst diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/compaction.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/compaction_hudi_data.rst similarity index 98% rename from doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/compaction.rst rename to doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/compaction_hudi_data.rst index 386f38a..2deeca5 100644 --- a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/compaction.rst +++ b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/compaction_hudi_data.rst @@ -2,8 +2,8 @@ .. _mrs_01_24277: -COMPACTION -========== +COMPACTION Hudi Data +==================== Function -------- diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/delete.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/delete_hudi_data.rst similarity index 97% rename from doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/delete.rst rename to doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/delete_hudi_data.rst index c80428a..7b40ec5 100644 --- a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/delete.rst +++ b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/delete_hudi_data.rst @@ -2,8 +2,8 @@ .. _mrs_01_24276: -DELETE -====== +DELETE Hudi Data +================ Function -------- diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/index.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/index.rst similarity index 50% rename from doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/index.rst rename to doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/index.rst index 8b4eef4..23f078b 100644 --- a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/index.rst +++ b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/index.rst @@ -2,15 +2,15 @@ .. _mrs_01_24272: -DML -=== +Hudi DML +======== - :ref:`INSERT INTO ` - :ref:`MERGE INTO ` -- :ref:`UPDATE ` -- :ref:`DELETE ` -- :ref:`COMPACTION ` -- :ref:`SET/RESET ` +- :ref:`UPDATE Hudi Data ` +- :ref:`DELETE Hudi Data ` +- :ref:`COMPACTION Hudi Data ` +- :ref:`SET/RESET Hudi Data ` - :ref:`ARCHIVELOG ` - :ref:`CLEAN ` @@ -20,9 +20,9 @@ DML insert_into merge_into - update - delete - compaction - set_reset + update_hudi_data + delete_hudi_data + compaction_hudi_data + set_reset_hudi_data archivelog clean diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/insert_into.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/insert_into.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/insert_into.rst rename to doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/insert_into.rst diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/merge_into.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/merge_into.rst similarity index 100% rename from doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/merge_into.rst rename to doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/merge_into.rst diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/set_reset.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/set_reset_hudi_data.rst similarity index 99% rename from doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/set_reset.rst rename to doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/set_reset_hudi_data.rst index a8e20f4..861a220 100644 --- a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/set_reset.rst +++ b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/set_reset_hudi_data.rst @@ -2,8 +2,8 @@ .. _mrs_01_24278: -SET/RESET -========= +SET/RESET Hudi Data +=================== Function -------- diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/update.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/update_hudi_data.rst similarity index 98% rename from doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/update.rst rename to doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/update_hudi_data.rst index 90a7aaa..62e9f30 100644 --- a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/dml/update.rst +++ b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/hudi_dml/update_hudi_data.rst @@ -2,8 +2,8 @@ .. _mrs_01_24275: -UPDATE -====== +UPDATE Hudi Data +================ Function -------- diff --git a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/index.rst b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/index.rst index 599fda0..1b33af8 100644 --- a/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/index.rst +++ b/doc/component-operation-guide-lts/source/using_hudi/hudi_sql_syntax_reference/index.rst @@ -6,8 +6,8 @@ Hudi SQL Syntax Reference ========================= - :ref:`Constraints ` -- :ref:`DDL ` -- :ref:`DML ` +- :ref:`Hudi DDL ` +- :ref:`Hudi DML ` - :ref:`CALL COMMAND ` .. toctree:: @@ -15,6 +15,6 @@ Hudi SQL Syntax Reference :hidden: constraints - ddl/index - dml/index + hudi_ddl/index + hudi_dml/index call_command/index diff --git a/doc/component-operation-guide-lts/source/using_loader/exporting_data/index.rst b/doc/component-operation-guide-lts/source/using_loader/exporting_data/index.rst index 9e18339..54ab502 100644 --- a/doc/component-operation-guide-lts/source/using_loader/exporting_data/index.rst +++ b/doc/component-operation-guide-lts/source/using_loader/exporting_data/index.rst @@ -5,7 +5,7 @@ Exporting Data ============== -- :ref:`Overview ` +- :ref:`Loader Exporting Data Overview ` - :ref:`Using Loader to Export Data ` - :ref:`Typical Scenario: Exporting Data from HDFS/OBS to an SFTP Server ` - :ref:`Typical Scenario: Exporting Data from HBase to an SFTP Server ` @@ -21,7 +21,7 @@ Exporting Data :maxdepth: 1 :hidden: - overview + loader_exporting_data_overview using_loader_to_export_data typical_scenario_exporting_data_from_hdfs_obs_to_an_sftp_server typical_scenario_exporting_data_from_hbase_to_an_sftp_server diff --git a/doc/component-operation-guide-lts/source/using_loader/exporting_data/overview.rst b/doc/component-operation-guide-lts/source/using_loader/exporting_data/loader_exporting_data_overview.rst similarity index 98% rename from doc/component-operation-guide-lts/source/using_loader/exporting_data/overview.rst rename to doc/component-operation-guide-lts/source/using_loader/exporting_data/loader_exporting_data_overview.rst index 5e6e984..889cf60 100644 --- a/doc/component-operation-guide-lts/source/using_loader/exporting_data/overview.rst +++ b/doc/component-operation-guide-lts/source/using_loader/exporting_data/loader_exporting_data_overview.rst @@ -2,8 +2,8 @@ .. _mrs_01_1101: -Overview -======== +Loader Exporting Data Overview +============================== Description ----------- diff --git a/doc/component-operation-guide-lts/source/using_loader/importing_data/index.rst b/doc/component-operation-guide-lts/source/using_loader/importing_data/index.rst index 1b1d995..ace00d3 100644 --- a/doc/component-operation-guide-lts/source/using_loader/importing_data/index.rst +++ b/doc/component-operation-guide-lts/source/using_loader/importing_data/index.rst @@ -5,7 +5,7 @@ Importing Data ============== -- :ref:`Overview ` +- :ref:`Loader Importing Data Overview ` - :ref:`Importing Data Using Loader ` - :ref:`Typical Scenario: Importing Data from an SFTP Server to HDFS or OBS ` - :ref:`Typical Scenario: Importing Data from an SFTP Server to HBase ` @@ -24,7 +24,7 @@ Importing Data :maxdepth: 1 :hidden: - overview + loader_importing_data_overview importing_data_using_loader typical_scenario_importing_data_from_an_sftp_server_to_hdfs_or_obs typical_scenario_importing_data_from_an_sftp_server_to_hbase diff --git a/doc/component-operation-guide-lts/source/using_loader/importing_data/overview.rst b/doc/component-operation-guide-lts/source/using_loader/importing_data/loader_importing_data_overview.rst similarity index 98% rename from doc/component-operation-guide-lts/source/using_loader/importing_data/overview.rst rename to doc/component-operation-guide-lts/source/using_loader/importing_data/loader_importing_data_overview.rst index 7219f57..be2b6ea 100644 --- a/doc/component-operation-guide-lts/source/using_loader/importing_data/overview.rst +++ b/doc/component-operation-guide-lts/source/using_loader/importing_data/loader_importing_data_overview.rst @@ -2,8 +2,8 @@ .. _mrs_01_1087: -Overview -======== +Loader Importing Data Overview +============================== Description ----------- diff --git a/doc/component-operation-guide-lts/source/using_loader/operator_help/index.rst b/doc/component-operation-guide-lts/source/using_loader/operator_help/index.rst index 40d21b0..99aef79 100644 --- a/doc/component-operation-guide-lts/source/using_loader/operator_help/index.rst +++ b/doc/component-operation-guide-lts/source/using_loader/operator_help/index.rst @@ -5,7 +5,7 @@ Operator Help ============= -- :ref:`Overview ` +- :ref:`Loader Operator Overview ` - :ref:`Input Operators ` - :ref:`Conversion Operators ` - :ref:`Output Operators ` @@ -17,7 +17,7 @@ Operator Help :maxdepth: 1 :hidden: - overview + loader_operator_overview input_operators/index conversion_operators/index output_operators/index diff --git a/doc/component-operation-guide-lts/source/using_loader/operator_help/overview.rst b/doc/component-operation-guide-lts/source/using_loader/operator_help/loader_operator_overview.rst similarity index 99% rename from doc/component-operation-guide-lts/source/using_loader/operator_help/overview.rst rename to doc/component-operation-guide-lts/source/using_loader/operator_help/loader_operator_overview.rst index f2012e2..bdaa435 100644 --- a/doc/component-operation-guide-lts/source/using_loader/operator_help/overview.rst +++ b/doc/component-operation-guide-lts/source/using_loader/operator_help/loader_operator_overview.rst @@ -2,8 +2,8 @@ .. _mrs_01_1120: -Overview -======== +Loader Operator Overview +======================== Conversion Process ------------------ diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/creating_a_workflow.rst b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/creating_a_workflow.rst index 77e7e07..9b8e1d7 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/creating_a_workflow.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/creating_a_workflow.rst @@ -26,14 +26,14 @@ Procedure For submitting different job types, follow instructions in the following sections: - - :ref:`Submitting a Hive2 Job ` - - :ref:`Submitting a Spark2x Job ` - - :ref:`Submitting a Java Job ` - - :ref:`Submitting a Loader Job ` - - :ref:`Submitting a MapReduce Job ` - - :ref:`Submitting a Sub-workflow Job ` - - :ref:`Submitting a Shell Job ` - - :ref:`Submitting an HDFS Job ` - - :ref:`Submitting a DistCp Job ` + - :ref:`Submitting a Hive2 Job in Hue ` + - :ref:`Submitting a Spark2x Job in Hue ` + - :ref:`Submitting a Java Job in Hue ` + - :ref:`Submitting a Loader Job in Hue ` + - :ref:`Submitting a MapReduce Job in Hue ` + - :ref:`Submitting a Sub-workflow Job in Hue ` + - :ref:`Submitting a Shell Job in Hue ` + - :ref:`Submitting an HDFS Job in Hue ` + - :ref:`Submitting a DistCp Job in Hue ` .. |image1| image:: /_static/images/en-us_image_0000001296059856.png diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/example_of_mutual_trust_operations.rst b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/example_of_mutual_trust_operations_in_hue.rst similarity index 96% rename from doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/example_of_mutual_trust_operations.rst rename to doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/example_of_mutual_trust_operations_in_hue.rst index 166be74..0f4c96c 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/example_of_mutual_trust_operations.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/example_of_mutual_trust_operations_in_hue.rst @@ -2,8 +2,8 @@ .. _mrs_01_1830: -Example of Mutual Trust Operations -================================== +Example of Mutual Trust Operations in Hue +========================================= Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/index.rst b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/index.rst index 6286aa5..1f247fc 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/index.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/index.rst @@ -5,34 +5,34 @@ Submitting a Workflow Job ========================= -- :ref:`Submitting a Hive2 Job ` -- :ref:`Submitting a Spark2x Job ` -- :ref:`Submitting a Java Job ` -- :ref:`Submitting a Loader Job ` -- :ref:`Submitting a MapReduce Job ` -- :ref:`Submitting a Sub-workflow Job ` -- :ref:`Submitting a Shell Job ` -- :ref:`Submitting an HDFS Job ` -- :ref:`Submitting a DistCp Job ` -- :ref:`Example of Mutual Trust Operations ` -- :ref:`Submitting an SSH Job ` -- :ref:`Submitting a Hive Script ` -- :ref:`Submitting an Email Job ` +- :ref:`Submitting a Hive2 Job in Hue ` +- :ref:`Submitting a Spark2x Job in Hue ` +- :ref:`Submitting a Java Job in Hue ` +- :ref:`Submitting a Loader Job in Hue ` +- :ref:`Submitting a MapReduce Job in Hue ` +- :ref:`Submitting a Sub-workflow Job in Hue ` +- :ref:`Submitting a Shell Job in Hue ` +- :ref:`Submitting an HDFS Job in Hue ` +- :ref:`Submitting a DistCp Job in Hue ` +- :ref:`Example of Mutual Trust Operations in Hue ` +- :ref:`Submitting an SSH Job in Hue ` +- :ref:`Submitting a Hive Script in Hue ` +- :ref:`Submitting an Email Job in Hue ` .. toctree:: :maxdepth: 1 :hidden: - submitting_a_hive2_job - submitting_a_spark2x_job - submitting_a_java_job - submitting_a_loader_job - submitting_a_mapreduce_job - submitting_a_sub-workflow_job - submitting_a_shell_job - submitting_an_hdfs_job - submitting_a_distcp_job - example_of_mutual_trust_operations - submitting_an_ssh_job - submitting_a_hive_script - submitting_an_email_job + submitting_a_hive2_job_in_hue + submitting_a_spark2x_job_in_hue + submitting_a_java_job_in_hue + submitting_a_loader_job_in_hue + submitting_a_mapreduce_job_in_hue + submitting_a_sub-workflow_job_in_hue + submitting_a_shell_job_in_hue + submitting_an_hdfs_job_in_hue + submitting_a_distcp_job_in_hue + example_of_mutual_trust_operations_in_hue + submitting_an_ssh_job_in_hue + submitting_a_hive_script_in_hue + submitting_an_email_job_in_hue diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_distcp_job.rst b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_distcp_job_in_hue.rst similarity index 98% rename from doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_distcp_job.rst rename to doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_distcp_job_in_hue.rst index ebface2..afe2341 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_distcp_job.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_distcp_job_in_hue.rst @@ -2,8 +2,8 @@ .. _mrs_01_1829: -Submitting a DistCp Job -======================= +Submitting a DistCp Job in Hue +============================== Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_hive2_job.rst b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_hive2_job_in_hue.rst similarity index 97% rename from doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_hive2_job.rst rename to doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_hive2_job_in_hue.rst index 0f15f4e..319025e 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_hive2_job.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_hive2_job_in_hue.rst @@ -2,8 +2,8 @@ .. _mrs_01_1820: -Submitting a Hive2 Job -====================== +Submitting a Hive2 Job in Hue +============================= Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_hive_script.rst b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_hive_script_in_hue.rst similarity index 93% rename from doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_hive_script.rst rename to doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_hive_script_in_hue.rst index 323c2bf..4753620 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_hive_script.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_hive_script_in_hue.rst @@ -2,8 +2,8 @@ .. _mrs_01_2372: -Submitting a Hive Script -======================== +Submitting a Hive Script in Hue +=============================== Scenario -------- @@ -23,7 +23,7 @@ Procedure |image3| -#. Configure the Job XML, for example, to the HDFS path **/user/admin/examples/apps/hive2/hive-site.xml**. For details, see :ref:`Submitting a Hive2 Job `. +#. Configure the Job XML, for example, to the HDFS path **/user/admin/examples/apps/hive2/hive-site.xml**. For details, see :ref:`Submitting a Hive2 Job in Hue `. #. Click |image4| in the upper right corner of the Oozie editor. diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_java_job.rst b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_java_job_in_hue.rst similarity index 95% rename from doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_java_job.rst rename to doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_java_job_in_hue.rst index 8fbe333..962128f 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_java_job.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_java_job_in_hue.rst @@ -2,8 +2,8 @@ .. _mrs_01_1822: -Submitting a Java Job -===================== +Submitting a Java Job in Hue +============================ Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_loader_job.rst b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_loader_job_in_hue.rst similarity index 95% rename from doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_loader_job.rst rename to doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_loader_job_in_hue.rst index a7bc623..3268d76 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_loader_job.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_loader_job_in_hue.rst @@ -2,8 +2,8 @@ .. _mrs_01_1823: -Submitting a Loader Job -======================= +Submitting a Loader Job in Hue +============================== Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_mapreduce_job.rst b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_mapreduce_job_in_hue.rst similarity index 96% rename from doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_mapreduce_job.rst rename to doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_mapreduce_job_in_hue.rst index 9920814..1ecb94b 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_mapreduce_job.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_mapreduce_job_in_hue.rst @@ -2,8 +2,8 @@ .. _mrs_01_1824: -Submitting a MapReduce Job -========================== +Submitting a MapReduce Job in Hue +================================= Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_shell_job.rst b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_shell_job_in_hue.rst similarity index 96% rename from doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_shell_job.rst rename to doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_shell_job_in_hue.rst index 18aa945..810f87b 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_shell_job.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_shell_job_in_hue.rst @@ -2,8 +2,8 @@ .. _mrs_01_1826: -Submitting a Shell Job -====================== +Submitting a Shell Job in Hue +============================= Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_spark2x_job.rst b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_spark2x_job_in_hue.rst similarity index 97% rename from doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_spark2x_job.rst rename to doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_spark2x_job_in_hue.rst index a1cef6c..e1c88f5 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_spark2x_job.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_spark2x_job_in_hue.rst @@ -2,8 +2,8 @@ .. _mrs_01_1821: -Submitting a Spark2x Job -======================== +Submitting a Spark2x Job in Hue +=============================== Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_sub-workflow_job.rst b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_sub-workflow_job_in_hue.rst similarity index 94% rename from doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_sub-workflow_job.rst rename to doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_sub-workflow_job_in_hue.rst index 2e6f772..5c00b25 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_sub-workflow_job.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_a_sub-workflow_job_in_hue.rst @@ -2,8 +2,8 @@ .. _mrs_01_1825: -Submitting a Sub-workflow Job -============================= +Submitting a Sub-workflow Job in Hue +==================================== Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_an_email_job.rst b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_an_email_job_in_hue.rst similarity index 98% rename from doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_an_email_job.rst rename to doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_an_email_job_in_hue.rst index 61e492f..048dc1b 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_an_email_job.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_an_email_job_in_hue.rst @@ -2,8 +2,8 @@ .. _mrs_01_24114: -Submitting an Email Job -======================= +Submitting an Email Job in Hue +============================== Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_an_hdfs_job.rst b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_an_hdfs_job_in_hue.rst similarity index 95% rename from doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_an_hdfs_job.rst rename to doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_an_hdfs_job_in_hue.rst index 05bbee0..0a7e500 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_an_hdfs_job.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_an_hdfs_job_in_hue.rst @@ -2,8 +2,8 @@ .. _mrs_01_1827: -Submitting an HDFS Job -====================== +Submitting an HDFS Job in Hue +============================= Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_an_ssh_job.rst b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_an_ssh_job_in_hue.rst similarity index 91% rename from doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_an_ssh_job.rst rename to doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_an_ssh_job_in_hue.rst index ff23740..cb802c7 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_an_ssh_job.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_hue_to_submit_an_oozie_job/submitting_a_workflow_job/submitting_an_ssh_job_in_hue.rst @@ -2,8 +2,8 @@ .. _mrs_01_1831: -Submitting an SSH Job -===================== +Submitting an SSH Job in Hue +============================ Scenario -------- @@ -15,7 +15,7 @@ Procedure #. Create a workflow. For details, see :ref:`Creating a Workflow `. -#. For details about how to add the trust relationship, see :ref:`Example of Mutual Trust Operations `. +#. For details about how to add the trust relationship, see :ref:`Example of Mutual Trust Operations in Hue `. #. On the workflow editing page, select the **Ssh** button |image1| and drag it to the operation area. diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/index.rst b/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/index.rst index ce4999d..b276ced 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/index.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/index.rst @@ -5,18 +5,18 @@ Using Oozie Client to Submit an Oozie Job ========================================= -- :ref:`Submitting a Hive Job ` -- :ref:`Submitting a Spark2x Job ` -- :ref:`Submitting a Loader Job ` -- :ref:`Submitting a DistCp Job ` -- :ref:`Submitting Other Jobs ` +- :ref:`Submitting a Hive Job with Oozie Client ` +- :ref:`Submitting a Spark2x Job with Oozie Client ` +- :ref:`Submitting a Loader Job with Oozie Client ` +- :ref:`Submitting a DistCp Job with Oozie Client ` +- :ref:`Submitting Other Jobs with Oozie Client ` .. toctree:: :maxdepth: 1 :hidden: - submitting_a_hive_job - submitting_a_spark2x_job - submitting_a_loader_job - submitting_a_distcp_job - submitting_other_jobs + submitting_a_hive_job_with_oozie_client + submitting_a_spark2x_job_with_oozie_client + submitting_a_loader_job_with_oozie_client + submitting_a_distcp_job_with_oozie_client + submitting_other_jobs_with_oozie_client diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_distcp_job.rst b/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_distcp_job_with_oozie_client.rst similarity index 98% rename from doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_distcp_job.rst rename to doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_distcp_job_with_oozie_client.rst index dd61866..fb9f8fa 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_distcp_job.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_distcp_job_with_oozie_client.rst @@ -2,8 +2,8 @@ .. _mrs_01_2392: -Submitting a DistCp Job -======================= +Submitting a DistCp Job with Oozie Client +========================================= Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_hive_job.rst b/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_hive_job_with_oozie_client.rst similarity index 98% rename from doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_hive_job.rst rename to doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_hive_job_with_oozie_client.rst index 9a006b0..d814af2 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_hive_job.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_hive_job_with_oozie_client.rst @@ -2,8 +2,8 @@ .. _mrs_01_1813: -Submitting a Hive Job -===================== +Submitting a Hive Job with Oozie Client +======================================= Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_loader_job.rst b/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_loader_job_with_oozie_client.rst similarity index 98% rename from doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_loader_job.rst rename to doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_loader_job_with_oozie_client.rst index 3fcff09..fdaf048 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_loader_job.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_loader_job_with_oozie_client.rst @@ -2,8 +2,8 @@ .. _mrs_01_1815: -Submitting a Loader Job -======================= +Submitting a Loader Job with Oozie Client +========================================= Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_spark2x_job.rst b/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_spark2x_job_with_oozie_client.rst similarity index 97% rename from doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_spark2x_job.rst rename to doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_spark2x_job_with_oozie_client.rst index 977185c..f50b31f 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_spark2x_job.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_a_spark2x_job_with_oozie_client.rst @@ -2,8 +2,8 @@ .. _mrs_01_1814: -Submitting a Spark2x Job -======================== +Submitting a Spark2x Job with Oozie Client +========================================== Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_other_jobs.rst b/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_other_jobs_with_oozie_client.rst similarity index 98% rename from doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_other_jobs.rst rename to doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_other_jobs_with_oozie_client.rst index 43b0700..863ccda 100644 --- a/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_other_jobs.rst +++ b/doc/component-operation-guide-lts/source/using_oozie/using_oozie_client_to_submit_an_oozie_job/submitting_other_jobs_with_oozie_client.rst @@ -2,8 +2,8 @@ .. _mrs_01_1816: -Submitting Other Jobs -===================== +Submitting Other Jobs with Oozie Client +======================================= Scenario -------- diff --git a/doc/component-operation-guide-lts/source/using_ranger/adding_a_ranger_access_permission_policy_for_hetuengine.rst b/doc/component-operation-guide-lts/source/using_ranger/adding_a_ranger_access_permission_policy_for_hetuengine.rst index 8295311..93c9879 100644 --- a/doc/component-operation-guide-lts/source/using_ranger/adding_a_ranger_access_permission_policy_for_hetuengine.rst +++ b/doc/component-operation-guide-lts/source/using_ranger/adding_a_ranger_access_permission_policy_for_hetuengine.rst @@ -239,7 +239,7 @@ Ranger supports data masking for HetuEngine data. It can process the return resu | | | | | Click **Select Masking Option** and select a data masking policy. | | | | - | | - **Redact**: Use **x** to mask all letters and **n** to mask all digits. | + | | - **Redact**: Use **x** to mask all letters and **0** to mask all digits. | | | - **Partial mask: show last 4**: Only the last four characters are displayed, and the rest characters are displayed using **x**. | | | - **Partial mask: show first 4**: Only the first four characters are displayed, and the rest characters are displayed using **x**. | | | - **Hash**: Replace the original value with the hash value. | diff --git a/doc/component-operation-guide-lts/source/using_ranger/adding_a_ranger_access_permission_policy_for_hive.rst b/doc/component-operation-guide-lts/source/using_ranger/adding_a_ranger_access_permission_policy_for_hive.rst index 6bf8763..7a4b3a8 100644 --- a/doc/component-operation-guide-lts/source/using_ranger/adding_a_ranger_access_permission_policy_for_hive.rst +++ b/doc/component-operation-guide-lts/source/using_ranger/adding_a_ranger_access_permission_policy_for_hive.rst @@ -217,7 +217,7 @@ Ranger supports data masking for Hive data. It can process the returned result o | | | | | Click **Select Masking Option** and select a data masking policy. | | | | - | | - Redact: Use **x** to mask all letters and **n** to mask all digits. | + | | - Redact: Use **x** to mask all letters and **0** to mask all digits. | | | - Partial mask: show last 4: Only the last four characters are displayed, and the rest characters are displayed using **x**. | | | - Partial mask: show first 4: Only the first four characters are displayed, and the rest characters are displayed using **x**. | | | - Hash: Replace the original value with the hash value. The Hive built-in function **mask_hash** is used. This is valid only for fields of the string, character, and varchar types. NULL is returned for fields of other types. | diff --git a/doc/component-operation-guide-lts/source/using_ranger/adding_a_ranger_access_permission_policy_for_spark2x.rst b/doc/component-operation-guide-lts/source/using_ranger/adding_a_ranger_access_permission_policy_for_spark2x.rst index d9447a6..5a382d7 100644 --- a/doc/component-operation-guide-lts/source/using_ranger/adding_a_ranger_access_permission_policy_for_spark2x.rst +++ b/doc/component-operation-guide-lts/source/using_ranger/adding_a_ranger_access_permission_policy_for_spark2x.rst @@ -220,7 +220,7 @@ Ranger supports data masking for Spark2x data. It can process the returned resul | | | | | Click **Select Masking Option** and select a data masking policy. | | | | - | | - Redact: Use **x** to mask all letters and **n** to mask all digits. | + | | - Redact: Use **x** to mask all letters and **0** to mask all digits. | | | - Partial mask: show last 4: Only the last four characters are displayed. | | | - Partial mask: show first 4: Only the first four characters are displayed. | | | - Hash: Perform hash calculation for data. |