mikacur/MRS-operation-guide-lts
1
0
Fork 0
forked from docs/mapreduce-service
Code Pull Requests Activity

Update content

Browse Source
This commit is contained in:
OpenTelekomCloud Proposal Bot 2023-09-13 09:24:55 +00:00
parent af30c87347
commit bf823a143a
5 changed files with 140 additions and 347 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

77
api-ref/source/apis/cluster_management_apis_v1/creating_a_cluster_and_running_a_job.rst
View File

File diff suppressed because it is too large Load Diff

116
api-ref/source/apis/cluster_management_apis_v1/querying_a_cluster_list.rst
View File

File diff suppressed because it is too large Load Diff

118
api-ref/source/apis/cluster_management_apis_v1/querying_cluster_details.rst
View File

File diff suppressed because it is too large Load Diff

47
api-ref/source/apis/cluster_management_apis_v2/creating_clusters.rst
View File

@ -27,9 +27,9 @@ Before using the API, you need to obtain the resources listed in :ref:`Table 1 <
+-----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Zone | Obtain the region and AZ information. For more information about regions and AZs, see `Regions and Endpoints <https://docs.otc.t-systems.com/en-us/endpoint/index.html>`__. | | Zone | Obtain the region and AZ information. For more information about regions and AZs, see `Regions and Endpoints <https://docs.otc.t-systems.com/en-us/endpoint/index.html>`__. |
+-----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Version | Currently, MRS 1.6.3, MRS 1.7.2, MRS 1.9.2 MRS 2.1.0, MRS 3.1.0-LTS.1, MRS 3.1.2-LTS.3 and MRS3.2.0-LTS.1 are supported. | | Version | Currently, MRS 3.1.2-LTS.3 and MRS 3.2.0-LTS.2 are supported. |
+-----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Component | - MRS 3.2.0-LTS.1 supports the following components: | | Component | - MRS 3.2.0-LTS.2 supports the following components: |
| | | | | |
| | - An analysis cluster contains the following components: Hadoop, Spark2x, HBase, Hive, Hue, Loader, Flink, Oozie, ZooKeeper, HetuEngine, Ranger, and Tez. | | | - An analysis cluster contains the following components: Hadoop, Spark2x, HBase, Hive, Hue, Loader, Flink, Oozie, ZooKeeper, HetuEngine, Ranger, and Tez. |
| | - A streaming cluster contains the following components: Kafka, Flume, ZooKeeper, and Ranger. | | | - A streaming cluster contains the following components: Kafka, Flume, ZooKeeper, and Ranger. |
@ -43,30 +43,6 @@ Before using the API, you need to obtain the resources listed in :ref:`Table 1 <
| | - The streaming cluster contains the following components: Kafka, Flume, ZooKeeper, and Ranger. | | | - The streaming cluster contains the following components: Kafka, Flume, ZooKeeper, and Ranger. |
| | - The hybrid cluster contains the following components: Hadoop, Spark2x, HBase, Hive, Hue, HetuEngine, Loader, Flink, Oozie, ZooKeeper, Ranger, Tez, Kafka, and Flume. | | | - The hybrid cluster contains the following components: Hadoop, Spark2x, HBase, Hive, Hue, HetuEngine, Loader, Flink, Oozie, ZooKeeper, Ranger, Tez, Kafka, and Flume. |
| | - A custom cluster contains the following components: Hadoop, Spark2x, HBase, Hive, Hue, HetuEngine, Loader, Kafka, Flume, Flink, Oozie, ZooKeeper, Ranger, Tez, and ClickHouse. | | | - A custom cluster contains the following components: Hadoop, Spark2x, HBase, Hive, Hue, HetuEngine, Loader, Kafka, Flume, Flink, Oozie, ZooKeeper, Ranger, Tez, and ClickHouse. |
| | |
| | - MRS 3.1.0-LTS.1 supports the following components: |
| | |
| | - The analysis cluster contains the following components: Hadoop, Spark2x, HBase, Hive, Hue, HetuEngine, Loader, Flink, Oozie, ZooKeeper, Ranger, and Tez. |
| | - The streaming cluster contains the following components: Kafka, Flume, ZooKeeper, and Ranger. |
| | - The hybrid cluster contains the following components: Hadoop, Spark2x, HBase, Hive, Hue, HetuEngine, Loader, Flink, Oozie, ZooKeeper, Ranger, Tez, Kafka, and Flume. |
| | - A custom cluster contains the following components: Hadoop, Spark2x, HBase, Hive, Hue, HetuEngine, Loader, Kafka, Flume, Flink, Oozie, ZooKeeper, Ranger, and Tez. |
| | |
| | - MRS 2.1.0 supports the following components: |
| | |
| | - The analysis cluster contains the following components: Presto, Hadoop, Spark, HBase, Hive, Hue, Loader, Tez, Flink. |
| | - The streaming cluster contains the following components: Kafka, Storm, and Flume. |
| | - The hybrid cluster contains the following components: Hadoop, Hive, Presto, Spark, Tez, and Flink. |
| | |
| | - MRS 1.9.2 supports the following components: |
| | |
| | - The analysis cluster contains the following components: Presto, Hadoop, Spark, HBase, Opentsdb, Hive, Hue, Loader, Tez, Flink, Alluxio and Ranger |
| | - The streaming cluster contains the following components: Kafka, KafkaManager, Storm, and Flume. |
| | - The hybrid cluster contains the following components: Hadoop, Hive, Presto, Spark, Tez, Kafka, Flink, and Ranger. |
| | |
| | - MRS 1.7.2 and MRS 1.6.3 support the following components: |
| | |
| | - The analysis cluster contains the following components: Hadoop, Spark, HBase, Hive, Hue, and Loader |
| | - The streaming cluster contains the following components: Kafka, Storm, and Flume. |
+-----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
URI URI
@ -98,13 +74,8 @@ Request
| | | | | | | | | |
| | | | Possible values are as follows: | | | | | Possible values are as follows: |
| | | | | | | | | |
| | | | - MRS 1.6.3 |
| | | | - MRS 1.7.2 |
| | | | - MRS 1.9.2 |
| | | | - MRS 2.1.0 |
| | | | - MRS 3.1.0-LTS.1 |
| | | | - MRS 3.1.2-LTS.3 | | | | | - MRS 3.1.2-LTS.3 |
| | | | - MRS 3.2.1-LTS.1 | | | | | - MRS 3.2.0-LTS.2 |
+------------------------+-----------------+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +------------------------+-----------------+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| cluster_name | Yes | String | Cluster name. It must be unique. | | cluster_name | Yes | String | Cluster name. It must be unique. |
| | | | | | | | | |
@ -139,7 +110,7 @@ Request
| | | | | | | | | |
| | | | On the **Virtual Private Cloud** page, obtain the subnet name of the VPC from the list. | | | | | On the **Virtual Private Cloud** page, obtain the subnet name of the VPC from the list. |
+------------------------+-----------------+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +------------------------+-----------------+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| components | Yes | String | List of component names, which are separated by commas (,). For details about the component names, see the component list of each version in Table 4-1. | | components | Yes | String | List of component names, which are separated by commas (,). For details about the component names, see the component list of each version in :ref:`Table 1 <mrs_02_0101__tbbd2986d18874f82a8ab886ac25a57f8>`. |
+------------------------+-----------------+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +------------------------+-----------------+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| availability_zone | Yes | String | Name of an AZ. | | availability_zone | Yes | String | Name of an AZ. |
| | | | | | | | | |
@ -167,10 +138,6 @@ Request
| | | | - Spaces | | | | | - Spaces |
| | | | | | | | | |
| | | | - Cannot be the username or the username spelled backwards. | | | | | - Cannot be the username or the username spelled backwards. |
| | | | |
| | | | .. note:: |
| | | | |
| | | | For MRS 1.7.2 or earlier, this parameter is mandatory only when **safe_mode** is set to **KERBEROS**. |
+------------------------+-----------------+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +------------------------+-----------------+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| login_mode | Yes | String | Node login mode. | | login_mode | Yes | String | Node login mode. |
| | | | | | | | | |
@ -215,8 +182,6 @@ Request
| node_groups | Yes | Array of NodeGroup | Information about the node groups in the cluster. For details about the parameters, see :ref:`Table 5 <mrs_02_0101__table3419221413>`. | | node_groups | Yes | Array of NodeGroup | Information about the node groups in the cluster. For details about the parameters, see :ref:`Table 5 <mrs_02_0101__table3419221413>`. |
+------------------------+-----------------+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +------------------------+-----------------+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| bootstrap_scripts | No | Array of BootstrapScript | Bootstrap action script information. For more parameter description, see :ref:`Table 8 <mrs_02_0101__table1258382865010>`. | | bootstrap_scripts | No | Array of BootstrapScript | Bootstrap action script information. For more parameter description, see :ref:`Table 8 <mrs_02_0101__table1258382865010>`. |
| | | | |
| | | | MRS 1.7.2 or later supports this parameter. |
+------------------------+-----------------+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +------------------------+-----------------+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| add_jobs | No | Array of AddJobReq | Jobs can be submitted when a cluster is created. Currently, only one job can be created. For details about job parameters, see :ref:`Table 9 <mrs_02_0101__t8ded0b3ae11742cea98a467ce26fd093>`. | | add_jobs | No | Array of AddJobReq | Jobs can be submitted when a cluster is created. Currently, only one job can be created. For details about job parameters, see :ref:`Table 9 <mrs_02_0101__t8ded0b3ae11742cea98a467ce26fd093>`. |
+------------------------+-----------------+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +------------------------+-----------------+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
@ -475,12 +440,8 @@ Request
| resources_plans | No | List | Resource plan list. For details, see :ref:`Table 11 <mrs_02_0101__table10281451162111>`. If this parameter is left blank, the resource plan is disabled. | | resources_plans | No | List | Resource plan list. For details, see :ref:`Table 11 <mrs_02_0101__table10281451162111>`. If this parameter is left blank, the resource plan is disabled. |
| | | | | | | | | |
| | | | When auto scaling is enabled, either a resource plan or an auto scaling rule must be configured. | | | | | When auto scaling is enabled, either a resource plan or an auto scaling rule must be configured. |
| | | | |
| | | | MRS 1.6.3 or later supports this parameter. |
+---------------------+-----------------+-----------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------------------+-----------------+-----------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| exec_scripts | No | List | List of custom scaling automation scripts. For details, see :ref:`Table 12 <mrs_02_0101__table1921110172216>`. If this parameter is left blank, a hook script is disabled. | | exec_scripts | No | List | List of custom scaling automation scripts. For details, see :ref:`Table 12 <mrs_02_0101__table1921110172216>`. If this parameter is left blank, a hook script is disabled. |
| | | | |
| | | | MRS 1.7.2 or later supports this parameter. |
+---------------------+-----------------+-----------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------------------+-----------------+-----------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| rules | No | List | List of auto scaling rules. For details, see :ref:`Table 13 <mrs_02_0101__t4c9e3e169631470d81d260543affb7e1>`. | | rules | No | List | List of auto scaling rules. For details, see :ref:`Table 13 <mrs_02_0101__t4c9e3e169631470d81d260543affb7e1>`. |
| | | | | | | | | |

1
api-ref/source/change_history.rst
View File

@ -11,6 +11,7 @@ Change History
| 2023-09-06 | - Added an API for changing a cluster name. For details, see :ref:`Changing a Cluster Name <mrs_02_0201>`. | | 2023-09-06 | - Added an API for changing a cluster name. For details, see :ref:`Changing a Cluster Name <mrs_02_0201>`. |
| | | | | |
| | - Added an API for checking auto scaling policies. For details, see :ref:`Viewing Auto Scaling Policies <mrs_02_0200>`. | | | - Added an API for checking auto scaling policies. For details, see :ref:`Viewing Auto Scaling Policies <mrs_02_0200>`. |
| | - Updated the description of the MRS cluster version based on the site requirements. For details, see :ref:`Creating Clusters <mrs_02_0101>` and :ref:`Creating a Cluster and Running a Job <mrs_02_0028>`. |
+-----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| 2023-08-03 | - Modified the available specifications for MRS clusters. For details, see :ref:`ECS Specifications Used by MRS <mrs_01_9005>`. | | 2023-08-03 | - Modified the available specifications for MRS clusters. For details, see :ref:`ECS Specifications Used by MRS <mrs_01_9005>`. |
+-----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ +-----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+