Creating a DataArts Migration Resource Group Incremental Package

This type of incremental package provides resource groups for real-time jobs in DataArts Migration. DataArts Migration resource groups can be used to migrate data to the cloud and ingest data into and export data out of a data lake. It provides wizard-based configuration and management and can migrate all and incremental data from a single table, entire database, or database or table shard.

DataArts Migration resource groups can be used in the following scenarios:

They can be used to create and run real-time processing migration jobs to migrate data to the cloud or ingest data into the data lake.

By default, a DataArts Studio instance does not contain DataArts Migration resource groups. If you want to migrate data in real time, create a DataArts Migration resource group incremental package.

Context

Creating a DataArts Migration Resource Group

  1. You can buy a resource group in either of the following ways:
    • Method 1

      Locate an enabled instance and click Create.

      Figure 1 Incremental package
    • Method 2
      1. Locate an instance and click Access.
      2. In the upper right corner, click Buy.
    • Method 3
      1. Locate an instance, click More, and select Resources.
        Figure 2 Accessing Resources
      2. On the Real-Time Resources tab page, click Buy Resource Group.
        Figure 3 Buying a resource group
  1. On the displayed page, set parameters based on Table 1.
    Figure 4 Creating a DataArts Migration resource group
    Table 1 Parameters for the DataArts Migration resource group incremental package

    Parameter

    Description

    Package

    DataArts Migration resource group

    Name

    Enter the resource group name.

    Description

    Enter a description for the DataArts Migration resource group.

    Specifications

    Select the specifications for the resource group, including the CU value, applicable environment, and maximum number of jobs that can be created.

    The maximum number of migration tasks or jobs that can be created varies depending on the resource group specifications. Select the specifications that suit your needs. A maximum of 50 tables can be created for a single job (at least 2 CUs are required).

    Small: 16 CUs and a maximum of 7 jobs This option is applicable to tests and does not support high availability. It is not recommended.

    Medium: 64 CUs and a maximum of 32 jobs

    Large: 96 CUs and a maximum of 48 jobs

    Super-large: 128 CUs and a maximum of 64 jobs

    Network Segment

    Recommended network segments:

    • 10.0.0.0–10.255.0.0/8–19
    • 172.16.0.0–172.31.0.0/12–19
    • 192.168.0.0~192.168.0.0/16 ~19
      NOTE:
      • To use VPC peering connections, set a network segment that does not overlap with that of the source and destination cluster or instance. If they overlap, the network will be disconnected.
      • Restricted by the CCE logic, the maximum length of the network segment mask is 19 bits. Network segments with a mask longer than 20 bits are not supported.

    Discount Quota (Hour)

    A discount package is prepaid by month or year. Compared with pay-per-use billing, the fee is reduced by 15% to 29%.

    • You cannot modify the specifications of an existing resource group. If you need higher specifications, create another resource group.
    • A pay-per-use resource package in use cannot be unsubscribed from. For details, see .
  2. Click Create Now, confirm the settings, and click Next. If the resource group fails to be created and a quota issue is displayed, contact the service personnel to apply for a quota.
  3. Go to the corresponding workspace to view the DataArts Migration resource group you have created.
  1. On the displayed page, set the following parameters:
    1. Select DataArts Migration resource group for Package.
    2. Select Pay-per-Use Package for Billing Mode.
    3. Specify a validity period in Required Duration for the package.
    4. Enter the number of subscribed packages in Quantity. For example, if you set Required Duration to 1 month and Quantity to 2, you will have a 1,490-hour quota in one month.
  2. Click Buy Now, confirm the specifications, and click Next.
  3. After you buy this package, the system will not automatically create a DataArts Migration resource group. You need to buy a pay-per-use incremental package in the same region and with the same specifications as this package by following the instructions in Creating a DataArts Migration Resource Group. Then you can enjoy the favorable price of this package.