forked from docs/doc-exports
chenxiaoxiong
f9e2808b7c
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: chenxiaoxiong <chenxiaoxiong@huawei.com> Co-committed-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
130 lines
35 KiB
HTML
130 lines
35 KiB
HTML
<a name="dataartsstudio_01_0098"></a><a name="dataartsstudio_01_0098"></a>
|
|
|
|
<h1 class="topictitle1">Migrating an Entire MySQL Database to RDS</h1>
|
|
<div id="body8662426"><div class="section" id="dataartsstudio_01_0098__en-us_topic_0108275389_section21020958143223"><h4 class="sectiontitle">Scenario</h4><p id="dataartsstudio_01_0098__en-us_topic_0108275389_p2512222093411">This section describes how to migrate the entire on-premises MySQL database to RDS using the CDM's entire DB migration function.</p>
|
|
<p id="dataartsstudio_01_0098__en-us_topic_0108275389_p40358636185948">Currently, CDM can migrate the entire on-premises MySQL database to RDS for MySQL, RDS for PostgreSQL, or RDS for SQL Server. The following describes how to migrate the entire database to RDS. The procedure is as follows:</p>
|
|
<ol id="dataartsstudio_01_0098__en-us_topic_0108275389_ol1285624335512"><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li2856343185511"><a href="#dataartsstudio_01_0098__en-us_topic_0108275389_section563314494359">Creating a CDM Cluster and Binding an EIP to the Cluster</a></li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li18845154182010"><a href="#dataartsstudio_01_0098__en-us_topic_0108275389_section3392631930">Creating a MySQL Link</a></li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li1328254972017"><a href="#dataartsstudio_01_0098__en-us_topic_0108275389_section196516591234">Creating an RDS Link</a></li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li345435614209"><a href="#dataartsstudio_01_0098__en-us_topic_0108275389_section1508747294234">Creating an Entire DB Migration Job</a></li></ol>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0098__en-us_topic_0108275389_section5787168294234"><h4 class="sectiontitle">Prerequisites</h4><ul id="dataartsstudio_01_0098__en-us_topic_0108275389_ul4239050219109"><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li2083911261826">You have sufficient EIP quota.</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li5262551719109">You have obtained an RDS database instance and the database engine of this instance is MySQL.</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li17447423191013">The on-premises MySQL database can be accessed through the public network. If the MySQL database is deployed on an on-premises data center or a third-party cloud, ensure that an IP address that can be accessed from the public network has been configured for the MySQL database, or the VPN or Direct Connect between the on-premises data center and the cloud service platform has been established.</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li5957984119135">You have obtained the IP addresses, names, usernames, and passwords of the on-premises MySQL database and RDS for MySQL.</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li178721321413">You have uploaded the MySQL database driver on the <span class="menucascade" id="dataartsstudio_01_0098__en-us_topic_0108275389_menucascade911719110529"><b><span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_uicontrol101171113526">Job Management</span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_uicontrol1117317529">Links</span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_uicontrol91173115218">Driver Management</span></b></span> page.</li></ul>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0098__en-us_topic_0108275389_section563314494359"><a name="dataartsstudio_01_0098__en-us_topic_0108275389_section563314494359"></a><a name="en-us_topic_0108275389_section563314494359"></a><h4 class="sectiontitle">Creating a CDM Cluster and Binding an EIP to the Cluster</h4><ol id="dataartsstudio_01_0098__en-us_topic_0108275389_ol686765753513"><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li17684194391813"><span id="dataartsstudio_01_0098__en-us_topic_0108275389_p342142211225">Create a CDM cluster.</span><p><div class="p" id="dataartsstudio_01_0098__en-us_topic_0108275389_p19115245121819">The key configurations are as follows:<ul id="dataartsstudio_01_0098__en-us_topic_0108275389_u4fa55d1ed2cb44c8bd08d0cb52a91fdb"><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li603163259221">The flavor of the CDM cluster is selected based on the amount of data to be migrated. Generally, cdm.medium meets the requirements for most migration scenarios.</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li47341850195815">The CDM cluster and the RDS for MySQL instance must be in the same VPC. In addition, it is recommended that the CDM cluster be in the same subnet and security group as the RDS for MySQL instance.</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li164996685911">If the same subnet and security group cannot be used for security purposes, ensure that a security group rule has been configured to allow the CDM cluster to access the RDS for MySQL instance.</li></ul>
|
|
</div>
|
|
</p></li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li1844914916273"><span>After the CDM cluster is created, on the <strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b1343240191119">Cluster Management</strong> page, click <span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_uicontrol10431640201119"><b>Bind EIP</b></span> in the <strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b243194010115">Operation</strong> column to bind an EIP to the cluster. The CDM cluster uses the EIP to access the on-premises MySQL database.</span><p><div class="note" id="dataartsstudio_01_0098__en-us_topic_0108275389_note24642513383"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0108275471_p1693084519332">If SSL encryption is configured for the access channel of a local data source, CDM cannot connect to the data source using the EIP.</p>
|
|
</div></div>
|
|
</p></li></ol>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0098__en-us_topic_0108275389_section3392631930"><a name="dataartsstudio_01_0098__en-us_topic_0108275389_section3392631930"></a><a name="en-us_topic_0108275389_section3392631930"></a><h4 class="sectiontitle">Creating a MySQL Link</h4><ol id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_ol1175033817329"><li id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_li16641390115738"><span>On the <span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_uicontrol269123222818"><b>Cluster Management</b></span> page, locate a cluster and click <span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_uicontrol56903211288"><b>Job Management</b></span> in the <strong id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_b8691432152814">Operation</strong> column. On the displayed page, click the <strong id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_b1770432112813">Links</strong> tab and then <strong id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_b670133217284">Create Link</strong>.</span></li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_li55925676152157"><span>Select <span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_uicontrol12819217182710"><b>MySQL</b></span> and click <span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_uicontrol178191117102712"><b>Next</b></span>. On the displayed page, configure MySQL link parameters.</span><p><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_p30757446152044">Click <strong id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_b19202333413">Show Advanced Attributes</strong> to view more optional parameters. For details, see <a href="dataartsstudio_01_1211.html">RDS for MySQL/MySQL Database Link Parameters</a>. Retain the default values of the optional parameters and configure the mandatory parameters according to <a href="#dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_table5321744015490">Table 1</a>.</p>
|
|
|
|
<div class="tablenoborder"><a name="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_table5321744015490"></a><a name="en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_table5321744015490"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_table5321744015490" frame="border" border="1" rules="all"><caption><b>Table 1 </b>MySQL link parameters</caption><thead align="left"><tr id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_row185605615490"><th align="left" class="cellrowborder" valign="top" width="21.39%" id="mcps1.3.4.2.2.2.2.2.4.1.1"><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p3088488815490">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="46.01%" id="mcps1.3.4.2.2.2.2.2.4.1.2"><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p1864797615490">Description</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="32.6%" id="mcps1.3.4.2.2.2.2.2.4.1.3"><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p12195902165556">Example Value</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_row6448267615421"><td class="cellrowborder" valign="top" width="21.39%" headers="mcps1.3.4.2.2.2.2.2.4.1.1 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p5571423915421">Name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="46.01%" headers="mcps1.3.4.2.2.2.2.2.4.1.2 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p1655951515421">Unique link name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="32.6%" headers="mcps1.3.4.2.2.2.2.2.4.1.3 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p6625233515421">mysqllink</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_row23645714155554"><td class="cellrowborder" valign="top" width="21.39%" headers="mcps1.3.4.2.2.2.2.2.4.1.1 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p36254680155554">Database Server</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="46.01%" headers="mcps1.3.4.2.2.2.2.2.4.1.2 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p57055815164650">IP address or domain name of the MySQL database server</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="32.6%" headers="mcps1.3.4.2.2.2.2.2.4.1.3 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p54006514165556">-</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_row35721234155558"><td class="cellrowborder" valign="top" width="21.39%" headers="mcps1.3.4.2.2.2.2.2.4.1.1 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p7738819155558">Port</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="46.01%" headers="mcps1.3.4.2.2.2.2.2.4.1.2 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p44462215165646">MySQL database port</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="32.6%" headers="mcps1.3.4.2.2.2.2.2.4.1.3 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p44954710165556">3306</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_row58054787162632"><td class="cellrowborder" valign="top" width="21.39%" headers="mcps1.3.4.2.2.2.2.2.4.1.1 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p4817321162632">Database Name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="46.01%" headers="mcps1.3.4.2.2.2.2.2.4.1.2 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p23569444165647">Name of the MySQL database</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="32.6%" headers="mcps1.3.4.2.2.2.2.2.4.1.3 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p22858665165556">sqoop</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_row121116115490"><td class="cellrowborder" valign="top" width="21.39%" headers="mcps1.3.4.2.2.2.2.2.4.1.1 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p3099525315490">Username</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="46.01%" headers="mcps1.3.4.2.2.2.2.2.4.1.2 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p2758753215490">User who has the read, write, and delete permissions on the MySQL database</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="32.6%" headers="mcps1.3.4.2.2.2.2.2.4.1.3 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p14053644165556">admin</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_row4576104015490"><td class="cellrowborder" valign="top" width="21.39%" headers="mcps1.3.4.2.2.2.2.2.4.1.1 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p1565673415490">Password</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="46.01%" headers="mcps1.3.4.2.2.2.2.2.4.1.2 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p6023590815490">Password of the user</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="32.6%" headers="mcps1.3.4.2.2.2.2.2.4.1.3 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p44559445165556">-</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_row1695382013335"><td class="cellrowborder" valign="top" width="21.39%" headers="mcps1.3.4.2.2.2.2.2.4.1.1 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_p1395410209337">Use Local API</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="46.01%" headers="mcps1.3.4.2.2.2.2.2.4.1.2 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_p16954220143310">Whether to use the local API of the database for acceleration. (The system attempts to enable the <strong id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_b152419603572158">local_infile</strong> system variable of the MySQL database.)</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="32.6%" headers="mcps1.3.4.2.2.2.2.2.4.1.3 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_p195462013337">Yes</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_row117692617437"><td class="cellrowborder" valign="top" width="21.39%" headers="mcps1.3.4.2.2.2.2.2.4.1.1 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p18773153334318">Use Agent</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="46.01%" headers="mcps1.3.4.2.2.2.2.2.4.1.2 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_p14586850165214"><span id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_text1558625010526">The agent function will be unavailable soon and does not need to be configured.</span></p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="32.6%" headers="mcps1.3.4.2.2.2.2.2.4.1.3 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_en-us_topic_0284710796_en-us_topic_0111325168_en-us_topic_0108275298_p1977311335439">-</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_row189746446585"><td class="cellrowborder" valign="top" width="21.39%" headers="mcps1.3.4.2.2.2.2.2.4.1.1 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_p179755443589">local_infile Character Set</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="46.01%" headers="mcps1.3.4.2.2.2.2.2.4.1.2 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_p497514412583">When using local_infile to import data to MySQL, you can configure the encoding format.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="32.6%" headers="mcps1.3.4.2.2.2.2.2.4.1.3 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_p9975244135817">utf8</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_row29922517620"><td class="cellrowborder" valign="top" width="21.39%" headers="mcps1.3.4.2.2.2.2.2.4.1.1 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_p199921356617">Driver Version</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="46.01%" headers="mcps1.3.4.2.2.2.2.2.4.1.2 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_p189932517616">Before connecting CDM to a relational database, you need to upload the JDK 8 .jar driver of the relational database. Download the MySQL driver 5.1.48 from <a href="https://downloads.mysql.com/archives/c-j/" target="_blank" rel="noopener noreferrer">https://downloads.mysql.com/archives/c-j/</a>, obtain <strong id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_b7945214826">mysql-connector-java-5.1.48.jar</strong>, and upload it.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="32.6%" headers="mcps1.3.4.2.2.2.2.2.4.1.3 "><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_en-us_topic_0108275298_en-us_topic_0000001147041354_p899375564">-</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</p></li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_li1697949616149"><span>Click <span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_uicontrol5119298426"><b>Save</b></span>. The <span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_uicontrol31182964212"><b>Link Management</b></span> page is displayed.</span><p><div class="note" id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_note1896191114270"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0111325168_p296110116274">If an error occurs during the saving, the security settings of the MySQL database are incorrect. In this case, you need to enable the EIP of the CDM cluster to access the MySQL database.</p>
|
|
</div></div>
|
|
</p></li></ol>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0098__en-us_topic_0108275389_section196516591234"><a name="dataartsstudio_01_0098__en-us_topic_0108275389_section196516591234"></a><a name="en-us_topic_0108275389_section196516591234"></a><h4 class="sectiontitle">Creating an RDS Link</h4><ol id="dataartsstudio_01_0098__en-us_topic_0108275389_ol3128144010415"><li id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0108275437_li135396271350"><span>Click <span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_uicontrol1831851418360"><b>Job Management</b></span> in the <strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b3318111415363">Operation</strong> column of the CDM cluster. On the displayed page, click the <strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b331818142363">Links</strong> tab and then <strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b13318141463617">Create Link</strong>. The <strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b6319514133615">Select Connector</strong> page is displayed.</span><p><div class="fignone" id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0108275437_en-us_topic_0108275298_fig13640155194015"><span class="figcap"><b>Figure 1 </b>Selecting a connector type</span><br><span><img id="dataartsstudio_01_0098__en-us_topic_0108275389_en-us_topic_0108275477_image53893842012" src="en-us_image_0000002234235252.png" title="Click to enlarge" class="imgResize"></span></div>
|
|
</p></li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li34861627101120"><span>Select <span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_uicontrol20263131471220"><b>RDS for MySQL</b></span> and click <span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_uicontrol7263171410129"><b>Next</b></span> to configure parameters for the RDS for MySQL link.</span><p><ul id="dataartsstudio_01_0098__en-us_topic_0108275389_ul28152782103433"><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li52048451103433"><strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b842352706113830_3">Name</strong>: Enter a custom link name, for example, <span class="parmvalue" id="dataartsstudio_01_0098__en-us_topic_0108275389_parmvalue828948688152639_3"><b>rds_link</b></span>.</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li1357721781415"><strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b84235270616816_3">Database Server</strong> and <strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b84235270616822_3">Port</strong>: Enter the address information about the RDS for MySQL database.</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li1569515212141"><strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b84235270616833_3">Database Name</strong>: Enter the name of the RDS for MySQL database.</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li60805539103359"><strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b84235270616559">Username</strong> and <strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b842352706165512">Password</strong>: Enter the username and password used for logging in to the database.</li></ul>
|
|
<div class="note" id="dataartsstudio_01_0098__en-us_topic_0108275389_note32539508195712"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dataartsstudio_01_0098__en-us_topic_0108275389_ul16948183713182"><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li149486377185">During RDS link creation, if <span class="parmname" id="dataartsstudio_01_0098__en-us_topic_0108275389_parmname676697798165557"><b>Use Local API</b></span> in <span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_uicontrol230942777165655"><b>Show Advanced Attributes</b></span> is set to <span class="parmvalue" id="dataartsstudio_01_0098__en-us_topic_0108275389_parmvalue1898984563165626"><b>Yes</b></span>, you can use the LOAD DATA function provided by MySQL to speed up data import.</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li3120184141811">The LOAD DATA function is disabled by default on RDS for MySQL, so you need to modify the parameter group of the MySQL instance and set <span class="parmname" id="dataartsstudio_01_0098__en-us_topic_0108275389_parmname975724629165916"><b>local_infile</b></span> to <span class="parmvalue" id="dataartsstudio_01_0098__en-us_topic_0108275389_parmvalue907052081165922"><b>ON</b></span> to enable this function.</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li115341343151816">If the <span class="parmname" id="dataartsstudio_01_0098__en-us_topic_0108275389_parmname5838373112711"><b>local_infile</b></span> parameter group cannot be edited, it is the default parameter group. You need to create a parameter group and modify its value, and apply it to the MySQL instance of RDS.</li></ul>
|
|
</div></div>
|
|
</p></li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li15181643348"><span>Click <span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_uicontrol13175175981711"><b>Save</b></span>. The <span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_uicontrol91911159201712"><b>Link Management</b></span> page is displayed.</span></li></ol>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_01_0098__en-us_topic_0108275389_section1508747294234"><a name="dataartsstudio_01_0098__en-us_topic_0108275389_section1508747294234"></a><a name="en-us_topic_0108275389_section1508747294234"></a><h4 class="sectiontitle">Creating an Entire DB Migration Job</h4><ol id="dataartsstudio_01_0098__en-us_topic_0108275389_ol4836259095851"><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li6209919410469"><span>After the two links are created, choose <span class="menucascade" id="dataartsstudio_01_0098__en-us_topic_0108275389_menucascade144077978617522"><b><span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_uicontrol201076814617522">Entire DB Migration</span></b> > <b><span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_uicontrol104517287417522">Create Job</span></b></span> to create a migration job. See <a href="#dataartsstudio_01_0098__en-us_topic_0108275389_fig4434922711956">Figure 2</a>.</span><p><div class="fignone" id="dataartsstudio_01_0098__en-us_topic_0108275389_fig4434922711956"><a name="dataartsstudio_01_0098__en-us_topic_0108275389_fig4434922711956"></a><a name="en-us_topic_0108275389_fig4434922711956"></a><span class="figcap"><b>Figure 2 </b>Creating an entire DB migration job</span><br><span><img id="dataartsstudio_01_0098__en-us_topic_0108275389_image1782794618297" src="en-us_image_0000002234081548.png" title="Click to enlarge" class="imgResize"></span></div>
|
|
<ul id="dataartsstudio_01_0098__en-us_topic_0108275389_ul54261246111141"><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li8471839201140"><strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b8423527061777">Job Name</strong>: Enter a name for the entire DB migration job.</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li19627182651520"><strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b122131948792">Source Job Configuration</strong><ul id="dataartsstudio_01_0098__en-us_topic_0108275389_ul1462793931512"><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li16267563111423"><strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b121601157131816">Source Link Name</strong>: Select the <span class="parmvalue" id="dataartsstudio_01_0098__en-us_topic_0108275389_parmvalue416095720188"><b>mysqllink</b></span> created in <a href="#dataartsstudio_01_0098__en-us_topic_0108275389_section3392631930">Creating a MySQL Link</a>.</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li146581049121510"><strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b1875828111010">Schema/Tablespace</strong>: Select the on-premises MySQL database from which data is to be exported.</li></ul>
|
|
</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li48201601620"><strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b29501252141020">Destination Job Configuration</strong><ul id="dataartsstudio_01_0098__en-us_topic_0108275389_ul185361225191612"><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li54123274111239"><strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b1447522714201">Destination Link Name</strong>: Select the <span class="parmvalue" id="dataartsstudio_01_0098__en-us_topic_0108275389_parmvalue7429133616207"><b>rds_link</b></span> link created in <a href="#dataartsstudio_01_0098__en-us_topic_0108275389_section196516591234">Creating an RDS Link</a>.</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li37444940194313"><strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b54971558111011">Schema/Tablespace</strong>: Select the name of the RDS database to which data is to be imported.</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li15647261195037"><strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b842352706171213">Auto Table Creation</strong>: Select <span class="parmvalue" id="dataartsstudio_01_0098__en-us_topic_0108275389_parmvalue1750113523171247"><b>Auto creation</b></span>, which indicates that CDM automatically creates tables in the RDS database when tables of the on-premises MySQL database do not exist in the RDS database.</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li40191811195136"><strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b5236111461914">Clear Data Before Import</strong>: Select <span class="parmvalue" id="dataartsstudio_01_0098__en-us_topic_0108275389_parmvalue523661419191"><b>Yes</b></span>, which indicates that when a table with the same name as the table in the on-premises MySQL database exists in the RDS database, CDM clears data in the table on RDS.</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li356210116336"><strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b965431710213">Constraint Conflict Handling</strong>: Select <span class="parmvalue" id="dataartsstudio_01_0098__en-us_topic_0108275389_parmvalue233511143387"><b>insert into</b></span>.</li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li43352279178">Retain the default values of the optional parameters in <strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b12255125317149">Show Advanced Attributes</strong>.</li></ul>
|
|
</li></ul>
|
|
</p></li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li1736615194412"><span>Click <span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_uicontrol207231031144613"><b>Next</b></span>. The page for selecting tables to be migrated is displayed. You can select all or part of tables to migrate.</span></li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li1629345594319"><span>Click <span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_uicontrol1072878102216"><b>Save and Run</b></span> and CDM immediately starts the entire DB migration job.</span><p><p id="dataartsstudio_01_0098__en-us_topic_0108275389_p144732134411">When the job starts running, a sub-job will be generated for each table. You can click the job name to view the sub-job list.</p>
|
|
</p></li><li id="dataartsstudio_01_0098__en-us_topic_0108275389_li1980019346250"><span>In the <strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b071165019222">Operation</strong> column of the job, click <span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_uicontrol1471115014223"><b>Historical Record</b></span> to view the job's historical execution records and read/write statistics.</span><p><p id="dataartsstudio_01_0098__en-us_topic_0108275389_p967664032512">There are no logs for the entire DB migration job. However, the sub-jobs have logs. On the <strong id="dataartsstudio_01_0098__en-us_topic_0108275389_b332392513235">Historical Record</strong> page of the sub-jobs, click <span class="uicontrol" id="dataartsstudio_01_0098__en-us_topic_0108275389_uicontrol132316257239"><b>Log</b></span> to view the job logs.</p>
|
|
</p></li></ol>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0086.html">Tutorials</a></div>
|
|
</div>
|
|
</div>
|
|
|
|
|
|
<script language="JavaScript">
|
|
<!--
|
|
initImageViewer('.imgResize');
|
|
var msg_imageMax = "view original image";
|
|
var msg_imageClose = "close";
|
|
//--></script> |