doc-exports/docs/dataartsstudio/umn/dataartsstudio_01_0099.html

<a name="dataartsstudio_01_0099"></a><a name="dataartsstudio_01_0099"></a>

<h1 class="topictitle1">Migrating the Entire Elasticsearch Database to CSS</h1>
<div id="body8662426"><div class="section" id="dataartsstudio_01_0099__en-us_topic_0123220230_section21020958143223"><h4 class="sectiontitle">Scenario</h4><p id="dataartsstudio_01_0099__en-us_topic_0123220230_p4504939393411">CSS provides users with structured and unstructured data search, statistics, and report capabilities. This section describes how to use CDM to migrate the entire Elasticsearch database to Cloud Search Service. The procedure is as follows:</p>
<ol id="dataartsstudio_01_0099__en-us_topic_0123220230_ol127531251174811"><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li15753145111481"><a href="#dataartsstudio_01_0099__en-us_topic_0123220230_section286612269318">Creating a CDM Cluster and Binding an EIP to the Cluster</a></li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li064315714813"><a href="#dataartsstudio_01_0099__en-us_topic_0123220230_section14541143415338">Creating a Cloud Search Service Link</a></li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li158301720164913"><a href="#dataartsstudio_01_0099__en-us_topic_0123220230_section46839536342">Creating an Elasticsearch Link</a></li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li1262719368491"><a href="#dataartsstudio_01_0099__en-us_topic_0123220230_section1508747294234">Creating an Entire DB Migration Job</a></li></ol>
</div>
<div class="section" id="dataartsstudio_01_0099__en-us_topic_0123220230_section5787168294234"><h4 class="sectiontitle">Prerequisites</h4><ul id="dataartsstudio_01_0099__en-us_topic_0123220230_ul56609460102758"><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li1458495263814">You have sufficient EIP quota.</li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li44641429102758">You have subscribed to CSS and obtained the IP address and port number of the CSS cluster.</li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li1131029104219">You have obtained the IP address, port number, username, and password of the on-premises Elasticsearch database server.<p id="dataartsstudio_01_0099__en-us_topic_0123220230_p13312193354215"><a name="dataartsstudio_01_0099__en-us_topic_0123220230_li1131029104219"></a><a name="en-us_topic_0123220230_li1131029104219"></a>If the Elasticsearch server is deployed on an on-premises data center or a third-party cloud, ensure that an IP address that can be accessed from the public network has been configured for the Elasticsearch server, or the VPN or Direct Connect between the on-premises data center and  has been established.</p>
</li></ul>
</div>
<div class="section" id="dataartsstudio_01_0099__en-us_topic_0123220230_section286612269318"><a name="dataartsstudio_01_0099__en-us_topic_0123220230_section286612269318"></a><a name="en-us_topic_0123220230_section286612269318"></a><h4 class="sectiontitle">Creating a CDM Cluster and Binding an EIP to the Cluster</h4><ol id="dataartsstudio_01_0099__en-us_topic_0123220230_ol4836259095851"><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li6933418152314"><span id="dataartsstudio_01_0099__en-us_topic_0123220230_p342142211225">Create a CDM cluster.</span><p><div class="p" id="dataartsstudio_01_0099__en-us_topic_0123220230_p610616206231">The key configurations are as follows:<ul id="dataartsstudio_01_0099__en-us_topic_0123220230_ul38535026103632"><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li603163259221">The flavor of the CDM cluster is selected based on the amount of data to be migrated. Generally, cdm.medium meets the requirements for most migration scenarios.</li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li387920532184">The CDM and Cloud Search Service clusters must be in the same VPC. In addition, it is recommended that the CDM cluster be in the same subnet and security group as the Cloud Search Service cluster.</li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li18923216133716">If the same subnet and security group cannot be used for security purposes, ensure that a security group rule has been configured to allow the CDM cluster to access the Cloud Search Service cluster.</li></ul>
</div>
</p></li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li11735854103611"><span>After the CDM cluster is created, on the <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b20742145410516">Cluster Management</strong> page, click <span class="uicontrol" id="dataartsstudio_01_0099__en-us_topic_0123220230_uicontrol974225413519"><b>Bind EIP</b></span> in the <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b127422541957">Operation</strong> column to bind an EIP to the cluster. The CDM cluster uses the EIP to access the on-premises Elasticsearch.</span><p><div class="note" id="dataartsstudio_01_0099__en-us_topic_0123220230_note24642513383"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275471_p1693084519332">If SSL encryption is configured for the access channel of a local data source, CDM cannot connect to the data source using the EIP.</p>
</div></div>
</p></li></ol>
</div>
<div class="section" id="dataartsstudio_01_0099__en-us_topic_0123220230_section14541143415338"><a name="dataartsstudio_01_0099__en-us_topic_0123220230_section14541143415338"></a><a name="en-us_topic_0123220230_section14541143415338"></a><h4 class="sectiontitle">Creating a Cloud Search Service Link</h4><ol id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_ol2092852715016"><li id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_li135396271350"><span>Click <span class="uicontrol" id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_en-us_topic_0108275298_uicontrol19806194174318"><b>Job Management</b></span> in the <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_en-us_topic_0108275298_b2806249435">Operation</strong> column of the CDM cluster. On the displayed page, click the <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_en-us_topic_0108275298_b480613424310">Links</strong> tab and then <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_en-us_topic_0108275298_b10806184174313">Create Link</strong>. The <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_en-us_topic_0108275298_b16807154184319">Select Connector</strong> page is displayed.</span></li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_li3943142717504"><span>Select <span class="uicontrol" id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_uicontrol11292928261"><b>Cloud Search Service</b></span> and click <span class="uicontrol" id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_uicontrol59955341361"><b>Next</b></span>. On the page that is displayed, configure the CSS link parameters.</span><p><ul id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_ul1094362745018"><li id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_li79437273507"><strong id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_b166221591570">Name</strong>: Enter a custom link name, for example, <span class="parmvalue" id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_parmvalue10622893716"><b>csslink</b></span>.</li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_li18338133301920"><strong id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_b2893141015591">Elasticsearch Server List</strong>: Enter the IP address and port number of the Cloud Search Service cluster (cluster later than 5.<em id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_i1782675814106">x</em>). The format is <em id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_i1189315105595">ip:port</em>. Use semicolons to separate multiple addresses. For example, <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_b389312105592">192.168.0.1:9200;192.168.0.2:9200</strong>.</li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_li8960162715012"><strong id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_b845025383">Username</strong> and <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_b3139149188">Password</strong>: Enter the username and password used for logging in to the Cloud Search Service cluster. The user must have the read and write permissions on the database.</li></ul>
</p></li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_li11960112710508"><span>Click <span class="uicontrol" id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_uicontrol228245913106"><b>Save</b></span>. The <span class="uicontrol" id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0108275437_uicontrol02821659201014"><b>Link Management</b></span> page is displayed.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_0099__en-us_topic_0123220230_section46839536342"><a name="dataartsstudio_01_0099__en-us_topic_0123220230_section46839536342"></a><a name="en-us_topic_0123220230_section46839536342"></a><h4 class="sectiontitle">Creating an Elasticsearch Link</h4><ol id="dataartsstudio_01_0099__en-us_topic_0123220230_ol1741864210357"><li id="dataartsstudio_01_0099__en-us_topic_0123220230_en-us_topic_0111325168_li16641390115738"><span>On the <span class="uicontrol" id="dataartsstudio_01_0099__en-us_topic_0123220230_uicontrol018654285017"><b>Cluster Management</b></span> page, locate a cluster and click <span class="uicontrol" id="dataartsstudio_01_0099__en-us_topic_0123220230_uicontrol9186164275016"><b>Job Management</b></span> in the <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b171862042195017">Operation</strong> column. On the displayed page, click the <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b91871342115017">Links</strong> tab and then <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b15187104216507">Create Link</strong>.</span></li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li788834054711"><span>Select <span class="uicontrol" id="dataartsstudio_01_0099__en-us_topic_0123220230_uicontrol1327613136910"><b>Elasticsearch</b></span> and click <span class="uicontrol" id="dataartsstudio_01_0099__en-us_topic_0123220230_uicontrol10420201695"><b>Next</b></span> to configure parameters for the Elasticsearch link. The parameters are the same as those for the CSS link.</span><p><ul id="dataartsstudio_01_0099__en-us_topic_0123220230_ul108651428506"><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li148651942155010"><strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b105926111017">Name</strong>: Enter a custom link name, for example, <span class="parmvalue" id="dataartsstudio_01_0099__en-us_topic_0123220230_parmvalue1476210305106"><b>es_link</b></span>.</li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li13880942125017"><strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b77124441563">Elasticsearch Server List</strong>: Enter the IP address and port number of the on-premises Elasticsearch database. Use semicolons to separate multiple addresses.</li></ul>
</p></li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li859032113368"><span>Click <span class="uicontrol" id="dataartsstudio_01_0099__en-us_topic_0123220230_uicontrol114871095152"><b>Save</b></span>. The <span class="uicontrol" id="dataartsstudio_01_0099__en-us_topic_0123220230_uicontrol74879951520"><b>Link Management</b></span> page is displayed.</span></li></ol>
</div>
<div class="section" id="dataartsstudio_01_0099__en-us_topic_0123220230_section1508747294234"><a name="dataartsstudio_01_0099__en-us_topic_0123220230_section1508747294234"></a><a name="en-us_topic_0123220230_section1508747294234"></a><h4 class="sectiontitle">Creating an Entire DB Migration Job</h4><ol id="dataartsstudio_01_0099__en-us_topic_0123220230_ol1249481816572"><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li1549410188578"><span>Choose <span class="menucascade" id="dataartsstudio_01_0099__en-us_topic_0123220230_menucascade4409123281518"><b><span class="uicontrol" id="dataartsstudio_01_0099__en-us_topic_0123220230_uicontrol840963211150">Entire DB Migration</span></b> &gt; <b><span class="uicontrol" id="dataartsstudio_01_0099__en-us_topic_0123220230_uicontrol10409632131517">Create Job</span></b></span> to create an entire DB migration job.</span><p><div class="fignone" id="dataartsstudio_01_0099__en-us_topic_0123220230_fig1049421815715"><span class="figcap"><b>Figure 1 </b>Creating an entire DB migration job</span><br><span><img id="dataartsstudio_01_0099__en-us_topic_0123220230_image157058161299" src="en-us_image_0000002269123741.png" title="Click to enlarge" class="imgResize"></span></div>
<ul id="dataartsstudio_01_0099__en-us_topic_0123220230_ul194941418165712"><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li4494101814577"><strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b4729153051615">Job Name</strong>: Enter a unique name.</li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li84942184579"><strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b571415332163">Source Job Configuration</strong><ul id="dataartsstudio_01_0099__en-us_topic_0123220230_ul1149431812572"><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li16494191814573"><strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b16573153531614">Source Link Name</strong>: Select the <span class="uicontrol" id="dataartsstudio_01_0099__en-us_topic_0123220230_uicontrol893944514165"><b>es_link</b></span> link created in <a href="#dataartsstudio_01_0099__en-us_topic_0123220230_section46839536342">Creating an Elasticsearch Link</a>.</li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li1749421845719"><strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b932314171715">Index</strong>: Click the icon next to the text box to select an index in the on-premises Elasticsearch database or manually enter an index name. The name can contain only lowercase letters. If multiple indexes need to be migrated at a time, set this parameter to a wildcard character. CDM migrates all indexes that meet the wildcard condition. For example, if this parameter is set to <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b20520614303">cdm*</strong>, CDM migrates all indexes starting with <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b145201014106">cdm</strong>, such as <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b1352091413017">cdm01</strong>, <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b18520214806">cdmB3</strong>, <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b452016149018">cdm_45</strong> and so on.</li></ul>
</li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li54949188578"><strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b16161101211820">Destination Job Configuration</strong><ul id="dataartsstudio_01_0099__en-us_topic_0123220230_ul194942185578"><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li94941218195713"><strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b1583191312184">Destination Link Name</strong>: Select the <span class="parmvalue" id="dataartsstudio_01_0099__en-us_topic_0123220230_parmvalue2834132185"><b>csslink</b></span> link created in <a href="#dataartsstudio_01_0099__en-us_topic_0123220230_section14541143415338">Creating a Cloud Search Service Link</a>.</li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li1494218155713"><strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b1295893117183">Index</strong>: Enter the index of the data to be written. You can select an existing index in Cloud Search Service or manually enter an index name that does not exist. The name can contain only lowercase letters. CDM automatically creates the index in Cloud Search Service. If multiple indexes are migrated at a time, this parameter cannot be configured. CDM automatically creates indexes at the migration destination.</li><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li3494101895712"><strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b341722192011">Clear Data Before Import</strong>: If the selected index already exists in Cloud Search Service, you can choose whether to clear the data in the index before importing data. If you select <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b1764101042117">No</strong>, the data is added to the index.</li></ul>
</li></ul>
</p></li></ol><ol start="2" id="dataartsstudio_01_0099__en-us_topic_0123220230_ol78951410103312"><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li989561063318"><span>Click <span class="uicontrol" id="dataartsstudio_01_0099__en-us_topic_0123220230_uicontrol240965542210"><b>Save and Run</b></span>. The <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b15644150102310">Job Management</strong> page is displayed, on which you can view the job execution progress and result.</span><p><p id="dataartsstudio_01_0099__en-us_topic_0123220230_p16895110173310">A sub-job will be generated for each type in the on-premises Elasticsearch index for concurrent execution. You can click the job name to view the sub-job progress.</p>
</p></li></ol><ol start="3" id="dataartsstudio_01_0099__en-us_topic_0123220230_ol184683557330"><li id="dataartsstudio_01_0099__en-us_topic_0123220230_li1813992411334"><span>After the job is successfully executed, in the <strong id="dataartsstudio_01_0099__en-us_topic_0123220230_b418012142615">Operation</strong> column of the job, click <span class="uicontrol" id="dataartsstudio_01_0099__en-us_topic_0123220230_uicontrol718022115266"><b>Historical Record</b></span> to view the job's historical execution records, read/write statistics, and job logs (only the sub-jobs have job logs).</span><p><div class="fignone" id="dataartsstudio_01_0099__en-us_topic_0123220230_fig16685144144719"><span class="figcap"><b>Figure 2 </b>Historical Record</span><br><span><img id="dataartsstudio_01_0099__en-us_topic_0123220230_image116851444114713" src="en-us_image_0000002234244360.png" title="Click to enlarge" class="imgResize"></span></div>
</p></li></ol>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0086.html">Tutorials</a></div>
</div>
</div>


<script language="JavaScript">
<!--
initImageViewer('.imgResize');
var msg_imageMax = "view original image";
var msg_imageClose = "close";
//--></script>