forked from docs/doc-exports
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: luhuayi <luhuayi@huawei.com> Co-committed-by: luhuayi <luhuayi@huawei.com>
560 lines
104 KiB
HTML
560 lines
104 KiB
HTML
<a name="EN-US_TOPIC_0000001838498170"></a><a name="EN-US_TOPIC_0000001838498170"></a>
|
|
|
|
<h1 class="topictitle1">Accessing Hive Metastore Across Clusters</h1>
|
|
<div id="body8662426"><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p9473123822114">To access MRS Hive data from <span id="EN-US_TOPIC_0000001838498170__ph484067134213">storage-compute decoupled</span> data warehouse, including when Hive is connected to HDFS or OBS, create an external schema. This function is supported only by 9.1.0 and later versions.</p>
|
|
<div class="section" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_section142721712193120"><h4 class="sectiontitle">Preparing the Environment</h4><ul id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ul128891216292"><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li1488917218291">Create a <span id="EN-US_TOPIC_0000001838498170__ph1828113382277">storage-compute decoupled</span> and an MRS analysis cluster. Ensure that the MRS and GaussDB(DWS) clusters are in the same region, AZ, and VPC subnet and that the clusters can communicate with each other.</li></ul>
|
|
</div>
|
|
<div class="section" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_section77841914162611"><h4 class="sectiontitle">Constraints and Limitations</h4><ul id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ul117259614521"><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li1572510612524">Currently, only the SELECT, INSERT, and INSERT OVERWRITE operations can be performed on tables in the Hive database through external schemas.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li2040151895313">MRS supports two types of data sources. For details, see <a href="#EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_table751712227268">Table 1</a>.
|
|
<div class="tablenoborder"><a name="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_table751712227268"></a><a name="en-us_topic_0000001473887582_table751712227268"></a><table cellpadding="4" cellspacing="0" summary="" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_table751712227268" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Operations supported by MRS data sources</caption><thead align="left"><tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row651712212264"><th align="left" class="cellrowborder" valign="top" width="10.62893710628937%" id="mcps1.3.3.2.2.2.2.8.1.1"><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p205171822142612">Data Source</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="8.849115088491152%" id="mcps1.3.3.2.2.2.2.8.1.2"><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p14143830135913">Table Type</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="19.208079192080792%" id="mcps1.3.3.2.2.2.2.8.1.3"><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p138421059125918">Operation</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="15.07849215078492%" id="mcps1.3.3.2.2.2.2.8.1.4"><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p75174224261">TEXT</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="14.638536146385361%" id="mcps1.3.3.2.2.2.2.8.1.5"><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p19517182216264">CSV</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="15.008499150084992%" id="mcps1.3.3.2.2.2.2.8.1.6"><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p451882212266">PARQUET</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="16.58834116588341%" id="mcps1.3.3.2.2.2.2.8.1.7"><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1351810227263">ORC</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row14518322102615"><td class="cellrowborder" rowspan="4" valign="top" width="10.62893710628937%" headers="mcps1.3.3.2.2.2.2.8.1.1 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p85181822112616">HDFS</p>
|
|
</td>
|
|
<td class="cellrowborder" rowspan="2" valign="top" width="8.849115088491152%" headers="mcps1.3.3.2.2.2.2.8.1.2 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p2143153011599">Non-partitioned table</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="19.208079192080792%" headers="mcps1.3.3.2.2.2.2.8.1.3 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p9843155915913">SELECT</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15.07849215078492%" headers="mcps1.3.3.2.2.2.2.8.1.4 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p351862282611">√</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="14.638536146385361%" headers="mcps1.3.3.2.2.2.2.8.1.5 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p11518722152618">√</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15.008499150084992%" headers="mcps1.3.3.2.2.2.2.8.1.6 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1151832215269">√</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.58834116588341%" headers="mcps1.3.3.2.2.2.2.8.1.7 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p651872214262">√</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row1488411321012"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.1 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p688411321507">INSERT/INSERT OVERWRITE</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.2 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p18884143212014">x</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.3 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p28848321018">x</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.4 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p128840324019">√</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.5 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1688414321103">√</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row106025263016"><td class="cellrowborder" rowspan="2" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.1 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p560315262015">Partitioned table</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.2 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p9322131810220">SELECT</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.3 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p460314264019">√</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.4 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p86033269015">√</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.5 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p760314261012">√</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.6 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1460310261809">√</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row89905292014"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.1 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p13322318921">INSERT/INSERT OVERWRITE</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.2 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p179901129505">x</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.3 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p499018292006">x</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.4 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p49903296017">√</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.5 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p11990429408">√</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row1518192282614"><td class="cellrowborder" rowspan="4" valign="top" width="10.62893710628937%" headers="mcps1.3.3.2.2.2.2.8.1.1 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p19518162211267">OBS</p>
|
|
</td>
|
|
<td class="cellrowborder" rowspan="2" valign="top" width="8.849115088491152%" headers="mcps1.3.3.2.2.2.2.8.1.2 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p175522415212">Non-partitioned table</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="19.208079192080792%" headers="mcps1.3.3.2.2.2.2.8.1.3 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p123355201828">SELECT</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15.07849215078492%" headers="mcps1.3.3.2.2.2.2.8.1.4 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p4518622162610">√</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="14.638536146385361%" headers="mcps1.3.3.2.2.2.2.8.1.5 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p18518822122614">√</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15.008499150084992%" headers="mcps1.3.3.2.2.2.2.8.1.6 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1051802218266">√</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.58834116588341%" headers="mcps1.3.3.2.2.2.2.8.1.7 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p151892262617">√</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row451842262618"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.1 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p73355208220">INSERT/INSERT OVERWRITE</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.2 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p20518182216267">x</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.3 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p115186224263">x</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.4 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1518142213269">√</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.5 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1851822216262">√</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row15518122272618"><td class="cellrowborder" rowspan="2" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.1 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p87552241223">Partitioned table</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.2 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p14424221125">SELECT</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.3 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p3518822192618">x</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.4 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1518162212264">x</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.5 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p95181022152618">√</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.6 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p5518722112610">√</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row181446416"><td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.1 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p34249211520">INSERT/INSERT OVERWRITE</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.2 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p178140615112">x</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.3 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p88143613117">x</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.4 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1781446519">√</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" headers="mcps1.3.3.2.2.2.2.8.1.5 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1081436516">√</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</li></ul>
|
|
<ul id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ul230155113597"><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li76865417596">Transaction atomicity is no longer ensured. If a transaction fails, data consistency cannot be ensured. Rollback is not supported.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li1615208112">GRANT and REVOKE operations cannot be performed on tables created on Hive using external schemas.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li83272271614">Concurrency support: Concurrent read and write operations on GaussDB(DWS), Hive, and Spark may cause dirty reads. Concurrent operations including INSERT OVERWRITE on the same non-partitioned table or the same partition of the same partitioned table may not ensure the expected result. Therefore, do not perform such operations.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li167881522134117">The Hive Metastore features do not support the federation mechanism.</li></ul>
|
|
</div>
|
|
<div class="section" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_section139199196306"><h4 class="sectiontitle">Procedure</h4><ol id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ol1111918478208"><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li1311934712208">Create a table in Hive.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li21191947152020">Insert data on Hive, or upload a local TXT data file to an OBS bucket then import the file to Hive through the OBS bucket, and import the file from the TXT storage table to the ORC storage table.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li611919475209">Create an MRS data source connection.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li31191747112016">Create a foreign server.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li2011974762010">Create an external schema.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li7119247162018">Use the external schema to import data to or read data from Hive tables.</li></ol>
|
|
</div>
|
|
<div class="section" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_section8857173392115"><h4 class="sectiontitle">Preparing the ORC Table Data Source of MRS</h4><ol id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ol71012593563"><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li21011559135617"><span>Create a <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b19633053763226">product_info.txt</strong> file on the local PC, copy the following data to the file, and save the file to the local PC.</span><p><div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_screen13684153410579"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal"> 1</span>
|
|
<span class="normal"> 2</span>
|
|
<span class="normal"> 3</span>
|
|
<span class="normal"> 4</span>
|
|
<span class="normal"> 5</span>
|
|
<span class="normal"> 6</span>
|
|
<span class="normal"> 7</span>
|
|
<span class="normal"> 8</span>
|
|
<span class="normal"> 9</span>
|
|
<span class="normal">10</span>
|
|
<span class="normal">11</span>
|
|
<span class="normal">12</span>
|
|
<span class="normal">13</span>
|
|
<span class="normal">14</span>
|
|
<span class="normal">15</span>
|
|
<span class="normal">16</span>
|
|
<span class="normal">17</span>
|
|
<span class="normal">18</span>
|
|
<span class="normal">19</span>
|
|
<span class="normal">20</span></pre></div></td><td class="code"><div><pre><span></span><span class="mi">100</span><span class="p">,</span><span class="n">XHDK</span><span class="o">-</span><span class="n">A</span><span class="o">-</span><span class="mi">1293</span><span class="o">-#</span><span class="n">fJ3</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">01</span><span class="p">,</span><span class="n">A</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">Autumn</span><span class="w"> </span><span class="k">New</span><span class="w"> </span><span class="n">Shirt</span><span class="w"> </span><span class="n">Women</span><span class="p">,</span><span class="n">red</span><span class="p">,</span><span class="n">M</span><span class="p">,</span><span class="mi">328</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">04</span><span class="p">,</span><span class="mi">715</span><span class="p">,</span><span class="n">good</span>
|
|
<span class="mi">205</span><span class="p">,</span><span class="n">KDKE</span><span class="o">-</span><span class="n">B</span><span class="o">-</span><span class="mi">9947</span><span class="o">-#</span><span class="n">kL5</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">01</span><span class="p">,</span><span class="n">A</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">Autumn</span><span class="w"> </span><span class="k">New</span><span class="w"> </span><span class="n">Knitwear</span><span class="w"> </span><span class="n">Women</span><span class="p">,</span><span class="n">pink</span><span class="p">,</span><span class="n">L</span><span class="p">,</span><span class="mi">584</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">05</span><span class="p">,</span><span class="mi">406</span><span class="p">,</span><span class="n">very</span><span class="w"> </span><span class="n">good</span><span class="o">!</span>
|
|
<span class="mi">300</span><span class="p">,</span><span class="n">JODL</span><span class="o">-</span><span class="n">X</span><span class="o">-</span><span class="mi">1937</span><span class="o">-#</span><span class="n">pV7</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">01</span><span class="p">,</span><span class="n">A</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">autumn</span><span class="w"> </span><span class="k">new</span><span class="w"> </span><span class="n">T</span><span class="o">-</span><span class="n">shirt</span><span class="w"> </span><span class="n">men</span><span class="p">,</span><span class="n">red</span><span class="p">,</span><span class="n">XL</span><span class="p">,</span><span class="mi">1245</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">03</span><span class="p">,</span><span class="mi">502</span><span class="p">,</span><span class="n">Bad</span><span class="p">.</span>
|
|
<span class="mi">310</span><span class="p">,</span><span class="n">QQPX</span><span class="o">-</span><span class="n">R</span><span class="o">-</span><span class="mi">3956</span><span class="o">-#</span><span class="n">aD8</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">02</span><span class="p">,</span><span class="n">B</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">autumn</span><span class="w"> </span><span class="k">new</span><span class="w"> </span><span class="n">jacket</span><span class="w"> </span><span class="n">women</span><span class="p">,</span><span class="n">red</span><span class="p">,</span><span class="n">L</span><span class="p">,</span><span class="mi">411</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">05</span><span class="p">,</span><span class="mi">436</span><span class="p">,</span><span class="n">It</span><span class="s1">'s really super nice</span>
|
|
<span class="s1">150,ABEF-C-1820-#mC6,2017-09-03,B,2017 Autumn New Jeans Women,blue,M,1223,2017-09-06,1200,The seller'</span><span class="n">s</span><span class="w"> </span><span class="n">packaging</span><span class="w"> </span><span class="k">is</span><span class="w"> </span><span class="n">exquisite</span>
|
|
<span class="mi">200</span><span class="p">,</span><span class="n">BCQP</span><span class="o">-</span><span class="n">E</span><span class="o">-</span><span class="mi">2365</span><span class="o">-#</span><span class="n">qE4</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">04</span><span class="p">,</span><span class="n">B</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">autumn</span><span class="w"> </span><span class="k">new</span><span class="w"> </span><span class="n">casual</span><span class="w"> </span><span class="n">pants</span><span class="w"> </span><span class="n">men</span><span class="p">,</span><span class="n">black</span><span class="p">,</span><span class="n">L</span><span class="p">,</span><span class="mi">997</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">10</span><span class="p">,</span><span class="mi">301</span><span class="p">,</span><span class="n">The</span><span class="w"> </span><span class="n">clothes</span><span class="w"> </span><span class="k">are</span><span class="w"> </span><span class="k">of</span><span class="w"> </span><span class="n">good</span><span class="w"> </span><span class="n">quality</span><span class="p">.</span>
|
|
<span class="mi">250</span><span class="p">,</span><span class="n">EABE</span><span class="o">-</span><span class="n">D</span><span class="o">-</span><span class="mi">1476</span><span class="o">-#</span><span class="n">oB1</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">10</span><span class="p">,</span><span class="n">A</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">autumn</span><span class="w"> </span><span class="k">new</span><span class="w"> </span><span class="n">dress</span><span class="w"> </span><span class="n">women</span><span class="p">,</span><span class="n">black</span><span class="p">,</span><span class="n">S</span><span class="p">,</span><span class="mi">841</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">15</span><span class="p">,</span><span class="mi">299</span><span class="p">,</span><span class="n">Follow</span><span class="w"> </span><span class="n">the</span><span class="w"> </span><span class="n">store</span><span class="w"> </span><span class="k">for</span><span class="w"> </span><span class="n">a</span><span class="w"> </span><span class="n">long</span><span class="w"> </span><span class="k">time</span><span class="p">.</span>
|
|
<span class="mi">108</span><span class="p">,</span><span class="n">CDXK</span><span class="o">-</span><span class="n">F</span><span class="o">-</span><span class="mi">1527</span><span class="o">-#</span><span class="n">pL2</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">11</span><span class="p">,</span><span class="n">A</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">autumn</span><span class="w"> </span><span class="k">new</span><span class="w"> </span><span class="n">dress</span><span class="w"> </span><span class="n">women</span><span class="p">,</span><span class="n">red</span><span class="p">,</span><span class="n">M</span><span class="p">,</span><span class="mi">85</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">14</span><span class="p">,</span><span class="mi">22</span><span class="p">,</span><span class="n">It</span><span class="s1">'s really amazing to buy</span>
|
|
<span class="s1">450,MMCE-H-4728-#nP9,2017-09-11,A,2017 autumn new jacket women,white,M,114,2017-09-14,22,Open the package and the clothes have no odor</span>
|
|
<span class="s1">260,OCDA-G-2817-#bD3,2017-09-12,B,2017 autumn new woolen coat women,red,L,2004,2017-09-15,826,Very favorite clothes</span>
|
|
<span class="s1">980,ZKDS-J-5490-#cW4,2017-09-13,B,2017 Autumn New Women'</span><span class="n">s</span><span class="w"> </span><span class="n">Cotton</span><span class="w"> </span><span class="n">Clothing</span><span class="p">,</span><span class="n">red</span><span class="p">,</span><span class="n">M</span><span class="p">,</span><span class="mi">112</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">16</span><span class="p">,</span><span class="mi">219</span><span class="p">,</span><span class="n">The</span><span class="w"> </span><span class="n">clothes</span><span class="w"> </span><span class="k">are</span><span class="w"> </span><span class="n">small</span>
|
|
<span class="mi">98</span><span class="p">,</span><span class="n">FKQB</span><span class="o">-</span><span class="n">I</span><span class="o">-</span><span class="mi">2564</span><span class="o">-#</span><span class="n">dA5</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">15</span><span class="p">,</span><span class="n">B</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">autumn</span><span class="w"> </span><span class="k">new</span><span class="w"> </span><span class="n">shoes</span><span class="w"> </span><span class="n">men</span><span class="p">,</span><span class="n">green</span><span class="p">,</span><span class="n">M</span><span class="p">,</span><span class="mi">4345</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">18</span><span class="p">,</span><span class="mi">5473</span><span class="p">,</span><span class="n">The</span><span class="w"> </span><span class="n">clothes</span><span class="w"> </span><span class="k">are</span><span class="w"> </span><span class="n">thick</span><span class="w"> </span><span class="k">and</span><span class="w"> </span><span class="n">it</span><span class="s1">'s better this winter.</span>
|
|
<span class="s1">150,DMQY-K-6579-#eS6,2017-09-21,A,2017 autumn new underwear men,yellow,37,2840,2017-09-25,5831,This price is very cost effective</span>
|
|
<span class="s1">200,GKLW-l-2897-#wQ7,2017-09-22,A,2017 Autumn New Jeans Men,blue,39,5879,2017-09-25,7200,The clothes are very comfortable to wear</span>
|
|
<span class="s1">300,HWEC-L-2531-#xP8,2017-09-23,A,2017 autumn new shoes women,brown,M,403,2017-09-26,607,good</span>
|
|
<span class="s1">100,IQPD-M-3214-#yQ1,2017-09-24,B,2017 Autumn New Wide Leg Pants Women,black,M,3045,2017-09-27,5021,very good.</span>
|
|
<span class="s1">350,LPEC-N-4572-#zX2,2017-09-25,B,2017 Autumn New Underwear Women,red,M,239,2017-09-28,407,The seller'</span><span class="n">s</span><span class="w"> </span><span class="n">service</span><span class="w"> </span><span class="k">is</span><span class="w"> </span><span class="n">very</span><span class="w"> </span><span class="n">good</span>
|
|
<span class="mi">110</span><span class="p">,</span><span class="n">NQAB</span><span class="o">-</span><span class="n">O</span><span class="o">-</span><span class="mi">3768</span><span class="o">-#</span><span class="n">sM3</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">26</span><span class="p">,</span><span class="n">B</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">autumn</span><span class="w"> </span><span class="k">new</span><span class="w"> </span><span class="n">underwear</span><span class="w"> </span><span class="n">women</span><span class="p">,</span><span class="n">red</span><span class="p">,</span><span class="n">S</span><span class="p">,</span><span class="mi">6089</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">29</span><span class="p">,</span><span class="mi">7021</span><span class="p">,</span><span class="n">The</span><span class="w"> </span><span class="n">color</span><span class="w"> </span><span class="k">is</span><span class="w"> </span><span class="n">very</span><span class="w"> </span><span class="n">good</span><span class="w"> </span>
|
|
<span class="mi">210</span><span class="p">,</span><span class="n">HWNB</span><span class="o">-</span><span class="n">P</span><span class="o">-</span><span class="mi">7879</span><span class="o">-#</span><span class="n">tN4</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">27</span><span class="p">,</span><span class="n">B</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">autumn</span><span class="w"> </span><span class="k">new</span><span class="w"> </span><span class="n">underwear</span><span class="w"> </span><span class="n">women</span><span class="p">,</span><span class="n">red</span><span class="p">,</span><span class="n">L</span><span class="p">,</span><span class="mi">3201</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">30</span><span class="p">,</span><span class="mi">4059</span><span class="p">,</span><span class="n">I</span><span class="w"> </span><span class="k">like</span><span class="w"> </span><span class="n">it</span><span class="w"> </span><span class="n">very</span><span class="w"> </span><span class="n">much</span><span class="w"> </span><span class="k">and</span><span class="w"> </span><span class="n">the</span><span class="w"> </span><span class="n">quality</span><span class="w"> </span><span class="k">is</span><span class="w"> </span><span class="n">good</span><span class="p">.</span>
|
|
<span class="mi">230</span><span class="p">,</span><span class="n">JKHU</span><span class="o">-</span><span class="n">Q</span><span class="o">-</span><span class="mi">8865</span><span class="o">-#</span><span class="n">uO5</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">09</span><span class="o">-</span><span class="mi">29</span><span class="p">,</span><span class="k">C</span><span class="p">,</span><span class="mi">2017</span><span class="w"> </span><span class="n">Autumn</span><span class="w"> </span><span class="k">New</span><span class="w"> </span><span class="n">Clothes</span><span class="w"> </span><span class="k">with</span><span class="w"> </span><span class="n">Chiffon</span><span class="w"> </span><span class="n">Shirt</span><span class="p">,</span><span class="n">black</span><span class="p">,</span><span class="n">M</span><span class="p">,</span><span class="mi">2056</span><span class="p">,</span><span class="mi">2017</span><span class="o">-</span><span class="mi">10</span><span class="o">-</span><span class="mi">02</span><span class="p">,</span><span class="mi">3842</span><span class="p">,</span><span class="n">very</span><span class="w"> </span><span class="n">good</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
</p></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li5547132710577"><span>Log in to the OBS console, click <strong id="EN-US_TOPIC_0000001838498170__b477173010116">Create Parallel File System</strong>, configure the following parameters, and click <strong id="EN-US_TOPIC_0000001838498170__b14771173018114">Create Now</strong>.</span><p>
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_table136525111625" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Bucket parameters</caption><thead align="left"><tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row1665215111627"><th align="left" class="cellrowborder" valign="top" width="28.360000000000003%" id="mcps1.3.5.2.2.2.1.2.3.1.1"><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p665212111123">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="71.64%" id="mcps1.3.5.2.2.2.1.2.3.1.2"><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p365231117219">Value</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row265216118215"><td class="cellrowborder" valign="top" width="28.360000000000003%" headers="mcps1.3.5.2.2.2.1.2.3.1.1 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p765251113218">Region</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.64%" headers="mcps1.3.5.2.2.2.1.2.3.1.2 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p181731493513">Based on site requirements</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row46524112026"><td class="cellrowborder" valign="top" width="28.360000000000003%" headers="mcps1.3.5.2.2.2.1.2.3.1.1 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1365212111218">Data Redundancy Policy</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.64%" headers="mcps1.3.5.2.2.2.1.2.3.1.2 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1665281113210">Single-AZ storage</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row1365241119210"><td class="cellrowborder" valign="top" width="28.360000000000003%" headers="mcps1.3.5.2.2.2.1.2.3.1.1 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p365217111424">Bucket Name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.64%" headers="mcps1.3.5.2.2.2.1.2.3.1.2 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p126525111218">mrs-datasource</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row14652151114211"><td class="cellrowborder" valign="top" width="28.360000000000003%" headers="mcps1.3.5.2.2.2.1.2.3.1.1 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p9652311326">Default Storage Class</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.64%" headers="mcps1.3.5.2.2.2.1.2.3.1.2 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p14652181116219">Standard</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row166521115219"><td class="cellrowborder" valign="top" width="28.360000000000003%" headers="mcps1.3.5.2.2.2.1.2.3.1.1 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p8652131114210">Bucket Policy</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.64%" headers="mcps1.3.5.2.2.2.1.2.3.1.2 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1165213111629">Private</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row19652151120219"><td class="cellrowborder" valign="top" width="28.360000000000003%" headers="mcps1.3.5.2.2.2.1.2.3.1.1 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p166522113216">Default Encryption</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.64%" headers="mcps1.3.5.2.2.2.1.2.3.1.2 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p10652311421">Disable</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row16652161119210"><td class="cellrowborder" valign="top" width="28.360000000000003%" headers="mcps1.3.5.2.2.2.1.2.3.1.1 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p86521011729">Direct Reading</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.64%" headers="mcps1.3.5.2.2.2.1.2.3.1.2 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1765218111124">Disable</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row191398334411"><td class="cellrowborder" valign="top" width="28.360000000000003%" headers="mcps1.3.5.2.2.2.1.2.3.1.1 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p01398331346">Enterprise Project</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.64%" headers="mcps1.3.5.2.2.2.1.2.3.1.2 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p913918331646">default</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_row178066341748"><td class="cellrowborder" valign="top" width="28.360000000000003%" headers="mcps1.3.5.2.2.2.1.2.3.1.1 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p20806193415415">Tags</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="71.64%" headers="mcps1.3.5.2.2.2.1.2.3.1.2 "><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p6806434249">N/A</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</p></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li15904113185"><span>Switch back to the MRS console and click the name of the created MRS cluster. On the <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b2026418793226">Dashboard</strong> page, click the Synchronize button next to <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b13906516453226">IAM User Sync</strong>. The synchronization takes about 5 minutes.</span></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li116986421317"><span>Click <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b3634737833226">Nodes</strong> and click a master node. On the displayed page, switch to the <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b16198663793226">EIPs</strong> tab, click <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b14559506973226">Bind EIP</strong>, select an existing EIP, and click <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b13576115503226">OK</strong>. If no EIP is available, create one. Record the EIP.</span></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li456461312214"><span>(Optional) Connect Hive to OBS.</span><p><div class="note" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_note1157192732211"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p10737202762218">Perform this step when Hive interconnects with OBS. Skip this step when Hive interconnects with HDFS.</p>
|
|
</div></div>
|
|
<div class="p" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1535181814227"><ol type="a" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ol148581830162413"><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li785810309248">Go back to the MRS cluster page. Click the cluster name. On the <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b9632149133226">Dashboard</strong> tab page of the cluster details page, click <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b14356618343226">Access Manager</strong>. If a message is displayed indicating that EIP needs to be bound, bind an EIP first.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li26891244162410">In the <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b21294192943226">Access MRS Manager</strong> dialog box, click <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b11719394483226">OK</strong>. You will be redirected to the MRS Manager login page. Enter the username <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b6101029003226">admin</strong> and its password for logging in to MRS Manager. The password is the one you entered when creating the MRS cluster.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li564985511244">Interconnect Hive with OBS by referring to .</li></ol>
|
|
</div>
|
|
</p></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li1053201072811"><span>Download the client.</span><p><ol type="a" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ol1839312372814"><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li12393152319283">Go back to the MRS cluster page. Click the cluster name. On the <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b5740607653226">Dashboard</strong> tab page of the cluster details page, click <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b11549664163226">Access Manager</strong>. If a message is displayed indicating that EIP needs to be bound, bind an EIP first.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li144140315297">In the <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b3153382513226">Access MRS Manager</strong> dialog box, click <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b15817902323226">OK</strong>. You will be redirected to the MRS Manager login page. Enter the username <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b17327669173226">admin</strong> and its password for logging in to MRS Manager. The password is the one you entered when creating the MRS cluster.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li51752683016">Choose <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b1509921783226">Services</strong> > <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b7760432173226">Download Client</strong>. Set <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b11540454883226">Client Type</strong> to <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b6974681673226">Only configuration files</strong> and set <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b15888310743226">Download To</strong> to <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b20637198313226">Server</strong>. Click <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b20566413003226">OK</strong>.<p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1597118183118"><span><img id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_image15954201814314" src="figure/en-us_image_0000001884500297.png"></span></p>
|
|
</li></ol>
|
|
</p></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li39868439380"><span>Log in to the active master node as user <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b20946904563226">root</strong> and update the client configuration of the active management node.</span><p><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p188054819402"><strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b96032023124016">cd /opt/client</strong></p>
|
|
<p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p218151183915"><strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b6622468603226">sh refreshConfig.sh /opt/client</strong> <i><span class="varname" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_varname20707774093226">Full_path_of_client_configuration_file_package</span></i></p>
|
|
<p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p02509215394">In this tutorial, run the following command:</p>
|
|
<p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1783142619397"><strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b1216510314395">sh refreshConfig.sh /opt/client</strong> /tmp/MRS-client/MRS_Services_Client.tar</p>
|
|
</p></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li92033529124"><span>Switch to user <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b3695484873226">omm</strong> and go to the directory where the Hive client is located.</span><p><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p178331054181211"><strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b9833554171218">su - omm</strong></p>
|
|
<p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p3833354131213"><strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b283355461219">cd /opt/client</strong></p>
|
|
</p></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li5799191543216"><span>Create the <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b13340404843226">product_info</strong> table whose storage format is TEXTFILE on Hive.</span><p><ol type="a" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ol15758193511367"><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li167581352366">Import environment variables to the <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b7399541183226">/opt/client</strong> directory.<p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p239645815369"><strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b34271317173715">source bigdata_env</strong></p>
|
|
<div class="note" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_note174419221343"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p921913218474">If <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b18930163463520">find: 'opt/client/Hudi': Permission denied</strong> is displayed, ignore it. This does not affect subsequent operations.</p>
|
|
</div></div>
|
|
</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li7945455173618">Log in to the Hive client.<ol class="substepthirdol" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ol5251731132517"><li id="EN-US_TOPIC_0000001838498170__li777081219433">If Kerberos authentication is enabled for the current cluster, run the command below to authenticate the current user. The current user must have the permission to create Hive tables. For details, see "Creating a Role" in <span id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ph20646193672518"><em id="EN-US_TOPIC_0000001838498170__i1880410586588">MapReduce Service User Guide</em></span>.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li12255311257">Configure roles with corresponding permissions. For details, see "Creating a Role" in <span id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ph1064663610254"><em id="EN-US_TOPIC_0000001838498170__i168801723621">MapReduce Service User Guide</em></span>.. Bind a role to the user. If Kerberos authentication is not enabled for the current cluster, you do not need to run the following command:<p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p35121246277"><strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b628235553514">kinit</strong> <em id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_i3283185503520">MRS cluster user</em></p>
|
|
</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li18591104612261">Run the following command to start the Hive client:<p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p174721114142718"><a name="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li18591104612261"></a><a name="en-us_topic_0000001473887582_li18591104612261"></a><strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b41801266244">beeline</strong></p>
|
|
</li></ol>
|
|
</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li136751926153713">Run the following SQL commands in sequence to create a demo database and the <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b9687102173226">product_info</strong> table:<div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_screen1873643184119"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">CREATE</span><span class="w"> </span><span class="k">DATABASE</span><span class="w"> </span><span class="n">demo</span><span class="p">;</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
<div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_screen86781636174113"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span></pre></div></td><td class="code"><div><pre><span></span><span class="n">USE</span><span class="w"> </span><span class="n">demo</span><span class="p">;</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
<div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_screen71611548144112"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal"> 1</span>
|
|
<span class="normal"> 2</span>
|
|
<span class="normal"> 3</span>
|
|
<span class="normal"> 4</span>
|
|
<span class="normal"> 5</span>
|
|
<span class="normal"> 6</span>
|
|
<span class="normal"> 7</span>
|
|
<span class="normal"> 8</span>
|
|
<span class="normal"> 9</span>
|
|
<span class="normal">10</span>
|
|
<span class="normal">11</span>
|
|
<span class="normal">12</span>
|
|
<span class="normal">13</span>
|
|
<span class="normal">14</span>
|
|
<span class="normal">15</span>
|
|
<span class="normal">16</span>
|
|
<span class="normal">17</span>
|
|
<span class="normal">18</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">DROP</span><span class="w"> </span><span class="k">TABLE</span><span class="w"> </span><span class="n">product_info</span><span class="p">;</span>
|
|
|
|
<span class="k">CREATE</span><span class="w"> </span><span class="k">TABLE</span><span class="w"> </span><span class="n">product_info</span><span class="w"> </span>
|
|
<span class="p">(</span><span class="w"> </span>
|
|
<span class="w"> </span><span class="n">product_price</span><span class="w"> </span><span class="nb">int</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_id</span><span class="w"> </span><span class="nb">char</span><span class="p">(</span><span class="mi">30</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_time</span><span class="w"> </span><span class="nb">date</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_level</span><span class="w"> </span><span class="nb">char</span><span class="p">(</span><span class="mi">10</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_name</span><span class="w"> </span><span class="nb">varchar</span><span class="p">(</span><span class="mi">200</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_type1</span><span class="w"> </span><span class="nb">varchar</span><span class="p">(</span><span class="mi">20</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_type2</span><span class="w"> </span><span class="nb">char</span><span class="p">(</span><span class="mi">10</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_monthly_sales_cnt</span><span class="w"> </span><span class="nb">int</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_comment_time</span><span class="w"> </span><span class="nb">date</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_comment_num</span><span class="w"> </span><span class="nb">int</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_comment_content</span><span class="w"> </span><span class="nb">varchar</span><span class="p">(</span><span class="mi">200</span><span class="p">)</span><span class="w"> </span>
|
|
<span class="p">)</span><span class="w"> </span>
|
|
<span class="k">row</span><span class="w"> </span><span class="n">format</span><span class="w"> </span><span class="n">delimited</span><span class="w"> </span><span class="n">fields</span><span class="w"> </span><span class="n">terminated</span><span class="w"> </span><span class="k">by</span><span class="w"> </span><span class="s1">','</span><span class="w"> </span>
|
|
<span class="n">stored</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="n">TEXTFILE</span><span class="p">;</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
</li></ol>
|
|
</p></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li186016733320"><span>Import the <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b13847263483226">product_info.txt</strong> file to Hive.</span><p><ul id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ul121032030142016"><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li121031230162014">Hive is interconnected with OBS: Go back to OBS Console, click the name of the bucket, choose <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b113131254163610">Objects</strong> > <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b7156257103615">Upload Object</strong>, and upload the <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b18629114313719">product_info.txt</strong> file to the path of the <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b17686185217373">product_info table</strong> in the OBS bucket.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li410323014205">Hive is interconnected with HDFS: Import the <strong id="EN-US_TOPIC_0000001838498170__b1882131723218">product_info.txt</strong> file to the HDFS path <strong id="EN-US_TOPIC_0000001838498170__b14882161713326">/user/hive/warehouse/demo.db/product_info/</strong>.<span id="EN-US_TOPIC_0000001838498170__ph148831017153212"> For operations related to importing data to the MRS cluster, see section "Cluster Operation Guide" > "Managing Active Clusters" > "Managing Data Files" in the <em id="EN-US_TOPIC_0000001838498170__i1288261783215">MapReduce Service User Guide</em>.</span>.</li></ul>
|
|
</p></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li175901856124211"><span>Create an ORC table and import data to the table.</span><p><ol type="a" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ol2567454194717"><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li6567254164711">Run the following SQL commands to create an ORC table:<div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_screen841174234812"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal"> 1</span>
|
|
<span class="normal"> 2</span>
|
|
<span class="normal"> 3</span>
|
|
<span class="normal"> 4</span>
|
|
<span class="normal"> 5</span>
|
|
<span class="normal"> 6</span>
|
|
<span class="normal"> 7</span>
|
|
<span class="normal"> 8</span>
|
|
<span class="normal"> 9</span>
|
|
<span class="normal">10</span>
|
|
<span class="normal">11</span>
|
|
<span class="normal">12</span>
|
|
<span class="normal">13</span>
|
|
<span class="normal">14</span>
|
|
<span class="normal">15</span>
|
|
<span class="normal">16</span>
|
|
<span class="normal">17</span>
|
|
<span class="normal">18</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">DROP</span><span class="w"> </span><span class="k">TABLE</span><span class="w"> </span><span class="n">product_info_orc</span><span class="p">;</span>
|
|
|
|
<span class="k">CREATE</span><span class="w"> </span><span class="k">TABLE</span><span class="w"> </span><span class="n">product_info_orc</span>
|
|
<span class="p">(</span><span class="w"> </span>
|
|
<span class="w"> </span><span class="n">product_price</span><span class="w"> </span><span class="nb">int</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_id</span><span class="w"> </span><span class="nb">char</span><span class="p">(</span><span class="mi">30</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_time</span><span class="w"> </span><span class="nb">date</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_level</span><span class="w"> </span><span class="nb">char</span><span class="p">(</span><span class="mi">10</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_name</span><span class="w"> </span><span class="nb">varchar</span><span class="p">(</span><span class="mi">200</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_type1</span><span class="w"> </span><span class="nb">varchar</span><span class="p">(</span><span class="mi">20</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_type2</span><span class="w"> </span><span class="nb">char</span><span class="p">(</span><span class="mi">10</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_monthly_sales_cnt</span><span class="w"> </span><span class="nb">int</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_comment_time</span><span class="w"> </span><span class="nb">date</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_comment_num</span><span class="w"> </span><span class="nb">int</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_comment_content</span><span class="w"> </span><span class="nb">varchar</span><span class="p">(</span><span class="mi">200</span><span class="p">)</span><span class="w"> </span>
|
|
<span class="p">)</span><span class="w"> </span>
|
|
<span class="k">row</span><span class="w"> </span><span class="n">format</span><span class="w"> </span><span class="n">delimited</span><span class="w"> </span><span class="n">fields</span><span class="w"> </span><span class="n">terminated</span><span class="w"> </span><span class="k">by</span><span class="w"> </span><span class="s1">','</span><span class="w"> </span>
|
|
<span class="n">stored</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="n">orc</span><span class="p">;</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li14661761487">Insert data in the <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b8799398043226">product_info</strong> table into the Hive ORC table <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b15707712623226">product_info_orc</strong>.<div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_screen1287331818519"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">insert</span><span class="w"> </span><span class="k">into</span><span class="w"> </span><span class="n">product_info_orc</span><span class="w"> </span><span class="k">select</span><span class="w"> </span><span class="o">*</span><span class="w"> </span><span class="k">from</span><span class="w"> </span><span class="n">product_info</span><span class="p">;</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li1914532125110">Query whether the data import is successful.<div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_screen086217139529"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">select</span><span class="w"> </span><span class="o">*</span><span class="w"> </span><span class="k">from</span><span class="w"> </span><span class="n">product_info_orc</span><span class="p">;</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
</li></ol>
|
|
</p></li></ol>
|
|
</div>
|
|
<div class="section" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_section985716338216"><h4 class="sectiontitle">Creating an MRS Data Source Connection</h4><ol id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ol52398165498"><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li10239191614492"><span>Log in to the GaussDB(DWS) console and click the created GaussDB(DWS) cluster. Ensure that the GaussDB(DWS) and MRS clusters are in the same region, AZ, and VPC subnet.</span></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li18739169145112"><span>Click the <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b15082708083226">MRS Data Source</strong> tab and click <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b16362771503226">Create MRS Cluster Connection</strong>.</span></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li16963183225519"><span>Set the following parameters and click <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b11680132154416">OK</strong>.</span><p><ul id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ul14187103663212"><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li41871536173219"><strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b1528735634514">Data Source</strong>: mrs_server</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li2187536193218"><strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b18970161220461">Configuration Mode</strong>: <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b180822010461">MRS Account</strong></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li12187173611327"><strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b43227324463">MRS Data Source</strong>: Select the created <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b10657185717468">mrs_01</strong> cluster.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li14187173653215"><strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b17671244164613">MRS Account</strong>: admin</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li2187133673213"><strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b680974804613">Password</strong>: Enter the password of the <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b1393170114718">admin</strong> user created for the MRS data source.</li></ul>
|
|
<p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p159381946185510"></p>
|
|
<p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1938946165516"><span><img id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_image14737115191515" src="figure/en-us_image_0000001884619813.png"></span></p>
|
|
<p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p836684191419"></p>
|
|
</p></li></ol>
|
|
</div>
|
|
<div class="section" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_section10660846540"><h4 class="sectiontitle">Creating a Foreign Server</h4><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p472914281125">Perform this step only when Hive interconnects with OBS. Skip this step when Hive interconnects with HDFS.</p>
|
|
<ol id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ol12123162416348"><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li10123182411344"><span>Use Data Studio to connect to the created GaussDB(DWS) cluster.</span></li></ol><ol start="2" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ol871233933615"><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_en-us_topic_0109259516_en-us_topic_0101997156_li5290144113112"><span>Run the following statement to create a foreign server.</span><p><div class="notice" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_note29448236569"><span class="noticetitle"><img src="public_sys-resources/notice_3.0-en-us.png"> </span><div class="noticebody"><p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p1794462317569">Hard-coded or plaintext AK and SK are risky. For security purposes, encrypt your AK and SK and store them in the configuration file or environment variables.</p>
|
|
</div></div>
|
|
<div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_en-us_topic_0109259516_en-us_topic_0101997156_screen11290114183116"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span>
|
|
<span class="normal">2</span>
|
|
<span class="normal">3</span>
|
|
<span class="normal">4</span>
|
|
<span class="normal">5</span>
|
|
<span class="normal">6</span>
|
|
<span class="normal">7</span>
|
|
<span class="normal">8</span>
|
|
<span class="normal">9</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">CREATE</span><span class="w"> </span><span class="n">SERVER</span><span class="w"> </span><span class="n">obs_server</span><span class="w"> </span><span class="k">FOREIGN</span><span class="w"> </span><span class="k">DATA</span><span class="w"> </span><span class="n">WRAPPER</span><span class="w"> </span><span class="n">DFS_FDW</span><span class="w"> </span>
|
|
<span class="k">OPTIONS</span><span class="w"> </span>
|
|
<span class="p">(</span>
|
|
<span class="n">address</span><span class="w"> </span><span class="s1">'obs.example.com:5443'</span><span class="p">,</span><span class="w"> </span><span class="o">//</span><span class="n">Address</span><span class="w"> </span><span class="k">for</span><span class="w"> </span><span class="n">accessing</span><span class="w"> </span><span class="n">OBS</span>
|
|
<span class="n">encrypt</span><span class="w"> </span><span class="s1">'on'</span><span class="p">,</span>
|
|
<span class="n">access_key</span><span class="w"> </span><span class="s1">'{AK value}'</span><span class="p">,</span>
|
|
<span class="n">secret_access_key</span><span class="w"> </span><span class="s1">'{SK value}'</span><span class="p">,</span>
|
|
<span class="w"> </span><span class="k">type</span><span class="w"> </span><span class="s1">'obs'</span>
|
|
<span class="p">);</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
</p></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_en-us_topic_0109259516_en-us_topic_0101997156_li1532292418484"><span>Check the foreign server.</span><p><div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_en-us_topic_0109259516_en-us_topic_0101997156_screen1329004143114"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">SELECT</span><span class="w"> </span><span class="o">*</span><span class="w"> </span><span class="k">FROM</span><span class="w"> </span><span class="n">pg_foreign_server</span><span class="w"> </span><span class="k">WHERE</span><span class="w"> </span><span class="n">srvname</span><span class="o">=</span><span class="s1">'obs_server'</span><span class="p">;</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
<p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_en-us_topic_0109259516_en-us_topic_0101997156_p182901244318">The server is successfully created if information similar to the following is displayed:</p>
|
|
<div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_en-us_topic_0109259516_en-us_topic_0101997156_screen1290843319"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span>
|
|
<span class="normal">2</span>
|
|
<span class="normal">3</span>
|
|
<span class="normal">4</span></pre></div></td><td class="code"><div><pre><span></span><span class="w"> </span><span class="n">srvname</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">srvowner</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">srvfdw</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">srvtype</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">srvversion</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">srvacl</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">srvoptions</span>
|
|
<span class="c1">--------------------------------------------------+----------+--------+---------+------------+--------+---------------------------------------------------------------------------------------------------------------------</span>
|
|
<span class="w"> </span><span class="n">obs_server</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="mi">16476</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="mi">14337</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">address</span><span class="o">=</span><span class="n">obs</span><span class="p">.</span><span class="n">example</span><span class="p">.</span><span class="n">com</span><span class="p">:</span><span class="mi">5443</span><span class="p">,</span><span class="k">type</span><span class="o">=</span><span class="n">obs</span><span class="p">,</span><span class="n">encrypt</span><span class="o">=</span><span class="k">on</span><span class="p">,</span><span class="n">access_key</span><span class="o">=***</span><span class="p">,</span><span class="n">secret_access_key</span><span class="o">=***</span><span class="err">}</span>
|
|
<span class="p">(</span><span class="mi">1</span><span class="w"> </span><span class="k">row</span><span class="p">)</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
</p></li></ol>
|
|
</div>
|
|
<div class="section" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_section898651317182"><h4 class="sectiontitle">Create an external schema.</h4><ol id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ol18377656135613"><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li12608752205717"><span>Obtain the internal IP address and port number of the Hive metastore service and the name of the Hive database to be accessed.</span><p><ol type="a" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_en-us_topic_0109259517_en-us_topic_0101477886_ol133446512517"><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_en-us_topic_0109259517_en-us_topic_0101477886_li3342652252">Log in to the MRS console.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_en-us_topic_0109259517_en-us_topic_0101477886_li113444515257">Choose <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b7378662273226">Cluster</strong> > <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b10973342263226">Active Cluster</strong> and click the name of the cluster to be queried to enter the page displaying the cluster's basic information.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_en-us_topic_0109259517_en-us_topic_0101477886_li183449512519">Click <strong id="EN-US_TOPIC_0000001838498170__b1497412620577">Go to manager</strong> on the O&M Management page and enter the username and password to log in to the management page.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_en-us_topic_0109259517_en-us_topic_0101477886_li334495162512">Click <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b9246134710411">Cluster</strong>, <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b124121491418">Hive</strong>, <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b9235155117417">Configuration</strong>, <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b240845714412">All Configurations</strong>, <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b93131102510">MetaStore</strong>, and <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b119892410511">Port</strong> in sequence, and record the value of <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b95537209515">hive.metastore.port</strong>.</li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li108798541217">Click <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b114627514515">Cluster</strong>, <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b16174253155">Hive</strong>, and <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b76117577519">Instance</strong> in sequence, and record the MetaStore management IP address of the host whose name contains <strong id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_b780912371861">master1</strong>.</li></ol>
|
|
</p></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li153771656115610"><span>Create an external schema.</span><p><div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_en-us_topic_0109259517_en-us_topic_0101477886_screen17865118123918"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal"> 1</span>
|
|
<span class="normal"> 2</span>
|
|
<span class="normal"> 3</span>
|
|
<span class="normal"> 4</span>
|
|
<span class="normal"> 5</span>
|
|
<span class="normal"> 6</span>
|
|
<span class="normal"> 7</span>
|
|
<span class="normal"> 8</span>
|
|
<span class="normal"> 9</span>
|
|
<span class="normal">10</span>
|
|
<span class="normal">11</span>
|
|
<span class="normal">12</span>
|
|
<span class="normal">13</span>
|
|
<span class="normal">14</span>
|
|
<span class="normal">15</span>
|
|
<span class="normal">16</span>
|
|
<span class="normal">17</span>
|
|
<span class="normal">18</span>
|
|
<span class="normal">19</span></pre></div></td><td class="code"><div><pre><span></span><span class="o">//</span><span class="k">When</span><span class="w"> </span><span class="n">interconnecting</span><span class="w"> </span><span class="n">Hive</span><span class="w"> </span><span class="k">with</span><span class="w"> </span><span class="n">OBS</span><span class="p">:</span><span class="w"> </span><span class="k">Set</span><span class="w"> </span><span class="n">SERVER</span><span class="w"> </span><span class="k">to</span><span class="w"> </span><span class="n">the</span><span class="w"> </span><span class="n">name</span><span class="w"> </span><span class="k">of</span><span class="w"> </span><span class="n">the</span><span class="w"> </span><span class="k">external</span><span class="w"> </span><span class="n">server</span><span class="w"> </span><span class="n">created</span><span class="w"> </span><span class="k">in</span><span class="w"> </span><span class="p">,</span><span class="w"> </span><span class="k">DATABASE</span><span class="w"> </span><span class="k">to</span><span class="w"> </span><span class="n">the</span><span class="w"> </span><span class="k">database</span><span class="w"> </span><span class="n">created</span><span class="w"> </span><span class="k">on</span><span class="w"> </span><span class="n">Hive</span><span class="p">,</span><span class="w"> </span><span class="n">METAADDRESS</span><span class="w"> </span><span class="k">to</span><span class="w"> </span><span class="n">the</span><span class="w"> </span><span class="n">IP</span><span class="w"> </span><span class="n">address</span><span class="w"> </span><span class="k">and</span><span class="w"> </span><span class="n">port</span><span class="w"> </span><span class="nb">number</span><span class="w"> </span><span class="k">of</span><span class="w"> </span><span class="n">the</span><span class="w"> </span><span class="n">Hive</span><span class="w"> </span><span class="n">metastore</span><span class="w"> </span><span class="n">service</span><span class="w"> </span><span class="n">recorded</span><span class="w"> </span><span class="k">in</span><span class="w"> </span><span class="p">,</span><span class="w"> </span><span class="k">and</span><span class="w"> </span><span class="n">CONFIGURATION</span><span class="w"> </span><span class="k">to</span><span class="w"> </span><span class="n">the</span><span class="w"> </span><span class="k">default</span><span class="w"> </span><span class="n">configuration</span><span class="w"> </span><span class="n">path</span><span class="w"> </span><span class="k">of</span><span class="w"> </span><span class="n">the</span><span class="w"> </span><span class="n">MRS</span><span class="w"> </span><span class="k">data</span><span class="w"> </span><span class="k">source</span><span class="p">.</span>
|
|
<span class="k">DROP</span><span class="w"> </span><span class="k">SCHEMA</span><span class="w"> </span><span class="k">IF</span><span class="w"> </span><span class="k">EXISTS</span><span class="w"> </span><span class="n">ex1</span><span class="p">;</span>
|
|
|
|
<span class="k">CREATE</span><span class="w"> </span><span class="k">EXTERNAL</span><span class="w"> </span><span class="k">SCHEMA</span><span class="w"> </span><span class="n">ex1</span>
|
|
<span class="w"> </span><span class="k">WITH</span><span class="w"> </span><span class="k">SOURCE</span><span class="w"> </span><span class="n">hive</span>
|
|
<span class="w"> </span><span class="k">DATABASE</span><span class="w"> </span><span class="s1">'demo'</span>
|
|
<span class="w"> </span><span class="n">SERVER</span><span class="w"> </span><span class="n">obs_server</span>
|
|
<span class="w"> </span><span class="n">METAADDRESS</span><span class="w"> </span><span class="s1">'***.***.***.***:***'</span>
|
|
<span class="w"> </span><span class="n">CONFIGURATION</span><span class="w"> </span><span class="s1">'/MRS/gaussdb/mrs_server'</span>
|
|
|
|
<span class="o">//</span><span class="k">When</span><span class="w"> </span><span class="n">interconnecting</span><span class="w"> </span><span class="n">Hive</span><span class="w"> </span><span class="k">with</span><span class="w"> </span><span class="n">HDFS</span><span class="p">:</span><span class="w"> </span><span class="k">Set</span><span class="w"> </span><span class="n">SERVER</span><span class="w"> </span><span class="k">to</span><span class="w"> </span><span class="n">mrs_server</span><span class="w"> </span><span class="p">(</span><span class="n">name</span><span class="w"> </span><span class="k">of</span><span class="w"> </span><span class="n">the</span><span class="w"> </span><span class="k">data</span><span class="w"> </span><span class="k">source</span><span class="w"> </span><span class="n">created</span><span class="w"> </span><span class="k">in</span><span class="w"> </span><span class="p">),</span><span class="w"> </span><span class="n">METAADDRESS</span><span class="w"> </span><span class="k">to</span><span class="w"> </span><span class="n">the</span><span class="w"> </span><span class="n">IP</span><span class="w"> </span><span class="n">address</span><span class="w"> </span><span class="k">and</span><span class="w"> </span><span class="n">port</span><span class="w"> </span><span class="nb">number</span><span class="w"> </span><span class="k">of</span><span class="w"> </span><span class="n">the</span><span class="w"> </span><span class="n">Hive</span><span class="w"> </span><span class="n">metastore</span><span class="w"> </span><span class="n">service</span><span class="w"> </span><span class="n">recorded</span><span class="w"> </span><span class="k">in</span><span class="w"> </span><span class="p">,</span><span class="w"> </span><span class="k">and</span><span class="w"> </span><span class="n">CONFIGURATION</span><span class="w"> </span><span class="k">to</span><span class="w"> </span><span class="n">the</span><span class="w"> </span><span class="k">default</span><span class="w"> </span><span class="n">configuration</span><span class="w"> </span><span class="n">path</span><span class="w"> </span><span class="k">of</span><span class="w"> </span><span class="n">the</span><span class="w"> </span><span class="n">MRS</span><span class="w"> </span><span class="k">data</span><span class="w"> </span><span class="k">source</span><span class="p">.</span>
|
|
<span class="k">DROP</span><span class="w"> </span><span class="k">SCHEMA</span><span class="w"> </span><span class="k">IF</span><span class="w"> </span><span class="k">EXISTS</span><span class="w"> </span><span class="n">ex1</span><span class="p">;</span>
|
|
|
|
<span class="k">CREATE</span><span class="w"> </span><span class="k">EXTERNAL</span><span class="w"> </span><span class="k">SCHEMA</span><span class="w"> </span><span class="n">ex1</span>
|
|
<span class="w"> </span><span class="k">WITH</span><span class="w"> </span><span class="k">SOURCE</span><span class="w"> </span><span class="n">hive</span>
|
|
<span class="w"> </span><span class="k">DATABASE</span><span class="w"> </span><span class="s1">'demo'</span>
|
|
<span class="w"> </span><span class="n">SERVER</span><span class="w"> </span><span class="n">mrs_server</span>
|
|
<span class="w"> </span><span class="n">METAADDRESS</span><span class="w"> </span><span class="s1">'***.***.***.***:***'</span>
|
|
<span class="w"> </span><span class="n">CONFIGURATION</span><span class="w"> </span><span class="s1">'/MRS/gaussdb/mrs_server'</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
</p></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li157089590417"><span>View the created external schema.</span><p><div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_screen281654511111"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span>
|
|
<span class="normal">2</span>
|
|
<span class="normal">3</span>
|
|
<span class="normal">4</span>
|
|
<span class="normal">5</span>
|
|
<span class="normal">6</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">SELECT</span><span class="w"> </span><span class="o">*</span><span class="w"> </span><span class="k">FROM</span><span class="w"> </span><span class="n">pg_namespace</span><span class="w"> </span><span class="k">WHERE</span><span class="w"> </span><span class="n">nspname</span><span class="o">=</span><span class="s1">'ex1'</span><span class="p">;</span>
|
|
<span class="k">SELECT</span><span class="w"> </span><span class="o">*</span><span class="w"> </span><span class="k">FROM</span><span class="w"> </span><span class="n">pg_external_namespace</span><span class="w"> </span><span class="k">WHERE</span><span class="w"> </span><span class="n">nspid</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="k">SELECT</span><span class="w"> </span><span class="n">oid</span><span class="w"> </span><span class="k">FROM</span><span class="w"> </span><span class="n">pg_namespace</span><span class="w"> </span><span class="k">WHERE</span><span class="w"> </span><span class="n">nspname</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'ex1'</span><span class="p">);</span>
|
|
<span class="w"> </span><span class="n">nspid</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">srvname</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">source</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">address</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">database</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">confpath</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">ensoptions</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">catalog</span>
|
|
<span class="c1">--------------------------------------------------+----------+--------+---------+------------+--------+---------------------------------------------------------------------------------------------------------------------</span>
|
|
<span class="w"> </span><span class="mi">16393</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">obs_server</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">hive</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">***</span><span class="p">.</span><span class="o">***</span><span class="p">.</span><span class="o">***</span><span class="p">.</span><span class="o">***</span><span class="p">:</span><span class="o">***</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">demo</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">***</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span>
|
|
<span class="p">(</span><span class="mi">1</span><span class="w"> </span><span class="k">row</span><span class="p">)</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
</p></li></ol>
|
|
<p id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_p191339201112"></p>
|
|
</div>
|
|
<div class="section" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_section16990191318186"><h4 class="sectiontitle">Importing Data</h4><ol id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ol10851817115"><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li68591720116"><span>Create a local table for data import.</span><p><div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_en-us_topic_0109259518_en-us_topic_0101477887_screen17865118123918"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal"> 1</span>
|
|
<span class="normal"> 2</span>
|
|
<span class="normal"> 3</span>
|
|
<span class="normal"> 4</span>
|
|
<span class="normal"> 5</span>
|
|
<span class="normal"> 6</span>
|
|
<span class="normal"> 7</span>
|
|
<span class="normal"> 8</span>
|
|
<span class="normal"> 9</span>
|
|
<span class="normal">10</span>
|
|
<span class="normal">11</span>
|
|
<span class="normal">12</span>
|
|
<span class="normal">13</span>
|
|
<span class="normal">14</span>
|
|
<span class="normal">15</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">DROP</span><span class="w"> </span><span class="k">TABLE</span><span class="w"> </span><span class="k">IF</span><span class="w"> </span><span class="k">EXISTS</span><span class="w"> </span><span class="n">product_info</span><span class="p">;</span>
|
|
<span class="k">CREATE</span><span class="w"> </span><span class="k">TABLE</span><span class="w"> </span><span class="n">product_info</span>
|
|
<span class="p">(</span>
|
|
<span class="w"> </span><span class="n">product_price</span><span class="w"> </span><span class="nb">integer</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_id</span><span class="w"> </span><span class="nb">char</span><span class="p">(</span><span class="mi">30</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_time</span><span class="w"> </span><span class="nb">date</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_level</span><span class="w"> </span><span class="nb">char</span><span class="p">(</span><span class="mi">10</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_name</span><span class="w"> </span><span class="nb">varchar</span><span class="p">(</span><span class="mi">200</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_type1</span><span class="w"> </span><span class="nb">varchar</span><span class="p">(</span><span class="mi">20</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_type2</span><span class="w"> </span><span class="nb">char</span><span class="p">(</span><span class="mi">10</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_monthly_sales_cnt</span><span class="w"> </span><span class="nb">integer</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_comment_time</span><span class="w"> </span><span class="nb">date</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_comment_num</span><span class="w"> </span><span class="nb">integer</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_comment_content</span><span class="w"> </span><span class="nb">varchar</span><span class="p">(</span><span class="mi">200</span><span class="p">)</span><span class="w"> </span>
|
|
<span class="p">)</span><span class="w"> </span><span class="p">;</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
</p></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li13473105019110"><span>Import the target table from the Hive table.</span><p><div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_screen64741645122"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">INSERT</span><span class="w"> </span><span class="k">INTO</span><span class="w"> </span><span class="n">product_info</span><span class="w"> </span><span class="k">SELECT</span><span class="w"> </span><span class="o">*</span><span class="w"> </span><span class="k">FROM</span><span class="w"> </span><span class="n">ex1</span><span class="p">.</span><span class="n">product_info_orc</span><span class="p">;</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
</p></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li89578361226"><span>Query the import result.</span><p><div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_en-us_topic_0109259518_en-us_topic_0101477887_screen669215472511"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">SELECT</span><span class="w"> </span><span class="o">*</span><span class="w"> </span><span class="k">FROM</span><span class="w"> </span><span class="n">product_info</span><span class="p">;</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
</p></li></ol>
|
|
</div>
|
|
<div class="section" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_section184271310162311"><h4 class="sectiontitle">Exporting Data</h4><ol id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_ol2386114682313"><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li23861946172318"><span>Create a local source table.</span><p><div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_screen1551113201330"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal"> 1</span>
|
|
<span class="normal"> 2</span>
|
|
<span class="normal"> 3</span>
|
|
<span class="normal"> 4</span>
|
|
<span class="normal"> 5</span>
|
|
<span class="normal"> 6</span>
|
|
<span class="normal"> 7</span>
|
|
<span class="normal"> 8</span>
|
|
<span class="normal"> 9</span>
|
|
<span class="normal">10</span>
|
|
<span class="normal">11</span>
|
|
<span class="normal">12</span>
|
|
<span class="normal">13</span>
|
|
<span class="normal">14</span>
|
|
<span class="normal">15</span>
|
|
<span class="normal">16</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">DROP</span><span class="w"> </span><span class="k">TABLE</span><span class="w"> </span><span class="k">IF</span><span class="w"> </span><span class="k">EXISTS</span><span class="w"> </span><span class="n">product_info_export</span><span class="p">;</span>
|
|
<span class="k">CREATE</span><span class="w"> </span><span class="k">TABLE</span><span class="w"> </span><span class="n">product_info_export</span>
|
|
<span class="p">(</span>
|
|
<span class="w"> </span><span class="n">product_price</span><span class="w"> </span><span class="nb">integer</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_id</span><span class="w"> </span><span class="nb">char</span><span class="p">(</span><span class="mi">30</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_time</span><span class="w"> </span><span class="nb">date</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_level</span><span class="w"> </span><span class="nb">char</span><span class="p">(</span><span class="mi">10</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_name</span><span class="w"> </span><span class="nb">varchar</span><span class="p">(</span><span class="mi">200</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_type1</span><span class="w"> </span><span class="nb">varchar</span><span class="p">(</span><span class="mi">20</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_type2</span><span class="w"> </span><span class="nb">char</span><span class="p">(</span><span class="mi">10</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_monthly_sales_cnt</span><span class="w"> </span><span class="nb">integer</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_comment_time</span><span class="w"> </span><span class="nb">date</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_comment_num</span><span class="w"> </span><span class="nb">integer</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_comment_content</span><span class="w"> </span><span class="nb">varchar</span><span class="p">(</span><span class="mi">200</span><span class="p">)</span><span class="w"> </span>
|
|
<span class="p">)</span><span class="w"> </span><span class="p">;</span>
|
|
<span class="k">INSERT</span><span class="w"> </span><span class="k">INTO</span><span class="w"> </span><span class="n">product_info_export</span><span class="w"> </span><span class="k">SELECT</span><span class="w"> </span><span class="o">*</span><span class="w"> </span><span class="k">FROM</span><span class="w"> </span><span class="n">product_info</span><span class="p">;</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
</p></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li1088103418416"><span>Create a target table on Hive.</span><p><div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_screen711253211336"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal"> 1</span>
|
|
<span class="normal"> 2</span>
|
|
<span class="normal"> 3</span>
|
|
<span class="normal"> 4</span>
|
|
<span class="normal"> 5</span>
|
|
<span class="normal"> 6</span>
|
|
<span class="normal"> 7</span>
|
|
<span class="normal"> 8</span>
|
|
<span class="normal"> 9</span>
|
|
<span class="normal">10</span>
|
|
<span class="normal">11</span>
|
|
<span class="normal">12</span>
|
|
<span class="normal">13</span>
|
|
<span class="normal">14</span>
|
|
<span class="normal">15</span>
|
|
<span class="normal">16</span>
|
|
<span class="normal">17</span>
|
|
<span class="normal">18</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">DROP</span><span class="w"> </span><span class="k">TABLE</span><span class="w"> </span><span class="n">product_info_orc_export</span><span class="p">;</span>
|
|
|
|
<span class="k">CREATE</span><span class="w"> </span><span class="k">TABLE</span><span class="w"> </span><span class="n">product_info_orc_export</span>
|
|
<span class="p">(</span><span class="w"> </span>
|
|
<span class="w"> </span><span class="n">product_price</span><span class="w"> </span><span class="nb">int</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_id</span><span class="w"> </span><span class="nb">char</span><span class="p">(</span><span class="mi">30</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_time</span><span class="w"> </span><span class="nb">date</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_level</span><span class="w"> </span><span class="nb">char</span><span class="p">(</span><span class="mi">10</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_name</span><span class="w"> </span><span class="nb">varchar</span><span class="p">(</span><span class="mi">200</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_type1</span><span class="w"> </span><span class="nb">varchar</span><span class="p">(</span><span class="mi">20</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_type2</span><span class="w"> </span><span class="nb">char</span><span class="p">(</span><span class="mi">10</span><span class="p">)</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_monthly_sales_cnt</span><span class="w"> </span><span class="nb">int</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_comment_time</span><span class="w"> </span><span class="nb">date</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_comment_num</span><span class="w"> </span><span class="nb">int</span><span class="w"> </span><span class="p">,</span>
|
|
<span class="w"> </span><span class="n">product_comment_content</span><span class="w"> </span><span class="nb">varchar</span><span class="p">(</span><span class="mi">200</span><span class="p">)</span><span class="w"> </span>
|
|
<span class="p">)</span><span class="w"> </span>
|
|
<span class="k">row</span><span class="w"> </span><span class="n">format</span><span class="w"> </span><span class="n">delimited</span><span class="w"> </span><span class="n">fields</span><span class="w"> </span><span class="n">terminated</span><span class="w"> </span><span class="k">by</span><span class="w"> </span><span class="s1">','</span><span class="w"> </span>
|
|
<span class="n">stored</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="n">orc</span><span class="p">;</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
</p></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li1650743202417"><span>Import the local source table to the Hive table.</span><p><div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_screen15611151754218"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">INSERT</span><span class="w"> </span><span class="k">INTO</span><span class="w"> </span><span class="n">ex1</span><span class="p">.</span><span class="n">product_info_orc_export</span><span class="w"> </span><span class="k">SELECT</span><span class="w"> </span><span class="o">*</span><span class="w"> </span><span class="k">FROM</span><span class="w"> </span><span class="n">product_info_export</span><span class="p">;</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
</p></li><li id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_li86768424418"><span>Query the import result on Hive</span><p><div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001838498170__en-us_topic_0000001473887582_screen169311658426"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">SELECT</span><span class="w"> </span><span class="o">*</span><span class="w"> </span><span class="k">FROM</span><span class="w"> </span><span class="n">product_info_orc_export</span><span class="p">;</span>
|
|
</pre></div></td></tr></table></div>
|
|
</div>
|
|
</p></li></ol>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dws_04_0179.html">Importing Data</a></div>
|
|
</div>
|
|
</div>
|
|
|