forked from docs/doc-exports
luhuayi
177cd61a57
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: luhuayi <luhuayi@huawei.com> Co-committed-by: luhuayi <luhuayi@huawei.com>
37 lines
3.9 KiB
HTML
37 lines
3.9 KiB
HTML
<a name="EN-US_TOPIC_0000001845330101"></a><a name="EN-US_TOPIC_0000001845330101"></a>
|
|
|
|
<h1 class="topictitle1">Accessing Hudi Tables on MRS</h1>
|
|
<div id="body0000001845330101"><p id="EN-US_TOPIC_0000001845330101__p12831626917">SQL on Hudi supports access to hudi tables stored on MRS. This function is supported only by clusters of version 9.1.0 or later.</p>
|
|
<div class="section" id="EN-US_TOPIC_0000001845330101__section3518924171412"><h4 class="sectiontitle">Prerequisites</h4><p id="EN-US_TOPIC_0000001845330101__p124271357184715">You have created an MRS data source. For details, see "MRS Data Sources" in <em id="EN-US_TOPIC_0000001845330101__i186562531498">Data Warehouse Service (DWS) User Guide</em>.</p>
|
|
<div class="note" id="EN-US_TOPIC_0000001845330101__note11727173221413"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="EN-US_TOPIC_0000001845330101__p19727032141410">SQL on Hudi can read hudi tables stored on MRS. The only difference in usage compared to OBS is when creating data sources.</p>
|
|
</div></div>
|
|
</div>
|
|
<div class="section" id="EN-US_TOPIC_0000001845330101__section1216331612493"><h4 class="sectiontitle">Accessing Multiple MRS Clusters Concurrently</h4><p id="EN-US_TOPIC_0000001845330101__p75815188493">Due to JDK restrictions, one JVM can store only one Kerberos configuration file at a time. As a result, one GaussDB(DWS) cluster cannot concurrently access hudi tables in multiple MRS clusters through SQL on Hudi. To avoid this issue, do as follows:</p>
|
|
</div>
|
|
<ol id="EN-US_TOPIC_0000001845330101__ol12593429195714"><li id="EN-US_TOPIC_0000001845330101__li10593172911573"><span>Obtain the krb5.conf file of each MRS cluster from the downloaded client.</span></li><li id="EN-US_TOPIC_0000001845330101__li1270843285920"><span>Use the krb5.conf file of any MRS cluster as the file to be combined (cluster A for short).</span></li><li id="EN-US_TOPIC_0000001845330101__li183854181711"><span>Add the KDC domain information of cluster B to <strong id="EN-US_TOPIC_0000001845330101__b391741418560">realms</strong> in cluster A's configuration file.</span><p><div class="p" id="EN-US_TOPIC_0000001845330101__p695514715238">Example:<pre class="screen" id="EN-US_TOPIC_0000001845330101__screen02717567224">[realms]
|
|
CLUSTER.A.COM = {
|
|
admin_server = ClusterA_SERVER_IP:PORT
|
|
kdc = ClusterA_KDC_IP:PORT
|
|
kdc = ClusterA_KDC_IP:PORT
|
|
}
|
|
CLUSTER.B.COM = {
|
|
admin_server = ClusterB_SERVER_IP:PORT
|
|
kdc = ClusterB_KDC_IP:PORT
|
|
kdc = ClusterB_KDC_IP:PORT
|
|
}</pre>
|
|
</div>
|
|
</p></li><li id="EN-US_TOPIC_0000001845330101__li7489111612215"><span>Add the domain information of cluster B to <strong id="EN-US_TOPIC_0000001845330101__b05431738145510">domain_realm</strong> in cluster A's configuration file.</span><p><div class="p" id="EN-US_TOPIC_0000001845330101__p1551510142239">Example:<pre class="screen" id="EN-US_TOPIC_0000001845330101__screen3282201382319">[domain_realm]
|
|
.cluster.a.com = CLUSTER.A.COM
|
|
.cluster.b.com = CLUSTER.B.COM</pre>
|
|
</div>
|
|
</p></li><li id="EN-US_TOPIC_0000001845330101__li5182167131411"><span>Replace the original <strong id="EN-US_TOPIC_0000001845330101__b327302820245">krb5.conf</strong> file with the combined one in the original path of each node in each cluster.</span></li></ol>
|
|
<div class="caution" id="EN-US_TOPIC_0000001845330101__note479115319174"><span class="cautiontitle"><img src="public_sys-resources/caution_3.0-en-us.png"> </span><div class="cautionbody"><p id="EN-US_TOPIC_0000001845330101__p10350143717171">The preceding example is for reference only. During actual operations, you need to combine the actual KDC domain information in the cluster' <strong id="EN-US_TOPIC_0000001845330101__b84967277573">realms</strong> or <strong id="EN-US_TOPIC_0000001845330101__b19361729155711">domain_realm</strong>.</p>
|
|
</div></div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dws_04_1069.html">SQL on Hudi</a></div>
|
|
</div>
|
|
</div>
|
|
|