vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/dli/sqlreference/dli_08_0230.html
Su, Xiaomeng 76a5b1ee83 dli_sqlreference_20240227 
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Co-authored-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
Co-committed-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
2024-03-27 22:02:33 +00:00

108 lines
13 KiB
HTML
Raw Blame History

<a name="dli_08_0230"></a><a name="dli_08_0230"></a>
<h1 class="topictitle1">Creating a DLI Table and Associating It with DDS</h1>
<div id="body1578361312451"><div class="section" id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_section540354616207"><h4 class="sectiontitle">Function</h4><p id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_p13312652114">This statement is used to create a DLI table and associate it with an existing DDS collection.</p>
<div class="note" id="dli_08_0230__note443995614391"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_08_0230__dli_08_0119_p964618104214">In Spark cross-source development scenarios, there is a risk of password leakage if datasource authentication information is directly configured. You are advised to use the datasource authentication provided by DLI.</p>
</div></div>
</div>
<div class="section" id="dli_08_0230__section1886921516407"><h4 class="sectiontitle">Prerequisites</h4><p id="dli_08_0230__p1976716256406">Before creating a DLI table and associating it with DDS, you need to create a datasource connection and bind it to a queue. For details about operations on the management console, see </p>
</div>
<div class="section" id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_section20884135882017"><h4 class="sectiontitle">Syntax</h4><div class="codecoloring" codetype="Sql" id="dli_08_0230__en-us_topic_0204105369_screen13181194105218"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal"> 1</span>
<span class="normal"> 2</span>
<span class="normal"> 3</span>
<span class="normal"> 4</span>
<span class="normal"> 5</span>
<span class="normal"> 6</span>
<span class="normal"> 7</span>
<span class="normal"> 8</span>
<span class="normal"> 9</span>
<span class="normal">10</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">CREATE</span><span class="w"> </span><span class="k">TABLE</span><span class="w"> </span><span class="p">[</span><span class="k">IF</span><span class="w"> </span><span class="k">NOT</span><span class="w"> </span><span class="k">EXISTS</span><span class="p">]</span><span class="w"> </span><span class="k">TABLE_NAME</span><span class="p">(</span>
<span class="w"> </span><span class="n">FIELDNAME1</span><span class="w"> </span><span class="n">FIELDTYPE1</span><span class="p">,</span>
<span class="w"> </span><span class="n">FIELDNAME2</span><span class="w"> </span><span class="n">FIELDTYPE2</span><span class="p">)</span>
<span class="w"> </span><span class="k">USING</span><span class="w"> </span><span class="n">MONGO</span><span class="w"> </span><span class="k">OPTIONS</span><span class="w"> </span><span class="p">(</span>
<span class="w"> </span><span class="s1">'url'</span><span class="o">=</span><span class="s1">'IP:PORT[,IP:PORT]/[DATABASE][.COLLECTION][AUTH_PROPERTIES]'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'database'</span><span class="o">=</span><span class="s1">'xx'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'collection'</span><span class="o">=</span><span class="s1">'xx'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'passwdauth'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'xxx'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'encryption'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'true'</span>
<span class="p">);</span>
</pre></div></td></tr></table></div>
</div>
<div class="note" id="dli_08_0230__note186081316314"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_08_0230__p16081517315">Document Database Service (DDS) is fully compatible with the MongoDB protocol. Therefore, the syntax used is <strong id="dli_08_0230__b855216314618">using mongo options</strong>.</p>
</div></div>
</div>
<div class="section" id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_section784510261216"><h4 class="sectiontitle">Keywords</h4>
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_t2fa8597e0dde4884bd6412ac207ebea8" frame="border" border="1" rules="all"><caption><b>Table 1 </b>CREATE TABLE keywords</caption><thead align="left"><tr id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_r16c75fd8fdbf41c79f9aee82b032351c"><th align="left" class="cellrowborder" valign="top" width="16.88%" id="mcps1.3.4.2.2.3.1.1"><p id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_a9dd69379a3f54904a9c510fb817659ad"><strong id="dli_08_0230__b09781421131220">Parameter</strong></p>
</th>
<th align="left" class="cellrowborder" valign="top" width="83.12%" id="mcps1.3.4.2.2.3.1.2"><p id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_a7ede0d62539542baa7e367cf902bf2b2"><strong id="dli_08_0230__en-us_topic_0093946771_en-us_topic_0053447306_en-us_topic_0039551470_b6335010717346">Description</strong></p>
</th>
</tr>
</thead>
<tbody><tr id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_row9789172211455"><td class="cellrowborder" valign="top" width="16.88%" headers="mcps1.3.4.2.2.3.1.1 "><p id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_p1783227111576">url</p>
</td>
<td class="cellrowborder" valign="top" width="83.12%" headers="mcps1.3.4.2.2.3.1.2 "><p id="dli_08_0230__en-us_topic_0204105369_p73919172215">Before obtaining the DDS IP address, you need to create a datasource connection first..</p>
<p id="dli_08_0230__en-us_topic_0204105369_p122509106014">After creating an enhanced datasource connection, use the random connection address provided by DDS. The format is as follows:</p>
<p id="dli_08_0230__en-us_topic_0204105369_p186884176012">"IP:PORT[,IP:PORT]/[DATABASE][.COLLECTION][AUTH_PROPERTIES]"</p>
<p id="dli_08_0230__en-us_topic_0204105369_p1545918141017">Example: "192.168.4.62:8635,192.168.5.134:8635/test?authSource=admin"</p>
</td>
</tr>
<tr id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_row166137253465"><td class="cellrowborder" valign="top" width="16.88%" headers="mcps1.3.4.2.2.3.1.1 "><p id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_p584237211576">database</p>
</td>
<td class="cellrowborder" valign="top" width="83.12%" headers="mcps1.3.4.2.2.3.1.2 "><p id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_p5902520811576">DDS database name. If the database name is specified in the URL, the database name in the URL does not take effect.</p>
</td>
</tr>
<tr id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_row193609262164"><td class="cellrowborder" valign="top" width="16.88%" headers="mcps1.3.4.2.2.3.1.1 "><p id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_p247311352164">collection</p>
</td>
<td class="cellrowborder" valign="top" width="83.12%" headers="mcps1.3.4.2.2.3.1.2 "><p id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_p570649132164">Collection name in the DDS. If the collection is specified in the URL, the collection in the URL does not take effect.</p>
</td>
</tr>
<tr id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_row469853952167"><td class="cellrowborder" valign="top" width="16.88%" headers="mcps1.3.4.2.2.3.1.1 "><p id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_p477206762167">user</p>
</td>
<td class="cellrowborder" valign="top" width="83.12%" headers="mcps1.3.4.2.2.3.1.2 "><p id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_p401695862167">(Discarded) Username for accessing the DDS cluster.</p>
</td>
</tr>
<tr id="dli_08_0230__en-us_topic_0204105369_row760162013214"><td class="cellrowborder" valign="top" width="16.88%" headers="mcps1.3.4.2.2.3.1.1 "><p id="dli_08_0230__en-us_topic_0204105369_p760311201523">password</p>
</td>
<td class="cellrowborder" valign="top" width="83.12%" headers="mcps1.3.4.2.2.3.1.2 "><p id="dli_08_0230__en-us_topic_0204105369_p26038205218">(Discarded) Password for accessing the DDS cluster.</p>
</td>
</tr>
<tr id="dli_08_0230__row564164916296"><td class="cellrowborder" valign="top" width="16.88%" headers="mcps1.3.4.2.2.3.1.1 "><p id="dli_08_0230__p367053022018">passwdauth</p>
</td>
<td class="cellrowborder" valign="top" width="83.12%" headers="mcps1.3.4.2.2.3.1.2 "><p id="dli_08_0230__en-us_topic_0151059555_p562616372455">Datasource password authentication name. For details about how to create datasource authentication, see Datasource Authentication in the <em id="dli_08_0230__i81407403617">Data Lake Insight User Guide</em>.</p>
</td>
</tr>
<tr id="dli_08_0230__row1565549102915"><td class="cellrowborder" valign="top" width="16.88%" headers="mcps1.3.4.2.2.3.1.1 "><p id="dli_08_0230__p1073983512205">encryption</p>
</td>
<td class="cellrowborder" valign="top" width="83.12%" headers="mcps1.3.4.2.2.3.1.2 "><p id="dli_08_0230__p13739113518204">Set this parameter to <span class="parmvalue" id="dli_08_0230__parmvalue625372122916"><b>true</b></span> when datasource password authentication is used.</p>
</td>
</tr>
</tbody>
</table>
</div>
<div class="note" id="dli_08_0230__en-us_topic_0204105369_note26469541236"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_08_0230__en-us_topic_0204105369_p764615417313">If a collection already exists in DDS, you do not need to specify schema information when creating a table. DLI automatically generates schema information based on data in the collection.</p>
</div></div>
</div>
<div class="section" id="dli_08_0230__en-us_topic_0204105369_en-us_topic_0142907229_en-us_topic_0114776213_en-us_topic_0103157088_section9892337112213"><h4 class="sectiontitle">Example</h4><div class="codecoloring" codetype="Sql" id="dli_08_0230__en-us_topic_0204105369_screen1630185635410"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span>
<span class="normal">2</span>
<span class="normal">3</span>
<span class="normal">4</span>
<span class="normal">5</span>
<span class="normal">6</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">create</span><span class="w"> </span><span class="k">table</span><span class="w"> </span><span class="mi">1</span><span class="n">_datasource</span><span class="p">.</span><span class="n">test_table1</span><span class="p">(</span><span class="n">id</span><span class="w"> </span><span class="n">string</span><span class="p">,</span><span class="w"> </span><span class="n">name</span><span class="w"> </span><span class="n">string</span><span class="p">,</span><span class="w"> </span><span class="n">age</span><span class="w"> </span><span class="nb">int</span><span class="p">)</span><span class="w"> </span><span class="k">using</span><span class="w"> </span><span class="n">mongo</span><span class="w"> </span><span class="k">options</span><span class="p">(</span>
<span class="w"> </span><span class="s1">'url'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'192.168.4.62:8635,192.168.5.134:8635/test?authSource=admin'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'database'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'test'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'collection'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'test'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'passwdauth'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'xxx'</span><span class="p">,</span>
<span class="w"> </span><span class="s1">'encryption'</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s1">'true'</span><span class="p">);</span>
</pre></div></td></tr></table></div>
</div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_08_0229.html">Creating a Datasource Connection with a DDS Table</a></div>
</div>
</div>
View Git Blame Copy Permalink