forked from docs/doc-exports
dli_umn_20250929
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: Su, Xiaomeng <suxiaomeng1@huawei.com> Co-committed-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
This commit is contained in:
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
@ -8,11 +8,16 @@
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dli_01_00006__row189735272308"><td class="cellrowborder" valign="top" width="33.67%" headers="mcps1.3.1.1.3.1.1 "><p id="dli_01_00006__p679643320304">2025-02-08</p>
|
||||
<tbody><tr id="dli_01_00006__row157250221587"><td class="cellrowborder" valign="top" width="33.67%" headers="mcps1.3.1.1.3.1.1 "><p id="dli_01_00006__p372517221488">2025-09-25</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="66.33%" headers="mcps1.3.1.1.3.1.2 "><p id="dli_01_00006__p1572517221189">Modified the following sections:</p>
|
||||
<ul id="dli_01_00006__ul342473718111"><li id="dli_01_00006__li1842517372116">Added the resource specification configuration descriptions of v1 and v2 to <a href="dli_01_0498.html">Creating a Flink OpenSource SQL Job</a>.</li><li id="dli_01_00006__li1342518377112">Added the resource specification configuration descriptions of v1 and v2 to <a href="dli_01_0457.html">Creating a Flink Jar Job</a>.</li><li id="dli_01_00006__li18425437161114">Added the mapping between compute resource specification parameters on the console and <strong id="dli_01_00006__b597419165504">Spark Argument(--conf)</strong> to <a href="dli_01_0384.html">Creating a Spark Job</a>.</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_00006__row189735272308"><td class="cellrowborder" valign="top" width="33.67%" headers="mcps1.3.1.1.3.1.1 "><p id="dli_01_00006__p679643320304">2025-02-08</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="66.33%" headers="mcps1.3.1.1.3.1.2 "><p id="dli_01_00006__p1796113323010">Modified the following sections:</p>
|
||||
<ul id="dli_01_00006__ul16796833163014"><li id="dli_01_00006__li1979613316302">Added descriptions about the specifications and use cases of elastic resource pools to <a href="dli_07_0027.html">Specifications</a>.</li><li id="dli_01_00006__li888314338315">Added instructions on how to change a DLI agency to <strong id="dli_01_00006__b36793109118">dli_management_agency</strong> to <a href="dli_01_0419.html">DLI Agency Overview</a>.</li><li id="dli_01_00006__li15566455193317">Added instructions on how to view a SQL execution plan on the DLI management console to <a href="dli_01_0638.html">Viewing a SQL Execution Plan</a>.</li><li id="dli_01_00006__li550215152409">Added instructions on how to connect DLI to AOM Prometheus for monitoring to <a href="dli_01_0665.html">Connecting DLI to AOM's Prometheus Monitoring</a>.</li><li id="dli_01_00006__li660522419010">Taken the following section offline:<p id="dli_01_00006__p8105155919011"><a name="dli_01_00006__li660522419010"></a><a name="li660522419010"></a>Creating a Flink SQL Job</p>
|
||||
</li></ul>
|
||||
<ul id="dli_01_00006__ul16796833163014"><li id="dli_01_00006__li1979613316302">Added descriptions about the specifications and use cases of elastic resource pools to <a href="dli_07_0027.html">Compute Resource Types and Specifications</a>.</li><li id="dli_01_00006__li888314338315">Added instructions on how to change a DLI agency to <strong id="dli_01_00006__b36793109118">dli_management_agency</strong> to <a href="dli_01_0419.html">DLI Agency Overview</a>.</li><li id="dli_01_00006__li15566455193317">Added instructions on how to view a SQL execution plan on the DLI management console to <a href="dli_01_0638.html">Viewing a SQL Execution Plan</a>.</li><li id="dli_01_00006__li660522419010">Taken offline the creation of Flink SQL jobs.</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_00006__row15952172464713"><td class="cellrowborder" valign="top" width="33.67%" headers="mcps1.3.1.1.3.1.1 "><p id="dli_01_00006__p738312864717">2024-07-11</p>
|
||||
@ -24,7 +29,7 @@
|
||||
<tr id="dli_01_00006__row1340918386143"><td class="cellrowborder" valign="top" width="33.67%" headers="mcps1.3.1.1.3.1.1 "><p id="dli_01_00006__p10168134117141">2024-04-28</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="66.33%" headers="mcps1.3.1.1.3.1.2 "><p id="dli_01_00006__p181681241101413">Added the following section:</p>
|
||||
<ul id="dli_01_00006__ul416812413143"><li id="dli_01_00006__li11168134151414"><a href="dli_01_0508.html">Creating an Elastic Resource Pool and Queues Within It</a></li></ul>
|
||||
<ul id="dli_01_00006__ul416812413143"><li id="dli_01_00006__li11168134151414"><a href="dli_01_0508.html">Creating an Elastic Resource Pool and Creating Queues Within It</a></li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_00006__row4248101042"><td class="cellrowborder" valign="top" width="33.67%" headers="mcps1.3.1.1.3.1.1 "><p id="dli_01_00006__p14248407419">2024-02-27</p>
|
||||
@ -44,13 +49,13 @@
|
||||
<tr id="dli_01_00006__row1569106191216"><td class="cellrowborder" valign="top" width="33.67%" headers="mcps1.3.1.1.3.1.1 "><p id="dli_01_00006__p36566919122">2023-10-08</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="66.33%" headers="mcps1.3.1.1.3.1.2 "><p id="dli_01_00006__p465618951211">Modified the following content:</p>
|
||||
<ul id="dli_01_00006__ul82951936181419"><li id="dli_01_00006__li129511362149">Modified the example format in <a href="dli_01_0384.html#dli_01_0384__table17326112613420">Table 2</a>.</li><li id="dli_01_00006__li3295163691419">Added notes and constraints on tag keys and tag values for creating Flink SQL jobs and <a href="dli_01_0457.html">Creating a Flink Jar Job</a>.</li></ul>
|
||||
<ul id="dli_01_00006__ul82951936181419"><li id="dli_01_00006__li129511362149">Modified the example format in <a href="dli_01_0384.html#dli_01_0384__table17326112613420">Table 3</a>.</li><li id="dli_01_00006__li3295163691419">Added notes and constraints on tag keys and tag values for creating Flink SQL jobs and <a href="dli_01_0457.html">Creating a Flink Jar Job</a>.</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_00006__row12145240104716"><td class="cellrowborder" valign="top" width="33.67%" headers="mcps1.3.1.1.3.1.1 "><p id="dli_01_00006__p193441641970">2023-09-07</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="66.33%" headers="mcps1.3.1.1.3.1.2 "><p id="dli_01_00006__p63854280713">Added the following sections:</p>
|
||||
<ul id="dli_01_00006__ul895111424710"><li id="dli_01_00006__li5328124733814"><a href="dli_01_0552.html">Managing Tags</a></li><li id="dli_01_00006__li11801555203817"><a href="dli_01_0384.html#dli_01_0384__table17326112613420">Table 2</a></li><li id="dli_01_00006__li109276713912"><a href="dli_01_0534.html">Enabling Dynamic Scaling for Flink Jobs</a></li><li id="dli_01_00006__li1356101513915"><a href="dli_01_0535.html">Setting the Priority for a SQL Job</a></li></ul>
|
||||
<ul id="dli_01_00006__ul895111424710"><li id="dli_01_00006__li5328124733814"><a href="dli_01_0552.html">Managing Tags for Database Tables</a></li><li id="dli_01_00006__li11801555203817"><a href="dli_01_0384.html#dli_01_0384__table17326112613420">Table 3</a></li><li id="dli_01_00006__li109276713912"><a href="dli_01_0534.html">Enabling Dynamic Scaling for Flink Jobs</a></li><li id="dli_01_00006__li1356101513915"><a href="dli_01_0535.html">Setting the Priority for a SQL Job</a></li></ul>
|
||||
<p id="dli_01_00006__p523145072419">Deleted the following section:</p>
|
||||
<ul id="dli_01_00006__ul204315504240"><li id="dli_01_00006__li64316503244">Deleted the content related to Flink job debugging.</li></ul>
|
||||
<p id="dli_01_00006__p19615231153914">Modified the following section:</p>
|
||||
|
||||
@ -6,15 +6,16 @@
|
||||
</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0001__section14601204916117"><h4 class="sectiontitle">Creating Compute Resources and Metadata Required for Running Jobs</h4><ul id="dli_01_0001__ul63253525168"><li id="dli_01_0001__li4325052101616">Before submitting a job using DLI, you need to create an elastic resource pool and create queues within it. This will provide the necessary compute resources for running the job. For how to create an elastic resource pool and create queues within it, see <a href="dli_01_0504.html">Overview of DLI Elastic Resource Pools and Queues</a>.<p id="dli_01_0001__p76301243103911">Alternatively, you can enhance DLI's computing environment by creating custom images. Specifically, to enhance the functions and performance of Spark and Flink jobs, you can create custom images by downloading the base images provided by DLI and adding dependencies (files, JAR files, or software) and private capabilities required for job execution. This changes the container runtime environment for the jobs.</p>
|
||||
<p id="dli_01_0001__p1558916387396">For example, you can add a Python package or C library related to machine learning to a custom image to help you extend functions. For how to create a custom image, see <a href="dli_01_0494.html">Using a Custom Image to Enhance the Job Running Environment</a>.</p>
|
||||
<p id="dli_01_0001__p1558916387396">For example, you can add a Python package or C library related to machine learning to a custom image to help you extend functions. For how to create a custom image, see <a href="dli_01_0494.html">Enhancing the Job Runtime Environment Using a Custom Image</a>.</p>
|
||||
</li><li id="dli_01_0001__li20816155172111">DLI metadata is the basis for developing SQL and Spark jobs. Before executing a job, you need to define databases and tables based on your business scenario.<div class="note" id="dli_01_0001__note9930169132116"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0001__p1793029152116">Flink allows for dynamic data types, enabling the definition of data structures at runtime without the need for predefined metadata.</p>
|
||||
</div></div>
|
||||
<ul id="dli_01_0001__ul199267513211"><li id="dli_01_0001__li11495849102120">Define your data structures, including data catalogs, databases, and tables. For details, see <a href="dli_01_0390.html">Creating Databases and Tables</a>.</li><li id="dli_01_0001__li892912291714">Create a bucket to store temporary data generated during job running, such as job logs and job results. For details, see <a href="dli_01_0536.html">Configuring a DLI Job Bucket</a>.</li><li id="dli_01_0001__li39297261711">Configure the permission to access metadata. For details, see <a href="dli_01_0447.html">Configuring Database Permissions on the DLI Console</a> and <a href="dli_01_0448.html">Configuring Table Permissions on the DLI Console</a>.</li></ul>
|
||||
<ul id="dli_01_0001__ul199267513211"><li id="dli_01_0001__li11495849102120">Define your data structures, including data catalogs, databases, and tables. For details, see <a href="dli_01_0390.html">Creating a Data Directory, Database, and Table</a>.</li><li id="dli_01_0001__li892912291714">Create a bucket to store temporary data generated during job running, such as job logs and job results. For details, see <a href="dli_01_0536.html">Configuring a DLI Job Bucket</a>.</li><li id="dli_01_0001__li39297261711">Configure the permission to access metadata. For details, see <a href="dli_01_0447.html">Configuring Database Permissions on the DLI Console</a> and <a href="dli_01_0448.html">Configuring Table Permissions on the DLI Console</a>.</li></ul>
|
||||
</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0001__section1542818345419"><h4 class="sectiontitle">Importing Data to DLI</h4><ul id="dli_01_0001__ul9974162293510"><li id="dli_01_0001__li17844113819217">DLI allows you to analyze and query data stored in OBS without the need to migrate it. Simply upload your data to OBS and use DLI for data analysis.</li><li id="dli_01_0001__li56411849203516">Cross-source access can reduce data duplication and latency when real-time access and processing of data from different sources is required for service needs.<p id="dli_01_0001__p1837516595371"><a name="dli_01_0001__li56411849203516"></a><a name="li56411849203516"></a>The prerequisites for cross-source access are that DLI can communicate with the data source network and DLI can obtain the access credentials to the data source.</p>
|
||||
<div class="section" id="dli_01_0001__section1542818345419"><h4 class="sectiontitle">Importing Data to DLI</h4><ul id="dli_01_0001__ul9974162293510"><li id="dli_01_0001__li17844113819217">DLI allows you to analyze and query data stored in OBS without the need to migrate it. Simply upload your data to OBS and use DLI for data analysis.</li><li id="dli_01_0001__li56411849203516">Cross-source access can reduce data replication and latency when real-time access and processing of data from different sources is required for service needs.<p id="dli_01_0001__p1837516595371"><a name="dli_01_0001__li56411849203516"></a><a name="li56411849203516"></a>The prerequisites for cross-source access are that DLI can communicate with the data source network and DLI can obtain the access credentials to the data source.</p>
|
||||
<ul id="dli_01_0001__ul1717315116388"><li id="dli_01_0001__li1764741614373">Configure network connection between DLI and the data source by referring to <a href="dli_01_0426.html">Configuring the Network Connection Between DLI and Data Sources (Enhanced Datasource Connection)</a>.</li><li id="dli_01_0001__li1062417276376">Manage data source credentials.<ul id="dli_01_0001__ul207641255531"><li id="dli_01_0001__li77501728185218">You can use DLI's datasource authentication to manage the authentication information for accessing a specified datasource.<p id="dli_01_0001__p36802397523"><a name="dli_01_0001__li77501728185218"></a><a name="li77501728185218"></a>This applies to SQL jobs and Flink 1.12 jobs. For details, see <a href="dli_01_0422.html">Using DLI Datasource Authentication to Manage Access Credentials for Data Sources</a>.</p>
|
||||
</li><li id="dli_01_0001__li161116426526">You can also use DEW to manage access credentials for data sources and use a custom agency to authorize DLI to access DEW.<p id="dli_01_0001__p124621343145214"><a name="dli_01_0001__li161116426526"></a><a name="li161116426526"></a>This applies to Spark 3.3.1 or later and Flink 1.15 or later. For details, see <a href="dli_01_0636.html">Using DEW to Manage Access Credentials for Data Sources</a> and <a href="dli_01_0486.html">Configuring an Agency to Allow DLI to Access Other Cloud Services</a>.</p>
|
||||
</li><li id="dli_01_0001__li161116426526">You can also use DEW to manage access credentials for data sources and use a custom agency to authorize DLI to access DEW.<p id="dli_01_0001__p119611281470"><a name="dli_01_0001__li161116426526"></a><a name="li161116426526"></a>This applies to Spark 3.3.1 or later and Flink 1.15 or later.</p>
|
||||
<p id="dli_01_0001__p124621343145214">For details, see <a href="dli_01_0636.html">Managing Data Source Access Credentials Using DEW</a> and <a href="dli_01_0486.html">Configuring an Agency to Allow DLI to Access Other Cloud Services</a>.</p>
|
||||
</li></ul>
|
||||
</li></ul>
|
||||
</li></ul>
|
||||
@ -64,7 +65,7 @@
|
||||
</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0001__section6191614351"><h4 class="sectiontitle">Using Cloud Eye to Monitor DLI</h4><p id="dli_01_0001__p18521249179">You can query DLI monitoring metrics and alarms through Cloud Eye management console or APIs.</p>
|
||||
<p id="dli_01_0001__p4109426491">For example, you can monitor the resource usage and job status of a DLI queue. For details about DLI metrics, see <a href="dli_01_0445.html">Using Cloud Eye to Monitor DLI</a>.</p>
|
||||
<p id="dli_01_0001__p4109426491">For example, you can monitor the resource usage and job status of a DLI queue. For details about DLI metrics, see <a href="dli_01_0445.html">Monitoring DLI Using Cloud Eye</a>.</p>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0001__section1252619542612"><h4 class="sectiontitle">Using CTS to Audit DLI</h4><p id="dli_01_0001__p133537411474">With CTS, you can log operations related to DLI, making it easier to search, audit, and trace in the future. For the supported operations, see <a href="dli_01_0318.html">Using CTS to Audit DLI</a>.</p>
|
||||
</div>
|
||||
|
||||
@ -1,12 +1,12 @@
|
||||
<a name="dli_01_0002"></a><a name="dli_01_0002"></a>
|
||||
|
||||
<h1 class="topictitle1">Using DLI to Submit a SQL Job to Query OBS Data</h1>
|
||||
<h1 class="topictitle1">Submitting a SQL Job to Query OBS Data Using DLI</h1>
|
||||
<div id="body1501038213757"><div class="section" id="dli_01_0002__section76281123162520"><h4 class="sectiontitle">Scenario</h4><p id="dli_01_0002__p11420171102612">DLI can query data stored in OBS. This section describes how to use DLI to submit a SQL job to query OBS data.</p>
|
||||
<p id="dli_01_0002__p15426183711011">To illustrate, create a new file called <strong id="dli_01_0002__b10837115171319">sampledata.csv</strong> and upload it to an OBS bucket. Then, create an elastic resource pool, create queues within it, and use DLI to create a database and table. Finally, use DLI's SQL editor to query 1,000 data records from the table.</p>
|
||||
<p id="dli_01_0002__p15426183711011">To illustrate, create a file called <strong id="dli_01_0002__b10837115171319">sampledata.csv</strong> and upload it to an OBS bucket. Then, create an elastic resource pool, create queues within it, and use DLI to create a database and table. Finally, use DLI's SQL editor to query 1,000 data records from the table.</p>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0002__section136122917251"><h4 class="sectiontitle">Procedure</h4><p id="dli_01_0002__p138611171318"><a href="#dli_01_0002__table1478217572316">Table 1</a> shows the process for submitting a SQL job to query OBS data.</p>
|
||||
|
||||
<div class="tablenoborder"><a name="dli_01_0002__table1478217572316"></a><a name="table1478217572316"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0002__table1478217572316" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Procedure for using DLI to submit a SQL job to query OBS data</caption><thead align="left"><tr id="dli_01_0002__row16782135753111"><th align="left" class="cellrowborder" valign="top" width="31.59%" id="mcps1.3.2.3.2.3.1.1"><p id="dli_01_0002__p478255733110">Procedure</p>
|
||||
<div class="tablenoborder"><a name="dli_01_0002__table1478217572316"></a><a name="table1478217572316"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0002__table1478217572316" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Procedure for using DLI to submit a SQL job to query OBS data</caption><thead align="left"><tr id="dli_01_0002__row16782135753111"><th align="left" class="cellrowborder" valign="top" width="31.59%" id="mcps1.3.2.3.2.3.1.1"><p id="dli_01_0002__p478255733110">Step</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="68.41000000000001%" id="mcps1.3.2.3.2.3.1.2"><p id="dli_01_0002__p3782185710311">Description</p>
|
||||
</th>
|
||||
@ -17,7 +17,7 @@
|
||||
<td class="cellrowborder" valign="top" width="68.41000000000001%" headers="mcps1.3.2.3.2.3.1.2 "><p id="dli_01_0002__p8783185719312">Upload data files to OBS.</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0002__row167836579316"><td class="cellrowborder" valign="top" width="31.59%" headers="mcps1.3.2.3.2.3.1.1 "><p id="dli_01_0002__p1478385713120"><a href="#dli_01_0002__section1573781010172">Step 2: Create an Elastic Resource Pool and Add Queues to the Pool</a></p>
|
||||
<tr id="dli_01_0002__row167836579316"><td class="cellrowborder" valign="top" width="31.59%" headers="mcps1.3.2.3.2.3.1.1 "><p id="dli_01_0002__p1478385713120"><a href="#dli_01_0002__section1573781010172">Step 2: Create an Elastic Resource Pool and Create Queues Within It</a></p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="68.41000000000001%" headers="mcps1.3.2.3.2.3.1.2 "><p id="dli_01_0002__p10783155773119">Create compute resources required for submitting jobs.</p>
|
||||
</td>
|
||||
@ -42,7 +42,7 @@
|
||||
</div>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0002__section61379418181550"><a name="dli_01_0002__section61379418181550"></a><a name="section61379418181550"></a><h4 class="sectiontitle">Step 1: Upload Data to OBS</h4><p id="dli_01_0002__p161899822612">Upload data files to OBS.</p>
|
||||
<ol id="dli_01_0002__ol19047014145745"><li id="dli_01_0002__li17461001806">Log in to the OBS management console.</li><li id="dli_01_0002__li1385211252717">Create a bucket. In this example, the bucket name is <strong id="dli_01_0002__b2533143112814">obs1</strong>.<ol type="a" id="dli_01_0002__ol182612310711"><li id="dli_01_0002__li462934116719">Click <span class="uicontrol" id="dli_01_0002__uicontrol481933104114"><b>Create Bucket</b></span> in the upper right corner.</li><li id="dli_01_0002__li183491949872">On the displayed <strong id="dli_01_0002__b997218337576">Create Bucket</strong> page, enter the <strong id="dli_01_0002__b41931653205710">Bucket Name</strong>. Retain the default values for other parameters or adjust them as needed.<div class="note" id="dli_01_0002__note1145175833410"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0002__p7146205812341">Select a region that matches the location of the DLI console.</p>
|
||||
<ol id="dli_01_0002__ol19047014145745"><li id="dli_01_0002__li17461001806">Log in to the OBS management console.</li><li id="dli_01_0002__li1385211252717">Create a bucket. In this example, the bucket name is <strong id="dli_01_0002__b2533143112814">obs1</strong>.<ol type="a" id="dli_01_0002__ol182612310711"><li id="dli_01_0002__li462934116719">Click <span class="uicontrol" id="dli_01_0002__uicontrol481933104114"><b>Create Bucket</b></span> in the upper right corner.</li><li id="dli_01_0002__li183491949872">On the displayed <strong id="dli_01_0002__b16856185804310">Create Bucket</strong> page, set <strong id="dli_01_0002__b2085735819435">Bucket Name</strong>. Retain the default values for other parameters or adjust them as needed.<div class="note" id="dli_01_0002__note1145175833410"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0002__p7146205812341">Select a region that matches the location of the DLI console.</p>
|
||||
</div></div>
|
||||
</li><li id="dli_01_0002__li3583138155449">Click <strong id="dli_01_0002__b55859547573">Create Now</strong>.</li></ol>
|
||||
</li><li id="dli_01_0002__li17845354105919">Click <strong id="dli_01_0002__b1314010449132">obs1</strong> to access its <strong id="dli_01_0002__b22171556131317">Objects</strong> tab page.</li><li id="dli_01_0002__li9783175118519">Click <strong id="dli_01_0002__b1830164072711">Upload Object</strong>. In the displayed dialog box, drag a desired file or folder, for example, <span class="parmname" id="dli_01_0002__parmname11831040102710"><b>sampledata.csv</b></span> to the <strong id="dli_01_0002__b191881648105918">Upload Object</strong> area. Then, click <span class="uicontrol" id="dli_01_0002__uicontrol13831134072715"><b>Upload</b></span>.<p id="dli_01_0002__p1366220522517">You can create a <strong id="dli_01_0002__b19103192713017">sampledata.txt</strong> file, copy the following content separated by commas (,), and save the file as <strong id="dli_01_0002__b1597217291805">sampledata.csv</strong>.</p>
|
||||
@ -51,11 +51,11 @@
|
||||
22,book_2
|
||||
29,book_9</pre>
|
||||
<p id="dli_01_0002__p1540915717295">After the file is uploaded successfully, the file path is <span class="filepath" id="dli_01_0002__filepath82411311208"><b>obs://obs1/sampledata.csv</b></span>.</p>
|
||||
<p id="dli_01_0002__p78002576167">For more operations on the OBS console, see the <em id="dli_01_0002__i1525854661917">Object Storage Service User Guide</em>.</p>
|
||||
<p id="dli_01_0002__p78002576167">For more operations on the OBS console, see <em id="dli_01_0002__i8344104019125">Object Storage Service User Guide</em>.</p>
|
||||
</li></ol>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0002__section1573781010172"><a name="dli_01_0002__section1573781010172"></a><a name="section1573781010172"></a><h4 class="sectiontitle">Step 2: Create an Elastic Resource Pool and Add Queues to the Pool</h4><div class="p" id="dli_01_0002__p2063644920599">In this example, the elastic resource pool <strong id="dli_01_0002__b910381414114">dli_resource_pool</strong> and queue <strong id="dli_01_0002__b1259816176416">dli_queue_01</strong> are created.<ol id="dli_01_0002__ol41351643251"><li id="dli_01_0002__li8135104192515">Log in to the DLI management console.</li><li id="dli_01_0002__li111362041255">In the navigation pane on the left, choose <strong id="dli_01_0002__b5593632164112">Resources</strong> > <strong id="dli_01_0002__b8593173220410">Resource Pool</strong>.</li><li id="dli_01_0002__li191366414251">On the displayed page, click <strong id="dli_01_0002__b941416417414">Buy Resource Pool</strong> in the upper right corner.</li><li id="dli_01_0002__li5136144162515">On the displayed page, set the parameters.<div class="p" id="dli_01_0002__p99045615127"><a name="dli_01_0002__li5136144162515"></a><a name="li5136144162515"></a><a href="#dli_01_0002__table67098261452">Table 2</a> describes the parameters.
|
||||
<div class="tablenoborder"><a name="dli_01_0002__table67098261452"></a><a name="table67098261452"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0002__table67098261452" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Parameters</caption><thead align="left"><tr id="dli_01_0002__row1670902620453"><th align="left" class="cellrowborder" valign="top" width="18.35%" id="mcps1.3.4.2.3.4.1.2.2.4.1.1"><p id="dli_01_0002__p27091526194510">Parameter</p>
|
||||
<div class="section" id="dli_01_0002__section1573781010172"><a name="dli_01_0002__section1573781010172"></a><a name="section1573781010172"></a><h4 class="sectiontitle">Step 2: Create an Elastic Resource Pool and Create Queues Within It</h4><div class="p" id="dli_01_0002__p2063644920599">In this example, the elastic resource pool <strong id="dli_01_0002__b910381414114">dli_resource_pool</strong> and queue <strong id="dli_01_0002__b1259816176416">dli_queue_01</strong> are created.<ol id="dli_01_0002__ol41351643251"><li id="dli_01_0002__li8135104192515">Log in to the DLI management console.</li><li id="dli_01_0002__li111362041255">In the navigation pane on the left, choose <strong id="dli_01_0002__b5593632164112">Resources</strong> > <strong id="dli_01_0002__b8593173220410">Resource Pool</strong>.</li><li id="dli_01_0002__li191366414251">On the displayed page, click <strong id="dli_01_0002__b941416417414">Buy Resource Pool</strong> in the upper right corner.</li><li id="dli_01_0002__li5136144162515">On the displayed page, set the parameters.<div class="p" id="dli_01_0002__p99045615127"><a name="dli_01_0002__li5136144162515"></a><a name="li5136144162515"></a><a href="#dli_01_0002__table67098261452">Table 2</a> describes the parameters.
|
||||
<div class="tablenoborder"><a name="dli_01_0002__table67098261452"></a><a name="table67098261452"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0002__table67098261452" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Parameter descriptions</caption><thead align="left"><tr id="dli_01_0002__row1670902620453"><th align="left" class="cellrowborder" valign="top" width="18.35%" id="mcps1.3.4.2.3.4.1.2.2.4.1.1"><p id="dli_01_0002__p27091526194510">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="45.51%" id="mcps1.3.4.2.3.4.1.2.2.4.1.2"><p id="dli_01_0002__p1570911262450">Description</p>
|
||||
</th>
|
||||
@ -137,7 +137,8 @@
|
||||
<td class="cellrowborder" valign="top" width="58.040000000000006%" headers="mcps1.3.4.2.3.8.1.2.4.1.2 "><p id="dli_01_0002__p17752432217">Type of the queue</p>
|
||||
<ul id="dli_01_0002__ul82501593816"><li id="dli_01_0002__li1525089585">To execute SQL jobs, select <strong id="dli_01_0002__b585112821715">For SQL</strong>.</li><li id="dli_01_0002__li182501891684">To execute Flink or Spark jobs, select <strong id="dli_01_0002__b2480535191715">For general purpose</strong>.</li></ul>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="23.810000000000002%" headers="mcps1.3.4.2.3.8.1.2.4.1.3 "><p id="dli_01_0002__p19659161091418">_</p>
|
||||
<td class="cellrowborder" valign="top" width="23.810000000000002%" headers="mcps1.3.4.2.3.8.1.2.4.1.3 "><p id="dli_01_0002__p2034913466508">For SQL jobs, select <strong id="dli_01_0002__b1197064625217">For SQL</strong>.</p>
|
||||
<p id="dli_01_0002__p411875815502">For other scenarios, select <strong id="dli_01_0002__b39101158115214">For general purpose</strong>.</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0002__row766824612288"><td class="cellrowborder" valign="top" width="18.15%" headers="mcps1.3.4.2.3.8.1.2.4.1.1 "><p id="dli_01_0002__p1466814465282">Enterprise Project</p>
|
||||
@ -197,9 +198,9 @@
|
||||
</div>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0002__section21433273112656"><a name="dli_01_0002__section21433273112656"></a><a name="section21433273112656"></a><h4 class="sectiontitle">Step 3: Create a Database</h4><p id="dli_01_0002__p498774501214">Before querying data, create a database, for example, <strong id="dli_01_0002__b84235270619941">db1</strong>.</p>
|
||||
<div class="note" id="dli_01_0002__note23711139194010"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0002__p143724399404">The <strong id="dli_01_0002__b842352706172053">default</strong> database is a built-in database. You cannot create the <strong id="dli_01_0002__b842352706172112">default</strong>. database.</p>
|
||||
<div class="note" id="dli_01_0002__note23711139194010"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0002__p143724399404"><strong id="dli_01_0002__b842352706172053">default</strong> is the database built in DLI. You cannot create a database named <strong id="dli_01_0002__b842352706172112">default</strong>.</p>
|
||||
</div></div>
|
||||
<ol id="dli_01_0002__ol1216817105472"><li id="dli_01_0002__li11682102472">In the left navigation pane of the DLI management console, choose <strong id="dli_01_0002__b124165381758">SQL Editor</strong>.</li><li id="dli_01_0002__li47441514124717">In the editing window on the right of the <strong id="dli_01_0002__b16368113112419">SQL Editor</strong> page, enter the following SQL statement and click <strong id="dli_01_0002__b1136814317247">Execute</strong>. Read and agree to the privacy agreement, and click <strong id="dli_01_0002__b2057914102316">OK</strong>.<pre class="screen" id="dli_01_0002__screen161415843616">create database db1;</pre>
|
||||
<ol id="dli_01_0002__ol1216817105472"><li id="dli_01_0002__li11682102472">In the navigation pane on the left of the DLI management console, choose <strong id="dli_01_0002__b124165381758">SQL Editor</strong>.</li><li id="dli_01_0002__li47441514124717">In the editing window on the right of the <strong id="dli_01_0002__b16368113112419">SQL Editor</strong> page, enter the following SQL statement and click <strong id="dli_01_0002__b1136814317247">Execute</strong>. Read and agree to the privacy agreement, and click <strong id="dli_01_0002__b2057914102316">OK</strong>.<pre class="screen" id="dli_01_0002__screen161415843616">create database db1;</pre>
|
||||
<p id="dli_01_0002__p38732969153456">After the database is successfully created, click <span><img id="dli_01_0002__image829710191020" src="en-us_image_0000001992752425.png"></span> in the middle pane to refresh the database list. The new database <strong id="dli_01_0002__b1829751101015">db1</strong> is displayed in the list.</p>
|
||||
</li></ol>
|
||||
</div>
|
||||
|
||||
@ -1,40 +1,45 @@
|
||||
<a name="dli_01_0003"></a><a name="dli_01_0003"></a>
|
||||
|
||||
<h1 class="topictitle1">Overview of Enhanced Datasource Connections</h1>
|
||||
<div id="body0000001105195630"><div class="section" id="dli_01_0003__section96073483278"><h4 class="sectiontitle">Why Create Enhanced Datasource Connections?</h4><p id="dli_01_0003__p522817397547">In cross-source data analysis scenarios, DLI needs to connect to external data sources. However, due to the different VPCs between the data source and DLI, the network cannot be connected, which results in DLI being unable to read data from the data source. DLI's enhanced datasource connection feature enables network connectivity between DLI and the data source.</p>
|
||||
<p id="dli_01_0003__p712043744118">This section will introduce a solution for cross-VPC data source network connectivity:</p>
|
||||
<ul id="dli_01_0003__ul080613266425"><li id="dli_01_0003__li4806192604220">Creating an enhanced datasource connection: Establish a VPC peering connection to connect DLI and the data source's VPC network.</li><li id="dli_01_0003__li8806226134218">Testing network connectivity: Verify the connectivity between the queue and the data source's network.</li></ul>
|
||||
<p id="dli_01_0003__p5494121814320">For details about the data sources that support cross-source access, see <a href="dli_01_0410.html">Common Development Methods for DLI Cross-Source Analysis</a>.</p>
|
||||
<div class="caution" id="dli_01_0003__note132261042151315"><span class="cautiontitle"><img src="public_sys-resources/caution_3.0-en-us.png"> </span><div class="cautionbody"><p id="dli_01_0003__p1822614217130">In cross-source development scenarios, there is a risk of password leakage if datasource authentication information is directly configured. You are advised to use Data Encryption Workshop (DEW) to store authentication information of data sources when Spark 3.3.1 or later and Flink 1.15 or later jobs access data sources using datasource connections. This will help you address issues related to data security, key security, and complex key management. For details, see <a href="dli_01_0636.html">Using DEW to Manage Access Credentials for Data Sources</a>.</p>
|
||||
</div></div>
|
||||
<div id="body0000001105195630"><div class="section" id="dli_01_0003__section96073483278"><h4 class="sectiontitle">How to Establish Network Connectivity Between a DLI Elastic Resource Pool and Data Sources?</h4><p id="dli_01_0003__p18131737114">Imagine DLI elastic resource pools and data sources as two isolated islands surrounded by water.</p>
|
||||
<p id="dli_01_0003__p2813153315">To enable traffic between these two islands, you need to first construct a bridge and then set up signs at both ends of this bridge.</p>
|
||||
<p id="dli_01_0003__p78131031719">DLI enhanced datasource connections serve as your construction team, enabling you to complete the building of both the bridge and the signs in one go.</p>
|
||||
<p id="dli_01_0003__p18915143116516">By using VPC peering to establish the bridge and defining system routes for direction guidance, you can further enhance navigation with additional custom routes.</p>
|
||||
<p id="dli_01_0003__p357118198812">If both DLI elastic resource pools and the CIDR block of data sources have IPv6 enabled, you have the option to designate this bridge to utilize the IPv6 network for communication. Moreover, you can create IPv6 routes.</p>
|
||||
<div class="fignone" id="dli_01_0003__fig1014281192317"><span class="figcap"><b>Figure 1 </b>Using an enhanced datasource connection to establish network communication between a DLI elastic resource pool and a data source</span><br><span><img id="dli_01_0003__image751892102416" src="en-us_image_0000002363051176.png" title="Click to enlarge" class="imgResize"></span></div>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0003__section398284992419"><h4 class="sectiontitle">Procedure</h4><p id="dli_01_0003__p96031481281">This part introduces the network connectivity solution for connecting a DLI elastic resource pool to a data source of a VPC using an enhanced datasource connection.</p>
|
||||
<ol id="dli_01_0003__ol13716852173019"><li id="dli_01_0003__li187161752133015">Creating an enhanced datasource connection: Establish a VPC peering connection to connect DLI and the data source's VPC network. For details, see <a href="dli_01_0006.html">Creating an Enhanced Datasource Connection</a>.</li><li id="dli_01_0003__li32436276335">Configure routing rules: After an enhanced datasource connection is created, the CIDR block is automatically associated with the system default route without additional operations.<p id="dli_01_0003__p459172814338"><a name="dli_01_0003__li32436276335"></a><a name="li32436276335"></a>Besides the system default route, you can add custom routing rules as needed to forward traffic destined for the target address to the specified next-hop address. For details, see <a href="dli_01_0014.html">Adding a Route for an Enhanced Datasource Connection</a>.</p>
|
||||
</li><li id="dli_01_0003__li17716105210303">Testing network connectivity: Verify the connectivity between the queue and the data source's network. See <a href="dli_01_0489.html">Testing the Network Connectivity Between a Queue and a Data Source</a>.</li></ol>
|
||||
<div class="fignone" id="dli_01_0003__fig16958173322712"><span class="figcap"><b>Figure 2 </b>Using an enhanced datasource connection to establish network communication between a DLI elastic resource pool and a data source</span><br><span><img id="dli_01_0003__image47901116171517" src="en-us_image_0000002397300825.png" title="Click to enlarge" class="imgResize"></span></div>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0003__section12469945134416"><h4 class="sectiontitle">Notes and Constraints</h4>
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0003__table1235203484811" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Notes and constraints on enhanced datasource connections</caption><thead align="left"><tr id="dli_01_0003__dli_07_0005_row16110394335"><th align="left" class="cellrowborder" valign="top" width="24.36%" id="mcps1.3.2.2.2.3.1.1"><p id="dli_01_0003__dli_07_0005_p171539103311">Item</p>
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0003__table1235203484811" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Notes and constraints on enhanced datasource connections</caption><thead align="left"><tr id="dli_01_0003__dli_07_0005_row16110394335"><th align="left" class="cellrowborder" valign="top" width="24.36%" id="mcps1.3.3.2.2.3.1.1"><p id="dli_01_0003__dli_07_0005_p171539103311">Item</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="75.64%" id="mcps1.3.2.2.2.3.1.2"><p id="dli_01_0003__dli_07_0005_p191163973315">Description</p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="75.64%" id="mcps1.3.3.2.2.3.1.2"><p id="dli_01_0003__dli_07_0005_p191163973315">Description</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dli_01_0003__dli_07_0005_row131133933316"><td class="cellrowborder" valign="top" width="24.36%" headers="mcps1.3.2.2.2.3.1.1 "><p id="dli_01_0003__dli_07_0005_p10133917337">Use case</p>
|
||||
<tbody><tr id="dli_01_0003__dli_07_0005_row131133933316"><td class="cellrowborder" valign="top" width="24.36%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0003__dli_07_0005_p10133917337">Use case</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="75.64%" headers="mcps1.3.2.2.2.3.1.2 "><ul id="dli_01_0003__dli_07_0005_ul920917130139"><li id="dli_01_0003__dli_07_0005_li82094136131">Datasource connections cannot be created for the <strong id="dli_01_0003__dli_07_0005_b275994812408">default</strong> queue.</li><li id="dli_01_0003__dli_07_0005_li2599248131320">Flink jobs can directly access DIS, OBS, and SMN data sources without using datasource connections.</li></ul>
|
||||
<td class="cellrowborder" valign="top" width="75.64%" headers="mcps1.3.3.2.2.3.1.2 "><ul id="dli_01_0003__dli_07_0005_ul920917130139"><li id="dli_01_0003__dli_07_0005_li82094136131">Datasource connections cannot be created for the <strong id="dli_01_0003__dli_07_0005_b275994812408">default</strong> queue.</li><li id="dli_01_0003__dli_07_0005_li2599248131320">Flink jobs can directly access DIS, OBS, and SMN data sources without using datasource connections.</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0003__dli_07_0005_row17163973311"><td class="cellrowborder" valign="top" width="24.36%" headers="mcps1.3.2.2.2.3.1.1 "><p id="dli_01_0003__dli_07_0005_p1610391330">Permission</p>
|
||||
<tr id="dli_01_0003__dli_07_0005_row17163973311"><td class="cellrowborder" valign="top" width="24.36%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0003__dli_07_0005_p1610391330">Permission</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="75.64%" headers="mcps1.3.2.2.2.3.1.2 "><ul id="dli_01_0003__dli_07_0005_ul152971649355"><li id="dli_01_0003__dli_07_0005_li3320184019107"><strong id="dli_01_0003__dli_07_0005_b15858611104116">VPC Administrator</strong> permissions are required for enhanced connections to use VPCs, subnets, routes, VPC peering connections.</li></ul>
|
||||
<td class="cellrowborder" valign="top" width="75.64%" headers="mcps1.3.3.2.2.3.1.2 "><ul id="dli_01_0003__dli_07_0005_ul152971649355"><li id="dli_01_0003__dli_07_0005_li3320184019107"><strong id="dli_01_0003__dli_07_0005_b15858611104116">VPC Administrator</strong> permissions are required for enhanced connections to use VPCs, subnets, routes, VPC peering connections.</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0003__dli_07_0005_row131639133318"><td class="cellrowborder" valign="top" width="24.36%" headers="mcps1.3.2.2.2.3.1.1 "><p id="dli_01_0003__dli_07_0005_p2183903314">Usage</p>
|
||||
<tr id="dli_01_0003__dli_07_0005_row131639133318"><td class="cellrowborder" valign="top" width="24.36%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0003__dli_07_0005_p2183903314">Usage</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="75.64%" headers="mcps1.3.2.2.2.3.1.2 "><ul id="dli_01_0003__dli_07_0005_ul129393016367"><li id="dli_01_0003__dli_07_0005_li196339467176">If you use an enhanced datasource connection, the CIDR block of the elastic resource pool or queue cannot overlap with that of the data source.</li><li id="dli_01_0003__dli_07_0005_li3209111310134">Only queues bound with datasource connections can access datasource tables.</li><li id="dli_01_0003__dli_07_0005_li1120931310136">Datasource tables do not support the preview function.</li></ul>
|
||||
<td class="cellrowborder" valign="top" width="75.64%" headers="mcps1.3.3.2.2.3.1.2 "><ul id="dli_01_0003__dli_07_0005_ul129393016367"><li id="dli_01_0003__dli_07_0005_li196339467176">If you use an enhanced datasource connection, the CIDR block of the elastic resource pool or queue cannot overlap with that of the data source.</li><li id="dli_01_0003__dli_07_0005_li3209111310134">Only queues bound with datasource connections can access datasource tables.</li><li id="dli_01_0003__dli_07_0005_li1120931310136">Datasource tables do not support the preview function.</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0003__dli_07_0005_row2021939113318"><td class="cellrowborder" valign="top" width="24.36%" headers="mcps1.3.2.2.2.3.1.1 "><p id="dli_01_0003__dli_07_0005_p621639153312">Connectivity check</p>
|
||||
<tr id="dli_01_0003__dli_07_0005_row2021939113318"><td class="cellrowborder" valign="top" width="24.36%" headers="mcps1.3.3.2.2.3.1.1 "><p id="dli_01_0003__dli_07_0005_p621639153312">Connectivity check</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="75.64%" headers="mcps1.3.2.2.2.3.1.2 "><ul id="dli_01_0003__dli_07_0005_ul827071003617"><li id="dli_01_0003__dli_07_0005_li11700174614348">When checking the connectivity of datasource connections, the notes and constraints on IP addresses are:<ul id="dli_01_0003__dli_07_0005_ul1254904218358"><li id="dli_01_0003__dli_07_0005_li15478548367">The IP address must be valid, which consists of four decimal numbers separated by periods (.). The value ranges from 0 to 255.</li><li id="dli_01_0003__dli_07_0005_li151317527373">During the test, you can add a port after the IP address and separate them with colons (:). The port can contain a maximum of five digits. The value ranges from 0 to 65535.<p id="dli_01_0003__dli_07_0005_p26801956133713"><a name="dli_01_0003__dli_07_0005_li151317527373"></a><a name="dli_07_0005_li151317527373"></a>For example, <strong id="dli_01_0003__dli_07_0005_b11869171511417">192.168.</strong><em id="dli_01_0003__dli_07_0005_i1917651964115">xx</em><strong id="dli_01_0003__dli_07_0005_b37501722194120">.</strong><em id="dli_01_0003__dli_07_0005_i151751326134116">xx</em> or <strong id="dli_01_0003__dli_07_0005_b4220103184115">192.168.</strong><em id="dli_01_0003__dli_07_0005_i7940153620413">xx</em><strong id="dli_01_0003__dli_07_0005_b11270124004111">.</strong><em id="dli_01_0003__dli_07_0005_i197261843124114">xx</em><strong id="dli_01_0003__dli_07_0005_b14999194774118">:8181</strong>.</p>
|
||||
<td class="cellrowborder" valign="top" width="75.64%" headers="mcps1.3.3.2.2.3.1.2 "><ul id="dli_01_0003__dli_07_0005_ul827071003617"><li id="dli_01_0003__dli_07_0005_li11700174614348">When checking the connectivity of datasource connections, the notes and constraints on IP addresses are:<ul id="dli_01_0003__dli_07_0005_ul1254904218358"><li id="dli_01_0003__dli_07_0005_li15478548367">The IP address must be valid, which consists of four decimal digits separated by periods (.). The value ranges from 0 to 255.</li><li id="dli_01_0003__dli_07_0005_li151317527373">During the test, you can add a port after the IP address and separate them with colons (:). The port can contain a maximum of five digits. The value ranges from 0 to 65535.<p id="dli_01_0003__dli_07_0005_p26801956133713"><a name="dli_01_0003__dli_07_0005_li151317527373"></a><a name="dli_07_0005_li151317527373"></a>For example, <strong id="dli_01_0003__dli_07_0005_b11869171511417">192.168.</strong><em id="dli_01_0003__dli_07_0005_i1917651964115">xx</em><strong id="dli_01_0003__dli_07_0005_b37501722194120">.</strong><em id="dli_01_0003__dli_07_0005_i151751326134116">xx</em> or <strong id="dli_01_0003__dli_07_0005_b4220103184115">192.168.</strong><em id="dli_01_0003__dli_07_0005_i7940153620413">xx</em><strong id="dli_01_0003__dli_07_0005_b11270124004111">.</strong><em id="dli_01_0003__dli_07_0005_i197261843124114">xx</em><strong id="dli_01_0003__dli_07_0005_b14999194774118">:8181</strong>.</p>
|
||||
</li></ul>
|
||||
</li><li id="dli_01_0003__dli_07_0005_li1327071015364">When checking the connectivity of datasource connections, the notes and constraints on domain names are:<ul id="dli_01_0003__dli_07_0005_ul7270201020363"><li id="dli_01_0003__dli_07_0005_li46789287572">The domain name can contain 1 to 255 characters. Only letters, numbers, underscores (_), and hyphens (-) are allowed.</li><li id="dli_01_0003__dli_07_0005_li667882815577">The top-level domain name must contain at least two letters, for example, <strong id="dli_01_0003__dli_07_0005_b11901337154319">.com</strong>, <strong id="dli_01_0003__dli_07_0005_b1028814124319">.net</strong>, and <strong id="dli_01_0003__dli_07_0005_b19839144614436">.cn</strong>.</li><li id="dli_01_0003__dli_07_0005_li627041023619">During the test, you can add a port after the domain name and separate them with colons (:). The port can contain a maximum of five digits. The value ranges from 0 to 65535.<p id="dli_01_0003__dli_07_0005_p172706106361"><a name="dli_01_0003__dli_07_0005_li627041023619"></a><a name="dli_07_0005_li627041023619"></a>Example: <strong id="dli_01_0003__dli_07_0005_b10341174121215">example.com:8080</strong></p>
|
||||
</li><li id="dli_01_0003__dli_07_0005_li1327071015364">When checking the connectivity of datasource connections, the notes and constraints on domain names are:<ul id="dli_01_0003__dli_07_0005_ul7270201020363"><li id="dli_01_0003__dli_07_0005_li46789287572">The domain name can contain 1 to 255 characters. Only letters, digits, underscores (_), and hyphens (-) are allowed.</li><li id="dli_01_0003__dli_07_0005_li667882815577">The top-level domain name must contain at least two letters, for example, <strong id="dli_01_0003__dli_07_0005_b11901337154319">.com</strong>, <strong id="dli_01_0003__dli_07_0005_b1028814124319">.net</strong>, and <strong id="dli_01_0003__dli_07_0005_b19839144614436">.cn</strong>.</li><li id="dli_01_0003__dli_07_0005_li627041023619">During the test, you can add a port after the domain name and separate them with colons (:). The port can contain a maximum of five digits. The value ranges from 0 to 65535.<p id="dli_01_0003__dli_07_0005_p172706106361"><a name="dli_01_0003__dli_07_0005_li627041023619"></a><a name="dli_07_0005_li627041023619"></a>Example: <strong id="dli_01_0003__dli_07_0005_b10341174121215">example.com:8080</strong></p>
|
||||
</li></ul>
|
||||
</li></ul>
|
||||
</td>
|
||||
@ -43,9 +48,6 @@
|
||||
</table>
|
||||
</div>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0003__section12566111415470"><h4 class="sectiontitle">Cross-Source Analysis Process</h4><p id="dli_01_0003__p239162984817">To use DLI for cross-source analysis, you need to create a datasource connection to connect DLI to the data source, and then develop jobs to access the data source.</p>
|
||||
<div class="fignone" id="dli_01_0003__fig1175617348416"><span class="figcap"><b>Figure 1 </b>Cross-source analysis flowchart</span><br><span><img id="dli_01_0003__image20990341165118" src="en-us_image_0000001570712116.png"></span></div>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
@ -53,3 +55,10 @@
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
<script language="JavaScript">
|
||||
<!--
|
||||
image_size('.imgResize');
|
||||
var msg_imageMax = "view original image";
|
||||
var msg_imageClose = "close";
|
||||
//--></script>
|
||||
@ -10,12 +10,12 @@
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0376.html">Changing the Database Owner on the DLI Console</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0552.html">Managing Tags</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0552.html">Managing Tags for Database Tables</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0390.html">Creating Databases and Tables</a></div>
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0390.html">Creating a Data Directory, Database, and Table</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
@ -2,8 +2,8 @@
|
||||
|
||||
<h1 class="topictitle1">Previewing Table Data on the DLI Console</h1>
|
||||
<div id="body1501038213757"><p id="dli_01_0007__p569436192936">The <span class="wintitle" id="dli_01_0007__wintitle159646911143"><b>Preview</b></span> page displays the first 10 records in the table.</p>
|
||||
<div class="section" id="dli_01_0007__section220516431119"><h4 class="sectiontitle">Procedure</h4><div class="p" id="dli_01_0007__p39191032115617">You can preview data on either the <span class="wintitle" id="dli_01_0007__wintitle202728967716401"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0007__wintitle1059923363164013"><b>SQL Editor</b></span> page.<ul id="dli_01_0007__ul57312886162410"><li id="dli_01_0007__li46053929162410">To preview data on the <span class="wintitle" id="dli_01_0007__wintitle4564762181553"><b>Data Management</b></span> page:<ol id="dli_01_0007__ol48633399145054"><li id="dli_01_0007__li35417823145054">On the left of the management console, choose <span class="uicontrol" id="dli_01_0007__uicontrol18482320394"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0007__uicontrol748212014913"><b>Databases and Tables</b></span>.</li><li id="dli_01_0007__li22126743145247">On the displayed <span class="wintitle" id="dli_01_0007__wintitle108175242144"><b>Data Management</b></span> page, click the name of the database where the target table whose data you want to export resides to switch to the <strong id="dli_01_0007__b38223243141">Manage Tables</strong> page.</li><li id="dli_01_0007__li36387870145557">Click <span class="uicontrol" id="dli_01_0007__uicontrol52771577102"><b>More</b></span> in the <strong id="dli_01_0007__b3277187171011">Operation</strong> column of the target table and select <span class="wintitle" id="dli_01_0007__wintitle1827707101011"><b>View Properties</b></span>.</li><li id="dli_01_0007__li86216531552">Click the <span class="wintitle" id="dli_01_0007__wintitle3454141011716"><b>Preview</b></span> tab to preview the table data.</li></ol>
|
||||
</li><li id="dli_01_0007__li11072851162410">To preview data on the <span class="wintitle" id="dli_01_0007__wintitle1606590135165610"><b>SQL Editor</b></span> page:<ol id="dli_01_0007__ol24485723162410"><li id="dli_01_0007__li19044916162410">On the left of the management console, click <span class="uicontrol" id="dli_01_0007__uicontrol666915283918"><b>SQL Editor</b></span>.</li><li id="dli_01_0007__li16991452612">In the navigation pane of the displayed <span class="wintitle" id="dli_01_0007__wintitle146852941019"><b>SQL Editor</b></span> page, click <strong id="dli_01_0007__b0685209161016">Databases</strong>.</li><li id="dli_01_0007__li66243256162410">Click the corresponding database name to view the tables in the database.</li><li id="dli_01_0007__li64103520162410">Click <span><img id="dli_01_0007__image14366125210269" src="en-us_image_0237994908.png"></span> on the right of the corresponding table, choose <strong id="dli_01_0007__b5366852132610">View Properties</strong> from the list menu, and click the <strong id="dli_01_0007__b73671852102615">Preview</strong> tab to preview the data of the table.</li></ol>
|
||||
<div class="section" id="dli_01_0007__section220516431119"><h4 class="sectiontitle">Procedure</h4><div class="p" id="dli_01_0007__p39191032115617">You can preview data on either the <span class="wintitle" id="dli_01_0007__wintitle202728967716401"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0007__wintitle1059923363164013"><b>SQL Editor</b></span> page.<ul id="dli_01_0007__ul57312886162410"><li id="dli_01_0007__li46053929162410">To preview data on the <span class="wintitle" id="dli_01_0007__wintitle4564762181553"><b>Data Management</b></span> page:<ol id="dli_01_0007__ol48633399145054"><li id="dli_01_0007__li35417823145054">In the navigation pane on the left of the console, choose <strong id="dli_01_0007__b94728251179">Data Management</strong> > <strong id="dli_01_0007__b1747212250719">Databases and Tables</strong>.</li><li id="dli_01_0007__li22126743145247">On the displayed <span class="wintitle" id="dli_01_0007__wintitle108175242144"><b>Data Management</b></span> page, click the name of the database where the target table whose data you want to export resides to switch to the <strong id="dli_01_0007__b38223243141">Manage Tables</strong> page.</li><li id="dli_01_0007__li36387870145557">Click <span class="uicontrol" id="dli_01_0007__uicontrol52771577102"><b>More</b></span> in the <strong id="dli_01_0007__b3277187171011">Operation</strong> column of the target table and select <span class="wintitle" id="dli_01_0007__wintitle1827707101011"><b>View Properties</b></span>.</li><li id="dli_01_0007__li86216531552">Click the <span class="wintitle" id="dli_01_0007__wintitle3454141011716"><b>Preview</b></span> tab to preview the table data.</li></ol>
|
||||
</li><li id="dli_01_0007__li11072851162410">To preview data on the <span class="wintitle" id="dli_01_0007__wintitle1606590135165610"><b>SQL Editor</b></span> page:<ol id="dli_01_0007__ol24485723162410"><li id="dli_01_0007__li19044916162410">In the navigation pane on the left of the management console, choose <strong id="dli_01_0007__b56256373151">SQL Editor</strong>.</li><li id="dli_01_0007__li16991452612">In the navigation pane of the displayed <span class="wintitle" id="dli_01_0007__wintitle146852941019"><b>SQL Editor</b></span> page, click <strong id="dli_01_0007__b0685209161016">Databases</strong>.</li><li id="dli_01_0007__li66243256162410">Click the corresponding database name to view the tables in the database.</li><li id="dli_01_0007__li64103520162410">Click <span><img id="dli_01_0007__image14366125210269" src="en-us_image_0237994908.png"></span> on the right of the corresponding table, choose <strong id="dli_01_0007__b5366852132610">View Properties</strong> from the list menu, and click the <strong id="dli_01_0007__b73671852102615">Preview</strong> tab to preview the data of the table.</li></ol>
|
||||
</li></ul>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
@ -1,17 +1,17 @@
|
||||
<a name="dli_01_0008"></a><a name="dli_01_0008"></a>
|
||||
|
||||
<h1 class="topictitle1">Viewing Table Metadata</h1>
|
||||
<div id="body1501038213757"><div class="section" id="dli_01_0008__section35142993104733"><h4 class="sectiontitle">Metadata Description</h4><ul id="dli_01_0008__ul3266683161032"><li id="dli_01_0008__li54899781161032">Metadata is used to define data types. It describes information about the data, including the source, size, format, and other data features. In database fields, metadata interprets data content in the data warehouse.</li><li id="dli_01_0008__li57091439161034">When you create a table, metadata is defined, consisting of the column name, type, and description.</li><li id="dli_01_0008__li194120268212">The <span class="wintitle" id="dli_01_0008__wintitle4795312310"><b>Metadata</b></span> page displays information about the target table, including <strong id="dli_01_0008__b98013311133">Column Name</strong>, <strong id="dli_01_0008__b184461231103011">Column Type</strong>, <strong id="dli_01_0008__b6809313317">Data Type</strong>, and <strong id="dli_01_0008__b1801231632">Description</strong>.</li></ul>
|
||||
<div id="body1501038213757"><div class="section" id="dli_01_0008__section35142993104733"><h4 class="sectiontitle">Metadata Description</h4><ul id="dli_01_0008__ul3266683161032"><li id="dli_01_0008__li54899781161032">Metadata is data used to define the type of data. It primarily describes information about the data itself, including its source, size, format, or other characteristics. In database fields, metadata interprets data content in the data warehouse.</li><li id="dli_01_0008__li57091439161034">When creating a table, metadata is defined by three columns: column name, type, and column description.</li><li id="dli_01_0008__li194120268212">The <span class="wintitle" id="dli_01_0008__wintitle4795312310"><b>Metadata</b></span> page displays information about the target table, including <strong id="dli_01_0008__b98013311133">Column Name</strong>, <strong id="dli_01_0008__b184461231103011">Column Type</strong>, <strong id="dli_01_0008__b6809313317">Data Type</strong>, and <strong id="dli_01_0008__b1801231632">Description</strong>.</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0008__section38089543314"><h4 class="sectiontitle">Procedure</h4><div class="p" id="dli_01_0008__p11776437345">You can view metadata on either the <span class="wintitle" id="dli_01_0008__wintitle202728967716401"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0008__wintitle1059923363164013"><b>SQL Editor</b></span> page.<ul id="dli_01_0008__ul41981589145011"><li id="dli_01_0008__li30083560145011">To view metadata on the <span class="wintitle" id="dli_01_0008__wintitle4564762181553"><b>Data Management</b></span> page:<ol id="dli_01_0008__ol48633399145054"><li id="dli_01_0008__li35417823145054">On the left of the management console, choose <span class="uicontrol" id="dli_01_0008__uicontrol165882511882"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0008__uicontrol1058910511686"><b>Databases and Tables</b></span>.</li><li id="dli_01_0008__li22126743145247">On the displayed <span class="wintitle" id="dli_01_0008__wintitle6486209315148"><b>Data Management</b></span> page, click the name of the database where the target table whose data you want to export resides to switch to the <strong id="dli_01_0008__b116953258919">Manage Tables</strong> page.</li><li id="dli_01_0008__li36387870145557">Click <span class="uicontrol" id="dli_01_0008__uicontrol516817179511"><b>More</b></span> in the <strong id="dli_01_0008__b1176621554">Operation</strong> column of the target table and select <strong id="dli_01_0008__b12853104513520">View Properties</strong>. In the <strong id="dli_01_0008__b134534533517">Metadata</strong> tab, view the metadata of the table.</li></ol>
|
||||
</li><li id="dli_01_0008__li662576911510">To view metadata on the <span class="wintitle" id="dli_01_0008__wintitle1606590135165610"><b>SQL Editor</b></span> page:<ol id="dli_01_0008__ol566308021525"><li id="dli_01_0008__li621294601525">On the left of the management console, click <span class="uicontrol" id="dli_01_0008__uicontrol64701326919"><b>SQL Editor</b></span>.</li><li id="dli_01_0008__li8680153010311">In the navigation pane of the displayed <span class="wintitle" id="dli_01_0008__wintitle128361538687"><b>SQL Editor</b></span> page, click <strong id="dli_01_0008__b483614381818">Databases</strong>.</li><li id="dli_01_0008__li1089513015246">Click the corresponding database name to view the tables in the database.</li><li id="dli_01_0008__li3980594015952">Click <span><img id="dli_01_0008__image5147182682614" src="en-us_image_0237994909.png"></span> on the right of the table and choose <strong id="dli_01_0008__b51481726202618">View Properties</strong> from the shortcut menu. On the <strong id="dli_01_0008__b19149026192613">Metadata</strong> tab page, view the metadata of the table.</li></ol>
|
||||
<div class="section" id="dli_01_0008__section38089543314"><h4 class="sectiontitle">Procedure</h4><div class="p" id="dli_01_0008__p11776437345">You can view metadata on either the <span class="wintitle" id="dli_01_0008__wintitle202728967716401"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0008__wintitle1059923363164013"><b>SQL Editor</b></span> page.<ul id="dli_01_0008__ul41981589145011"><li id="dli_01_0008__li30083560145011">To view metadata on the <span class="wintitle" id="dli_01_0008__wintitle4564762181553"><b>Data Management</b></span> page:<ol id="dli_01_0008__ol48633399145054"><li id="dli_01_0008__li35417823145054">In the navigation pane on the left of the console, choose <strong id="dli_01_0008__b13885184187">Data Management</strong> > <strong id="dli_01_0008__b08851842812">Databases and Tables</strong>.</li><li id="dli_01_0008__li22126743145247">On the displayed <span class="wintitle" id="dli_01_0008__wintitle6486209315148"><b>Data Management</b></span> page, click the name of the database where the target table whose data you want to export resides to switch to the <strong id="dli_01_0008__b116953258919">Manage Tables</strong> page.</li><li id="dli_01_0008__li36387870145557">Click <span class="uicontrol" id="dli_01_0008__uicontrol516817179511"><b>More</b></span> in the <strong id="dli_01_0008__b1176621554">Operation</strong> column of the target table and select <strong id="dli_01_0008__b12853104513520">View Properties</strong>. In the <strong id="dli_01_0008__b134534533517">Metadata</strong> tab, view the metadata of the table.</li></ol>
|
||||
</li><li id="dli_01_0008__li662576911510">To view metadata on the <span class="wintitle" id="dli_01_0008__wintitle1606590135165610"><b>SQL Editor</b></span> page:<ol id="dli_01_0008__ol566308021525"><li id="dli_01_0008__li621294601525">In the navigation pane on the left of the management console, choose <strong id="dli_01_0008__b253345113159">SQL Editor</strong>.</li><li id="dli_01_0008__li8680153010311">In the navigation pane of the displayed <span class="wintitle" id="dli_01_0008__wintitle128361538687"><b>SQL Editor</b></span> page, click <strong id="dli_01_0008__b483614381818">Databases</strong>.</li><li id="dli_01_0008__li1089513015246">Click the corresponding database name to view the tables in the database.</li><li id="dli_01_0008__li3980594015952">Click <span><img id="dli_01_0008__image5147182682614" src="en-us_image_0237994909.png"></span> on the right of the table and choose <strong id="dli_01_0008__b51481726202618">View Properties</strong> from the shortcut menu. On the <strong id="dli_01_0008__b19149026192613">Metadata</strong> tab page, view the metadata of the table.</li></ol>
|
||||
</li></ul>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0390.html">Creating Databases and Tables</a></div>
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0390.html">Creating a Data Directory, Database, and Table</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
24
docs/dli/umn/dli_01_0009.html
Normal file
24
docs/dli/umn/dli_01_0009.html
Normal file
@ -0,0 +1,24 @@
|
||||
<a name="dli_01_0009"></a><a name="dli_01_0009"></a>
|
||||
|
||||
<h1 class="topictitle1">Binding an Enhanced Datasource Connection to an Elastic Resource Pool</h1>
|
||||
<div id="body0000001221204429"><div class="section" id="dli_01_0009__section1315827472"><h4 class="sectiontitle">Scenario</h4><p id="dli_01_0009__p628293514719">To connect other resource pools to data sources through enhanced datasource connections, bind enhanced datasource connections to resource pools on the <strong id="dli_01_0009__b254754173415">Enhanced</strong> tab page.</p>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0009__section1455801718507"><h4 class="sectiontitle">Notes and Constraints</h4><ul id="dli_01_0009__ul5455165810144"><li id="dli_01_0009__li698500101511">The CIDR block of the DLI queue to be bound with a datasource connection cannot overlap with that of the data source.</li><li id="dli_01_0009__li6187125017427">The <strong id="dli_01_0009__b7932115104818">default</strong> queue preset in the system cannot be bound with a datasource connection.</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0009__section91616371579"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0009__ol194665011112"><li id="dli_01_0009__li56433424917">Log in to the DLI management console.</li><li id="dli_01_0009__li918675917143">In the navigation pane on the left, choose <strong id="dli_01_0009__b2856104383410">Datasource Connections</strong>.</li><li id="dli_01_0009__li747724617554">On the <strong id="dli_01_0009__b160814116503">Enhanced</strong> tab page displayed, bind an enhanced datasource connection to an elastic resource pool:<ol type="a" id="dli_01_0009__ol162321854175518"><li id="dli_01_0009__li16324435150">Locate your desired enhanced datasource connection, click <strong id="dli_01_0009__b7274102512587">More</strong> in the <strong id="dli_01_0009__b19421541195819">Operation</strong> column, and select <strong id="dli_01_0009__b109801173594">Bind Resource Pool</strong>.</li><li id="dli_01_0009__li20260172914910">In the <strong id="dli_01_0009__b135623447592">Bind Resource Pool</strong> dialog box, select the resource pool to be bound for <strong id="dli_01_0009__b79816399012">Resource Pool</strong>.</li><li id="dli_01_0009__li33942299478">Click <strong id="dli_01_0009__b850814571010">OK</strong>.</li></ol>
|
||||
</li><li id="dli_01_0009__li1817815292316">View the connection status on the <strong id="dli_01_0009__b155214133156">Enhanced</strong> tab page.<ul id="dli_01_0009__ul1789143416374"><li id="dli_01_0009__li58973418372">After an enhanced datasource connection is created, the status is <strong id="dli_01_0009__b1137660191615">Active</strong>, but it does not indicate that the queue is connected to the data source. Go to the queue management page to check whether the data source is connected. The procedure is as follows:<ol type="a" id="dli_01_0009__ol44967456361"><li id="dli_01_0009__li0496114514363">In the navigation pane on the left, choose <strong id="dli_01_0009__b581595064019">Resources</strong> > <strong id="dli_01_0009__b15448954154013">Queue Management</strong>. On the page displayed, locate a desired queue.</li><li id="dli_01_0009__li1349614523612">Click <strong id="dli_01_0009__b291116491429">More</strong> in the <strong id="dli_01_0009__b386175314427">Operation</strong> column and select <strong id="dli_01_0009__b1126865624211">Test Address Connectivity</strong>.</li><li id="dli_01_0009__li104961245183617">Enter the IP address and port number of the data source.</li></ol>
|
||||
</li></ul>
|
||||
<ul id="dli_01_0009__ul1843103517376"><li id="dli_01_0009__li13843173553712">On the details page of an enhanced datasource connection, you can view information about the VPC peering connection.<ul id="dli_01_0009__ul1518514181161"><li id="dli_01_0009__li13185191818619">VPC peering ID: ID of the VPC peering connection created in the cluster to which the queue belongs.<p id="dli_01_0009__p1813481412611"><a name="dli_01_0009__li13185191818619"></a><a name="li13185191818619"></a>A VPC peering connection is created for each queue bound to an enhanced datasource connection. The VPC peering connection is used for cross-VPC communication. Ensure that the security group used by the data source allows access from the CIDR block of the DLI queue, and do not delete the VPC peering connection during the datasource connection.</p>
|
||||
</li><li id="dli_01_0009__li1680712720619">Status of the VPC peering connection:<p id="dli_01_0009__p5382551161"><a name="dli_01_0009__li1680712720619"></a><a name="li1680712720619"></a>The status of a datasource connection can be <strong id="dli_01_0009__b0586152295518">Creating</strong>, <strong id="dli_01_0009__b44551527115519">Active</strong>, or <strong id="dli_01_0009__b129887286554">Failed</strong>.</p>
|
||||
<p id="dli_01_0009__p730618351964">If the connection status is <strong id="dli_01_0009__b5855339294">Failed</strong>, click <span><img id="dli_01_0009__image118513336293" src="en-us_image_0000001620741493.png"></span> on the left to view the detailed error information.</p>
|
||||
</li></ul>
|
||||
</li></ul>
|
||||
</li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0509.html">Managing Enhanced Datasource Connections</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
@ -2,13 +2,13 @@
|
||||
|
||||
<h1 class="topictitle1">Exporting DLI Table Data to OBS</h1>
|
||||
<div id="body1501291906720"><p id="dli_01_0010__p12368142105715">You can export data from a DLI table to OBS. During the export, a folder is created in OBS or the content in the existing folder is overwritten.</p>
|
||||
<div class="section" id="dli_01_0010__section181111466568"><h4 class="sectiontitle">Precautions</h4><ul id="dli_01_0010__ul12225587299"><li id="dli_01_0010__li0222105872918">The exported file can be in JSON format, and the text format can only be UTF-8.</li><li id="dli_01_0010__li6222205822916">Only the data in the DLI table (the table type is <strong id="dli_01_0010__b17552458537">Managed</strong>) can be exported to the OBS bucket, and the export path must be specified to the folder level.</li><li id="dli_01_0010__li675153163611">Data can be exported across accounts. That is, after account B authorizes account A, account A can export data to the OBS path of account B if account A has the permission to read the metadata and permission information about the OBS bucket of account B and read and write the path.</li></ul>
|
||||
<div class="section" id="dli_01_0010__section181111466568"><h4 class="sectiontitle">Precautions</h4><ul id="dli_01_0010__ul12225587299"><li id="dli_01_0010__li0222105872918">The exported file can be in JSON format, and the text format can only be UTF-8.</li><li id="dli_01_0010__li6222205822916">Data in DLI tables (table type: MANAGED) can only be exported to OBS buckets, and the export path must be a folder.</li><li id="dli_01_0010__li675153163611">Data can be exported across accounts. That is, after account B authorizes account A, account A can export data to the OBS path of account B if account A has the permission to read the metadata and permission information about the OBS bucket of account B and read and write the path.</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0010__section42958999144515"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0010__ol16716195143659"><li id="dli_01_0010__li2078303115103"><span>You can export data on either the <span class="wintitle" id="dli_01_0010__wintitle189235461532"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0010__wintitle392464655315"><b>SQL Editor</b></span> page.</span><p><ul id="dli_01_0010__ul13952860151010"><li id="dli_01_0010__li20669721151337">To export data on the <span class="wintitle" id="dli_01_0010__wintitle4564762181553"><b>Data Management</b></span> page:<ol type="a" id="dli_01_0010__ol65658627151340"><li id="dli_01_0010__li16879536151342">On the left of the management console, choose <span class="uicontrol" id="dli_01_0010__uicontrol1582814278819"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0010__uicontrol882811271784"><b>Databases and Tables</b></span>.</li><li id="dli_01_0010__li29714355165922">Click the name of the database corresponding to the table where data is to be exported to switch to the <strong id="dli_01_0010__b681715115537">Manage Tables</strong> page.</li><li id="dli_01_0010__li14811172414512">Select the corresponding table (DLI table) and choose <strong id="dli_01_0010__b03118415457">More</strong> > <strong id="dli_01_0010__b731104154514">Export</strong> in the <strong id="dli_01_0010__b123220419453">Operation</strong> column. The <span class="wintitle" id="dli_01_0010__wintitle63234104516"><b>Export Data</b></span> page is displayed.</li></ol>
|
||||
</li><li id="dli_01_0010__li10384371151118">To export data on the <span class="wintitle" id="dli_01_0010__wintitle134925579488"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0010__ol39382464151459"><li id="dli_01_0010__li26745450151459">On the left of the management console, click <span class="uicontrol" id="dli_01_0010__uicontrol7578153418814"><b>SQL Editor</b></span>.</li><li id="dli_01_0010__li1773513617043">In the navigation tree on the left, click <strong id="dli_01_0010__b20683530717">Databases</strong> to see all databases. Click the database name corresponding to the table to which data is to be exported. The tables are displayed.</li><li id="dli_01_0010__li2614201531">Click <span><img id="dli_01_0010__image10601210194513" src="en-us_image_0237994910.png"></span> on the right of the managed table (DLI table) whose data is to be exported, and choose <strong id="dli_01_0010__b1860815103455">Export</strong> from the shortcut menu.</li></ol>
|
||||
<div class="section" id="dli_01_0010__section42958999144515"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0010__ol16716195143659"><li id="dli_01_0010__li2078303115103"><span>You can export data on either the <span class="wintitle" id="dli_01_0010__wintitle189235461532"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0010__wintitle392464655315"><b>SQL Editor</b></span> page.</span><p><ul id="dli_01_0010__ul13952860151010"><li id="dli_01_0010__li20669721151337">To export data on the <span class="wintitle" id="dli_01_0010__wintitle4564762181553"><b>Data Management</b></span> page:<ol type="a" id="dli_01_0010__ol65658627151340"><li id="dli_01_0010__li16879536151342">In the navigation pane on the left of the console, choose <strong id="dli_01_0010__b145514411872">Data Management</strong> > <strong id="dli_01_0010__b14551541373">Databases and Tables</strong>.</li><li id="dli_01_0010__li29714355165922">Click the name of the database corresponding to the table where data is to be exported to switch to the <strong id="dli_01_0010__b681715115537">Manage Tables</strong> page.</li><li id="dli_01_0010__li14811172414512">Select the corresponding table (DLI table) and choose <strong id="dli_01_0010__b03118415457">More</strong> > <strong id="dli_01_0010__b731104154514">Export</strong> in the <strong id="dli_01_0010__b123220419453">Operation</strong> column. The <span class="wintitle" id="dli_01_0010__wintitle63234104516"><b>Export Data</b></span> page is displayed.</li></ol>
|
||||
</li><li id="dli_01_0010__li10384371151118">To export data on the <span class="wintitle" id="dli_01_0010__wintitle134925579488"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0010__ol39382464151459"><li id="dli_01_0010__li26745450151459">In the navigation pane on the left of the management console, choose <strong id="dli_01_0010__b16993184514153">SQL Editor</strong>.</li><li id="dli_01_0010__li1773513617043">In the navigation tree on the left, click <strong id="dli_01_0010__b20683530717">Databases</strong> to see all databases. Click the database name corresponding to the table to which data is to be exported. The tables are displayed.</li><li id="dli_01_0010__li2614201531">Click <span><img id="dli_01_0010__image10601210194513" src="en-us_image_0237994910.png"></span> on the right of the managed table (DLI table) whose data is to be exported, and choose <strong id="dli_01_0010__b1860815103455">Export</strong> from the shortcut menu.</li></ol>
|
||||
</li></ul>
|
||||
</p></li><li id="dli_01_0010__li10037634143659"><span>In the displayed <span class="wintitle" id="dli_01_0010__wintitle1477194264819"><b>Export Data</b></span> dialog box, specify parameters by referring to <a href="#dli_01_0010__table1903113115020">Table 1</a>.</span><p><div class="p" id="dli_01_0010__p25213331808">
|
||||
<div class="tablenoborder"><a name="dli_01_0010__table1903113115020"></a><a name="table1903113115020"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0010__table1903113115020" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dli_01_0010__row18963311404"><th align="left" class="cellrowborder" valign="top" width="13.8%" id="mcps1.3.3.2.2.2.1.1.2.3.1.1"><p id="dli_01_0010__p4896631504">Parameter</p>
|
||||
<div class="tablenoborder"><a name="dli_01_0010__table1903113115020"></a><a name="table1903113115020"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0010__table1903113115020" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter descriptions</caption><thead align="left"><tr id="dli_01_0010__row18963311404"><th align="left" class="cellrowborder" valign="top" width="13.8%" id="mcps1.3.3.2.2.2.1.1.2.3.1.1"><p id="dli_01_0010__p4896631504">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="86.2%" id="mcps1.3.3.2.2.2.1.1.2.3.1.2"><p id="dli_01_0010__p389619311604">Description</p>
|
||||
</th>
|
||||
|
||||
@ -1,12 +1,13 @@
|
||||
<a name="dli_01_0011"></a><a name="dli_01_0011"></a>
|
||||
|
||||
<h1 class="topictitle1">Deleting a Database on the DLI Console</h1>
|
||||
<div id="body1501038213757"><p id="dli_01_0011__p72900011460">You can delete databases as needed.</p>
|
||||
<div class="section" id="dli_01_0011__section591721184417"><h4 class="sectiontitle">Precautions</h4><ul id="dli_01_0011__ul9368914114615"><li id="dli_01_0011__li8641339162958">You are not allowed to delete databases or tables that are being used for running jobs.</li><li id="dli_01_0011__li55947051162958">The administrator, database owner, and users with the database deletion permission can delete the database.<div class="note" id="dli_01_0011__note2036861411465"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0011__p236921415463">If a database or table is deleted, it cannot be recovered. Exercise caution when performing this operation.</p>
|
||||
<div id="body1501038213757"><p id="dli_01_0011__p1931715289345">You can delete an unused database from the DLI console: when a database is no longer needed, such as after a test database has completed testing; if a database has errors or anomalies that cannot be fixed; when there is a need to reorganize the data structure, such as by modifying table designs; or if a database is idle and has no practical use.</p>
|
||||
<p id="dli_01_0011__p7353193092817">This section describes how to delete a database on the DLI management console.</p>
|
||||
<div class="section" id="dli_01_0011__section591721184417"><h4 class="sectiontitle">Precautions</h4><ul id="dli_01_0011__ul9368914114615"><li id="dli_01_0011__li8641339162958">Databases or tables that are being used for running jobs cannot be deleted.</li><li id="dli_01_0011__li55947051162958">The administrator, database owner, and users with the database deletion permission can delete the database.<div class="note" id="dli_01_0011__note2036861411465"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0011__p236921415463">If a database or table is deleted, it cannot be recovered. Exercise caution when performing this operation.</p>
|
||||
</div></div>
|
||||
</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0011__section168648524611"><h4 class="sectiontitle">Deleting a Database</h4><ol id="dli_01_0011__ol547114061117"><li id="dli_01_0011__li447124091115">On the left of the management console, choose <span class="uicontrol" id="dli_01_0011__uicontrol146221132504"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0011__uicontrol1162281395018"><b>Databases and Tables</b></span>.</li><li id="dli_01_0011__li1148194015113">Locate the row where the target database locates and click <strong id="dli_01_0011__b7893516155013">More</strong> > <span class="uicontrol" id="dli_01_0011__uicontrol189361635014"><b>Drop Database</b></span> in the <strong id="dli_01_0011__b189419168503">Operation</strong> column.<div class="note" id="dli_01_0011__note16416124311218"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0011__p24172043172113">You cannot delete databases that contain tables. To delete a database containing tables, delete the tables first.</p>
|
||||
<div class="section" id="dli_01_0011__section168648524611"><h4 class="sectiontitle">Deleting a Database</h4><ol id="dli_01_0011__ol547114061117"><li id="dli_01_0011__li447124091115">In the navigation pane on the left of the console, choose <strong id="dli_01_0011__b185459141781">Data Management</strong> > <strong id="dli_01_0011__b1054511141588">Databases and Tables</strong>.</li><li id="dli_01_0011__li1148194015113">Locate the row where the target database locates and click <strong id="dli_01_0011__b7893516155013">More</strong> > <span class="uicontrol" id="dli_01_0011__uicontrol189361635014"><b>Drop Database</b></span> in the <strong id="dli_01_0011__b189419168503">Operation</strong> column.<div class="note" id="dli_01_0011__note16416124311218"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0011__p24172043172113">You cannot delete databases that contain tables. To delete a database containing tables, delete the tables first.</p>
|
||||
</div></div>
|
||||
</li><li id="dli_01_0011__li13481408117">In the displayed dialog box, click <span class="uicontrol" id="dli_01_0011__uicontrol153561931162917"><b>Yes</b></span>.</li></ol>
|
||||
</div>
|
||||
|
||||
@ -4,9 +4,9 @@
|
||||
<div id="body0000001152155459"><div class="section" id="dli_01_0013__section17615192019582"><h4 class="sectiontitle">Scenario</h4><p id="dli_01_0013__p171819419301">Host information is the mapping between host IP addresses and domain names. After you configure host information, jobs can only use the configured domain names to access corresponding hosts. After a datasource connection is created, you can modify the host information.</p>
|
||||
<p id="dli_01_0013__p10340194113302">When accessing the HBase cluster of MRS, you need to configure the host name (domain name) and IP address of the instance.</p>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0013__section1137039955"><h4 class="sectiontitle">Constraints</h4><p id="dli_01_0013__p412134219514">You have obtained the MRS host information by referring to <a href="#dli_01_0013__section3607172865810">How Do I Obtain MRS Host Information?</a></p>
|
||||
<div class="section" id="dli_01_0013__section1137039955"><h4 class="sectiontitle">Notes and Constraints</h4><p id="dli_01_0013__p412134219514">You have obtained the MRS host information by referring to <a href="#dli_01_0013__section3607172865810">How Do I Obtain MRS Host Information?</a></p>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0013__section6859216954"><a name="dli_01_0013__section6859216954"></a><a name="section6859216954"></a><h4 class="sectiontitle">Modifying Host Information</h4><ol id="dli_01_0013__ol194665011112"><li id="dli_01_0013__li56433424917">Log in to the DLI management console.</li><li id="dli_01_0013__li918675917143">In the left navigation pane, choose <strong id="dli_01_0013__b17656194117209">Datasource Connections</strong>.</li><li id="dli_01_0013__li16324435150">On the <strong id="dli_01_0013__b1879911443570">Enhanced</strong> tab page displayed, locate the enhanced datasource connection to be modified, click <strong id="dli_01_0013__b19218829195811">More</strong> in the <strong id="dli_01_0013__b1529210539585">Operation</strong> column, and select <strong id="dli_01_0013__b9167149195813">Modify Host</strong>.</li><li id="dli_01_0013__li20260172914910">In the <strong id="dli_01_0013__b159175219015">Modify Host</strong> dialog box displayed, enter the obtained host information.<p id="dli_01_0013__p215110281626">Enter host information in the format of <em id="dli_01_0013__i1019185510110">Host IP address</em><strong id="dli_01_0013__b943812207215"> </strong><em id="dli_01_0013__i13582791126">Host name</em>. Information about multiple hosts is separated by line breaks.</p>
|
||||
<div class="section" id="dli_01_0013__section6859216954"><a name="dli_01_0013__section6859216954"></a><a name="section6859216954"></a><h4 class="sectiontitle">Modifying Host Information</h4><ol id="dli_01_0013__ol194665011112"><li id="dli_01_0013__li56433424917">Log in to the DLI management console.</li><li id="dli_01_0013__li918675917143">In the navigation pane on the left, choose <strong id="dli_01_0013__b14724510342">Datasource Connections</strong>.</li><li id="dli_01_0013__li16324435150">On the <strong id="dli_01_0013__b1879911443570">Enhanced</strong> tab page displayed, locate the enhanced datasource connection to be modified, click <strong id="dli_01_0013__b19218829195811">More</strong> in the <strong id="dli_01_0013__b1529210539585">Operation</strong> column, and select <strong id="dli_01_0013__b9167149195813">Modify Host</strong>.</li><li id="dli_01_0013__li20260172914910">In the <strong id="dli_01_0013__b159175219015">Modify Host</strong> dialog box displayed, enter the obtained host information.<p id="dli_01_0013__p215110281626">Enter host information in the format of <em id="dli_01_0013__i1019185510110">Host IP address</em> <em id="dli_01_0013__i13582791126">Host name</em>. Information about multiple hosts is separated by line breaks.</p>
|
||||
<p id="dli_01_0013__p119411248895">Example:</p>
|
||||
<p id="dli_01_0013__p636511511217">192.168.0.22 node-masterxxx1.com</p>
|
||||
<p id="dli_01_0013__p1536517151321">192.168.0.23 node-masterxxx2.com</p>
|
||||
@ -18,7 +18,7 @@
|
||||
<div class="note" id="dli_01_0013__note1426252593"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0013__p142655145920">If the MRS cluster has multiple IP addresses, enter any service IP address when creating a datasource connection.</p>
|
||||
</div></div>
|
||||
</li><li id="dli_01_0013__li914799171217"><strong id="dli_01_0013__b1392713419255">Method 2: Obtain MRS host information from the /etc/hosts file on an MRS node.</strong><ol id="dli_01_0013__ol207699227017"><li id="dli_01_0013__li67691922306">Log in to any MRS node as user <strong id="dli_01_0013__b187181123279">root</strong>.</li><li id="dli_01_0013__li17769172215019">Run the following command to obtain MRS hosts information. Copy and save the information.<p id="dli_01_0013__p16131162771410"><a name="dli_01_0013__li17769172215019"></a><a name="li17769172215019"></a><strong id="dli_01_0013__b9843629161411">cat /etc/hosts</strong></p>
|
||||
<div class="fignone" id="dli_01_0013__fig15752030165413"><span class="figcap"><b>Figure 1 </b>Obtaining hosts information</span><br><span><img id="dli_01_0013__image4830201818144" src="en-us_image_0000001586217017.png"></span></div>
|
||||
<div class="fignone" id="dli_01_0013__fig15752030165413"><span class="figcap"><b>Figure 1 </b>Obtaining hosts information</span><br><span><img id="dli_01_0013__image4830201818144" src="en-us_image_0000001586217017.png" title="Click to enlarge" class="imgResize"></span></div>
|
||||
</li><li id="dli_01_0013__li1176911221002">Modify host information by referring to <a href="#dli_01_0013__section6859216954">Modifying Host Information</a>.</li></ol>
|
||||
</li></ul>
|
||||
</div>
|
||||
@ -29,3 +29,10 @@
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
<script language="JavaScript">
|
||||
<!--
|
||||
image_size('.imgResize');
|
||||
var msg_imageMax = "view original image";
|
||||
var msg_imageClose = "close";
|
||||
//--></script>
|
||||
@ -1,13 +1,14 @@
|
||||
<a name="dli_01_0014"></a><a name="dli_01_0014"></a>
|
||||
|
||||
<h1 class="topictitle1">Adding a Route for an Enhanced Datasource Connection</h1>
|
||||
<div id="body0000001151955397"><div class="section" id="dli_01_0014__section2071923931014"><h4 class="sectiontitle">Scenario</h4><p id="dli_01_0014__p197659534560">A route is configured with the destination, next hop type, and next hop to determine where the network traffic is directed. Routes are classified into system routes and custom routes.</p>
|
||||
<p id="dli_01_0014__p477315405482">After an enhanced connection is created, the subnet is automatically associated with the default route. You can add custom routes as needed to forward traffic destined for the destination to the specified next hop.</p>
|
||||
<div class="note" id="dli_01_0014__note111421815105414"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0014__ul17762151184110"><li id="dli_01_0014__li22368248550">When an enhanced connection is created, the associated route table is the one associated with the subnet of the data source.</li><li id="dli_01_0014__li18611123515516">The route to be added in the <strong id="dli_01_0014__b16657053314">Add Route</strong> dialog box must be one in the route table associated with the subnet of the resource pool.</li><li id="dli_01_0014__li1037929184116">The subnet of the data source must be different from that used by the resource pool. Otherwise, a network segment conflict occurs.</li></ul>
|
||||
<div id="body0000001151955397"><div class="section" id="dli_01_0014__section2071923931014"><h4 class="sectiontitle">Scenario</h4><p id="dli_01_0014__p11548129135015">Enhanced datasource connections establish peering connections between DLI elastic resource pools and data sources to interconnect two VPC networks. If we liken these peering connections to exclusive bridges linking elastic resource pools and data sources, then routing serves as directional signage guiding the flow of network traffic.</p>
|
||||
<p id="dli_01_0014__p563574819429">Routing rules determine the direction of network traffic by configuring information such as the destination address, next hop type, and next hop address. Routes are classified into system routes and custom routes.</p>
|
||||
<p id="dli_01_0014__p477315405482">After an enhanced datasource connection is created, the subnet is automatically associated with the system default route. Besides the system default route, you can add custom routing rules as needed to forward traffic destined for the target address to the specified next-hop address.</p>
|
||||
<div class="note" id="dli_01_0014__note111421815105414"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0014__ul17762151184110"><li id="dli_01_0014__li22368248550">When an enhanced connection is created, the associated route table is the one associated with the subnet of the data source.</li><li id="dli_01_0014__li18611123515516">The route to be added in the <strong id="dli_01_0014__b16657053314">Add Route</strong> dialog box must be one in the route table associated with the subnet of the resource pool.</li><li id="dli_01_0014__li1037929184116">The data source subnet and the elastic resource pool subnet must be different subnets to avoid network segment conflicts.</li></ul>
|
||||
</div></div>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0014__section15147134471017"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0014__ol194665011112"><li id="dli_01_0014__li56433424917">Log in to the DLI management console.</li><li id="dli_01_0014__li918675917143">In the left navigation pane, choose <strong id="dli_01_0014__b10271163810368">Datasource Connections</strong>.</li><li id="dli_01_0014__li392585072817">On the <strong id="dli_01_0014__b11744144083617">Enhanced</strong> tab page displayed, locate the row containing the enhanced connection to which a route needs to be added, and add the route.<ul id="dli_01_0014__ul738113128302"><li id="dli_01_0014__li738131211308">Method 1:<ol type="a" id="dli_01_0014__ol162321854175518"><li id="dli_01_0014__li16324435150">On the <strong id="dli_01_0014__b178531518183712">Enhanced</strong> tab page displayed, locate the enhanced datasource connection to which a route needs to be added and click <strong id="dli_01_0014__b18853131819370">Manage Route</strong> in the <strong id="dli_01_0014__b28541418103716">Operation</strong> column.</li><li id="dli_01_0014__li68349103411">Click <strong id="dli_01_0014__b17616559388">Add Route</strong>.</li><li id="dli_01_0014__li20260172914910">In the <strong id="dli_01_0014__b1796015143388">Add Route</strong> dialog box, enter the route information. For details about the parameters, see <a href="#dli_01_0014__table42440623119">Table 1</a>.</li><li id="dli_01_0014__li33942299478">Click <strong id="dli_01_0014__b660111761113243">OK</strong>.</li></ol>
|
||||
</li><li id="dli_01_0014__li107318579335">Method 2:<ol type="a" id="dli_01_0014__ol27313571336"><li id="dli_01_0014__li14734111510300">On the <strong id="dli_01_0014__b834074083816">Enhanced</strong> tab page displayed, locate the enhanced datasource connection to which a route needs to be added, click <strong id="dli_01_0014__b6340164012388">More</strong> in the <strong id="dli_01_0014__b034114404384">Operation</strong> column, and select <strong id="dli_01_0014__b734204015384">Add Route</strong>.</li><li id="dli_01_0014__li14631114193214">In the <strong id="dli_01_0014__b1459920815398">Add Route</strong> dialog box, enter the route information. For details about the parameters, see <a href="#dli_01_0014__table42440623119">Table 1</a>.</li><li id="dli_01_0014__li67311357173311">Click <strong id="dli_01_0014__b423331158113243">OK</strong>.</li></ol>
|
||||
<div class="section" id="dli_01_0014__section15147134471017"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0014__ol194665011112"><li id="dli_01_0014__li56433424917">Log in to the DLI management console.</li><li id="dli_01_0014__li918675917143">In the navigation pane on the left, choose <strong id="dli_01_0014__b193771319163914">Datasource Connections</strong>.</li><li id="dli_01_0014__li392585072817">On the displayed <strong id="dli_01_0014__b157872022123912">Enhanced</strong> tab, locate the enhanced datasource connection where you want to add a route and then add a route.<ul id="dli_01_0014__ul738113128302"><li id="dli_01_0014__li738131211308">Method 1:<ol type="a" id="dli_01_0014__ol162321854175518"><li id="dli_01_0014__li16324435150">On the <strong id="dli_01_0014__b09112723916">Enhanced</strong> tab, locate the enhanced datasource connection where you want to add a route and click <strong id="dli_01_0014__b20919277393">Manage Route</strong> in its <strong id="dli_01_0014__b995274397">Operation</strong> column.</li><li id="dli_01_0014__li68349103411">On the displayed page, click <strong id="dli_01_0014__b1357329123920">Add Route</strong>.</li><li id="dli_01_0014__li20260172914910">In the <strong id="dli_01_0014__b21901039123913">Add Route</strong> dialog box, set the parameters based on <a href="#dli_01_0014__table42440623119">Table 1</a>.</li><li id="dli_01_0014__li33942299478">Click <strong id="dli_01_0014__b660111761113243">OK</strong>.</li></ol>
|
||||
</li><li id="dli_01_0014__li107318579335">Method 2:<ol type="a" id="dli_01_0014__ol27313571336"><li id="dli_01_0014__li14734111510300">On the <strong id="dli_01_0014__b1018154343917">Enhanced</strong> tab, locate the enhanced datasource connection where you want to add a route, click <strong id="dli_01_0014__b171813430396">More</strong> in its <strong id="dli_01_0014__b131817431393">Operation</strong> column, and select <strong id="dli_01_0014__b11181104383917">Add Route</strong>.</li><li id="dli_01_0014__li14631114193214">In the <strong id="dli_01_0014__b19264145013395">Add Route</strong> dialog box, set the parameters based on <a href="#dli_01_0014__table42440623119">Table 1</a>.</li><li id="dli_01_0014__li67311357173311">Click <strong id="dli_01_0014__b423331158113243">OK</strong>.</li></ol>
|
||||
</li></ul>
|
||||
|
||||
<div class="tablenoborder"><a name="dli_01_0014__table42440623119"></a><a name="table42440623119"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0014__table42440623119" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters for adding a custom route</caption><thead align="left"><tr id="dli_01_0014__row1624410615313"><th align="left" class="cellrowborder" valign="top" width="17.46%" id="mcps1.3.2.2.3.3.2.3.1.1"><p id="dli_01_0014__p172444619318">Parameter</p>
|
||||
@ -18,13 +19,13 @@
|
||||
</thead>
|
||||
<tbody><tr id="dli_01_0014__row624518623112"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.2.2.3.3.2.3.1.1 "><p id="dli_01_0014__p1024516613118">Route Name</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="82.54%" headers="mcps1.3.2.2.3.3.2.3.1.2 "><p id="dli_01_0014__p152455618315">Name of a custom route, which is unique in the same enhanced datasource scenario. The name can contain 1 to 64 characters. Only digits, letters, underscores (_), and hyphens (-) are allowed.</p>
|
||||
<td class="cellrowborder" valign="top" width="82.54%" headers="mcps1.3.2.2.3.3.2.3.1.2 "><p id="dli_01_0014__p152455618315">Name of a custom route, which is unique in the same enhanced datasource connection. The name can contain up to 64 characters. Only digits, letters, underscores (_), and hyphens (-) are allowed.</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0014__row122452064312"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.2.2.3.3.2.3.1.1 "><p id="dli_01_0014__p1124516623114">IP Address</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="82.54%" headers="mcps1.3.2.2.3.3.2.3.1.2 "><p id="dli_01_0014__p112451867310">Custom route CIDR block. The CIDR block of different routes can overlap but cannot be the same.</p>
|
||||
<p id="dli_01_0014__p993601752819">Do not add the CIDR blocks <strong id="dli_01_0014__b1147314411438">100.125.</strong><em id="dli_01_0014__i141951672436">xx.xx</em> and <strong id="dli_01_0014__b960211118432">100.64.</strong><em id="dli_01_0014__i11964141484310">xx.xx</em> to prevent conflicts with the internal CIDR blocks of services such as SWR. This can lead to failure of the enhanced datasource connection.</p>
|
||||
<td class="cellrowborder" valign="top" width="82.54%" headers="mcps1.3.2.2.3.3.2.3.1.2 "><p id="dli_01_0014__p112451867310">Custom route CIDR block. The CIDR blocks of different routes can overlap but cannot be identical.</p>
|
||||
<p id="dli_01_0014__p993601752819">Do not add the <strong id="dli_01_0014__b652327124010">100.125.</strong><em id="dli_01_0014__i4534272402">xx.xx</em> or <strong id="dli_01_0014__b45382710400">100.64.</strong><em id="dli_01_0014__i95352774013">xx.xx</em> CIDR blocks to avoid conflicts with the internal CIDR blocks of services like SWR, which can cause enhanced datasource connections to fail.</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
|
||||
@ -7,10 +7,10 @@
|
||||
<p id="dli_01_0015__p102341554184819"></p>
|
||||
</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0015__section20128473551"><h4 class="sectiontitle">Operations</h4><ol id="dli_01_0015__ol31809540103928"><li id="dli_01_0015__li10639209101950"><span>On the top menu bar of the DLI management console, click <strong id="dli_01_0015__b761084715252">Resources</strong> > <span class="uicontrol" id="dli_01_0015__uicontrol4872154310282"><b>Queue Management</b></span>.</span></li><li id="dli_01_0015__li5676629917517"><span>Select the queue to be configured and choose <strong id="dli_01_0015__b1355011215377">Manage Permissions</strong> in the <strong id="dli_01_0015__b165505213716">Operation</strong> column. The <strong id="dli_01_0015__b842352706171520">User Permission Info</strong> area displays the list of users who have permissions on the queue.</span><p><p id="dli_01_0015__p123538119117">You can grant queue permissions to new users, modify permissions for users who have some permissions on a queue, and revoke all permissions for a user on a queue.</p>
|
||||
<ul id="dli_01_0015__ul60761295191140"><li id="dli_01_0015__li188984072720"><strong id="dli_01_0015__b6310839111817">Grant permissions to a new user.</strong><div class="p" id="dli_01_0015__p3651154182719">A new user does not have permissions on the queue.<ol type="a" id="dli_01_0015__ol38619773141515"><li id="dli_01_0015__li1545661718056">Click <strong id="dli_01_0015__b16897820560">Set Permission</strong> on the right of <strong id="dli_01_0015__b1908875614">User Permissions</strong> page. The <span class="wintitle" id="dli_01_0015__wintitle1990108175620"><b>Set Permission</b></span> dialog box is displayed.</li><li id="dli_01_0015__li12033638141515">Specify <span class="parmname" id="dli_01_0015__parmname1572165209191914"><b>Username</b></span> and select corresponding permissions.</li><li id="dli_01_0015__li136261439132">Click <span class="uicontrol" id="dli_01_0015__uicontrol131405151191935"><b>OK</b></span>.<p id="dli_01_0015__p97671211131410"><a href="#dli_01_0015__table15710625151416">Table 1</a> describes the related parameters.</p>
|
||||
<div class="section" id="dli_01_0015__section20128473551"><h4 class="sectiontitle">Operations</h4><ol id="dli_01_0015__ol31809540103928"><li id="dli_01_0015__li10639209101950"><span>In the navigation pane on the left of the DLI management console, choose <strong id="dli_01_0015__b1546134765111">Resources</strong> > <strong id="dli_01_0015__b1154634718517">Queue Management</strong>.</span></li><li id="dli_01_0015__li5676629917517"><span>Select the queue to be configured and choose <strong id="dli_01_0015__b1355011215377">Manage Permissions</strong> in the <strong id="dli_01_0015__b165505213716">Operation</strong> column. The <strong id="dli_01_0015__b842352706171520">User Permission Info</strong> area displays the list of users who have permissions on the queue.</span><p><p id="dli_01_0015__p123538119117">You can grant queue permissions to new users, modify permissions for users who have some permissions on a queue, and revoke all permissions for a user on a queue.</p>
|
||||
<ul id="dli_01_0015__ul60761295191140"><li id="dli_01_0015__li188984072720"><strong id="dli_01_0015__b6310839111817">Grant permissions to a new user.</strong><div class="p" id="dli_01_0015__p3651154182719">A new user does not have permissions on the queue.<ol type="a" id="dli_01_0015__ol38619773141515"><li id="dli_01_0015__li1545661718056">Click <strong id="dli_01_0015__b157794915362">Grant Permission</strong> on the right of <strong id="dli_01_0015__b2057718494362">User Permissions</strong> page. The <span class="wintitle" id="dli_01_0015__wintitle757710499366"><b>Grant Permission</b></span> dialog box is displayed.</li><li id="dli_01_0015__li12033638141515">Specify <span class="parmname" id="dli_01_0015__parmname1572165209191914"><b>Username</b></span> and select corresponding permissions.</li><li id="dli_01_0015__li136261439132">Click <span class="uicontrol" id="dli_01_0015__uicontrol131405151191935"><b>OK</b></span>.<p id="dli_01_0015__p97671211131410"><a href="#dli_01_0015__table15710625151416">Table 1</a> describes the related parameters.</p>
|
||||
|
||||
<div class="tablenoborder"><a name="dli_01_0015__table15710625151416"></a><a name="table15710625151416"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0015__table15710625151416" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dli_01_0015__row1771212551410"><th align="left" class="cellrowborder" valign="top" width="20%" id="mcps1.3.3.2.2.2.2.1.2.1.3.3.2.3.1.1"><p id="dli_01_0015__p4713132520147">Parameter</p>
|
||||
<div class="tablenoborder"><a name="dli_01_0015__table15710625151416"></a><a name="table15710625151416"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0015__table15710625151416" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter descriptions</caption><thead align="left"><tr id="dli_01_0015__row1771212551410"><th align="left" class="cellrowborder" valign="top" width="20%" id="mcps1.3.3.2.2.2.2.1.2.1.3.3.2.3.1.1"><p id="dli_01_0015__p4713132520147">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="80%" id="mcps1.3.3.2.2.2.2.1.2.1.3.3.2.3.1.2"><p id="dli_01_0015__p1971410256146">Description</p>
|
||||
</th>
|
||||
@ -18,8 +18,8 @@
|
||||
</thead>
|
||||
<tbody><tr id="dli_01_0015__row207191525121418"><td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.3.2.2.2.2.1.2.1.3.3.2.3.1.1 "><p id="dli_01_0015__p5721152541411">Username</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="80%" headers="mcps1.3.3.2.2.2.2.1.2.1.3.3.2.3.1.2 "><p id="dli_01_0015__p77232254145">Name of the authorized user.</p>
|
||||
<div class="note" id="dli_01_0015__note18961324477"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0015__p13896623472">The username is an existing IAM user name and has logged in to the DLI management console.</p>
|
||||
<td class="cellrowborder" valign="top" width="80%" headers="mcps1.3.3.2.2.2.2.1.2.1.3.3.2.3.1.2 "><p id="dli_01_0015__p77232254145">Name of the user you want to grant permissions to</p>
|
||||
<div class="note" id="dli_01_0015__note18961324477"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0015__p13896623472">The username must be an existing IAM username and has been used to log in to the DLI management console.</p>
|
||||
</div></div>
|
||||
</td>
|
||||
</tr>
|
||||
@ -33,9 +33,9 @@
|
||||
</div>
|
||||
</li></ol>
|
||||
</div>
|
||||
</li><li id="dli_01_0015__li5373564191140"><strong id="dli_01_0015__b1647918533213">To grant or revoke permissions for a user who already has certain permissions on a queue, perform the following steps:</strong><ol type="a" id="dli_01_0015__ol64022357191649"><li id="dli_01_0015__li11136112815177">In the list under <span class="wintitle" id="dli_01_0015__wintitle2724849191220"><b>User Permission Info</b></span> for a queue, select the user whose permissions need to be modified and click <span class="uicontrol" id="dli_01_0015__uicontrol197263497126"><b>Set Permission</b></span> in the <span class="uicontrol" id="dli_01_0015__uicontrol156991298917161"><b>Operation</b></span> column.</li><li id="dli_01_0015__li3483530142353">In the displayed <span class="wintitle" id="dli_01_0015__wintitle1283331883119"><b>Set Permission</b></span> dialog box, modify the permissions of the current user. <a href="#dli_01_0015__table15710625151416">Table 1</a> lists the detailed permission descriptions.<p id="dli_01_0015__p3341848294412">If all options under <span class="parmname" id="dli_01_0015__parmname191181136193316"><b>Set Permission</b></span> are gray, you are not allowed to change permissions on this queue. You can apply to the administrator, queue owner, or other authorized users for queue permission granting and revoking.</p>
|
||||
</li><li id="dli_01_0015__li5373564191140"><strong id="dli_01_0015__b1647918533213">To grant or revoke permissions for a user who already has certain permissions on a queue, perform the following steps:</strong><ol type="a" id="dli_01_0015__ol64022357191649"><li id="dli_01_0015__li11136112815177">In the list under <span class="wintitle" id="dli_01_0015__wintitle2724849191220"><b>User Permissions</b></span> for a queue, select the user whose permissions need to be modified and click <span class="uicontrol" id="dli_01_0015__uicontrol197263497126"><b>Set Permission</b></span> in the <span class="uicontrol" id="dli_01_0015__uicontrol156991298917161"><b>Operation</b></span> column.</li><li id="dli_01_0015__li3483530142353">In the displayed <span class="wintitle" id="dli_01_0015__wintitle1283331883119"><b>Set Permission</b></span> dialog box, modify the permissions of the current user. <a href="#dli_01_0015__table15710625151416">Table 1</a> lists the detailed permission descriptions.<p id="dli_01_0015__p3341848294412">If all options under <span class="parmname" id="dli_01_0015__parmname191181136193316"><b>Set Permission</b></span> are gray, you are not allowed to change permissions on this queue. You can apply to the administrator, queue owner, or other authorized users for queue permission granting and revoking.</p>
|
||||
</li><li id="dli_01_0015__li10389193018234">Click <span class="uicontrol" id="dli_01_0015__uicontrol1516336014162242"><b>OK</b></span>.</li></ol>
|
||||
</li><li id="dli_01_0015__li2536165618122"><strong id="dli_01_0015__b3926205032220">To revoke all permissions for a user on a queue, perform the following steps:</strong><p id="dli_01_0015__p41775579123">In the user list under <span class="wintitle" id="dli_01_0015__wintitle780039627"><b>Permission Info</b></span>, select the user whose permission needs to be revoked and click <span class="uicontrol" id="dli_01_0015__uicontrol398062711"><b>Revoke Permission</b></span> under <span class="uicontrol" id="dli_01_0015__uicontrol18942202419342"><b>Operation</b></span>. In the <strong id="dli_01_0015__b19765113823218">Revoke Permission</strong> dialog box, click <span class="uicontrol" id="dli_01_0015__uicontrol35891343193211"><b>OK</b></span>. All permissions on this queue are revoked.</p>
|
||||
</li><li id="dli_01_0015__li2536165618122"><strong id="dli_01_0015__b168575553349">To revoke all permissions from a user, perform the following steps:</strong><p id="dli_01_0015__p41775579123">In the user list under <span class="wintitle" id="dli_01_0015__wintitle1069610127"><b>Permission Info</b></span>, select the user whose permission needs to be revoked and click <span class="uicontrol" id="dli_01_0015__uicontrol2015231357"><b>Revoke Permission</b></span> under <span class="uicontrol" id="dli_01_0015__uicontrol18942202419342"><b>Operation</b></span>. In the <strong id="dli_01_0015__b19765113823218">Revoke Permission</strong> dialog box, click <span class="uicontrol" id="dli_01_0015__uicontrol35891343193211"><b>OK</b></span>. All permissions on this queue are revoked.</p>
|
||||
</li></ul>
|
||||
</p></li></ol>
|
||||
</div>
|
||||
|
||||
@ -50,7 +50,7 @@
|
||||
<tr id="dli_01_0017__row1662880815250"><td class="cellrowborder" valign="top" width="21.18%" headers="mcps1.3.1.3.2.3.1.1 "><p id="dli_01_0017__p475621615250">Operation</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="78.82000000000001%" headers="mcps1.3.1.3.2.3.1.2 "><ul id="dli_01_0017__ul181927155164"><li id="dli_01_0017__li29989219586"><strong id="dli_01_0017__b6261141101419">Edit</strong>: Edit the job.</li><li id="dli_01_0017__li72649507173"><strong id="dli_01_0017__b62191943141417">Cancel</strong><ul id="dli_01_0017__ul968854181713"><li id="dli_01_0017__li7191115171613">You can terminate a job only when the job is in <span class="parmname" id="dli_01_0017__parmname1651372525718"><b>Submitting</b></span> or <span class="parmname" id="dli_01_0017__parmname5514122515579"><b>Running</b></span> status.</li><li id="dli_01_0017__li19191815111614">A job whose status is <span class="parmvalue" id="dli_01_0017__parmvalue1615317385572"><b>Finished</b></span>, <span class="parmvalue" id="dli_01_0017__parmvalue1615323815719"><b>Failed</b></span>, or <span class="parmvalue" id="dli_01_0017__parmvalue181549386575"><b>Canceled</b></span> cannot be terminated.</li><li id="dli_01_0017__li1819251531618">If the <span class="uicontrol" id="dli_01_0017__uicontrol8986150195815"><b>Cancel</b></span> button is gray, you are not allowed to perform this operation.</li></ul>
|
||||
</li><li id="dli_01_0017__li821851916016"><strong id="dli_01_0017__b8637165181412">Re-execute</strong>: Execute the job again.</li><li id="dli_01_0017__li12875164791814"><strong id="dli_01_0017__b10242547150">SparkUI</strong>: Display the Spark job execution page.<div class="note" id="dli_01_0017__note151024818191"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0017__ul55667208198"><li id="dli_01_0017__li956713205198">When you execute a job on a created queue, the cluster is restarted. It takes about 10 minutes. If you click <strong id="dli_01_0017__b1274243225511">SparkUI</strong> before the cluster is created, an empty <strong id="dli_01_0017__b12742203215512">projectID</strong> will be cached. The SparkUI page cannot be displayed. You are advised to use a dedicated queue so that the cluster will not be released. Alternatively, wait for a while after the job is submitted (the cluster is created), and then check <strong id="dli_01_0017__b1381493675517">SparkUI</strong>.</li><li id="dli_01_0017__li1359102371912">SparkUI can currently only display the latest 100 jobs.</li></ul>
|
||||
</li><li id="dli_01_0017__li821851916016"><strong id="dli_01_0017__b8637165181412">Re-execute</strong>: Execute the job again.</li><li id="dli_01_0017__li12875164791814"><strong id="dli_01_0017__b10242547150">SparkUI</strong>: Display the Spark job execution page.<div class="note" id="dli_01_0017__note151024818191"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0017__ul55667208198"><li id="dli_01_0017__li956713205198">When you execute a job on a created queue, the cluster is restarted. It takes about 10 minutes. If you click <strong id="dli_01_0017__b1274243225511">SparkUI</strong> before the cluster is created, an empty <strong id="dli_01_0017__b12742203215512">projectID</strong> will be cached. The SparkUI page cannot be displayed. You are advised to use a dedicated queue so that the cluster will not be released. Alternatively, wait for a while after the job is submitted (the cluster is created), and then check <strong id="dli_01_0017__b1381493675517">SparkUI</strong>.</li><li id="dli_01_0017__li1359102371912">You can view only the latest 100 job records on DLI's SparkUI.</li></ul>
|
||||
</div></div>
|
||||
</li></ul>
|
||||
<ul id="dli_01_0017__ul1875134719182"><li id="dli_01_0017__li3883129255">In addition to the preceding operations, the following operations are available for QUERY jobs and asynchronous DDL jobs.<ul id="dli_01_0017__ul14392109145620"><li id="dli_01_0017__li38468323121"><strong id="dli_01_0017__b53531757153820">View Result</strong>: View the job running result.</li><li id="dli_01_0017__li37817583123"><strong id="dli_01_0017__b55953114394">Export Result</strong>: Export the job running result to the created OBS bucket.</li></ul>
|
||||
@ -78,7 +78,7 @@
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0402.html">Submitting a SQL Job Using DLI</a></div>
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0402.html">Submitting a SQL Job on the DLI Management Console</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
@ -12,7 +12,7 @@
|
||||
</li></ul>
|
||||
<p id="dli_01_0018__p126011320104116">After creating a VPC peering connection and route between the enhanced datasource connection of project A and the queue of project B, you can create a job in the queue of project B to access the data source of project A.</p>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0018__section868620183613"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0018__ol194665011112"><li id="dli_01_0018__li56433424917">Log in to the DLI management console.</li><li id="dli_01_0018__li918675917143">In the left navigation pane, choose <strong id="dli_01_0018__b114961232427">Datasource Connections</strong>.</li><li id="dli_01_0018__li392585072817">On the <strong id="dli_01_0018__b165204381424">Enhanced</strong> tab page displayed, locate the desired enhanced connection, click <strong id="dli_01_0018__b145215381125">More</strong> in the <strong id="dli_01_0018__b6521173813211">Operation</strong> column, and select <strong id="dli_01_0018__b052115387219">Manage Permission</strong>.<ul id="dli_01_0018__ul738113128302"><li id="dli_01_0018__li738131211308"><strong id="dli_01_0018__b123601733135">Granting permission</strong><ol type="a" id="dli_01_0018__ol162321854175518"><li id="dli_01_0018__li16324435150">In the <strong id="dli_01_0018__b622182918414">Permissions</strong> dialog box displayed, select <strong id="dli_01_0018__b766835217418">Grant Permission</strong> for <strong id="dli_01_0018__b09311323520">Set Permission</strong>.</li><li id="dli_01_0018__li20260172914910">Enter the project ID.</li><li id="dli_01_0018__li33942299478">Click <strong id="dli_01_0018__b643114417515">OK</strong> to grant the resource pool operation permission to the project.</li></ol>
|
||||
<div class="section" id="dli_01_0018__section868620183613"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0018__ol194665011112"><li id="dli_01_0018__li56433424917">Log in to the DLI management console.</li><li id="dli_01_0018__li918675917143">In the navigation pane on the left, choose <strong id="dli_01_0018__b1201612163414">Datasource Connections</strong>.</li><li id="dli_01_0018__li392585072817">On the <strong id="dli_01_0018__b165204381424">Enhanced</strong> tab page displayed, locate the desired enhanced connection, click <strong id="dli_01_0018__b145215381125">More</strong> in the <strong id="dli_01_0018__b6521173813211">Operation</strong> column, and select <strong id="dli_01_0018__b052115387219">Manage Permission</strong>.<ul id="dli_01_0018__ul738113128302"><li id="dli_01_0018__li738131211308"><strong id="dli_01_0018__b123601733135">Granting permission</strong><ol type="a" id="dli_01_0018__ol162321854175518"><li id="dli_01_0018__li16324435150">In the <strong id="dli_01_0018__b622182918414">Permissions</strong> dialog box displayed, select <strong id="dli_01_0018__b766835217418">Grant Permission</strong> for <strong id="dli_01_0018__b09311323520">Set Permission</strong>.</li><li id="dli_01_0018__li20260172914910">Enter the project ID.</li><li id="dli_01_0018__li33942299478">Click <strong id="dli_01_0018__b643114417515">OK</strong> to grant the resource pool operation permission to the project.</li></ol>
|
||||
</li><li id="dli_01_0018__li107318579335"><strong id="dli_01_0018__b9748165894114">Revoking permission</strong><ol type="a" id="dli_01_0018__ol27313571336"><li id="dli_01_0018__li105681553154018">In the <strong id="dli_01_0018__b594517311263">Permissions</strong> dialog box displayed, select <strong id="dli_01_0018__b129461831469">Revoke Permission</strong> for <strong id="dli_01_0018__b79461931065">Set Permission</strong>.</li><li id="dli_01_0018__li25686535401">Select a project ID.</li><li id="dli_01_0018__li13568145384020">Click <strong id="dli_01_0018__b683511710718">OK</strong> to revoke the resource pool operation permission from the specified project.</li></ol>
|
||||
</li></ul>
|
||||
</li></ol>
|
||||
|
||||
@ -1,12 +1,11 @@
|
||||
<a name="dli_01_0019"></a><a name="dli_01_0019"></a>
|
||||
|
||||
<h1 class="topictitle1">Enhanced Datasource Connection Tag Management</h1>
|
||||
<div id="body0000001151875549"><div class="section" id="dli_01_0019__section1670871310579"><h4 class="sectiontitle">Scenario</h4><p id="dli_01_0019__p985684415815">A tag is a key-value pair customized by users and used to identify cloud resources. It helps users to classify and search for cloud resources. A tag consists of a tag key and a tag value.</p>
|
||||
<div id="body0000001151875549"><div class="section" id="dli_01_0019__section1670871310579"><h4 class="sectiontitle">Scenario</h4><p id="dli_01_0019__p985684415815">A tag is a user-defined key-value pair used to identify cloud resources, helping you classify and search for them. A tag consists of a tag key and a tag value.</p>
|
||||
<p id="dli_01_0019__p1650242964010">If you use tags in other cloud services, you are advised to create the same tag key-value pairs for cloud resources used by the same business to keep consistency.</p>
|
||||
<p id="dli_01_0019__p16364141220591">DLI supports the following two types of tags:</p>
|
||||
<ul id="dli_01_0019__ul75413231279"><li id="dli_01_0019__li1466720183510">Resource tags: non-global tags created on DLI.</li></ul>
|
||||
<ul id="dli_01_0019__ul1577516103102"><li id="dli_01_0019__li14345142518119">Predefined tags: global tags created on Tag Management Service (TMS).<p id="dli_01_0019__p16703594315"><a name="dli_01_0019__li14345142518119"></a><a name="li14345142518119"></a></p>
|
||||
<div class="p" id="dli_01_0019__p16364141220591">DLI supports the following two types of tags:<ul id="dli_01_0019__dli_01_0463_ul75413231279"><li id="dli_01_0019__dli_01_0463_li1466720183510">Resource tags: indicate non-global tags created on DLI.</li><li id="dli_01_0019__dli_01_0463_li43733200318">Predefined tags: global tags created on Tag Management Service (TMS).<p id="dli_01_0019__dli_01_0463_p045333012270"><a name="dli_01_0019__dli_01_0463_li43733200318"></a><a name="dli_01_0463_li43733200318"></a>For details about predefined tags, see <em id="dli_01_0019__dli_01_0463_i15773010687469">Tag Management Service User Guide</em>.</p>
|
||||
</li></ul>
|
||||
</div>
|
||||
<p id="dli_01_0019__p12367184618163">DLI allows you to add, modify, or delete tags for datasource connections.</p>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0019__section255181815714"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0019__ol12288184619571"><li id="dli_01_0019__li72887464571">In the left navigation pane of the DLI management console, choose <strong id="dli_01_0019__b10897141315487">Datasource Connections</strong>.</li><li id="dli_01_0019__li02886464577">In the <strong id="dli_01_0019__b1854435122215">Operation</strong> column of the link, choose <strong id="dli_01_0019__b17238103118223">More</strong> > <strong id="dli_01_0019__b6982627112219">Tags</strong>.</li><li id="dli_01_0019__li142881346185720">The tag management page is displayed, showing the tag information about the current connection.</li><li id="dli_01_0019__li152881946175715">Click <span class="uicontrol" id="dli_01_0019__uicontrol12584321205011"><b>Add/Edit Tag</b></span>. The <span class="wintitle" id="dli_01_0019__wintitle758412195016"><b>Add/Edit Tag</b></span> dialog is displayed. Add or edit tag keys and values and click <strong id="dli_01_0019__b5886358549">OK</strong>.
|
||||
@ -22,7 +21,7 @@
|
||||
<ul id="dli_01_0019__ul6423144611162"><li id="dli_01_0019__li14251946151610">Click the text box and select a predefined tag key from the drop-down list.<p id="dli_01_0019__p12169132323510"><a name="dli_01_0019__li14251946151610"></a><a name="li14251946151610"></a>To add a predefined tag, you need to create one on TMS and then select it from the <span class="parmname" id="dli_01_0019__parmname17849229544175"><b>Tag key</b></span> drop-down list. You can click <strong id="dli_01_0019__b39408883441711">View predefined tags</strong> to go to the <strong id="dli_01_0019__b119048434541711">Predefined Tags</strong> page of the TMS console. Then, click <strong id="dli_01_0019__b141119490641711">Create Tag</strong> in the upper corner of the page to create a predefined tag.</p>
|
||||
<p id="dli_01_0019__p1926211187356"></p>
|
||||
</li></ul>
|
||||
<ul id="dli_01_0019__ul643911462165"><li id="dli_01_0019__li7441146181612">Enter a tag key in the text box.<div class="note" id="dli_01_0019__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0019__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, numbers, spaces, and special characters (_.:+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0019__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
||||
<ul id="dli_01_0019__ul643911462165"><li id="dli_01_0019__li7441146181612">Enter a tag key in the text box.<div class="note" id="dli_01_0019__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0019__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0019__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
||||
</div></div>
|
||||
</li></ul>
|
||||
</td>
|
||||
@ -30,7 +29,7 @@
|
||||
<tr id="dli_01_0019__row645064691617"><td class="cellrowborder" valign="top" width="12.94%" headers="mcps1.3.2.2.4.4.2.3.1.1 "><p id="dli_01_0019__p345210468163">Tag value</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="87.06%" headers="mcps1.3.2.2.4.4.2.3.1.2 "><p id="dli_01_0019__p1545619468165">You can perform the following operations:</p>
|
||||
<ul id="dli_01_0019__ul1045720469162"><li id="dli_01_0019__li545914661612">Click the text box and select a predefined tag value from the drop-down list.</li><li id="dli_01_0019__li184611546101610">Enter a tag value in the text box.<div class="note" id="dli_01_0019__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0019__dli_01_0363_p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, numbers, spaces, and special characters (_.:+-@) are allowed.</p>
|
||||
<ul id="dli_01_0019__ul1045720469162"><li id="dli_01_0019__li545914661612">Click the text box and select a predefined tag value from the drop-down list.</li><li id="dli_01_0019__li184611546101610">Enter a tag value in the text box.<div class="note" id="dli_01_0019__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0019__dli_01_0363_p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, digits, spaces, and special characters (_.:+-@) are allowed.</p>
|
||||
</div></div>
|
||||
</li></ul>
|
||||
</td>
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@ -1,7 +1,7 @@
|
||||
<a name="dli_01_0021"></a><a name="dli_01_0021"></a>
|
||||
|
||||
<h1 class="topictitle1">Creating a SQL Job Template</h1>
|
||||
<div id="body1501038213757"><p id="dli_01_0021__p60316341134840">To facilitate SQL operation execution, DLI allows you to customize query templates or save the SQL statements in use as templates. After templates are saved, you do not need to compile SQL statements. Instead, you can directly perform the SQL operations using the templates.</p>
|
||||
<div id="body1501038213757"><p id="dli_01_0021__p60316341134840">DLI allows you to create custom templates or save currently used SQL statements as templates for quick and convenient SQL operations. Once a template is saved, you can execute SQL operations directly through the template without the need to write SQL statements.</p>
|
||||
<p id="dli_01_0021__p9291154524111">SQL templates include sample templates and custom templates. The default sample template contains 22 standard TPC-H query statements, which can meet most TPC-H test requirements. For details, see <a href="dli_01_05111.html">TPC-H Sample Data in the SQL Templates Preset on DLI</a>.</p>
|
||||
<div class="note" id="dli_01_0021__note1596214331554"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0021__p810457114113">In the navigation pane on the left, choose <strong id="dli_01_0021__b13947911195216">Job Templates</strong> > <strong id="dli_01_0021__b2097633115114">SQL Templates</strong>. In the upper right corner of the displayed page, click <strong id="dli_01_0021__b49761731205111">Settings</strong>. In the displayed <strong id="dli_01_0021__b2094413205519">Settings</strong> dialog box, choose whether to display templates by group.</p>
|
||||
<p id="dli_01_0021__p20101557204111">If you enable <strong id="dli_01_0021__b228574605417">Display by Group</strong>, the display options are <strong id="dli_01_0021__b2325122865811">Expand the first group</strong>, <strong id="dli_01_0021__b3489103475813">Expand all</strong>, and <strong id="dli_01_0021__b1240773817582">Collapse all</strong>.</p>
|
||||
@ -9,9 +9,9 @@
|
||||
<div class="section" id="dli_01_0021__section73391334165211"><h4 class="sectiontitle">Creating a SQL Job Template</h4><p id="dli_01_0021__p1499386269">You can create a template on either the <span class="wintitle" id="dli_01_0021__wintitle1110695211279"><b>Job Templates</b></span> or the <span class="wintitle" id="dli_01_0021__wintitle17106205212720"><b>SQL Editor</b></span> page.</p>
|
||||
<ul id="dli_01_0021__ul161981531193516"><li id="dli_01_0021__li6067656217264">To create a template on the <span class="wintitle" id="dli_01_0021__wintitle46974877161025"><b>Job Templates</b></span> page:<ol id="dli_01_0021__ol46612018172655"><li id="dli_01_0021__li28223746172655">On the left of the management console, choose <span class="uicontrol" id="dli_01_0021__uicontrol64691210181112"><b>Job Templates</b></span> > <span class="uicontrol" id="dli_01_0021__uicontrol1514111187110"><b>SQL Templates</b></span>.</li><li id="dli_01_0021__li12412519172825">On the <span class="wintitle" id="dli_01_0021__wintitle3223730153419"><b>SQL Templates</b></span> page, click <strong id="dli_01_0021__b8940123818383">Create Template</strong> to create a template.<p id="dli_01_0021__p18646132611325">Enter the template name, SQL statement, and description information. For details, see <a href="#dli_01_0021__table8760202135313">Table 1</a>.</p>
|
||||
|
||||
<div class="tablenoborder"><a name="dli_01_0021__table8760202135313"></a><a name="table8760202135313"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0021__table8760202135313" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dli_01_0021__row1175916216534"><th align="left" class="cellrowborder" valign="top" width="21%" id="mcps1.3.4.3.1.2.2.4.2.3.1.1"><p id="dli_01_0021__p11759202116537"><strong id="dli_01_0021__b842352706183148">Parameter</strong></p>
|
||||
<div class="tablenoborder"><a name="dli_01_0021__table8760202135313"></a><a name="table8760202135313"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0021__table8760202135313" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter descriptions</caption><thead align="left"><tr id="dli_01_0021__row1175916216534"><th align="left" class="cellrowborder" valign="top" width="21%" id="mcps1.3.4.3.1.2.2.4.2.3.1.1"><p id="dli_01_0021__p11759202116537">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="79%" id="mcps1.3.4.3.1.2.2.4.2.3.1.2"><p id="dli_01_0021__p1575912112538"><strong id="dli_01_0021__b1479020893717">Description</strong></p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="79%" id="mcps1.3.4.3.1.2.2.4.2.3.1.2"><p id="dli_01_0021__p1575912112538">Description</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
|
||||
@ -1,14 +1,14 @@
|
||||
<a name="dli_01_0022"></a><a name="dli_01_0022"></a>
|
||||
|
||||
<h1 class="topictitle1">Managing Queue Tags</h1>
|
||||
<div id="body0000001167728179"><div class="section" id="dli_01_0022__section570224151519"><h4 class="sectiontitle">Tag Management</h4><p id="dli_01_0022__p985684415815">A tag is a key-value pair that you can customize to identify cloud resources. It helps you to classify and search for cloud resources. A tag consists of a tag key and a tag value.</p>
|
||||
<div id="body0000001167728179"><div class="section" id="dli_01_0022__section570224151519"><h4 class="sectiontitle">Tag Management</h4><p id="dli_01_0022__p985684415815">A tag is a user-defined key-value pair used to identify cloud resources, helping you classify and search for them. A tag consists of a tag key and a tag value.</p>
|
||||
<p id="dli_01_0022__p1650242964010">If you use tags in other cloud services, you are advised to create the same tag (key-value pairs) for cloud resources used by the same business to keep consistency.</p>
|
||||
<p id="dli_01_0022__p16364141220591">DLI supports the following two types of tags:</p>
|
||||
<ul id="dli_01_0022__ul75413231279"><li id="dli_01_0022__li1466720183510">Resource tags: non-global tags created on DLI</li></ul>
|
||||
<ul id="dli_01_0022__ul1577516103102"><li id="dli_01_0022__li61271284311">Predefined tags: global tags created on Tag Management Service (TMS).<p id="dli_01_0022__p16703594315"><a name="dli_01_0022__li61271284311"></a><a name="li61271284311"></a></p>
|
||||
<ul id="dli_01_0022__ul1577516103102"><li id="dli_01_0022__li61271284311">Predefined tags: global tags created on Tag Management Service (TMS).<p id="dli_01_0022__p045333012270"><a name="dli_01_0022__li61271284311"></a><a name="li61271284311"></a>For details about predefined tags, see <em id="dli_01_0022__i7877172719464">Tag Management Service User Guide</em>.</p>
|
||||
</li></ul>
|
||||
<p id="dli_01_0022__p12367184618163">DLI allows you to add, modify, or delete tags for queues.</p>
|
||||
<ol id="dli_01_0022__ol113701546131616"><li id="dli_01_0022__li159548152199"><span>In the navigation pane of the DLI management console, choose <strong id="dli_01_0022__b1269494934416">Resources</strong> > <span class="uicontrol" id="dli_01_0022__uicontrol369419499449"><b>Queue Management</b></span>.</span></li><li id="dli_01_0022__li49543159191"><span>In the <strong id="dli_01_0022__b18927195935615">Operation</strong> column of the queue, choose <strong id="dli_01_0022__b19331459165611">More</strong> > <strong id="dli_01_0022__b7934105919563">Tags</strong>.</span></li><li id="dli_01_0022__li4382946161614"><span>The tag management page is displayed, showing the tag information about the current queue.</span></li><li id="dli_01_0022__li13387164631618"><span>Click <span class="uicontrol" id="dli_01_0022__uicontrol561019162567"><b>Add/Edit Tag</b></span> to switch to the <span class="wintitle" id="dli_01_0022__wintitle3616161605619"><b>Add/Edit Tag</b></span> dialog box. Enter a tag and a value, and click <strong id="dli_01_0022__b1945411675720">Add</strong>.</span><p>
|
||||
<ol id="dli_01_0022__ol113701546131616"><li id="dli_01_0022__li159548152199"><span>In the navigation pane on the left of the DLI management console, choose <strong id="dli_01_0022__b95871256144314">Resources</strong> > <strong id="dli_01_0022__b1858765619439">Queue Management</strong>.</span></li><li id="dli_01_0022__li49543159191"><span>In the <strong id="dli_01_0022__b18927195935615">Operation</strong> column of the queue, choose <strong id="dli_01_0022__b19331459165611">More</strong> > <strong id="dli_01_0022__b7934105919563">Tags</strong>.</span></li><li id="dli_01_0022__li4382946161614"><span>The tag management page is displayed, showing the tag information about the current queue.</span></li><li id="dli_01_0022__li13387164631618"><span>On the page that appears, click <strong id="dli_01_0022__b1720744175015">Add/Edit Tag</strong> in the upper left corner. Enter a tag and a value, and click <strong id="dli_01_0022__b1945411675720">Add</strong>.</span><p>
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0022__table139874691610" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Tag parameters</caption><thead align="left"><tr id="dli_01_0022__row1640724610160"><th align="left" class="cellrowborder" valign="top" width="12.94%" id="mcps1.3.1.8.4.2.1.2.3.1.1"><p id="dli_01_0022__p17410246121616">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="87.06%" id="mcps1.3.1.8.4.2.1.2.3.1.2"><p id="dli_01_0022__p154131746131615">Description</p>
|
||||
@ -21,7 +21,7 @@
|
||||
<ul id="dli_01_0022__ul6423144611162"><li id="dli_01_0022__li14251946151610">Click the text box and select a predefined tag key from the drop-down list.<p id="dli_01_0022__p12169132323510"><a name="dli_01_0022__li14251946151610"></a><a name="li14251946151610"></a>To add a predefined tag, you need to create one on TMS and then select it from the <span class="parmname" id="dli_01_0022__parmname672234855114"><b>Tag key</b></span> drop-down list. You can click <strong id="dli_01_0022__b1270845085112">View predefined tags</strong> to go to the <strong id="dli_01_0022__b170955055115">Predefined Tags</strong> page of the TMS console. Then, click <strong id="dli_01_0022__b157091850115120">Create Tag</strong> in the upper corner of the page to create a predefined tag.</p>
|
||||
<p id="dli_01_0022__p1926211187356"></p>
|
||||
</li></ul>
|
||||
<ul id="dli_01_0022__ul643911462165"><li id="dli_01_0022__li7441146181612">Enter a tag key in the text box.<div class="note" id="dli_01_0022__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0022__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, numbers, spaces, and special characters (_.:+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0022__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
||||
<ul id="dli_01_0022__ul643911462165"><li id="dli_01_0022__li7441146181612">Enter a tag key in the text box.<div class="note" id="dli_01_0022__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0022__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0022__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
||||
</div></div>
|
||||
</li></ul>
|
||||
</td>
|
||||
@ -29,7 +29,7 @@
|
||||
<tr id="dli_01_0022__row645064691617"><td class="cellrowborder" valign="top" width="12.94%" headers="mcps1.3.1.8.4.2.1.2.3.1.1 "><p id="dli_01_0022__p345210468163">Tag value</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="87.06%" headers="mcps1.3.1.8.4.2.1.2.3.1.2 "><p id="dli_01_0022__p1545619468165">You can specify the tag value in either of the following ways:</p>
|
||||
<ul id="dli_01_0022__ul1045720469162"><li id="dli_01_0022__li545914661612">Click the text box and select a predefined tag value from the drop-down list.</li><li id="dli_01_0022__li184611546101610">Enter a tag value in the text box.<div class="note" id="dli_01_0022__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0022__dli_01_0363_p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, numbers, spaces, and special characters (_.:+-@) are allowed.</p>
|
||||
<ul id="dli_01_0022__ul1045720469162"><li id="dli_01_0022__li545914661612">Click the text box and select a predefined tag value from the drop-down list.</li><li id="dli_01_0022__li184611546101610">Enter a tag value in the text box.<div class="note" id="dli_01_0022__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0022__dli_01_0363_p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, digits, spaces, and special characters (_.:+-@) are allowed.</p>
|
||||
</div></div>
|
||||
</li></ul>
|
||||
</td>
|
||||
|
||||
@ -4,15 +4,15 @@
|
||||
<div id="body1510283588485"></div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0002.html">Using DLI to Submit a SQL Job to Query OBS Data</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0002.html">Submitting a SQL Job to Query OBS Data Using DLI</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0020.html">Using DLI to Submit a SQL Job to Query RDS for MySQL Data</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0020.html">Submitting a SQL Job to Query RDS for MySQL Data Using DLI</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0531.html">Using DLI to Submit a Flink OpenSource SQL Job to Query RDS for MySQL Data</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0531.html">Submitting a Flink OpenSource SQL Job to Query RDS for MySQL Data Using DLI</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0512.html">Using DLI to Submit a Flink Jar Job</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0512.html">Submitting a Flink Jar Job Using DLI</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0375.html">Using DLI to Submit a Spark Jar Job</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0375.html">Submitting a Spark Jar Job Using DLI</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
</div>
|
||||
|
||||
@ -4,9 +4,6 @@
|
||||
<div id="body1513046454923"><div class="p" id="dli_01_0228__p1549719615415">Databases and tables are the basis for developing SQL and Spark jobs. Before running a job, you need to define databases and tables based on your service scenarios.<div class="note" id="dli_01_0228__note9930169132116"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0228__p1793029152116">Flink allows for dynamic data types, enabling the definition of data structures at runtime without the need for predefined metadata.</p>
|
||||
</div></div>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0228__section1774332145617"><h4 class="sectiontitle">Data Catalog</h4><p id="dli_01_0228__p22721955145">A data catalog is a metadata management object that can contain multiple databases.</p>
|
||||
<p id="dli_01_0228__p52899104546">For how to create a database and a table in a DLI data catalog, see <a href="dli_01_0005.html">Creating a Database and Table on the DLI Console</a>.</p>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0228__section1154218221099"><h4 class="sectiontitle">Database</h4><p id="dli_01_0228__p545653217199">A database is a repository of data organized, stored, and managed on computer storage devices according to data structures. Databases are typically used to store, retrieve, and manage structured data, consisting of multiple data tables that are interrelated through keys and indexes.</p>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0228__section239216431995"><h4 class="sectiontitle">Table</h4><p id="dli_01_0228__p1464381714117">Tables are one of the most important components of a database, consisting of rows and columns. Each row represents a data item, while each column represents a property or feature of the data. Tables are used to organize and store specific types of data, making it possible to query and analyze the data effectively.</p>
|
||||
@ -27,7 +24,7 @@
|
||||
</li><li id="dli_01_0228__li106399254176"><strong id="dli_01_0228__b332317302015">View table</strong><p id="dli_01_0228__p8510229161711">A view table is a virtual table that does not store actual data. Instead, it dynamically generates data based on the defined query logic. Views are typically used to simplify complex queries or provide customized data views for different users or applications.</p>
|
||||
<p id="dli_01_0228__p1189411349171">A view table can be created based on one or multiple tables, providing a flexible way to display data without affecting the storage and organization of the underlying data.</p>
|
||||
<p id="dli_01_0228__p888782503817">In the navigation pane on the left of the DLI console, choose <strong id="dli_01_0228__b418904011126">Data Management</strong> > <strong id="dli_01_0228__b12190154021212">Databases and Tables</strong>. On the displayed page, click the name of a database. In the displayed table list, tables whose <strong id="dli_01_0228__b1519084061211">Type</strong> is <strong id="dli_01_0228__b319034081210">VIEW</strong> are view tables.</p>
|
||||
<div class="note" id="dli_01_0228__note754618172317"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0228__p1035610441232">A view can only be created using SQL statements. You cannot create a view on the <strong id="dli_01_0228__b10302171210315">Create Table</strong> page. Table or view information in a view cannot be modified. Otherwise, the query may fail.</p>
|
||||
<div class="note" id="dli_01_0228__note754618172317"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_01_0228__p1035610441232">Views can be created only by using SQL statements, not through the <strong id="dli_01_0228__b7193134810178">Create Table</strong> page. Table or view information in a view cannot be modified. Otherwise, the query may fail.</p>
|
||||
</div></div>
|
||||
</li><li id="dli_01_0228__li11639125111715"><strong id="dli_01_0228__b156711617413">Datasource table</strong><p id="dli_01_0228__p698574014178">A datasource table is a data table that can be queried and analyzed across multiple data sources. This type of tables can integrate data from varying data sources and provide a unified data view.</p>
|
||||
<p id="dli_01_0228__p15633615178">Datasource tables are typically used in data warehouse and data lake architectures, allowing users to perform complex queries across multiple data sources.</p>
|
||||
@ -35,31 +32,31 @@
|
||||
</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0228__section8360181926"><h4 class="sectiontitle">Notes and Constraints on Databases and Tables</h4>
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0228__table11967122774713" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Notes and constraints on DLI resources</caption><thead align="left"><tr id="dli_01_0228__dli_07_0005_row11477165113116"><th align="left" class="cellrowborder" valign="top" width="23.990000000000002%" id="mcps1.3.7.2.2.3.1.1"><p id="dli_01_0228__dli_07_0005_p20866135443112">Item</p>
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0228__table11967122774713" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Notes and constraints on DLI resources</caption><thead align="left"><tr id="dli_01_0228__dli_07_0005_row11477165113116"><th align="left" class="cellrowborder" valign="top" width="23.990000000000002%" id="mcps1.3.6.2.2.3.1.1"><p id="dli_01_0228__dli_07_0005_p20866135443112">Item</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="76.01%" id="mcps1.3.7.2.2.3.1.2"><p id="dli_01_0228__dli_07_0005_p786635433114">Description</p>
|
||||
<th align="left" class="cellrowborder" valign="top" width="76.01%" id="mcps1.3.6.2.2.3.1.2"><p id="dli_01_0228__dli_07_0005_p786635433114">Description</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dli_01_0228__dli_07_0005_row247745113318"><td class="cellrowborder" valign="top" width="23.990000000000002%" headers="mcps1.3.7.2.2.3.1.1 "><p id="dli_01_0228__dli_07_0005_p647714511312">Database</p>
|
||||
<tbody><tr id="dli_01_0228__dli_07_0005_row247745113318"><td class="cellrowborder" valign="top" width="23.990000000000002%" headers="mcps1.3.6.2.2.3.1.1 "><p id="dli_01_0228__dli_07_0005_p647714511312">Database</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="76.01%" headers="mcps1.3.7.2.2.3.1.2 "><ul id="dli_01_0228__dli_07_0005_ul898883973917"><li id="dli_01_0228__dli_07_0005_li1479161816292"><strong id="dli_01_0228__dli_07_0005_b13239173891316">default</strong> is the database built in DLI. You cannot create a database named <strong id="dli_01_0228__dli_07_0005_b112224411159">default</strong>.</li><li id="dli_01_0228__dli_07_0005_li44809180291">DLI supports a maximum of 50 databases.</li></ul>
|
||||
<td class="cellrowborder" valign="top" width="76.01%" headers="mcps1.3.6.2.2.3.1.2 "><ul id="dli_01_0228__dli_07_0005_ul898883973917"><li id="dli_01_0228__dli_07_0005_li1479161816292"><strong id="dli_01_0228__dli_07_0005_b13239173891316">default</strong> is the database built in DLI. You cannot create a database named <strong id="dli_01_0228__dli_07_0005_b112224411159">default</strong>.</li><li id="dli_01_0228__dli_07_0005_li44809180291">DLI supports a maximum of 50 databases.</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0228__dli_07_0005_row847745133110"><td class="cellrowborder" valign="top" width="23.990000000000002%" headers="mcps1.3.7.2.2.3.1.1 "><p id="dli_01_0228__dli_07_0005_p10477125133118">Data table</p>
|
||||
<tr id="dli_01_0228__dli_07_0005_row847745133110"><td class="cellrowborder" valign="top" width="23.990000000000002%" headers="mcps1.3.6.2.2.3.1.1 "><p id="dli_01_0228__dli_07_0005_p10477125133118">Data table</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="76.01%" headers="mcps1.3.7.2.2.3.1.2 "><ul id="dli_01_0228__dli_07_0005_ul618418211249"><li id="dli_01_0228__dli_07_0005_li73208126302">DLI supports a maximum of 5,000 tables.</li><li id="dli_01_0228__dli_07_0005_li693410241413">DLI supports the following table types:<ul id="dli_01_0228__dli_07_0005_ul165901694404"><li id="dli_01_0228__dli_07_0005_li18590159184015"><strong id="dli_01_0228__dli_07_0005_b36524201812">MANAGED</strong>: Data is stored in a DLI table.</li><li id="dli_01_0228__dli_07_0005_li45903944018"><strong id="dli_01_0228__dli_07_0005_b9982521141813">EXTERNAL</strong>: Data is stored in an OBS table.</li><li id="dli_01_0228__dli_07_0005_li15901990404"><strong id="dli_01_0228__dli_07_0005_b58918578193">View</strong>: A view can only be created using SQL statements.</li><li id="dli_01_0228__dli_07_0005_li18935939173511">Datasource table: The table type is also <strong id="dli_01_0228__dli_07_0005_b96694314229">EXTERNAL</strong>.</li></ul>
|
||||
<td class="cellrowborder" valign="top" width="76.01%" headers="mcps1.3.6.2.2.3.1.2 "><ul id="dli_01_0228__dli_07_0005_ul618418211249"><li id="dli_01_0228__dli_07_0005_li73208126302">DLI supports a maximum of 5,000 tables.</li><li id="dli_01_0228__dli_07_0005_li693410241413">DLI supports the following table types:<ul id="dli_01_0228__dli_07_0005_ul165901694404"><li id="dli_01_0228__dli_07_0005_li18590159184015"><strong id="dli_01_0228__dli_07_0005_b36524201812">MANAGED</strong>: Data is stored in a DLI table.</li><li id="dli_01_0228__dli_07_0005_li45903944018"><strong id="dli_01_0228__dli_07_0005_b9982521141813">EXTERNAL</strong>: Data is stored in an OBS table.</li><li id="dli_01_0228__dli_07_0005_li15901990404"><strong id="dli_01_0228__dli_07_0005_b58918578193">View</strong>: A view can only be created using SQL statements.</li><li id="dli_01_0228__dli_07_0005_li18935939173511">Datasource table: The table type is also <strong id="dli_01_0228__dli_07_0005_b96694314229">EXTERNAL</strong>.</li></ul>
|
||||
</li><li id="dli_01_0228__dli_07_0005_li57353313451">You cannot specify a storage path when creating a DLI table.</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0228__dli_07_0005_row1847775143114"><td class="cellrowborder" valign="top" width="23.990000000000002%" headers="mcps1.3.7.2.2.3.1.1 "><p id="dli_01_0228__dli_07_0005_p19477165112311">Data import</p>
|
||||
<tr id="dli_01_0228__dli_07_0005_row1847775143114"><td class="cellrowborder" valign="top" width="23.990000000000002%" headers="mcps1.3.6.2.2.3.1.1 "><p id="dli_01_0228__dli_07_0005_p19477165112311">Data import</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="76.01%" headers="mcps1.3.7.2.2.3.1.2 "><ul id="dli_01_0228__dli_07_0005_ul124061017728"><li id="dli_01_0228__dli_07_0005_li63275321982">Only OBS data can be imported to DLI or OBS.</li><li id="dli_01_0228__dli_07_0005_li61329131626">You can import data in CSV, Parquet, ORC, JSON, or Avro format from OBS to tables created on DLI.</li><li id="dli_01_0228__dli_07_0005_li10140613526">To import data in CSV format to a partitioned table, place the partition column in the last column of the data source.</li><li id="dli_01_0228__dli_07_0005_li36678261928">The encoding format of imported data can only be UTF-8.</li></ul>
|
||||
<td class="cellrowborder" valign="top" width="76.01%" headers="mcps1.3.6.2.2.3.1.2 "><ul id="dli_01_0228__dli_07_0005_ul124061017728"><li id="dli_01_0228__dli_07_0005_li63275321982">Only OBS data can be imported to DLI or OBS.</li><li id="dli_01_0228__dli_07_0005_li61329131626">You can import data in CSV, Parquet, ORC, JSON, or Avro format from OBS to tables created on DLI.</li><li id="dli_01_0228__dli_07_0005_li10140613526">To import data in CSV format to a partitioned table, place the partition column in the last column of the data source.</li><li id="dli_01_0228__dli_07_0005_li36678261928">The encoding format of imported data can only be UTF-8.</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0228__dli_07_0005_row164770519318"><td class="cellrowborder" valign="top" width="23.990000000000002%" headers="mcps1.3.7.2.2.3.1.1 "><p id="dli_01_0228__dli_07_0005_p8477165116315">Data export</p>
|
||||
<tr id="dli_01_0228__dli_07_0005_row164770519318"><td class="cellrowborder" valign="top" width="23.990000000000002%" headers="mcps1.3.6.2.2.3.1.1 "><p id="dli_01_0228__dli_07_0005_p8477165116315">Data export</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="76.01%" headers="mcps1.3.7.2.2.3.1.2 "><ul id="dli_01_0228__dli_07_0005_ul1227515591725"><li id="dli_01_0228__dli_07_0005_li450618543211">Data in DLI tables (whose table type is <strong id="dli_01_0228__dli_07_0005_b1468011952916">MANAGED</strong>) can only be exported to OBS buckets, and the export path must contain a folder.</li><li id="dli_01_0228__dli_07_0005_li58491911635">The exported file is in JSON format, and the text format can only be UTF-8.</li><li id="dli_01_0228__dli_07_0005_li195527411331">Data can be exported across accounts. That is, after account B authorizes account A, account A has the permission to read the metadata and permission information of account B's OBS bucket as well as the read and write permissions on the path. Account A can export data to the OBS path of account B.</li></ul>
|
||||
<td class="cellrowborder" valign="top" width="76.01%" headers="mcps1.3.6.2.2.3.1.2 "><ul id="dli_01_0228__dli_07_0005_ul1227515591725"><li id="dli_01_0228__dli_07_0005_li450618543211">Data in DLI tables (whose table type is <strong id="dli_01_0228__dli_07_0005_b1468011952916">MANAGED</strong>) can only be exported to OBS buckets, and the export path must contain a folder.</li><li id="dli_01_0228__dli_07_0005_li58491911635">The exported file is in JSON format, and the text format can only be UTF-8.</li><li id="dli_01_0228__dli_07_0005_li195527411331">Data can be exported across accounts. That is, after account B authorizes account A, account A has the permission to read the metadata and permission information of account B's OBS bucket as well as the read and write permissions on the path. Account A can export data to the OBS path of account B.</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
@ -72,7 +69,7 @@
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0390.html">Creating Databases and Tables</a></div>
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0390.html">Creating a Data Directory, Database, and Table</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
@ -1,17 +1,17 @@
|
||||
<a name="dli_01_0253"></a><a name="dli_01_0253"></a>
|
||||
|
||||
<h1 class="topictitle1">Importing OBS Data to DLI</h1>
|
||||
<div id="body1519716643081"><p id="dli_01_0253__p1793214255012">This section describes how to import data stored in OBS to a table on the DLI console.</p>
|
||||
<h1 class="topictitle1">Importing OBS Data to a DLI Table</h1>
|
||||
<div id="body1519716643081"><p id="dli_01_0253__p1793214255012">This section describes how to import data stored in OBS to a table on the DLI console. Data can be imported to both DLI tables (table type: MANAGED) and OBS tables (table type: EXTERNAL).</p>
|
||||
<div class="section" id="dli_01_0253__section321713588229"><h4 class="sectiontitle">Precautions</h4><ul id="dli_01_0253__ul7225153265013"><li id="dli_01_0253__li10225103235019">Only one path can be specified during data import. The path cannot contain commas (,).</li><li id="dli_01_0253__li119556312517">To import data in CSV format to a partitioned table, place the column to be partitioned in the last column of the data source.</li><li id="dli_01_0253__li1962615137530">You are advised not to concurrently import data in to a table. If you concurrently import data into a table, there is a possibility that conflicts occur, leading to failed data import.</li><li id="dli_01_0253__li5626191395311">The imported file can be in CSV, Parquet, ORC, JSON, and Avro format. The encoding format must be UTF-8.</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0253__section46923850144935"><h4 class="sectiontitle">Prerequisites</h4><p id="dli_01_0253__p2990805493216">The data to be imported has been stored on OBS.</p>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0253__section1935812127104"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0253__ol64023642144515"><li id="dli_01_0253__li2078303115103"><span>You can import data on either the <span class="wintitle" id="dli_01_0253__wintitle6968736183919"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0253__wintitle296873615397"><b>SQL Editor</b></span> page.</span><p><ul id="dli_01_0253__ul13952860151010"><li id="dli_01_0253__li20669721151337">To import data on the <span class="wintitle" id="dli_01_0253__wintitle718703911393"><b>Data Management</b></span> page:<ol type="a" id="dli_01_0253__ol65658627151340"><li id="dli_01_0253__li16879536151342">On the left of the management console, choose <span class="uicontrol" id="dli_01_0253__uicontrol1861322375215"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0253__uicontrol8614122385211"><b>Databases and Tables</b></span>.</li><li id="dli_01_0253__li29714355165922">Click the name of the database corresponding to the table where data is to be imported to switch to the table management page.</li><li id="dli_01_0253__li14811172414512">Locate the row where the target table resides and choose <strong id="dli_01_0253__b1434424713920">More</strong> > <strong id="dli_01_0253__b834444717393">Import</strong> in the <strong id="dli_01_0253__b113451847143918">Operation</strong> column. The <span class="wintitle" id="dli_01_0253__wintitle9345164715393"><b>Import</b></span> dialog box is displayed.</li></ol>
|
||||
<div class="section" id="dli_01_0253__section1935812127104"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0253__ol64023642144515"><li id="dli_01_0253__li2078303115103"><span>You can import data on either the <span class="wintitle" id="dli_01_0253__wintitle6968736183919"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0253__wintitle296873615397"><b>SQL Editor</b></span> page.</span><p><ul id="dli_01_0253__ul13952860151010"><li id="dli_01_0253__li20669721151337">To import data on the <span class="wintitle" id="dli_01_0253__wintitle718703911393"><b>Data Management</b></span> page:<ol type="a" id="dli_01_0253__ol65658627151340"><li id="dli_01_0253__li16879536151342">In the navigation pane on the left of the console, choose <strong id="dli_01_0253__b626824716817">Data Management</strong> > <strong id="dli_01_0253__b192681447680">Databases and Tables</strong>.</li><li id="dli_01_0253__li29714355165922">Click the name of the database corresponding to the table where data is to be imported to switch to the table management page.</li><li id="dli_01_0253__li14811172414512">Locate the row where the target table resides and choose <strong id="dli_01_0253__b1434424713920">More</strong> > <strong id="dli_01_0253__b834444717393">Import</strong> in the <strong id="dli_01_0253__b113451847143918">Operation</strong> column. The <span class="wintitle" id="dli_01_0253__wintitle9345164715393"><b>Import</b></span> dialog box is displayed.</li></ol>
|
||||
</li><li id="dli_01_0253__li10384371151118">To import data on the <span class="wintitle" id="dli_01_0253__wintitle163710502399"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0253__ol39382464151459"><li id="dli_01_0253__li26745450151459">On the left of the management console, click <span class="uicontrol" id="dli_01_0253__uicontrol1351715612720"><b>SQL Editor</b></span>.</li><li id="dli_01_0253__li1773513617043">In the navigation tree on the left of <span class="uicontrol" id="dli_01_0253__uicontrol1274112477320"><b>SQL Editor</b></span>, click <strong id="dli_01_0253__b19748144733213">Databases</strong> to see all databases. Click the database where the target table belongs. The table list is displayed.</li><li id="dli_01_0253__li2614201531">Click <span><img id="dli_01_0253__image12511124192410" src="en-us_image_0237990324.png"></span> on the right of the table and choose <strong id="dli_01_0253__b17511124172416">Import</strong> from the shortcut menu. The <span class="wintitle" id="dli_01_0253__wintitle8521424132418"><b>Import</b></span> page is displayed.<p id="dli_01_0253__p186911222355"></p>
|
||||
</li></ol>
|
||||
</li></ul>
|
||||
</p></li><li id="dli_01_0253__li88586820311"><span>In the <strong id="dli_01_0253__b1393765403">Import</strong> dialog box, set the parameters based on <a href="#dli_01_0253__table48581581434">Table 1</a>.</span><p>
|
||||
<div class="tablenoborder"><a name="dli_01_0253__table48581581434"></a><a name="table48581581434"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0253__table48581581434" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Description</caption><thead align="left"><tr id="dli_01_0253__row3843181339"><th align="left" class="cellrowborder" valign="top" width="20.3%" id="mcps1.3.4.2.2.2.1.2.4.1.1"><p id="dli_01_0253__p1984310813310">Parameter</p>
|
||||
<div class="tablenoborder"><a name="dli_01_0253__table48581581434"></a><a name="table48581581434"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0253__table48581581434" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter descriptions</caption><thead align="left"><tr id="dli_01_0253__row3843181339"><th align="left" class="cellrowborder" valign="top" width="20.3%" id="mcps1.3.4.2.2.2.1.2.4.1.1"><p id="dli_01_0253__p1984310813310">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="64.2%" id="mcps1.3.4.2.2.2.1.2.4.1.2"><p id="dli_01_0253__p884311813319">Description</p>
|
||||
</th>
|
||||
@ -35,7 +35,7 @@
|
||||
</tr>
|
||||
<tr id="dli_01_0253__row165786187388"><td class="cellrowborder" valign="top" width="20.3%" headers="mcps1.3.4.2.2.2.1.2.4.1.1 "><p id="dli_01_0253__p1465062213810">Queues</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="64.2%" headers="mcps1.3.4.2.2.2.1.2.4.1.2 "><p id="dli_01_0253__p5650622163818">Queue where the imported data will be used</p>
|
||||
<td class="cellrowborder" valign="top" width="64.2%" headers="mcps1.3.4.2.2.2.1.2.4.1.2 "><p id="dli_01_0253__p5650622163818">Select a queue.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="15.5%" headers="mcps1.3.4.2.2.2.1.2.4.1.3 "><p id="dli_01_0253__p12578518153815">-</p>
|
||||
</td>
|
||||
@ -50,9 +50,8 @@
|
||||
<tr id="dli_01_0253__row13845148639"><td class="cellrowborder" valign="top" width="20.3%" headers="mcps1.3.4.2.2.2.1.2.4.1.1 "><p id="dli_01_0253__p178451288318">Path</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="64.2%" headers="mcps1.3.4.2.2.2.1.2.4.1.2 "><p id="dli_01_0253__p15845286316">You can directly enter a path or click <span><img id="dli_01_0253__image108564914367" src="en-us_image_0206789903.png"></span> and select an OBS path. If no bucket is available, you can directly switch to the OBS management console and create an OBS bucket.</p>
|
||||
<ul id="dli_01_0253__ul1231712537815"><li id="dli_01_0253__li18100130185114"><strong id="dli_01_0253__b138585573617">When creating an OBS table, you must specify a folder as the directory. If a file is specified, data import may be failed.</strong></li><li id="dli_01_0253__li827292919521"><strong id="dli_01_0253__b12630137182">If a folder and a file have the same name in the OBS directory, the file path is preferred as the path of the data to be imported.</strong></li></ul>
|
||||
<div class="note" id="dli_01_0253__note3205452194215"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0253__p7205155219427">The path can be a file or folder.</p>
|
||||
</div></div>
|
||||
<p id="dli_01_0253__p125873272415">The path can be a file or folder.</p>
|
||||
<ul id="dli_01_0253__ul1231712537815"><li id="dli_01_0253__li18100130185114">When creating an OBS table, you must specify a folder as the directory. If a file is specified, data import will fail.</li><li id="dli_01_0253__li827292919521">When there are both a folder and a file with the same name in the OBS directory, importing data pointing to that path will prioritize the file over the folder.</li></ul>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="15.5%" headers="mcps1.3.4.2.2.2.1.2.4.1.3 "><p id="dli_01_0253__p14845158237">obs://DLI/sampledata.csv</p>
|
||||
</td>
|
||||
|
||||
@ -39,7 +39,7 @@
|
||||
<td class="cellrowborder" valign="top" width="32.54%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0318__p142517479419">createTable</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0318__row32519471449"><td class="cellrowborder" valign="top" width="34.93%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0318__p52554719419">Deleting tables</p>
|
||||
<tr id="dli_01_0318__row32519471449"><td class="cellrowborder" valign="top" width="34.93%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0318__p52554719419">Dropping a table</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="32.53%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0318__p925947145">table</p>
|
||||
</td>
|
||||
@ -396,8 +396,51 @@
|
||||
<td class="cellrowborder" valign="top" width="32.54%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0318__p73712471243">updateGlobalVariable</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0318__row888231332519"><td class="cellrowborder" valign="top" width="34.93%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0318__p5882413122512">Querying resources by enterprise project</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="32.53%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0318__p68821713182514">tms</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="32.54%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0318__p128820132259">tmsQueryResources</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0318__row16688485132"><td class="cellrowborder" valign="top" width="34.93%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0318__p166974881310">Creating an elastic resource pool</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="32.53%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0318__p569204818137">elasticresourcepool</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="32.54%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0318__p19695483132">createElasticResourcePool</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0318__row269948161314"><td class="cellrowborder" valign="top" width="34.93%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0318__p18695481133">Deleting an elastic resource pool</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="32.53%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0318__p116915482133">elasticresourcepool</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="32.54%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0318__p1069948151316">deleteElasticResourcePool</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0318__row2691448131313"><td class="cellrowborder" valign="top" width="34.93%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0318__p1070184891313">Updating an elastic resource pool</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="32.53%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0318__p1870148131319">elasticresourcepool</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="32.54%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0318__p370174831317">updateElasticResourcePool</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0318__row270144815138"><td class="cellrowborder" valign="top" width="34.93%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0318__p1470648101312">Binding a queue to an elastic resource pool</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="32.53%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0318__p15707487139">elasticresourcepool</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="32.54%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0318__p2070104811314">associateQueueToElasticResourcePool</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0318__row87094811317"><td class="cellrowborder" valign="top" width="34.93%" headers="mcps1.3.2.2.4.1.1 "><p id="dli_01_0318__p070184818135">Updating the queue properties of an elastic resource pool</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="32.53%" headers="mcps1.3.2.2.4.1.2 "><p id="dli_01_0318__p19701348191320">elasticresourcepool</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="32.54%" headers="mcps1.3.2.2.4.1.3 "><p id="dli_01_0318__p1370154817133">updateElasticResourcePoolQueuePriority</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
</div>
|
||||
<div></div>
|
||||
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@ -1,6 +1,6 @@
|
||||
<a name="dli_01_0363"></a><a name="dli_01_0363"></a>
|
||||
|
||||
<h1 class="topictitle1">Creating a Non-Elastic Resource Pool Queue (Discarded and Not Recommended)</h1>
|
||||
<h1 class="topictitle1">Creating a Non-Elastic Resource Pool Queue (Deprecated, Not Recommended)</h1>
|
||||
<div id="body1501038213757"><p id="dli_01_0363__p179621953184914">Queues in the non-elastic resource pool mode are the previous-gen of resource management for DLI. It involved purchasing and releasing resources based on usage demands, requiring estimation of resource needs before making purchases.</p>
|
||||
<p id="dli_01_0363__p87271510165015">Queues in an elastic resource pool are recommended, as they offer the flexibility to use resources with high utilization as needed. For how to buy an elastic resource pool and create queues within it, see <a href="dli_01_0505.html">Creating an Elastic Resource Pool and Creating Queues Within It</a>.</p>
|
||||
<div class="note" id="dli_01_0363__note1293204515206"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0363__ul17341756521"><li id="dli_01_0363__li1174985419502">If you use a sub-account to create a queue for the first time, log in to the DLI management console using the main account and keep records in the DLI database before creating a queue.</li><li id="dli_01_0363__li1373411525216">It takes 6 to 10 minutes for a job running on a new queue for the first time.</li><li id="dli_01_0363__li11343161015521">After a queue is created, if no job is run within one hour, the system releases the queue.</li><li id="dli_01_0363__li253742810428">Queues with 16 CUs do not support scale-out or scale-in.</li><li id="dli_01_0363__li6119202221710">Queues with 64 CUs do not support scale-in.</li></ul>
|
||||
@ -32,11 +32,11 @@
|
||||
</table>
|
||||
</div>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0363__section14223343145314"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0363__ol24716195296"><li id="dli_01_0363__li947220195291">You can create a queue on the <span class="wintitle" id="dli_01_0363__wintitle686912613315"><b>Overview</b></span>, <span class="wintitle" id="dli_01_0363__wintitle20869192623118"><b>SQL Editor</b></span>, or <span class="wintitle" id="dli_01_0363__wintitle18870626173120"><b>Queue Management</b></span> page.<ul id="dli_01_0363__ul435871517496"><li id="dli_01_0363__li1359201518491">In the upper right corner of the <strong id="dli_01_0363__b3686177172119">Overview</strong> page, click Create Queue.</li><li id="dli_01_0363__li8634112214911">To create a queue on the <span class="wintitle" id="dli_01_0363__wintitle1782046172416"><b>Queue Management</b></span> page:<ol type="a" id="dli_01_0363__ol1592205194915"><li id="dli_01_0363__li1059116511492">In the navigation pane on the left of the DLI management console, choose <strong id="dli_01_0363__b17602111461616">Resources</strong> > <strong id="dli_01_0363__b162311148201617">Queue Management</strong>.</li><li id="dli_01_0363__li759275184915">In the upper right corner of the <span class="wintitle" id="dli_01_0363__wintitle1629419173214"><b>Queue Management</b></span> page, click <strong id="dli_01_0363__b152951717182111">Create Queue</strong> to create a queue.</li></ol>
|
||||
</li><li id="dli_01_0363__li10613182974914">To create a queue on the <span class="wintitle" id="dli_01_0363__wintitle18993133744419"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0363__ol864692284913"><li id="dli_01_0363__li13646152224918">In the navigation pane of the DLI management console, click <span class="uicontrol" id="dli_01_0363__uicontrol1996404019456"><b>SQL Editor</b></span>.</li><li id="dli_01_0363__li1864613225498">Click <strong id="dli_01_0363__b39030518577">Queues</strong>. On the tab page displayed, click <span><img id="dli_01_0363__image654613242326" src="en-us_image_0237406526.png"></span> on the right to create a queue.</li></ol>
|
||||
<div class="section" id="dli_01_0363__section14223343145314"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0363__ol24716195296"><li id="dli_01_0363__li947220195291">You can create a queue on the <span class="wintitle" id="dli_01_0363__wintitle686912613315"><b>Overview</b></span>, <span class="wintitle" id="dli_01_0363__wintitle20869192623118"><b>SQL Editor</b></span>, or <span class="wintitle" id="dli_01_0363__wintitle18870626173120"><b>Queue Management</b></span> page.<ul id="dli_01_0363__ul435871517496"><li id="dli_01_0363__li1359201518491">In the upper right corner of the <strong id="dli_01_0363__b3686177172119">Overview</strong> page, click Create Queue.</li><li id="dli_01_0363__li8634112214911">To create a queue on the <span class="wintitle" id="dli_01_0363__wintitle1782046172416"><b>Queue Management</b></span> page:<ol type="a" id="dli_01_0363__ol1592205194915"><li id="dli_01_0363__li1059116511492">In the navigation pane on the left of the DLI management console, choose <strong id="dli_01_0363__b17602111461616">Resources</strong> > <strong id="dli_01_0363__b162311148201617">Queue Management</strong>.</li><li id="dli_01_0363__li759275184915">In the upper right corner of the <span class="wintitle" id="dli_01_0363__wintitle1629419173214"><b>Queue Management</b></span> page, click <strong id="dli_01_0363__b38170171255">Create Queue</strong> to create a queue.</li></ol>
|
||||
</li><li id="dli_01_0363__li10613182974914">To create a queue on the <span class="wintitle" id="dli_01_0363__wintitle18993133744419"><b>SQL Editor</b></span> page:<ol type="a" id="dli_01_0363__ol864692284913"><li id="dli_01_0363__li13646152224918">In the navigation pane on the left of the DLI management console, choose <strong id="dli_01_0363__b19193547153916">SQL Editor</strong>.</li><li id="dli_01_0363__li1864613225498">Click <strong id="dli_01_0363__b39030518577">Queues</strong>. On the tab page displayed, click <span><img id="dli_01_0363__image654613242326" src="en-us_image_0237406526.png"></span> on the right to create a queue.</li></ol>
|
||||
</li></ul>
|
||||
</li><li id="dli_01_0363__li1472111916293">On the <strong id="dli_01_0363__b1674113163515">Create Queue</strong> page displayed, set the parameters according to <a href="#dli_01_0363__table17301125219910">Table 2</a>.
|
||||
<div class="tablenoborder"><a name="dli_01_0363__table17301125219910"></a><a name="table17301125219910"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0363__table17301125219910" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Parameters</caption><thead align="left"><tr id="dli_01_0363__row112973522913"><th align="left" class="cellrowborder" valign="top" width="14.75%" id="mcps1.3.5.2.2.3.2.3.1.1"><p id="dli_01_0363__p17297145215918">Parameter</p>
|
||||
</li><li id="dli_01_0363__li1472111916293">On the <strong id="dli_01_0363__b1939220364252">Create Queue</strong> page displayed, set the parameters according to <a href="#dli_01_0363__table17301125219910">Table 2</a>.
|
||||
<div class="tablenoborder"><a name="dli_01_0363__table17301125219910"></a><a name="table17301125219910"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0363__table17301125219910" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Parameter descriptions</caption><thead align="left"><tr id="dli_01_0363__row112973522913"><th align="left" class="cellrowborder" valign="top" width="14.75%" id="mcps1.3.5.2.2.3.2.3.1.1"><p id="dli_01_0363__p17297145215918">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="85.25%" id="mcps1.3.5.2.2.3.2.3.1.2"><p id="dli_01_0363__p1229775212915">Description</p>
|
||||
</th>
|
||||
@ -45,7 +45,7 @@
|
||||
<tbody><tr id="dli_01_0363__row132972521295"><td class="cellrowborder" valign="top" width="14.75%" headers="mcps1.3.5.2.2.3.2.3.1.1 "><p id="dli_01_0363__p029718521495">Name</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="85.25%" headers="mcps1.3.5.2.2.3.2.3.1.2 "><p id="dli_01_0363__p192978528910">Queue name</p>
|
||||
<ul id="dli_01_0363__ul429710528910"><li id="dli_01_0363__li162973521797">Only numbers, letters, and underscores (_) are allowed. The value cannot contain only numbers, start with an underscore (_), or be left unspecified.</li><li id="dli_01_0363__li12978521191">The value can contain a maximum of 128 characters.</li></ul>
|
||||
<ul id="dli_01_0363__ul429710528910"><li id="dli_01_0363__li162973521797">Only digits, letters, and underscores (_) are allowed. The value cannot contain only digits, start with an underscore (_), or be left unspecified.</li><li id="dli_01_0363__li12978521191">The value can contain a maximum of 128 characters.</li></ul>
|
||||
<div class="note" id="dli_01_0363__note13297452697"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p192979529919">The queue name is case-insensitive. Uppercase letters will be automatically converted to lowercase letters.</p>
|
||||
</div></div>
|
||||
</td>
|
||||
@ -81,9 +81,9 @@
|
||||
<td class="cellrowborder" valign="top" width="85.25%" headers="mcps1.3.5.2.2.3.2.3.1.2 "><p id="dli_01_0363__p7662154145213">Tags used to identify cloud resources. A tag includes the tag key and tag value. If you want to use the same tag to identify multiple cloud resources, that is, to select the same tag from the drop-down list box for all services, you are advised to create predefined tags on the Tag Management Service (TMS).</p>
|
||||
<div class="note" id="dli_01_0363__note15300105218914"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0363__ul1830018521911"><li id="dli_01_0363__li186815313365">A maximum of 20 tags can be added.</li><li id="dli_01_0363__li183008521591">Only one tag value can be added to a tag key.</li><li id="dli_01_0363__li14484164661614">The key name in each resource must be unique.</li></ul>
|
||||
</div></div>
|
||||
<ul id="dli_01_0363__ul1300052697"><li id="dli_01_0363__li5300952598">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0363__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, numbers, spaces, and special characters (_.:+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0363__b544594615499">_sys_</strong>.</p>
|
||||
<ul id="dli_01_0363__ul1300052697"><li id="dli_01_0363__li5300952598">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0363__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0363__b544594615499">_sys_</strong>.</p>
|
||||
</div></div>
|
||||
</li><li id="dli_01_0363__li730019524916">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0363__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, numbers, spaces, and special characters (_.:+-@) are allowed.</p>
|
||||
</li><li id="dli_01_0363__li730019524916">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0363__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0363__p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, digits, spaces, and special characters (_.:+-@) are allowed.</p>
|
||||
</div></div>
|
||||
</li></ul>
|
||||
</td>
|
||||
@ -99,7 +99,7 @@
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0508.html">Creating an Elastic Resource Pool and Queues Within It</a></div>
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0508.html">Creating an Elastic Resource Pool and Creating Queues Within It</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
@ -7,7 +7,7 @@
|
||||
<div class="section" id="dli_01_0367__section18887174943920"><h4 class="sectiontitle">Prerequisites</h4><p id="dli_01_0367__p420613556395">All software packages must be uploaded to OBS for storage in advance.</p>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_section14223343145314"><h4 class="sectiontitle">Procedure</h4><ol id="dli_01_0367__ol172795412248"><li id="dli_01_0367__li0727165414248">On the left of the management console, choose <span class="uicontrol" id="dli_01_0367__uicontrol155446476912"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0367__uicontrol1252865218920"><b>Package Management</b></span>.</li><li id="dli_01_0367__li13727135411249">On the <span class="wintitle" id="dli_01_0367__wintitle196674031013"><b>Package Management</b></span> page, click <strong id="dli_01_0367__b14725441019">Create</strong> in the upper right corner to create a package.</li><li id="dli_01_0367__li10728165402418">In the displayed <span class="wintitle" id="dli_01_0367__wintitle11408195612575"><b>Create Package</b></span> dialog box, set related parameters by referring to <a href="#dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_table19616613171536">Table 1</a>.
|
||||
<div class="tablenoborder"><a name="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_table19616613171536"></a><a name="en-us_topic_0122016946_en-us_topic_0093946917_table19616613171536"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_table19616613171536" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter description</caption><thead align="left"><tr id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_row15177266171536"><th align="left" class="cellrowborder" valign="top" width="16.32%" id="mcps1.3.4.2.3.3.2.3.1.1"><p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p5976489517160">Parameter</p>
|
||||
<div class="tablenoborder"><a name="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_table19616613171536"></a><a name="en-us_topic_0122016946_en-us_topic_0093946917_table19616613171536"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_table19616613171536" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter descriptions</caption><thead align="left"><tr id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_row15177266171536"><th align="left" class="cellrowborder" valign="top" width="16.32%" id="mcps1.3.4.2.3.3.2.3.1.1"><p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p5976489517160">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="83.67999999999999%" id="mcps1.3.4.2.3.3.2.3.1.2"><p id="dli_01_0367__en-us_topic_0122016946_en-us_topic_0093946917_p911830717160">Description</p>
|
||||
</th>
|
||||
@ -44,10 +44,10 @@
|
||||
<td class="cellrowborder" valign="top" width="83.67999999999999%" headers="mcps1.3.4.2.3.3.2.3.1.2 "><p id="dli_01_0367__p52841736202320">Tags used to identify cloud resources. A tag includes the tag key and tag value. If you want to use the same tag to identify multiple cloud resources, that is, to select the same tag from the drop-down list box for all services, you are advised to create predefined tags on the Tag Management Service (TMS).</p>
|
||||
<div class="note" id="dli_01_0367__note647119469162"><span class="notetitle"> NOTE: </span><div class="notebody"><ul id="dli_01_0367__dli_01_0363_ul1830018521911"><li id="dli_01_0367__dli_01_0363_li186815313365">A maximum of 20 tags can be added.</li><li id="dli_01_0367__dli_01_0363_li183008521591">Only one tag value can be added to a tag key.</li><li id="dli_01_0367__dli_01_0363_li14484164661614">The key name in each resource must be unique.</li></ul>
|
||||
</div></div>
|
||||
<ul id="dli_01_0367__ul6617123554815"><li id="dli_01_0367__li9617123518481">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0367__note18617135124816"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0367__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, numbers, spaces, and special characters (_.:+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0367__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
||||
<ul id="dli_01_0367__ul6617123554815"><li id="dli_01_0367__li9617123518481">Tag key: Enter a tag key name in the text box.<div class="note" id="dli_01_0367__note18617135124816"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0367__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0367__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
||||
</div></div>
|
||||
</li></ul>
|
||||
<ul id="dli_01_0367__ul16911451899"><li id="dli_01_0367__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0367__note86179355480"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0367__dli_01_0363_p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, numbers, spaces, and special characters (_.:+-@) are allowed.</p>
|
||||
<ul id="dli_01_0367__ul16911451899"><li id="dli_01_0367__li26911851193">Tag value: Enter a tag value in the text box.<div class="note" id="dli_01_0367__note86179355480"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0367__dli_01_0363_p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, digits, spaces, and special characters (_.:+-@) are allowed.</p>
|
||||
</div></div>
|
||||
</li></ul>
|
||||
</td>
|
||||
|
||||
@ -13,10 +13,10 @@
|
||||
<tbody><tr id="dli_01_0369__row13417154613164"><td class="cellrowborder" valign="top" width="12.94%" headers="mcps1.3.3.4.2.2.3.1.1 "><p id="dli_01_0369__p74201346111616">Tag key</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="87.06%" headers="mcps1.3.3.4.2.2.3.1.2 "><p id="dli_01_0369__p642018464167">You can specify the tag key in either of the following ways:</p>
|
||||
<ul id="dli_01_0369__ul6423144611162"><li id="dli_01_0369__li14251946151610">Click the text box and select a predefined tag key from the drop-down list.<p id="dli_01_0369__p12169132323510"><a name="dli_01_0369__li14251946151610"></a><a name="li14251946151610"></a>To add a predefined tag, you need to create one on TMS and then select it from the tag key drop-down list. You can click <strong id="dli_01_0369__b493974583811">View predefined tags</strong> to go to the <strong id="dli_01_0369__b19939145203820">Predefined Tags</strong> page of the TMS console. Then, click <strong id="dli_01_0369__b1093911456383">Create Tag</strong> in the upper corner of the page to create a predefined tag.</p>
|
||||
<ul id="dli_01_0369__ul6423144611162"><li id="dli_01_0369__li14251946151610">Click the text box and select a predefined tag key from the drop-down list.<p id="dli_01_0369__p12169132323510"><a name="dli_01_0369__li14251946151610"></a><a name="li14251946151610"></a>To add a predefined tag, you need to create one on TMS and then select it from the <span class="parmname" id="dli_01_0369__parmname1314811551015"><b>Tag key</b></span> drop-down list. You can click <strong id="dli_01_0369__b493974583811">View predefined tags</strong> to go to the <strong id="dli_01_0369__b19939145203820">Predefined Tags</strong> page of the TMS console. Then, click <strong id="dli_01_0369__b1093911456383">Create Tag</strong> in the upper corner of the page to create a predefined tag.</p>
|
||||
<p id="dli_01_0369__p1926211187356"></p>
|
||||
</li></ul>
|
||||
<ul id="dli_01_0369__ul643911462165"><li id="dli_01_0369__li7441146181612">Enter a tag key in the text box.<div class="note" id="dli_01_0369__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0369__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, numbers, spaces, and special characters (_.:+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0369__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
||||
<ul id="dli_01_0369__ul643911462165"><li id="dli_01_0369__li7441146181612">Enter a tag key in the text box.<div class="note" id="dli_01_0369__note206961611105313"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0369__dli_01_0363_p1448010306508">A tag key can contain a maximum of 128 characters. Only letters, digits, spaces, and special characters (_.:+-@) are allowed, but the value cannot start or end with a space or start with <strong id="dli_01_0369__dli_01_0363_b544594615499">_sys_</strong>.</p>
|
||||
</div></div>
|
||||
</li></ul>
|
||||
</td>
|
||||
@ -24,7 +24,7 @@
|
||||
<tr id="dli_01_0369__row645064691617"><td class="cellrowborder" valign="top" width="12.94%" headers="mcps1.3.3.4.2.2.3.1.1 "><p id="dli_01_0369__p345210468163">Tag value</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="87.06%" headers="mcps1.3.3.4.2.2.3.1.2 "><p id="dli_01_0369__p1545619468165">You can specify the tag value in either of the following ways:</p>
|
||||
<ul id="dli_01_0369__ul1045720469162"><li id="dli_01_0369__li545914661612">Click the text box and select a predefined tag value from the drop-down list.</li><li id="dli_01_0369__li184611546101610">Enter a tag value in the text box.<div class="note" id="dli_01_0369__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0369__dli_01_0363_p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, numbers, spaces, and special characters (_.:+-@) are allowed.</p>
|
||||
<ul id="dli_01_0369__ul1045720469162"><li id="dli_01_0369__li545914661612">Click the text box and select a predefined tag value from the drop-down list.</li><li id="dli_01_0369__li184611546101610">Enter a tag value in the text box.<div class="note" id="dli_01_0369__note11572532152719"><span class="notetitle"> NOTE: </span><div class="notebody"><p id="dli_01_0369__dli_01_0363_p4702194215507">A tag value can contain a maximum of 255 characters. Only letters, digits, spaces, and special characters (_.:+-@) are allowed.</p>
|
||||
</div></div>
|
||||
</li></ul>
|
||||
</td>
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@ -2,7 +2,7 @@
|
||||
|
||||
<h1 class="topictitle1">Changing the Database Owner on the DLI Console</h1>
|
||||
<div id="body1569491496985"><p id="dli_01_0376__p7729122613405">In practical use, developers create databases and tables, which are then handed over to testers for testing. Once testing is complete, the databases and tables are handed over to O&M personnel for experience. In this scenario, ownership of the data can be transferred to another owner by changing the database owner.</p>
|
||||
<div class="section" id="dli_01_0376__section48746710711"><h4 class="sectiontitle">Changing the Database Owner</h4><div class="p" id="dli_01_0376__p17554192016499">You can change the owner of a database on either the <span class="wintitle" id="dli_01_0376__wintitle112031233219"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0376__wintitle112037333118"><b>SQL Editor</b></span> page.<ul id="dli_01_0376__ul10405142364818"><li id="dli_01_0376__li2040592311485">On the <span class="wintitle" id="dli_01_0376__wintitle1588611347119"><b>Data Management</b></span> page, change the database owner.<ol id="dli_01_0376__ol153397745813"><li id="dli_01_0376__li182443471248">On the left of the management console, choose <span class="uicontrol" id="dli_01_0376__uicontrol14267241951"><b>Data Management</b></span> > <span class="uicontrol" id="dli_01_0376__uicontrol226424355"><b>Databases and Tables</b></span>.</li><li id="dli_01_0376__li1924517478247">On the <span class="wintitle" id="dli_01_0376__wintitle25814432053"><b>Databases and Tables</b></span> page, locate the database you want and click <strong id="dli_01_0376__b029313718312">More</strong> > <span class="uicontrol" id="dli_01_0376__uicontrol119711541751"><b>Modify Database</b></span> in the <strong id="dli_01_0376__b829315585512">Operation</strong> column.</li><li id="dli_01_0376__li1979150165815">In the displayed dialog box, enter a new owner name (an existing username) and click <span class="uicontrol" id="dli_01_0376__uicontrol3175153914115"><b>OK</b></span>.</li></ol>
|
||||
<div class="section" id="dli_01_0376__section48746710711"><h4 class="sectiontitle">Changing the Database Owner</h4><div class="p" id="dli_01_0376__p17554192016499">You can change the owner of a database on either the <span class="wintitle" id="dli_01_0376__wintitle112031233219"><b>Data Management</b></span> page or the <span class="wintitle" id="dli_01_0376__wintitle112037333118"><b>SQL Editor</b></span> page.<ul id="dli_01_0376__ul10405142364818"><li id="dli_01_0376__li2040592311485">On the <span class="wintitle" id="dli_01_0376__wintitle1588611347119"><b>Data Management</b></span> page, change the database owner.<ol id="dli_01_0376__ol153397745813"><li id="dli_01_0376__li182443471248">In the navigation pane on the left of the console, choose <strong id="dli_01_0376__b135771332672">Data Management</strong> > <strong id="dli_01_0376__b3577123218710">Databases and Tables</strong>.</li><li id="dli_01_0376__li1924517478247">On the <span class="wintitle" id="dli_01_0376__wintitle25814432053"><b>Databases and Tables</b></span> page, locate the database you want and click <strong id="dli_01_0376__b029313718312">More</strong> > <span class="uicontrol" id="dli_01_0376__uicontrol119711541751"><b>Modify Database</b></span> in the <strong id="dli_01_0376__b829315585512">Operation</strong> column.</li><li id="dli_01_0376__li1979150165815">In the displayed <strong id="dli_01_0376__b1361294142219">Modify Owner</strong> dialog box, enter a new owner name (an existing username) and click <strong id="dli_01_0376__b1961364117223">OK</strong>.</li></ol>
|
||||
</li><li id="dli_01_0376__li10384371151118">Change the database owner on the <span class="wintitle" id="dli_01_0376__wintitle1853761213618"><b>SQL Editor</b></span> page.<ol id="dli_01_0376__ol39382464151459"><li id="dli_01_0376__li169951648123920">On the left of the management console, click <strong id="dli_01_0376__b198591277618">SQL Editor</strong>.</li><li id="dli_01_0376__li1773513617043">In the navigation tree on the left, click <strong id="dli_01_0376__b71971655102315">Databases</strong>, click <span><img id="dli_01_0376__image819875518239" src="en-us_image_0237984360.png"></span> on the right of the database you want to modify, and choose <strong id="dli_01_0376__b21982055122314">Modify Database</strong> from the shortcut menu.</li><li id="dli_01_0376__li0998173818546">In the displayed dialog box, enter a new owner name (an existing username) and click <span class="uicontrol" id="dli_01_0376__uicontrol1952613461213"><b>OK</b></span>.</li></ol>
|
||||
</li></ul>
|
||||
</div>
|
||||
|
||||
@ -21,7 +21,7 @@
|
||||
</ul>
|
||||
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0389.html">Submitting a Flink Job Using DLI</a></div>
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0389.html">Submitting a Flink Job on the DLI Management Console</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@ -9,7 +9,7 @@
|
||||
</div>
|
||||
<div class="section" id="dli_01_0379__section733182634316"><h4 class="sectiontitle">Prerequisites</h4><p id="dli_01_0379__p16611122532011">Before the configuration, create an OBS bucket or parallel file system (PFS). In big data scenarios, you are advised to create a PFS. PFS is a high-performance file system provided by OBS, with access latency in milliseconds. PFS can achieve a bandwidth performance of up to TB/s and millions of IOPS, which makes it ideal for processing high-performance computing (HPC) workloads.</p>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0379__section26141553165620"><h4 class="sectiontitle">Configuring a Bucket for DLI Jobs</h4><ol id="dli_01_0379__ol3466216175716"><li id="dli_01_0379__li1216717496572">In the navigation pane of the DLI console, choose <strong id="dli_01_0379__b97932310341">Global Configuration</strong> > <strong id="dli_01_0379__b1979373163416">Project</strong>.</li><li id="dli_01_0379__li11674105415712">On the <strong id="dli_01_0379__b822073012210">Project</strong> page, click <span><img id="dli_01_0379__image1722163014213" src="en-us_image_0000001995796834.png"></span> next to <strong id="dli_01_0379__b132213301820">Job Bucket</strong> to configure bucket information.</li><li id="dli_01_0379__li10719540416">Click <span><img id="dli_01_0379__image744954619597" src="en-us_image_0000002032236253.png"></span> to view available buckets.</li><li id="dli_01_0379__li1058412263820">In the displayed <strong id="dli_01_0379__b1461112401012">OBS</strong> dialog box, click the name of a bucket or search for and click a bucket name and then click <strong id="dli_01_0379__b1536218110318">OK</strong>. In the <strong id="dli_01_0379__b966982915110">Set Job Bucket</strong> dialog box, click <strong id="dli_01_0379__b1087118171117">OK</strong>.<p id="dli_01_0379__p11790738382">Temporary data generated during DLI job running will be stored in the OBS bucket.</p>
|
||||
<div class="section" id="dli_01_0379__section26141553165620"><h4 class="sectiontitle">Configuring a Bucket for DLI Jobs</h4><ol id="dli_01_0379__ol3466216175716"><li id="dli_01_0379__li1216717496572">In the navigation pane of the DLI console, choose <strong id="dli_01_0379__b97932310341">Global Configuration</strong> > <strong id="dli_01_0379__b1979373163416">Project</strong>.</li><li id="dli_01_0379__li11674105415712">On the <strong id="dli_01_0379__b822073012210">Project</strong> page, click <span><img id="dli_01_0379__image1722163014213" src="en-us_image_0000001995796834.png" title="Click to enlarge" class="imgResize"></span> next to <strong id="dli_01_0379__b132213301820">Job Bucket</strong> to configure bucket information.</li><li id="dli_01_0379__li10719540416">Click <span><img id="dli_01_0379__image744954619597" src="en-us_image_0000002032236253.png"></span> to view available buckets.</li><li id="dli_01_0379__li1058412263820">In the displayed <strong id="dli_01_0379__b1461112401012">OBS</strong> dialog box, click the name of a bucket or search for and click a bucket name and then click <strong id="dli_01_0379__b1536218110318">OK</strong>. In the <strong id="dli_01_0379__b966982915110">Set Job Bucket</strong> dialog box, click <strong id="dli_01_0379__b1087118171117">OK</strong>.<p id="dli_01_0379__p11790738382">Temporary data generated during DLI job running will be stored in the OBS bucket.</p>
|
||||
</li></ol>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0379__section1218555864210"><h4 class="sectiontitle">Querying Logs for Spark Jobs</h4><ol id="dli_01_0379__ol11681726194811"><li id="dli_01_0379__li41681726154813">Log in to the DLI console. In the navigation pane on the left, choose <strong id="dli_01_0379__b15924157129">Job Management</strong> > <strong id="dli_01_0379__b192418591216">Spark Jobs</strong>.</li><li id="dli_01_0379__li141685261489">Select the Spark job whose jobs you want to query, click <strong id="dli_01_0379__b15948215144">More</strong> in the <strong id="dli_01_0379__b1379512511144">Operation</strong> column, and select <strong id="dli_01_0379__b97541146121510">View Log</strong>.<p id="dli_01_0379__p47726278482">The system automatically switches to the log path of the DLI job bucket.</p>
|
||||
@ -18,7 +18,14 @@
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0465.html">Submitting a Spark Job Using DLI</a></div>
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0465.html">Submitting a Spark Job on the DLI Management Console</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
<script language="JavaScript">
|
||||
<!--
|
||||
image_size('.imgResize');
|
||||
var msg_imageMax = "view original image";
|
||||
var msg_imageClose = "close";
|
||||
//--></script>
|
||||
File diff suppressed because it is too large
Load Diff
@ -1,7 +1,7 @@
|
||||
<a name="dli_01_0385"></a><a name="dli_01_0385"></a>
|
||||
|
||||
<h1 class="topictitle1">Managing Spark Jobs</h1>
|
||||
<div id="body8662426"><div class="section" id="dli_01_0385__section12526165519235"><h4 class="sectiontitle">Viewing Basic Information</h4><p id="dli_01_0385__en-us_topic_0122090417_p66482014175614">On the <strong id="dli_01_0385__b12378211295">Overview</strong> page, click <strong id="dli_01_0385__b33842119911">Spark Jobs</strong> to go to the SQL job management page. Alternatively, you can click <strong id="dli_01_0385__b14384815912">Job Management</strong> > <strong id="dli_01_0385__b203841011191">Spark Jobs</strong>. The page displays all Spark jobs. If there are a large number of jobs, they will be displayed on multiple pages. DLI allows you to view jobs in all statuses.</p>
|
||||
<div id="body8662426"><div class="section" id="dli_01_0385__section12526165519235"><a name="dli_01_0385__section12526165519235"></a><a name="section12526165519235"></a><h4 class="sectiontitle">Viewing Basic Information</h4><p id="dli_01_0385__en-us_topic_0122090417_p66482014175614">On the <strong id="dli_01_0385__b12378211295">Overview</strong> page, click <strong id="dli_01_0385__b33842119911">Spark Jobs</strong> to go to the SQL job management page. Alternatively, you can click <strong id="dli_01_0385__b14384815912">Job Management</strong> > <strong id="dli_01_0385__b203841011191">Spark Jobs</strong>. The page displays all Spark jobs. If there are a large number of jobs, they will be displayed on multiple pages. DLI allows you to view jobs in all statuses.</p>
|
||||
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0385__en-us_topic_0122090417_table3950169215120" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Job management parameters</caption><thead align="left"><tr id="dli_01_0385__en-us_topic_0122090417_row2555468715120"><th align="left" class="cellrowborder" valign="top" width="16.07%" id="mcps1.3.1.3.2.3.1.1"><p id="dli_01_0385__en-us_topic_0122090417_p4021197415120">Parameter</p>
|
||||
</th>
|
||||
@ -65,7 +65,7 @@
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0465.html">Submitting a Spark Job Using DLI</a></div>
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0465.html">Submitting a Spark Job on the DLI Management Console</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
@ -1,6 +1,6 @@
|
||||
<a name="dli_01_0389"></a><a name="dli_01_0389"></a>
|
||||
|
||||
<h1 class="topictitle1">Submitting a Flink Job Using DLI</h1>
|
||||
<h1 class="topictitle1">Submitting a Flink Job on the DLI Management Console</h1>
|
||||
<div id="body1536287138300"></div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
|
||||
@ -1,15 +1,17 @@
|
||||
<a name="dli_01_0390"></a><a name="dli_01_0390"></a>
|
||||
|
||||
<h1 class="topictitle1">Creating Databases and Tables</h1>
|
||||
<h1 class="topictitle1">Creating a Data Directory, Database, and Table</h1>
|
||||
<div id="body1536287138300"></div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0228.html">Understanding Data Catalogs, Databases, and Tables</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0005.html">Creating a Database and Table on the DLI Console</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0005.html">Creating a Data Catalog, Database, and Table on the DLI Console</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0008.html">Viewing Table Metadata</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0671.html">Managing Data Catalogs on the DLI Console</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0004.html">Managing Database Resources on the DLI Console</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0625.html">Managing Table Resources on the DLI Console</a></strong><br>
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@ -1,6 +1,6 @@
|
||||
<a name="dli_01_0402"></a><a name="dli_01_0402"></a>
|
||||
|
||||
<h1 class="topictitle1">Submitting a SQL Job Using DLI</h1>
|
||||
<h1 class="topictitle1">Submitting a SQL Job on the DLI Management Console</h1>
|
||||
<div id="body1543369643806"></div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
@ -8,6 +8,8 @@
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0621.html">Exporting SQL Job Results</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0612.html">Creating a SQL Inspection Rule</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0535.html">Setting the Priority for a SQL Job</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0637.html">Querying Logs for SQL Jobs</a></strong><br>
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
</div>
|
||||
<div>
|
||||
<div class="familylinks">
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0389.html">Submitting a Flink Job Using DLI</a></div>
|
||||
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_01_0389.html">Submitting a Flink Job on the DLI Management Console</a></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
@ -3,9 +3,9 @@
|
||||
<h1 class="topictitle1">Package Management Overview</h1>
|
||||
<div id="body1544008491695"><p id="dli_01_0407__p951462445812">Before running DLI jobs, UDF JAR files or Jar job packages need to be uploaded to the cloud platform for unified management and maintenance.</p>
|
||||
<p id="dli_01_0407__p981823717114">There are two ways to manage packages:</p>
|
||||
<ul id="dli_01_0407__ul42382103512"><li id="dli_01_0407__li088919108355">(Recommended) Upload packages to OBS: Upload Jar packages to an OBS bucket in advance and select the OBS path when configuring a job.</li><li id="dli_01_0407__li1943193611359">Upload packages to DLI: Upload Jar packages to an OBS bucket in advance, create a package on the <strong id="dli_01_0407__b867110189202">Data Management</strong> > <strong id="dli_01_0407__b178028398208">Package Management</strong> page of the DLI management console, and select the DLI package when configuring a job.</li></ul>
|
||||
<ul id="dli_01_0407__ul42382103512"><li id="dli_01_0407__li088919108355">(Recommended) Upload packages to OBS: Upload Jar packages to an OBS bucket in advance and select the OBS path when configuring a job.</li><li id="dli_01_0407__li1943193611359">The DLI package function will soon be discontinued. Upload packages to DLI: Upload Jar packages to an OBS bucket in advance, create a package on the <strong id="dli_01_0407__b1763245414716">Data Management</strong> > <strong id="dli_01_0407__b363219542071">Package Management</strong> page of the DLI management console, and select the DLI package when configuring a job.</li></ul>
|
||||
<p id="dli_01_0407__p1220364215347">This section describes how to upload and manage packages on the DLI management console.</p>
|
||||
<div class="note" id="dli_01_0407__note767611358420"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0407__ul6826150175"><li id="dli_01_0407__li1040215208719">When using Spark 3.3.1 or later or Flink1.15 or later to run jobs, you are advised to select packages stored in OBS.</li><li id="dli_01_0407__li1065219421711">When packaging Spark or Flink Jar jobs, do not upload the dependency packages that the platform already has to avoid conflicts with the built-in dependency packages of the platform. Refer to <a href="dli_01_0397.html">DLI Built-in Dependencies</a> for built-in dependency packages.</li></ul>
|
||||
<div class="note" id="dli_01_0407__note767611358420"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0407__ul6826150175"><li id="dli_01_0407__li1040215208719">The DLI package function will soon be discontinued. When using Spark 3.3.1 or later or Flink 1.15 or later to run jobs, you are advised to select packages stored in OBS.</li><li id="dli_01_0407__li1065219421711">When packaging Spark or Flink Jar jobs, do not upload the dependency packages that the platform already has to avoid conflicts with the built-in dependency packages of the platform. Refer to <a href="dli_01_0397.html">DLI Built-in Dependencies</a> for built-in dependency packages.</li></ul>
|
||||
</div></div>
|
||||
<div class="section" id="dli_01_0407__section194110185420"><h4 class="sectiontitle">Notes and Constraints</h4>
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0407__table152937675014" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Notes and constraints on package usage</caption><thead align="left"><tr id="dli_01_0407__dli_07_0005_row1591613875014"><th align="left" class="cellrowborder" valign="top" width="23.990000000000002%" id="mcps1.3.6.2.2.3.1.1"><p id="dli_01_0407__dli_07_0005_p135041019105018">Item</p>
|
||||
|
||||
@ -1,18 +1,17 @@
|
||||
<a name="dli_01_0408"></a><a name="dli_01_0408"></a>
|
||||
|
||||
<h1 class="topictitle1">Permissions Management</h1>
|
||||
<div id="body1544671596630"></div>
|
||||
<h1 class="topictitle1">DLI Permission Management</h1>
|
||||
<div id="body0000002308371126"><p id="dli_01_0408__p8060118"></p>
|
||||
</div>
|
||||
<div>
|
||||
<ul class="ullinks">
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0440.html">Overview</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0440.html">Overview of the DLI Permission System</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0451.html">Creating a Custom Policy</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0689.html">DLI Permission Management</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0417.html">DLI Resources</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0475.html">IAM Permission Management</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0475.html">DLI Request Conditions</a></strong><br>
|
||||
</li>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0441.html">Common Operations Supported by DLI System Policy</a></strong><br>
|
||||
<li class="ulchildlink"><strong><a href="dli_01_0695.html">Example Use Case: Creating a User Group and Granting Permissions for Using DLI Elastic Resource Pools and Databases</a></strong><br>
|
||||
</li>
|
||||
</ul>
|
||||
</div>
|
||||
|
||||
@ -6,7 +6,7 @@
|
||||
</div>
|
||||
<div class="section" id="dli_01_0410__section17130115116195"><h4 class="sectiontitle">Notes</h4><ul id="dli_01_0410__ul571971214216"><li id="dli_01_0410__li1371901292119">Flink jobs can directly access DIS, OBS, and SMN data sources without using datasource connections.</li><li id="dli_01_0410__li167197122213">You are advised to use enhanced datasource connections to connect DLI to data sources.</li></ul>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0410__section3279182415532"><h4 class="sectiontitle">DLI Supported Data Sources</h4><p id="dli_01_0410__p19826240125720"><a href="#dli_01_0410__table1771918377534">Table 1</a> lists the data sources supported by DLI. For how to use the data sources, see the <em id="dli_01_0410__i6759525164318">Data Lake Insight SQL Syntax Reference</em>.</p>
|
||||
<div class="section" id="dli_01_0410__section3279182415532"><h4 class="sectiontitle">DLI Supported Data Sources</h4><p id="dli_01_0410__p19826240125720"><a href="#dli_01_0410__table1771918377534">Table 1</a> lists the data sources supported by DLI. For how to use the data sources, see <em id="dli_01_0410__i6759525164318">Data Lake Insight SQL Syntax Reference</em>.</p>
|
||||
|
||||
<div class="tablenoborder"><a name="dli_01_0410__table1771918377534"></a><a name="table1771918377534"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0410__table1771918377534" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Supported data sources</caption><thead align="left"><tr id="dli_01_0410__row1671953725316"><th align="left" class="cellrowborder" valign="top" width="22.75%" id="mcps1.3.3.3.2.6.1.1"><p id="dli_01_0410__p1010013484111">Service</p>
|
||||
</th>
|
||||
@ -64,7 +64,7 @@
|
||||
<td class="cellrowborder" valign="top" width="19.23%" headers="mcps1.3.3.3.2.6.1.5 "><p id="dli_01_0410__p2072113376532">√</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0410__row19721537165316"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.3.2.6.1.1 "><p id="dli_01_0410__p9721113717537">DMS Kafka</p>
|
||||
<tr id="dli_01_0410__row19721537165316"><td class="cellrowborder" valign="top" width="22.75%" headers="mcps1.3.3.3.2.6.1.1 "><p id="dli_01_0410__p9721113717537">DMS for Kafka</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="19.11%" headers="mcps1.3.3.3.2.6.1.2 "><p id="dli_01_0410__p19721337155311">x</p>
|
||||
</td>
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@ -1,19 +1,54 @@
|
||||
<a name="dli_01_0418"></a><a name="dli_01_0418"></a>
|
||||
|
||||
<h1 class="topictitle1">Creating an IAM User and Granting Permissions</h1>
|
||||
<div id="body1557992073881"><p id="dli_01_0418__p1843116365528">You can use Identity and Access Management (IAM) to implement fine-grained permissions control on DLI resources. For details, see <a href="dli_01_0440.html">Overview</a>.</p>
|
||||
<div id="body1557992073881"><p id="dli_01_0418__p1843116365528">You can use Identity and Access Management (IAM) to implement fine-grained permissions management for your DLI resources. For details, see <a href="dli_01_0417.html">Overview</a>.</p>
|
||||
<p id="dli_01_0418__p1316316443569">If your cloud account does not need individual IAM users, then you may skip over this section.</p>
|
||||
<p id="dli_01_0418__p19117754135713">This section describes how to create an IAM user and grant DLI permissions to the user. <a href="#dli_01_0418__fig4118155455715">Figure 1</a> shows the procedure.</p>
|
||||
<div class="section" id="dli_01_0418__section3299192113013"><h4 class="sectiontitle">Prerequisites</h4><p id="dli_01_0418__p13734854619">Before assigning permissions to user groups, you should learn about system policies and select the policies based on service requirements. For details about system permissions supported by DLI, see <a href="dli_01_0440.html#dli_01_0440__section6224422143120">DLI System Permissions</a>.</p>
|
||||
<div class="section" id="dli_01_0418__section3299192113013"><h4 class="sectiontitle">Prerequisites</h4><p id="dli_01_0418__p6352239390">Before granting permissions to a user group, familiarize yourself with the DLI permissions that can be added to the user group and select them as needed.</p>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0418__section63665495717"><h4 class="sectiontitle">Process Flow</h4><div class="fignone" id="dli_01_0418__fig4118155455715"><a name="dli_01_0418__fig4118155455715"></a><a name="fig4118155455715"></a><span class="figcap"><b>Figure 1 </b>Process for granting DLI permissions</span><br><span><img id="dli_01_0418__en-us_topic_0000001489537442_image35161382273" src="en-us_image_0000002415789969.png" title="Click to enlarge" class="imgResize"></span></div>
|
||||
|
||||
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0418__table1644485592820" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Procedure</caption><thead align="left"><tr id="dli_01_0418__row1844465582811"><th align="left" class="cellrowborder" valign="top" width="15.02%" id="mcps1.3.5.3.2.4.1.1"><p id="dli_01_0418__p1844425520287">No.</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="25.7%" id="mcps1.3.5.3.2.4.1.2"><p id="dli_01_0418__p5445755152811">Step</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="59.28%" id="mcps1.3.5.3.2.4.1.3"><p id="dli_01_0418__p1044525516280">Description</p>
|
||||
</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody><tr id="dli_01_0418__row194453557288"><td class="cellrowborder" valign="top" width="15.02%" headers="mcps1.3.5.3.2.4.1.1 "><p id="dli_01_0418__p11445655162818">1</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="25.7%" headers="mcps1.3.5.3.2.4.1.2 "><p id="dli_01_0418__p106611213311">Create a user group and grant permissions to it.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="59.28%" headers="mcps1.3.5.3.2.4.1.3 "><p id="dli_01_0418__p5445135592819">Create a user group on the IAM console and grant the <strong id="dli_01_0418__b1173413506810">DLI ReadOnlyAccess</strong> permission to it.</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0418__row74455551282"><td class="cellrowborder" valign="top" width="15.02%" headers="mcps1.3.5.3.2.4.1.1 "><p id="dli_01_0418__p12445355112813">2</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="25.7%" headers="mcps1.3.5.3.2.4.1.2 "><p id="dli_01_0418__p193821693310">Create a user and add them to the user group.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="59.28%" headers="mcps1.3.5.3.2.4.1.3 "><p id="dli_01_0418__p14453559287">Create a user on the IAM console and add them to the created user group.</p>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0418__row194451552286"><td class="cellrowborder" valign="top" width="15.02%" headers="mcps1.3.5.3.2.4.1.1 "><p id="dli_01_0418__p844585582817">3</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="25.7%" headers="mcps1.3.5.3.2.4.1.2 "><p id="dli_01_0418__p97601132318">Log in as the IAM user and verify permissions.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="59.28%" headers="mcps1.3.5.3.2.4.1.3 "><p id="dli_01_0418__p1790194033019">Log in to the console using the newly created user, switch to the authorized region, and verify permissions.</p>
|
||||
<ul id="dli_01_0418__ul1890124018302"><li id="dli_01_0418__li19018408307">Choose <strong id="dli_01_0418__b197651231111315">Service List</strong> > <strong id="dli_01_0418__b167663319131">Data Lake Insight</strong>. If you can view the elastic resource pool list on the <strong id="dli_01_0418__b536617818187">Resources</strong> > <strong id="dli_01_0418__b5667681820">Resource Pool</strong> page but cannot purchase an elastic resource pool by clicking <strong id="dli_01_0418__b579811412182">Buy Resource Pool</strong> in the upper right corner (assuming the current permission includes only <strong id="dli_01_0418__b1841885717184">DLI ReadOnlyAccess</strong>), the <strong id="dli_01_0418__b342891031920">DLI ReadOnlyAccess</strong> permission has already taken effect.</li><li id="dli_01_0418__li590154014309">Choose any other service in <strong id="dli_01_0418__b175280122117">Service List</strong>. If a message appears indicating that you have insufficient permissions to access the service, the <strong id="dli_01_0418__b2521018218">DLI ReadOnlyAccess</strong> permission has already taken effect.</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0418__row0969161316295"><td class="cellrowborder" valign="top" width="15.02%" headers="mcps1.3.5.3.2.4.1.1 "><p id="dli_01_0418__p2969141316293">4</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="25.7%" headers="mcps1.3.5.3.2.4.1.2 "><p id="dli_01_0418__p139691313182912">Create a custom policy and associate it with the user group.</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="59.28%" headers="mcps1.3.5.3.2.4.1.3 "><p id="dli_01_0418__p196921314291">If the predefined DLI permissions in the system do not meet your authorization requirements, you can create custom policies.</p>
|
||||
<p id="dli_01_0418__p1388442135411">For details about how to create a custom policy, see <a href="dli_01_0451.html#dli_01_0451__en-us_topic_0206789937_section15041715821">Creating a Custom Policy</a>.</p>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0418__section63665495717"><h4 class="sectiontitle">Process Flow</h4><div class="fignone" id="dli_01_0418__fig4118155455715"><a name="dli_01_0418__fig4118155455715"></a><a name="fig4118155455715"></a><span class="figcap"><b>Figure 1 </b>Process for granting DLI permissions</span><br><span><img id="dli_01_0418__image03801418915" src="en-us_image_0206789726.jpg"></span></div>
|
||||
<p id="dli_01_0418__p582413330719"></p>
|
||||
<p id="dli_01_0418__p626243075914"></p>
|
||||
<ol id="dli_01_0418__ol139492810017"><li id="dli_01_0418__li895020818018"><a name="dli_01_0418__li895020818018"></a><a name="li895020818018"></a>Create a user group and grant the permission to it.<p id="dli_01_0418__p99501985019"><a name="dli_01_0418__li895020818018"></a><a name="li895020818018"></a>Create a user group on the IAM console and grant the <strong id="dli_01_0418__b163744195013">DLI ReadOnlyAccess</strong> permission to it.</p>
|
||||
</li><li id="dli_01_0418__li59503817014">Create a user and add the user to the user group.<p id="dli_01_0418__p4950882013"><a name="dli_01_0418__li59503817014"></a><a name="li59503817014"></a>Create a user on the IAM console and add the user to the group created in <a href="#dli_01_0418__li895020818018">1</a>.</p>
|
||||
</li><li id="dli_01_0418__li159506814017">Log in and verify the permission.<p id="dli_01_0418__p29911201511"><a name="dli_01_0418__li159506814017"></a><a name="li159506814017"></a>Log in to the management console using the newly created user, and verify that the user's permissions.</p>
|
||||
<ul id="dli_01_0418__ul9992304111"><li id="dli_01_0418__li149921301015">Choose <strong id="dli_01_0418__b837346639">Service List</strong> > <strong id="dli_01_0418__b1501447806">Data Lake Insight</strong>. The DLI management console is displayed. If you can view the queue list on the <strong id="dli_01_0418__b86423619315">Queue Management</strong> page but cannot buy DLI queues by clicking <strong id="dli_01_0418__b1701367313">Buy Queue</strong> in the upper right corner (assume that the current permission contains only <strong id="dli_01_0418__b1070193615314">DLI ReadOnlyAccess</strong>), the <strong id="dli_01_0418__b7710363316">DLI ReadOnlyAccess</strong> permission has taken effect.</li><li id="dli_01_0418__li29921500115">Choose any other service in <strong id="dli_01_0418__b688152518442">Service List</strong>. If a message appears indicating that you have insufficient permissions to access the service, the <strong id="dli_01_0418__b17881525164411">DLI ReadOnlyAccess</strong> permission has already taken effect.</li></ul>
|
||||
</li></ol>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
@ -22,3 +57,10 @@
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
<script language="JavaScript">
|
||||
<!--
|
||||
image_size('.imgResize');
|
||||
var msg_imageMax = "view original image";
|
||||
var msg_imageClose = "close";
|
||||
//--></script>
|
||||
@ -3,7 +3,7 @@
|
||||
<h1 class="topictitle1">DLI Agency Overview</h1>
|
||||
<div id="body1557992073881"><div class="section" id="dli_01_0419__section766995911819"><h4 class="sectiontitle">What Is an Agency?</h4><p id="dli_01_0419__p732919591212">Cloud services often interact with each other, with some of which dependent on other services. You can create an agency to delegate DLI to use other cloud services and perform resource O&M on your behalf.</p>
|
||||
<p id="dli_01_0419__p33476205477">For example, the AK/SK required by DLI Flink jobs is stored in DEW. To allow DLI to access DEW data during job execution, you need to provide an IAM agency to delegate the permissions to perform operations on DEW data to DLI.</p>
|
||||
<div class="fignone" id="dli_01_0419__fig1966812813338"><span class="figcap"><b>Figure 1 </b>DLI service agency</span><br><span><img id="dli_01_0419__image1767061717334" src="en-us_image_0000001742695104.png"></span></div>
|
||||
<div class="fignone" id="dli_01_0419__fig1966812813338"><span class="figcap"><b>Figure 1 </b>DLI service agency</span><br><span><img id="dli_01_0419__image1767061717334" src="en-us_image_0000001742695104.png" title="Click to enlarge" class="imgResize"></span></div>
|
||||
</div>
|
||||
<div class="section" id="dli_01_0419__section20471205014460"><h4 class="sectiontitle">DLI Agencies</h4><p id="dli_01_0419__p14101142142817">Before using DLI, you are advised to set up DLI agency permissions to ensure the proper functioning of DLI.</p>
|
||||
<ul id="dli_01_0419__ul15735918104"><li id="dli_01_0419__li47351418100">By default, DLI provides the following agencies: <strong id="dli_01_0419__b2030184531011">dli_admin_agency</strong>, <strong id="dli_01_0419__b13505204714109">dli_management_agency</strong>, and <strong id="dli_01_0419__b152271457121012">dli_data_clean_agency</strong>. The names of these agencies are fixed, but the permissions contained in them can be customized. In other scenarios, you need to create custom agencies. For details about the agencies, see <a href="#dli_01_0419__table966993514116">Table 1</a>.</li><li id="dli_01_0419__li12329172119283">DLI upgrades <strong id="dli_01_0419__b24782383013">dli_admin_agency</strong> to <strong id="dli_01_0419__b74862312308">dli_management_agency</strong> to meet the demand for fine-grained agency permissions management. The new agency has the necessary permissions for datasource operations, notifications, and user authorization operations. For details, see <a href="dli_01_0618.html">Configuring DLI Agency Permissions</a>.</li><li id="dli_01_0419__li37481611899">To use Flink 1.15, Spark 3.3.1 (Spark general queue scenario), or a later version to execute jobs, perform the following operations:<div class="p" id="dli_01_0419__p1858212277911"><a name="dli_01_0419__li37481611899"></a><a name="li37481611899"></a>Create an agency on the IAM console and add the agency information to the job configuration. For details, see <a href="dli_01_0616.html">Creating a Custom DLI Agency</a>.<ul id="dli_01_0419__ul1886232712110"><li id="dli_01_0419__li14355142519111">Common scenarios for creating an agency: DLI is allowed to read and write data from and to OBS, dump logs, and read and write Flink checkpoints. DLI is allowed to access DEW to obtain data access credentials and access catalogs to obtain metadata.</li><li id="dli_01_0419__li13659251418">You cannot use the default agency names <strong id="dli_01_0419__b9396134972910">dli_admin_agency</strong>, <strong id="dli_01_0419__b1632315542293">dli_management_agency</strong>, or <strong id="dli_01_0419__b11632218302">dli_data_clean_agency</strong>. It must be unique.</li></ul>
|
||||
@ -13,7 +13,7 @@
|
||||
<div class="note" id="dli_01_0419__note876811312109"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="dli_01_0419__ul19959752163312"><li id="dli_01_0419__li119590526334">Only the tenant account or a member account of user group <strong id="dli_01_0419__b1328117482327">admin</strong> can authorize the service.</li><li id="dli_01_0419__li199605524332">Do not delete the agency created by the system by default.</li></ul>
|
||||
</div></div>
|
||||
|
||||
<div class="tablenoborder"><a name="dli_01_0419__table966993514116"></a><a name="table966993514116"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0419__table966993514116" frame="border" border="1" rules="all"><caption><b>Table 1 </b>DLI agencies</caption><thead align="left"><tr id="dli_01_0419__row16693352117"><th align="left" class="cellrowborder" valign="top" width="26.93%" id="mcps1.3.2.5.2.4.1.1"><p id="dli_01_0419__p1766917354117">Permission</p>
|
||||
<div class="tablenoborder"><a name="dli_01_0419__table966993514116"></a><a name="table966993514116"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0419__table966993514116" frame="border" border="1" rules="all"><caption><b>Table 1 </b>DLI agencies</caption><thead align="left"><tr id="dli_01_0419__row16693352117"><th align="left" class="cellrowborder" valign="top" width="26.93%" id="mcps1.3.2.5.2.4.1.1"><p id="dli_01_0419__p1766917354117">Agency</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="19.39%" id="mcps1.3.2.5.2.4.1.2"><p id="dli_01_0419__p1553011215712">Type</p>
|
||||
</th>
|
||||
@ -25,7 +25,7 @@
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="19.39%" headers="mcps1.3.2.5.2.4.1.2 "><p id="dli_01_0419__p9530152076">Default agency</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="53.68000000000001%" headers="mcps1.3.2.5.2.4.1.3 "><p id="dli_01_0419__p1456314513121">This agency has been discarded and is not recommended. Upgrade the agency to <strong id="dli_01_0419__b2548319389">dli_management_agency</strong> as soon as possible.</p>
|
||||
<td class="cellrowborder" valign="top" width="53.68000000000001%" headers="mcps1.3.2.5.2.4.1.3 "><p id="dli_01_0419__p1456314513121">This agency has been deprecated and is not recommended. Upgrade the agency to <strong id="dli_01_0419__b2548319389">dli_management_agency</strong> as soon as possible.</p>
|
||||
<p id="dli_01_0419__p136695356116">For details about how to update an agency, see <a href="dli_01_0618.html">Configuring DLI Agency Permissions</a>.</p>
|
||||
</td>
|
||||
</tr>
|
||||
@ -91,3 +91,10 @@
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
<script language="JavaScript">
|
||||
<!--
|
||||
image_size('.imgResize');
|
||||
var msg_imageMax = "view original image";
|
||||
var msg_imageClose = "close";
|
||||
//--></script>
|
||||
@ -11,7 +11,7 @@
|
||||
</li><li id="dli_01_0427__li2302018145713"><a name="dli_01_0427__li2302018145713"></a><a name="li2302018145713"></a>Upload the authentication credential to the OBS bucket.<p id="dli_01_0427__p8436414145916"><a name="dli_01_0427__li2302018145713"></a><a name="li2302018145713"></a></p>
|
||||
</li><li id="dli_01_0427__li153031865715">Create a datasource authentication.<ol type="a" id="dli_01_0427__ol93301231175919"><li id="dli_01_0427__li161611037195919">Log in to the DLI management console.</li><li id="dli_01_0427__li7242128104311">Choose <strong id="dli_01_0427__b13551152102314">Datasource Connections</strong>. On the page displayed, click <strong id="dli_01_0427__b536643412236">Datasource Authentication</strong>.</li><li id="dli_01_0427__li128216271309">Click <strong id="dli_01_0427__b19104671973248">Create</strong>.<p id="dli_01_0427__p19696271803">Configure CSS authentication parameters according to <a href="#dli_01_0427__table1323455312373">Table 1</a>.</p>
|
||||
|
||||
<div class="tablenoborder"><a name="dli_01_0427__table1323455312373"></a><a name="table1323455312373"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0427__table1323455312373" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameters</caption><thead align="left"><tr id="dli_01_0427__row8233155311378"><th align="left" class="cellrowborder" valign="top" width="18.15%" id="mcps1.3.3.2.3.1.3.3.2.3.1.1"><p id="dli_01_0427__p182331453123716">Parameter</p>
|
||||
<div class="tablenoborder"><a name="dli_01_0427__table1323455312373"></a><a name="table1323455312373"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_01_0427__table1323455312373" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Parameter descriptions</caption><thead align="left"><tr id="dli_01_0427__row8233155311378"><th align="left" class="cellrowborder" valign="top" width="18.15%" id="mcps1.3.3.2.3.1.3.3.2.3.1.1"><p id="dli_01_0427__p182331453123716">Parameter</p>
|
||||
</th>
|
||||
<th align="left" class="cellrowborder" valign="top" width="81.85%" id="mcps1.3.3.2.3.1.3.3.2.3.1.2"><p id="dli_01_0427__p1923311536372">Description</p>
|
||||
</th>
|
||||
@ -19,8 +19,8 @@
|
||||
</thead>
|
||||
<tbody><tr id="dli_01_0427__row1234145343715"><td class="cellrowborder" valign="top" width="18.15%" headers="mcps1.3.3.2.3.1.3.3.2.3.1.1 "><p id="dli_01_0427__p13234185313376">Authentication Certificate</p>
|
||||
</td>
|
||||
<td class="cellrowborder" valign="top" width="81.85%" headers="mcps1.3.3.2.3.1.3.3.2.3.1.2 "><p id="dli_01_0427__p19234185315377">Name of the datasource authentication information to be created.</p>
|
||||
<ul id="dli_01_0427__ul122341153173717"><li id="dli_01_0427__li102346530370">The name can contain only digits, letters, and underscores (_), but cannot contain only digits or start with an underscore (_).</li><li id="dli_01_0427__li1223405343720">The length of the database name cannot exceed 128 characters.</li><li id="dli_01_0427__li4234195316374">It is recommended that the name contain the CSS security cluster name to distinguish security authentication information of different clusters.</li></ul>
|
||||
<td class="cellrowborder" valign="top" width="81.85%" headers="mcps1.3.3.2.3.1.3.3.2.3.1.2 "><p id="dli_01_0427__p19234185315377">Name of the datasource authentication to be created.</p>
|
||||
<ul id="dli_01_0427__ul122341153173717"><li id="dli_01_0427__li102346530370">The name can contain only digits, letters, and underscores (_), but cannot contain only digits or start with an underscore (_).</li><li id="dli_01_0427__li1223405343720">The value can contain a maximum of 128 characters.</li><li id="dli_01_0427__li4234195316374">It is recommended that the name contain the CSS security cluster name to distinguish security authentication information of different clusters.</li></ul>
|
||||
</td>
|
||||
</tr>
|
||||
<tr id="dli_01_0427__row1211739719"><td class="cellrowborder" valign="top" width="18.15%" headers="mcps1.3.3.2.3.1.3.3.2.3.1.1 "><p id="dli_01_0427__p10311312710">Type</p>
|
||||
|
||||
Some files were not shown because too many files have changed in this diff Show More
Reference in New Issue
Block a user