yexinru/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
Files
6d6608a45debccc04d375197645841881348d290
doc-exports/docs/dli/umn/ALL_META.TXT.json
Su, Xiaomeng 6d6608a45d dli_umn_20260211 
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Co-authored-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
Co-committed-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
2026-03-06 08:27:45 +00:00

6289 lines
199 KiB
JSON
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

[
{
"dockw":"User Guide"
},
{
"uri":"dli_01_0538.html",
"node_id":"dli_01_0538.xml",
"product_code":"dli",
"code":"1",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Service Overview",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Service Overview",
"githuburl":""
},
{
"uri":"dli_01_0378.html",
"node_id":"dli_01_0378.xml",
"product_code":"dli",
"code":"2",
"des":"Data Lake Insight (DLI) is a fully-managed, serverless service for data processing and analytics. It seamlessly combines stream processing, batch processing, and interact",
"doc_type":"usermanual",
"kw":"What Is Data Lake Insight,Service Overview,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"What Is Data Lake Insight",
"githuburl":""
},
{
"uri":"dli_07_0007.html",
"node_id":"dli_07_0007.xml",
"product_code":"dli",
"code":"3",
"des":"DLI offers standard SQL APIs, enabling you to perform massive data query and analysis using only SQL. Its syntax is fully compatible with ANSI SQL 2003 standards.This sig",
"doc_type":"usermanual",
"kw":"Advantages,Service Overview,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Advantages",
"githuburl":""
},
{
"uri":"dli_07_0002.html",
"node_id":"dli_07_0002.xml",
"product_code":"dli",
"code":"4",
"des":"DLI is applicable to large-scale log analysis, federated analysis of heterogeneous data sources, and big data ETL processing.Gaming operations data analysisDifferent depa",
"doc_type":"usermanual",
"kw":"Use Cases,Service Overview,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Use Cases",
"githuburl":""
},
{
"uri":"dli_01_0698.html",
"node_id":"dli_01_0698.xml",
"product_code":"dli",
"code":"5",
"des":"This section outlines the key features supported by DLI. For detailed information on regional availability of each feature, you can refer to the console.Before submitting",
"doc_type":"usermanual",
"kw":"Features,Service Overview,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Features",
"githuburl":""
},
{
"uri":"dli_07_0027.html",
"node_id":"dli_07_0027.xml",
"product_code":"dli",
"code":"6",
"des":"When performing big data analysis with DLI, you need to select the appropriate compute resources based on specific business needs. DLI offers a variety of resource types ",
"doc_type":"usermanual",
"kw":"Compute Resource Types and Specifications,Service Overview,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Compute Resource Types and Specifications",
"githuburl":""
},
{
"uri":"dli_07_0006.html",
"node_id":"dli_07_0006.xml",
"product_code":"dli",
"code":"7",
"des":"After purchasing DLI resources, you can use IAM to assign different access rights to employees, ensuring proper isolation between roles. IAM provides identity authenticat",
"doc_type":"usermanual",
"kw":"Permission Management,Service Overview,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Permission Management",
"githuburl":""
},
{
"uri":"dli_07_0005.html",
"node_id":"dli_07_0005.xml",
"product_code":"dli",
"code":"8",
"des":"For more notes and constraints on elastic resource pools, see Notes and Constraints on Using an Elastic Resource Pool.For more notes and constraints on using a queue, see",
"doc_type":"usermanual",
"kw":"Notes and Constraints,Service Overview,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Notes and Constraints",
"githuburl":""
},
{
"uri":"dli_07_0009.html",
"node_id":"dli_07_0009.xml",
"product_code":"dli",
"code":"9",
"des":"Quotas are enforced for service resources on the platform to prevent unforeseen spikes in resource usage. Quotas can limit the quantity and capacity of resources availabl",
"doc_type":"usermanual",
"kw":"Quota Management,Service Overview,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Quota Management",
"githuburl":""
},
{
"uri":"dli_07_0004.html",
"node_id":"dli_07_0004.xml",
"product_code":"dli",
"code":"10",
"des":"OBS works as the data source and data storage system for DLI, and delivers the following capabilities:Data source: DLI provides an API for you to import data from corresp",
"doc_type":"usermanual",
"kw":"Related Services,Service Overview,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Related Services",
"githuburl":""
},
{
"uri":"dli_07_0003.html",
"node_id":"dli_07_0003.xml",
"product_code":"dli",
"code":"11",
"des":"Actual CUs: The current allocated resource size of the elastic resource pool, measured in CUs.When no queues exist in the resource pool: The actual CUs equal the minimum ",
"doc_type":"usermanual",
"kw":"Basic Concepts,Service Overview,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Basic Concepts",
"githuburl":""
},
{
"uri":"dli_01_0220.html",
"node_id":"dli_01_0220.xml",
"product_code":"dli",
"code":"12",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Getting Started",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Getting Started",
"githuburl":""
},
{
"uri":"dli_01_0002.html",
"node_id":"dli_01_0002.xml",
"product_code":"dli",
"code":"13",
"des":"DLI can query data stored in OBS. This section describes how to use DLI to submit a SQL job to query OBS data.To illustrate, create a file called sampledata.csv and uploa",
"doc_type":"usermanual",
"kw":"Submitting a SQL Job to Query OBS Data Using DLI,Getting Started,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Submitting a SQL Job to Query OBS Data Using DLI",
"githuburl":""
},
{
"uri":"dli_01_0020.html",
"node_id":"dli_01_0020.xml",
"product_code":"dli",
"code":"14",
"des":"DLI can query data stored in RDS. This section describes how to use DLI to submit a SQL job to query RDS for MySQL data.In this example, we will create an RDS for MySQL D",
"doc_type":"usermanual",
"kw":"Submitting a SQL Job to Query RDS for MySQL Data Using DLI,Getting Started,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Submitting a SQL Job to Query RDS for MySQL Data Using DLI",
"githuburl":""
},
{
"uri":"dli_01_0531.html",
"node_id":"dli_01_0531.xml",
"product_code":"dli",
"code":"15",
"des":"DLI Flink jobs can use other cloud services as data sources and sink streams for real-time compute.This example describes how to create and submit a Flink OpenSource SQL ",
"doc_type":"usermanual",
"kw":"Submitting a Flink OpenSource SQL Job to Query RDS for MySQL Data Using DLI,Getting Started,User Gui",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Submitting a Flink OpenSource SQL Job to Query RDS for MySQL Data Using DLI",
"githuburl":""
},
{
"uri":"dli_01_0512.html",
"node_id":"dli_01_0512.xml",
"product_code":"dli",
"code":"16",
"des":"Flink Jar jobs are suitable for data analysis scenarios that require custom stream processing logic, complex state management, or integration with specific libraries. You",
"doc_type":"usermanual",
"kw":"Submitting a Flink Jar Job Using DLI,Getting Started,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Submitting a Flink Jar Job Using DLI",
"githuburl":""
},
{
"uri":"dli_01_0375.html",
"node_id":"dli_01_0375.xml",
"product_code":"dli",
"code":"17",
"des":"DLI allows you to submit Spark jobs compiled as JAR files, which contain the necessary code and dependency information for executing the job. These files are used for spe",
"doc_type":"usermanual",
"kw":"Submitting a Spark Jar Job Using DLI,Getting Started,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Submitting a Spark Jar Job Using DLI",
"githuburl":""
},
{
"uri":"dli_01_0001.html",
"node_id":"dli_01_0001.xml",
"product_code":"dli",
"code":"18",
"des":"This chapter walks you through on how to develop a DLI job.To manage fine-grained permissions for your DLI resources using IAM, create an IAM user and grant them permissi",
"doc_type":"usermanual",
"kw":"DLI Job Development Process,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"DLI Job Development Process",
"githuburl":""
},
{
"uri":"dli_01_0611.html",
"node_id":"dli_01_0611.xml",
"product_code":"dli",
"code":"19",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Preparations",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Preparations",
"githuburl":""
},
{
"uri":"dli_01_0618.html",
"node_id":"dli_01_0618.xml",
"product_code":"dli",
"code":"20",
"des":"Before using DLI, configure DLI agency permissions. This section describes the scenarios and steps for configuring DLI agency permissions (dli_management_agency).If you u",
"doc_type":"usermanual",
"kw":"Configuring DLI Agency Permissions,Preparations,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Configuring DLI Agency Permissions",
"githuburl":""
},
{
"uri":"dli_01_0418.html",
"node_id":"dli_01_0418.xml",
"product_code":"dli",
"code":"21",
"des":"You can use Identity and Access Management (IAM) to implement fine-grained permissions management for your DLI resources. For details, see Overview.If your cloud account ",
"doc_type":"usermanual",
"kw":"Creating an IAM User and Granting Permissions,Preparations,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Creating an IAM User and Granting Permissions",
"githuburl":""
},
{
"uri":"dli_01_0536.html",
"node_id":"dli_01_0536.xml",
"product_code":"dli",
"code":"22",
"des":"Before using DLI, you need to configure a DLI job bucket. The bucket is used to store temporary data generated during DLI job running, such as job logs and results.Config",
"doc_type":"usermanual",
"kw":"Configuring a DLI Job Bucket,Preparations,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Configuring a DLI Job Bucket",
"githuburl":""
},
{
"uri":"dli_01_0508.html",
"node_id":"dli_01_0508.xml",
"product_code":"dli",
"code":"23",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Creating an Elastic Resource Pool and Creating Queues Within It",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Creating an Elastic Resource Pool and Creating Queues Within It",
"githuburl":""
},
{
"uri":"dli_01_0504.html",
"node_id":"dli_01_0504.xml",
"product_code":"dli",
"code":"24",
"des":"DLI compute resources are the foundation to run jobs. This section describes the modes of DLI compute resources and queue types.Before we dive into the compute resource m",
"doc_type":"usermanual",
"kw":"Overview of DLI Elastic Resource Pools and Queues,Creating an Elastic Resource Pool and Creating Que",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Overview of DLI Elastic Resource Pools and Queues",
"githuburl":""
},
{
"uri":"dli_01_0505.html",
"node_id":"dli_01_0505.xml",
"product_code":"dli",
"code":"25",
"des":"An elastic resource pool offers compute resources (CPU and memory) required for running DLI jobs, which can adapt to the changing demands of services.You can create multi",
"doc_type":"usermanual",
"kw":"Creating an Elastic Resource Pool and Creating Queues Within It,Creating an Elastic Resource Pool an",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Creating an Elastic Resource Pool and Creating Queues Within It",
"githuburl":""
},
{
"uri":"dli_01_0529.html",
"node_id":"dli_01_0529.xml",
"product_code":"dli",
"code":"26",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Managing Elastic Resource Pools",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Managing Elastic Resource Pools",
"githuburl":""
},
{
"uri":"dli_01_0622.html",
"node_id":"dli_01_0622.xml",
"product_code":"dli",
"code":"27",
"des":"After creating an elastic resource pool, you can check and manage it on the management console.This section describes how to check basic information about an elastic reso",
"doc_type":"usermanual",
"kw":"Checking Basic Information,Managing Elastic Resource Pools,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Checking Basic Information",
"githuburl":""
},
{
"uri":"dli_01_0526.html",
"node_id":"dli_01_0526.xml",
"product_code":"dli",
"code":"28",
"des":"Administrators can assign permissions of different operation scopes to users for each elastic resource pool.The administrator and elastic resource pool owner have all per",
"doc_type":"usermanual",
"kw":"Managing Permissions,Managing Elastic Resource Pools,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Managing Permissions",
"githuburl":""
},
{
"uri":"dli_01_0530.html",
"node_id":"dli_01_0530.xml",
"product_code":"dli",
"code":"29",
"des":"If you want a queue to use resources in an elastic resource pool, bind the queue to the pool.You can click Associate Queue on the Resource Pool page to bind a queue to an",
"doc_type":"usermanual",
"kw":"Binding a Queue,Managing Elastic Resource Pools,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Binding a Queue",
"githuburl":""
},
{
"uri":"dli_01_0686.html",
"node_id":"dli_01_0686.xml",
"product_code":"dli",
"code":"30",
"des":"Scaling out or in an elastic resource pool essentially means adjusting the actual CUs of the resource pool.In an elastic resource pool:Actual CUs: actual size of resource",
"doc_type":"usermanual",
"kw":"Scaling Out or In an Elastic Resource Pool,Managing Elastic Resource Pools,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Scaling Out or In an Elastic Resource Pool",
"githuburl":""
},
{
"uri":"dli_01_0507.html",
"node_id":"dli_01_0507.xml",
"product_code":"dli",
"code":"31",
"des":"CU settings are used to control the maximum and minimum CU ranges for elastic resource pool scaling to prevent unlimited resource expansion risks.For example, if the curr",
"doc_type":"usermanual",
"kw":"Setting CUs,Managing Elastic Resource Pools,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Setting CUs",
"githuburl":""
},
{
"uri":"dli_01_0525.html",
"node_id":"dli_01_0525.xml",
"product_code":"dli",
"code":"32",
"des":"A tag is a user-defined key-value pair used to identify cloud resources, helping you classify and search for them. A tag consists of a tag key and a tag value.If you use ",
"doc_type":"usermanual",
"kw":"Managing Tags,Managing Elastic Resource Pools,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Managing Tags",
"githuburl":""
},
{
"uri":"dli_01_0506.html",
"node_id":"dli_01_0506.xml",
"product_code":"dli",
"code":"33",
"des":"Elastic resource pools support multiple queues to manage job execution efficiently. For details about how to create queues in a pool, see Creating an Elastic Resource Poo",
"doc_type":"usermanual",
"kw":"Adjusting Scaling Policies for Queues in an Elastic Resource Pool,Managing Elastic Resource Pools,Us",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Adjusting Scaling Policies for Queues in an Elastic Resource Pool",
"githuburl":""
},
{
"uri":"dli_01_0532.html",
"node_id":"dli_01_0532.xml",
"product_code":"dli",
"code":"34",
"des":"If you added a queue to or deleted one from an elastic resource pool, or you scaled an added queue, the CU quantity of the elastic resource pool may be changed. You can v",
"doc_type":"usermanual",
"kw":"Viewing Scaling History,Managing Elastic Resource Pools,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Viewing Scaling History",
"githuburl":""
},
{
"uri":"dli_01_0566.html",
"node_id":"dli_01_0566.xml",
"product_code":"dli",
"code":"35",
"des":"An enterprise project is a cloud resource management approach that allows organizations to plan resources based on their organizational structure. It enables unified mana",
"doc_type":"usermanual",
"kw":"Allocating to an Enterprise Project,Managing Elastic Resource Pools,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Allocating to an Enterprise Project",
"githuburl":""
},
{
"uri":"dli_01_0528.html",
"node_id":"dli_01_0528.xml",
"product_code":"dli",
"code":"36",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Managing Queues",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Managing Queues",
"githuburl":""
},
{
"uri":"dli_01_0663.html",
"node_id":"dli_01_0663.xml",
"product_code":"dli",
"code":"37",
"des":"This section walks you through how to view basic information about a queue on the management console, including the engine type and version.Log in to the DLI management c",
"doc_type":"usermanual",
"kw":"Viewing Basic Information About a Queue,Managing Queues,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Viewing Basic Information About a Queue",
"githuburl":""
},
{
"uri":"dli_01_0015.html",
"node_id":"dli_01_0015.xml",
"product_code":"dli",
"code":"38",
"des":"Administrators and queue owners have full operation permissions on queues. They can grant operation permissions to other users based on service needs. This ensures that u",
"doc_type":"usermanual",
"kw":"Queue Permission Management,Managing Queues,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Queue Permission Management",
"githuburl":""
},
{
"uri":"dli_01_0565.html",
"node_id":"dli_01_0565.xml",
"product_code":"dli",
"code":"39",
"des":"You can create enterprise projects matching the organizational structure of your enterprises to centrally manage cloud resources across regions by project. Then you can c",
"doc_type":"usermanual",
"kw":"Allocating a Queue to an Enterprise Project,Managing Queues,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Allocating a Queue to an Enterprise Project",
"githuburl":""
},
{
"uri":"dli_01_0421.html",
"node_id":"dli_01_0421.xml",
"product_code":"dli",
"code":"40",
"des":"Once you have created an SMN topic, you can easily subscribe to it by going to the Topic Management > Topics page of the SMN console. You can choose to receive notificati",
"doc_type":"usermanual",
"kw":"Creating an SMN Topic,Managing Queues,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Creating an SMN Topic",
"githuburl":""
},
{
"uri":"dli_01_0022.html",
"node_id":"dli_01_0022.xml",
"product_code":"dli",
"code":"41",
"des":"A tag is a user-defined key-value pair used to identify cloud resources, helping you classify and search for them. A tag consists of a tag key and a tag value.If you use ",
"doc_type":"usermanual",
"kw":"Managing Queue Tags,Managing Queues,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Managing Queue Tags",
"githuburl":""
},
{
"uri":"dli_01_0563.html",
"node_id":"dli_01_0563.xml",
"product_code":"dli",
"code":"42",
"des":"DLI allows you to set properties for queues.You can currently set the following property parameters:Spark driver parameters: Set them to improve the scheduling efficiency",
"doc_type":"usermanual",
"kw":"Setting Queue Properties,Managing Queues,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Setting Queue Properties",
"githuburl":""
},
{
"uri":"dli_01_0685.html",
"node_id":"dli_01_0685.xml",
"product_code":"dli",
"code":"43",
"des":"Spark Native is a core component of Apache Spark designed to enhance the performance of Spark SQL computations. By utilizing vectorized C++ acceleration libraries, it acc",
"doc_type":"usermanual",
"kw":"Enabling Spark Native Operator Optimization,Managing Queues,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Enabling Spark Native Operator Optimization",
"githuburl":""
},
{
"uri":"dli_01_0489.html",
"node_id":"dli_01_0489.xml",
"product_code":"dli",
"code":"44",
"des":"DLI's address connectivity testing feature can be used to verify network connectivity between DLI queues and destination addresses.This feature is typically utilized for ",
"doc_type":"usermanual",
"kw":"Testing the Network Connectivity Between a Queue and a Data Source,Managing Queues,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Testing the Network Connectivity Between a Queue and a Data Source",
"githuburl":""
},
{
"uri":"dli_01_0016.html",
"node_id":"dli_01_0016.xml",
"product_code":"dli",
"code":"45",
"des":"You can delete a queue based on actual conditions.This operation will fail if there are jobs in the Submitting or Running state on this queue.Deleting a queue does not ca",
"doc_type":"usermanual",
"kw":"Deleting a Queue,Managing Queues,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Deleting a Queue",
"githuburl":""
},
{
"uri":"dli_01_0487.html",
"node_id":"dli_01_0487.xml",
"product_code":"dli",
"code":"46",
"des":"Newly created queues need to run jobs before they can be scaled in or out.The operations described in this section only apply to queues in non-elastic resource pools.Queu",
"doc_type":"usermanual",
"kw":"Enabling Elastic Scaling for a Queue in a Non-Elastic Resource Pool,Managing Queues,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Enabling Elastic Scaling for a Queue in a Non-Elastic Resource Pool",
"githuburl":""
},
{
"uri":"dli_01_0488.html",
"node_id":"dli_01_0488.xml",
"product_code":"dli",
"code":"47",
"des":"When services are busy, you might need to use more compute resources to process services in a period. After this period, you do not require the same amount of resources. ",
"doc_type":"usermanual",
"kw":"Creating a Scheduled Elastic Scaling Task for a Queue in a Non-Elastic Resource Pool,Managing Queues",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Creating a Scheduled Elastic Scaling Task for a Queue in a Non-Elastic Resource Pool",
"githuburl":""
},
{
"uri":"dli_01_0443.html",
"node_id":"dli_01_0443.xml",
"product_code":"dli",
"code":"48",
"des":"If the CIDR block of the DLI queue conflicts with that of the user data source, you can change the CIDR block of the queue.If the queue whose CIDR block is to be modified",
"doc_type":"usermanual",
"kw":"Changing the CIDR Block of a Queue in a Non-Elastic Resource Pool,Managing Queues,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Changing the CIDR Block of a Queue in a Non-Elastic Resource Pool",
"githuburl":""
},
{
"uri":"dli_01_0515.html",
"node_id":"dli_01_0515.xml",
"product_code":"dli",
"code":"49",
"des":"This section walks you through the procedure of adding a queue to an elastic resource pool and binding an enhanced datasource connection to the elastic resource pool.Proc",
"doc_type":"usermanual",
"kw":"Example Use Case: Creating an Elastic Resource Pool and Running Jobs,Creating an Elastic Resource Po",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Example Use Case: Creating an Elastic Resource Pool and Running Jobs",
"githuburl":""
},
{
"uri":"dli_01_0516.html",
"node_id":"dli_01_0516.xml",
"product_code":"dli",
"code":"50",
"des":"A company has multiple departments that perform data analysis in different periods during a day.Department A requires a large number of compute resources from 00:00 a.m. ",
"doc_type":"usermanual",
"kw":"Example Use Case: Configuring Scaling Policies for Queues in an Elastic Resource Pool,Creating an El",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Example Use Case: Configuring Scaling Policies for Queues in an Elastic Resource Pool",
"githuburl":""
},
{
"uri":"dli_01_0363.html",
"node_id":"dli_01_0363.xml",
"product_code":"dli",
"code":"51",
"des":"Queues in the non-elastic resource pool mode are the previous-gen of resource management for DLI. It involved purchasing and releasing resources based on usage demands, r",
"doc_type":"usermanual",
"kw":"Creating a Non-Elastic Resource Pool Queue (Deprecated, Not Recommended),Creating an Elastic Resourc",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Creating a Non-Elastic Resource Pool Queue (Deprecated, Not Recommended)",
"githuburl":""
},
{
"uri":"dli_01_0390.html",
"node_id":"dli_01_0390.xml",
"product_code":"dli",
"code":"52",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Creating a Data Directory, Database, and Table",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Creating a Data Directory, Database, and Table",
"githuburl":""
},
{
"uri":"dli_01_0228.html",
"node_id":"dli_01_0228.xml",
"product_code":"dli",
"code":"53",
"des":"Databases and tables are the basis for developing SQL and Spark jobs. Before running a job, you need to define databases and tables based on your service scenarios.Flink ",
"doc_type":"usermanual",
"kw":"Understanding Data Catalogs, Databases, and Tables,Creating a Data Directory, Database, and Table,Us",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Understanding Data Catalogs, Databases, and Tables",
"githuburl":""
},
{
"uri":"dli_01_0005.html",
"node_id":"dli_01_0005.xml",
"product_code":"dli",
"code":"54",
"des":"A database is a repository of data organized, stored, and managed on computer storage devices according to data structures.A table is one of the most essential components",
"doc_type":"usermanual",
"kw":"Creating a Data Catalog, Database, and Table on the DLI Console,Creating a Data Directory, Database,",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Creating a Data Catalog, Database, and Table on the DLI Console",
"githuburl":""
},
{
"uri":"dli_01_0008.html",
"node_id":"dli_01_0008.xml",
"product_code":"dli",
"code":"55",
"des":"Metadata is data used to define the type of data. It primarily describes information about the data itself, including its source, size, format, or other characteristics. ",
"doc_type":"usermanual",
"kw":"Viewing Table Metadata,Creating a Data Directory, Database, and Table,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Viewing Table Metadata",
"githuburl":""
},
{
"uri":"dli_01_0671.html",
"node_id":"dli_01_0671.xml",
"product_code":"dli",
"code":"56",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Managing Data Catalogs on the DLI Console",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Managing Data Catalogs on the DLI Console",
"githuburl":""
},
{
"uri":"dli_01_0672.html",
"node_id":"dli_01_0672.xml",
"product_code":"dli",
"code":"57",
"des":"DLI data catalogs support authorization on the DLI console or authentication through IAM. By setting permissions, you can grant varying data catalog permissions to differ",
"doc_type":"usermanual",
"kw":"Configuring Data Catalog Permissions on the DLI Console,Managing Data Catalogs on the DLI Console,Us",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Configuring Data Catalog Permissions on the DLI Console",
"githuburl":""
},
{
"uri":"dli_01_0004.html",
"node_id":"dli_01_0004.xml",
"product_code":"dli",
"code":"58",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Managing Database Resources on the DLI Console",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Managing Database Resources on the DLI Console",
"githuburl":""
},
{
"uri":"dli_01_0447.html",
"node_id":"dli_01_0447.xml",
"product_code":"dli",
"code":"59",
"des":"By setting permissions, you can assign varying database permissions to different users.The administrator and database owner have all permissions, which cannot be set or m",
"doc_type":"usermanual",
"kw":"Configuring Database Permissions on the DLI Console,Managing Database Resources on the DLI Console,U",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Configuring Database Permissions on the DLI Console",
"githuburl":""
},
{
"uri":"dli_01_0011.html",
"node_id":"dli_01_0011.xml",
"product_code":"dli",
"code":"60",
"des":"You can delete an unused database from the DLI console: when a database is no longer needed, such as after a test database has completed testing; if a database has errors",
"doc_type":"usermanual",
"kw":"Deleting a Database on the DLI Console,Managing Database Resources on the DLI Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Deleting a Database on the DLI Console",
"githuburl":""
},
{
"uri":"dli_01_0376.html",
"node_id":"dli_01_0376.xml",
"product_code":"dli",
"code":"61",
"des":"In practical use, developers create databases and tables, which are then handed over to testers for testing. Once testing is complete, the databases and tables are handed",
"doc_type":"usermanual",
"kw":"Changing the Database Owner on the DLI Console,Managing Database Resources on the DLI Console,User G",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Changing the Database Owner on the DLI Console",
"githuburl":""
},
{
"uri":"dli_01_0552.html",
"node_id":"dli_01_0552.xml",
"product_code":"dli",
"code":"62",
"des":"A tag is a user-defined key-value pair used to identify cloud resources, helping you classify and search for them. A tag consists of a tag key and a tag value. If you use",
"doc_type":"usermanual",
"kw":"Managing Tags for Database Tables,Managing Database Resources on the DLI Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Managing Tags for Database Tables",
"githuburl":""
},
{
"uri":"dli_01_0625.html",
"node_id":"dli_01_0625.xml",
"product_code":"dli",
"code":"63",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Managing Table Resources on the DLI Console",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Managing Table Resources on the DLI Console",
"githuburl":""
},
{
"uri":"dli_01_0448.html",
"node_id":"dli_01_0448.xml",
"product_code":"dli",
"code":"64",
"des":"By setting permissions, you can assign varying table permissions to different users.The administrator and table owner have all permissions, which cannot be set or modifie",
"doc_type":"usermanual",
"kw":"Configuring Table Permissions on the DLI Console,Managing Table Resources on the DLI Console,User Gu",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Configuring Table Permissions on the DLI Console",
"githuburl":""
},
{
"uri":"dli_01_0626.html",
"node_id":"dli_01_0626.xml",
"product_code":"dli",
"code":"65",
"des":"You can delete an unused data table from the DLI console: when a data table is no longer needed, such as after a test data table has completed testing; if a data table ha",
"doc_type":"usermanual",
"kw":"Deleting a Table on the DLI Console,Managing Table Resources on the DLI Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Deleting a Table on the DLI Console",
"githuburl":""
},
{
"uri":"dli_01_0627.html",
"node_id":"dli_01_0627.xml",
"product_code":"dli",
"code":"66",
"des":"In practical use, developers create databases and tables, which are then handed over to testers for testing. Once testing is complete, the databases and tables are handed",
"doc_type":"usermanual",
"kw":"Changing the Table Owner on the DLI Console,Managing Table Resources on the DLI Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Changing the Table Owner on the DLI Console",
"githuburl":""
},
{
"uri":"dli_01_0253.html",
"node_id":"dli_01_0253.xml",
"product_code":"dli",
"code":"67",
"des":"This section describes how to import data stored in OBS to a table on the DLI console. Data can be imported to both DLI tables (table type: MANAGED) and OBS tables (table",
"doc_type":"usermanual",
"kw":"Importing OBS Data to a DLI Table,Managing Table Resources on the DLI Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Importing OBS Data to a DLI Table",
"githuburl":""
},
{
"uri":"dli_01_0010.html",
"node_id":"dli_01_0010.xml",
"product_code":"dli",
"code":"68",
"des":"You can export data from a DLI table to OBS. During the export, a folder is created in OBS or the content in the existing folder is overwritten.The exported file can be i",
"doc_type":"usermanual",
"kw":"Exporting DLI Table Data to OBS,Managing Table Resources on the DLI Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Exporting DLI Table Data to OBS",
"githuburl":""
},
{
"uri":"dli_01_0007.html",
"node_id":"dli_01_0007.xml",
"product_code":"dli",
"code":"69",
"des":"The Preview page displays the first 10 records in the table.You can preview data on either the Data Management page or the SQL Editor page.To preview data on the Data Man",
"doc_type":"usermanual",
"kw":"Previewing Table Data on the DLI Console,Managing Table Resources on the DLI Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Previewing Table Data on the DLI Console",
"githuburl":""
},
{
"uri":"dli_01_0661.html",
"node_id":"dli_01_0661.xml",
"product_code":"dli",
"code":"70",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Data Import and Migration",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Data Import and Migration",
"githuburl":""
},
{
"uri":"dli_01_0662.html",
"node_id":"dli_01_0662.xml",
"product_code":"dli",
"code":"71",
"des":"DLI enables direct access to data stored in OBS for query and analysis, eliminating the need for data migration.To begin using DLI for data analysis, just import your loc",
"doc_type":"usermanual",
"kw":"Overview,Data Import and Migration,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Overview",
"githuburl":""
},
{
"uri":"dli_01_0631.html",
"node_id":"dli_01_0631.xml",
"product_code":"dli",
"code":"72",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Migrating Data from External Data Sources to DLI",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Migrating Data from External Data Sources to DLI",
"githuburl":""
},
{
"uri":"dli_01_0632.html",
"node_id":"dli_01_0632.xml",
"product_code":"dli",
"code":"73",
"des":"To centrally analyze and manage scattered data from various systems, you can utilize migration tools like Cloud Data Migration (CDM) to migrate the data to DLI. Once the ",
"doc_type":"usermanual",
"kw":"Overview of Data Migration Scenarios,Migrating Data from External Data Sources to DLI,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Overview of Data Migration Scenarios",
"githuburl":""
},
{
"uri":"dli_01_0633.html",
"node_id":"dli_01_0633.xml",
"product_code":"dli",
"code":"74",
"des":"On its GUI, CDM enables you to create data migration tasks from multiple data sources to a data lake.This section describes how to use CDM to migrate data from data sourc",
"doc_type":"usermanual",
"kw":"Using CDM to Migrate Data to DLI,Migrating Data from External Data Sources to DLI,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Using CDM to Migrate Data to DLI",
"githuburl":""
},
{
"uri":"dli_01_0634.html",
"node_id":"dli_01_0634.xml",
"product_code":"dli",
"code":"75",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Configuring DLI to Read and Write Data from and to External Data Sources",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Configuring DLI to Read and Write Data from and to External Data Sources",
"githuburl":""
},
{
"uri":"dli_01_0635.html",
"node_id":"dli_01_0635.xml",
"product_code":"dli",
"code":"76",
"des":"To read and write external data sources when running DLI jobs, two conditions must be met:Establish network connectivity between DLI and the external data source to ensur",
"doc_type":"usermanual",
"kw":"Configuring DLI to Read and Write External Data Sources,Configuring DLI to Read and Write Data from ",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Configuring DLI to Read and Write External Data Sources",
"githuburl":""
},
{
"uri":"dli_01_0426.html",
"node_id":"dli_01_0426.xml",
"product_code":"dli",
"code":"77",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Configuring the Network Connection Between DLI and Data Sources (Enhanced Datasource Connection)",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Configuring the Network Connection Between DLI and Data Sources (Enhanced Datasource Connection)",
"githuburl":""
},
{
"uri":"dli_01_0003.html",
"node_id":"dli_01_0003.xml",
"product_code":"dli",
"code":"78",
"des":"Imagine DLI elastic resource pools and data sources as two isolated islands surrounded by water.To enable traffic between these two islands, you need to first construct a",
"doc_type":"usermanual",
"kw":"Overview of Enhanced Datasource Connections,Configuring the Network Connection Between DLI and Data ",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Overview of Enhanced Datasource Connections",
"githuburl":""
},
{
"uri":"dli_01_0006.html",
"node_id":"dli_01_0006.xml",
"product_code":"dli",
"code":"79",
"des":"Before using DLI to access data from other sources, you need to create an enhanced datasource connection to enable network communication between DLI and the destination d",
"doc_type":"usermanual",
"kw":"Creating an Enhanced Datasource Connection,Configuring the Network Connection Between DLI and Data S",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Creating an Enhanced Datasource Connection",
"githuburl":""
},
{
"uri":"dli_01_0410.html",
"node_id":"dli_01_0410.xml",
"product_code":"dli",
"code":"80",
"des":"If DLI needs to access external data sources, you need to establish enhanced datasource connections to enable the network between DLI and the data sources, and then devel",
"doc_type":"usermanual",
"kw":"Common Development Methods for DLI Cross-Source Analysis,Configuring the Network Connection Between ",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Common Development Methods for DLI Cross-Source Analysis",
"githuburl":""
},
{
"uri":"dli_01_0636.html",
"node_id":"dli_01_0636.xml",
"product_code":"dli",
"code":"81",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Managing Data Source Access Credentials Using DEW",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Managing Data Source Access Credentials Using DEW",
"githuburl":""
},
{
"uri":"dli_01_0687.html",
"node_id":"dli_01_0687.xml",
"product_code":"dli",
"code":"82",
"des":"When you use DLI to perform big data processing or cross-service data queries, authentication is a critical prerequisite to ensure legitimate access and data security. Em",
"doc_type":"usermanual",
"kw":"Using an Agency to Obtain Access Credentials in DLI,Managing Data Source Access Credentials Using DE",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Using an Agency to Obtain Access Credentials in DLI",
"githuburl":""
},
{
"uri":"dli_09_0210.html",
"node_id":"dli_09_0210.xml",
"product_code":"dli",
"code":"83",
"des":"When DLI writes the output data of Flink jobs to MySQL or DWS, you need to set sensitive parameters such as the username and password in the connector. Storing this infor",
"doc_type":"usermanual",
"kw":"Flink OpenSource SQL Jobs Using DEW to Manage Access Credentials,Managing Data Source Access Credent",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Flink OpenSource SQL Jobs Using DEW to Manage Access Credentials",
"githuburl":""
},
{
"uri":"dli_09_0211.html",
"node_id":"dli_09_0211.xml",
"product_code":"dli",
"code":"84",
"des":"When writing output data from Flink Jar jobs to OBS, you need to configure an AK/SK for accessing OBS. To ensure the security of AK/SK data, you can use DEW and CSMS for ",
"doc_type":"usermanual",
"kw":"Flink Jar Jobs Using DEW to Acquire Access Credentials for Reading and Writing Data from and to OBS,",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Flink Jar Jobs Using DEW to Acquire Access Credentials for Reading and Writing Data from and to OBS",
"githuburl":""
},
{
"uri":"dli_09_0215.html",
"node_id":"dli_09_0215.xml",
"product_code":"dli",
"code":"85",
"des":"A temporary security credential grants temporary access rights. It includes a temporary AK/SK and a security token, both of which must be used together.When writing outpu",
"doc_type":"usermanual",
"kw":"Spark Jar Jobs Using DEW to Acquire Access Credentials for Reading and Writing Data from and to OBS,",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Spark Jar Jobs Using DEW to Acquire Access Credentials for Reading and Writing Data from and to OBS",
"githuburl":""
},
{
"uri":"dli_01_0422.html",
"node_id":"dli_01_0422.xml",
"product_code":"dli",
"code":"86",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Using DLI Datasource Authentication to Manage Access Credentials for Data Sources",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Using DLI Datasource Authentication to Manage Access Credentials for Data Sources",
"githuburl":""
},
{
"uri":"dli_01_0561.html",
"node_id":"dli_01_0561.xml",
"product_code":"dli",
"code":"87",
"des":"When analyzing across multiple sources, you are advised not to configure authentication information directly in a job as it can lead to password leakage. Instead, you are",
"doc_type":"usermanual",
"kw":"Overview,Using DLI Datasource Authentication to Manage Access Credentials for Data Sources,User Guid",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Overview",
"githuburl":""
},
{
"uri":"dli_01_0427.html",
"node_id":"dli_01_0427.xml",
"product_code":"dli",
"code":"88",
"des":"Create a CSS datasource authentication on the DLI console to store the authentication information of the CSS security cluster to DLI. This will allow you to access to the",
"doc_type":"usermanual",
"kw":"Creating a CSS Datasource Authentication,Using DLI Datasource Authentication to Manage Access Creden",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Creating a CSS Datasource Authentication",
"githuburl":""
},
{
"uri":"dli_01_0558.html",
"node_id":"dli_01_0558.xml",
"product_code":"dli",
"code":"89",
"des":"Create a Kerberos datasource authentication on the DLI console to store the authentication information of the data source to DLI. This will allow you to access to the dat",
"doc_type":"usermanual",
"kw":"Creating a Kerberos Datasource Authentication,Using DLI Datasource Authentication to Manage Access C",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Creating a Kerberos Datasource Authentication",
"githuburl":""
},
{
"uri":"dli_01_0560.html",
"node_id":"dli_01_0560.xml",
"product_code":"dli",
"code":"90",
"des":"Create a Kafka_SSL datasource authentication on the DLI console to store the Kafka authentication information to DLI. This will allow you to access to Kafka instances wit",
"doc_type":"usermanual",
"kw":"Creating a Kafka_SSL Datasource Authentication,Using DLI Datasource Authentication to Manage Access ",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Creating a Kafka_SSL Datasource Authentication",
"githuburl":""
},
{
"uri":"dli_01_0559.html",
"node_id":"dli_01_0559.xml",
"product_code":"dli",
"code":"91",
"des":"Create a password datasource authentication on the DLI console to store passwords of the DWS, RDS, DCS, and DDS data sources to DLI. This will allow you to access to the ",
"doc_type":"usermanual",
"kw":"Creating a Password Datasource Authentication,Using DLI Datasource Authentication to Manage Access C",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Creating a Password Datasource Authentication",
"githuburl":""
},
{
"uri":"dli_01_0480.html",
"node_id":"dli_01_0480.xml",
"product_code":"dli",
"code":"92",
"des":"Grant permissions on a datasource authentication to users so multiple user jobs can use the datasource authentication without affecting each other.The administrator and t",
"doc_type":"usermanual",
"kw":"Datasource Authentication Permission Management,Using DLI Datasource Authentication to Manage Access",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Datasource Authentication Permission Management",
"githuburl":""
},
{
"uri":"dli_01_0509.html",
"node_id":"dli_01_0509.xml",
"product_code":"dli",
"code":"93",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Managing Enhanced Datasource Connections",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Managing Enhanced Datasource Connections",
"githuburl":""
},
{
"uri":"dli_01_0623.html",
"node_id":"dli_01_0623.xml",
"product_code":"dli",
"code":"94",
"des":"After creating an enhanced datasource connection, you can view and manage it on the management console.This section describes how to view basic information about an enhan",
"doc_type":"usermanual",
"kw":"Viewing Basic Information About an Enhanced Datasource Connection,Managing Enhanced Datasource Conne",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Viewing Basic Information About an Enhanced Datasource Connection",
"githuburl":""
},
{
"uri":"dli_01_0018.html",
"node_id":"dli_01_0018.xml",
"product_code":"dli",
"code":"95",
"des":"Enhanced connections support user authorization by project. After authorization, users in the project have the permission to perform operations on the enhanced connection",
"doc_type":"usermanual",
"kw":"Enhanced Connection Permission Management,Managing Enhanced Datasource Connections,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Enhanced Connection Permission Management",
"githuburl":""
},
{
"uri":"dli_01_0009.html",
"node_id":"dli_01_0009.xml",
"product_code":"dli",
"code":"96",
"des":"To connect other resource pools to data sources through enhanced datasource connections, bind enhanced datasource connections to resource pools on the Enhanced tab page.T",
"doc_type":"usermanual",
"kw":"Binding an Enhanced Datasource Connection to an Elastic Resource Pool,Managing Enhanced Datasource C",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Binding an Enhanced Datasource Connection to an Elastic Resource Pool",
"githuburl":""
},
{
"uri":"dli_01_0555.html",
"node_id":"dli_01_0555.xml",
"product_code":"dli",
"code":"97",
"des":"Unbind an enhanced datasource connection from an elastic resource pool that does not need to access a data source through an enhanced datasoruce connection.If the status ",
"doc_type":"usermanual",
"kw":"Unbinding an Enhanced Datasource Connection from an Elastic Resource Pool,Managing Enhanced Datasour",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Unbinding an Enhanced Datasource Connection from an Elastic Resource Pool",
"githuburl":""
},
{
"uri":"dli_01_0014.html",
"node_id":"dli_01_0014.xml",
"product_code":"dli",
"code":"98",
"des":"Enhanced datasource connections establish peering connections between DLI elastic resource pools and data sources to interconnect two VPC networks. If we liken these peer",
"doc_type":"usermanual",
"kw":"Adding a Route for an Enhanced Datasource Connection,Managing Enhanced Datasource Connections,User G",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Adding a Route for an Enhanced Datasource Connection",
"githuburl":""
},
{
"uri":"dli_01_0556.html",
"node_id":"dli_01_0556.xml",
"product_code":"dli",
"code":"99",
"des":"Delete a route that is no longer used.A custom route table cannot be deleted if it is associated with a subnet.Log in to the DLI management console.In the navigation pane",
"doc_type":"usermanual",
"kw":"Deleting the Route for an Enhanced Datasource Connection,Managing Enhanced Datasource Connections,Us",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Deleting the Route for an Enhanced Datasource Connection",
"githuburl":""
},
{
"uri":"dli_01_0013.html",
"node_id":"dli_01_0013.xml",
"product_code":"dli",
"code":"100",
"des":"Host information is the mapping between host IP addresses and domain names. After you configure host information, jobs can only use the configured domain names to access ",
"doc_type":"usermanual",
"kw":"Modifying Host Information in an Elastic Resource Pool,Managing Enhanced Datasource Connections,User",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Modifying Host Information in an Elastic Resource Pool",
"githuburl":""
},
{
"uri":"dli_01_0019.html",
"node_id":"dli_01_0019.xml",
"product_code":"dli",
"code":"101",
"des":"A tag is a user-defined key-value pair used to identify cloud resources, helping you classify and search for them. A tag consists of a tag key and a tag value.If you use ",
"doc_type":"usermanual",
"kw":"Enhanced Datasource Connection Tag Management,Managing Enhanced Datasource Connections,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Enhanced Datasource Connection Tag Management",
"githuburl":""
},
{
"uri":"dli_01_0553.html",
"node_id":"dli_01_0553.xml",
"product_code":"dli",
"code":"102",
"des":"Delete an enhanced datasource connection that is no longer used on the console.Log in to the DLI management console.In the navigation pane on the left, choose Datasource ",
"doc_type":"usermanual",
"kw":"Deleting an Enhanced Datasource Connection,Managing Enhanced Datasource Connections,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Deleting an Enhanced Datasource Connection",
"githuburl":""
},
{
"uri":"dli_01_0486.html",
"node_id":"dli_01_0486.xml",
"product_code":"dli",
"code":"103",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Configuring an Agency to Allow DLI to Access Other Cloud Services",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Configuring an Agency to Allow DLI to Access Other Cloud Services",
"githuburl":""
},
{
"uri":"dli_01_0419.html",
"node_id":"dli_01_0419.xml",
"product_code":"dli",
"code":"104",
"des":"Cloud services often need to interact with each other for business operations. In some cases, one cloud service may require collaboration with another. To facilitate this",
"doc_type":"usermanual",
"kw":"DLI Agency Overview,Configuring an Agency to Allow DLI to Access Other Cloud Services,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"DLI Agency Overview",
"githuburl":""
},
{
"uri":"dli_01_0616.html",
"node_id":"dli_01_0616.xml",
"product_code":"dli",
"code":"105",
"des":"When Flink 1.15, Spark 3.3, or a later version is used to execute jobs and the required agency is not included in the DLI system agency dli_management_agency, you need to",
"doc_type":"usermanual",
"kw":"Creating a Custom DLI Agency,Configuring an Agency to Allow DLI to Access Other Cloud Services,User ",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Creating a Custom DLI Agency",
"githuburl":""
},
{
"uri":"dli_01_0617.html",
"node_id":"dli_01_0617.xml",
"product_code":"dli",
"code":"106",
"des":"This section provides agency permission policies for common scenarios, which can be used to configure agency permission policies when you customize your permissions. The ",
"doc_type":"usermanual",
"kw":"Agency Permission Policies in Common Scenarios,Configuring an Agency to Allow DLI to Access Other Cl",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Agency Permission Policies in Common Scenarios",
"githuburl":""
},
{
"uri":"dli_01_0402.html",
"node_id":"dli_01_0402.xml",
"product_code":"dli",
"code":"107",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Submitting a SQL Job on the DLI Management Console",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Submitting a SQL Job on the DLI Management Console",
"githuburl":""
},
{
"uri":"dli_01_0320.html",
"node_id":"dli_01_0320.xml",
"product_code":"dli",
"code":"108",
"des":"DLI offers a SQL editor for executing data query operations using SQL statements.This section describes how to create and submit a SQL job using the DLI SQL editor.Before",
"doc_type":"usermanual",
"kw":"Creating and Submitting a SQL Job,Submitting a SQL Job on the DLI Management Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Creating and Submitting a SQL Job",
"githuburl":""
},
{
"uri":"dli_01_0621.html",
"node_id":"dli_01_0621.xml",
"product_code":"dli",
"code":"109",
"des":"Store the data results of analyzed SQL jobs in a specified location in the desired format.By default, DLI stores SQL job results in its job bucket. You can also download ",
"doc_type":"usermanual",
"kw":"Exporting SQL Job Results,Submitting a SQL Job on the DLI Management Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Exporting SQL Job Results",
"githuburl":""
},
{
"uri":"dli_01_0612.html",
"node_id":"dli_01_0612.xml",
"product_code":"dli",
"code":"110",
"des":"There are numerous SQL engines in the big data field, which bring diversity to the solutions but also expose some issues such as varying quality of SQL input statements, ",
"doc_type":"usermanual",
"kw":"Creating a SQL Inspection Rule,Submitting a SQL Job on the DLI Management Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Creating a SQL Inspection Rule",
"githuburl":""
},
{
"uri":"dli_01_0535.html",
"node_id":"dli_01_0535.xml",
"product_code":"dli",
"code":"111",
"des":"In actual job running, it is necessary to prioritize and ensure the normal running of important and urgent tasks due to their varying levels of importance and urgency. Th",
"doc_type":"usermanual",
"kw":"Setting the Priority for a SQL Job,Submitting a SQL Job on the DLI Management Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Setting the Priority for a SQL Job",
"githuburl":""
},
{
"uri":"dli_01_0637.html",
"node_id":"dli_01_0637.xml",
"product_code":"dli",
"code":"112",
"des":"DLI job buckets are used to store temporary data generated during DLI job running, such as job logs and results.This section describes how to configure a bucket for DLI j",
"doc_type":"usermanual",
"kw":"Querying Logs for SQL Jobs,Submitting a SQL Job on the DLI Management Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Querying Logs for SQL Jobs",
"githuburl":""
},
{
"uri":"dli_01_0017.html",
"node_id":"dli_01_0017.xml",
"product_code":"dli",
"code":"113",
"des":"The SQL Jobs page displays all SQL jobs, which may span multiple pages if there are many jobs. You can navigate to a specific page as needed. DLI allows you to view jobs ",
"doc_type":"usermanual",
"kw":"Managing SQL Jobs,Submitting a SQL Job on the DLI Management Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Managing SQL Jobs",
"githuburl":""
},
{
"uri":"dli_01_0638.html",
"node_id":"dli_01_0638.xml",
"product_code":"dli",
"code":"114",
"des":"A SQL execution plan is a logical flowchart of a database query that shows how a database management system executes a specific SQL query. The execution plan details the ",
"doc_type":"usermanual",
"kw":"Viewing a SQL Execution Plan,Submitting a SQL Job on the DLI Management Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Viewing a SQL Execution Plan",
"githuburl":""
},
{
"uri":"dli_01_05110.html",
"node_id":"dli_01_05110.xml",
"product_code":"dli",
"code":"115",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Creating and Managing SQL Job Templates",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Creating and Managing SQL Job Templates",
"githuburl":""
},
{
"uri":"dli_01_0021.html",
"node_id":"dli_01_0021.xml",
"product_code":"dli",
"code":"116",
"des":"DLI allows you to create custom templates or save currently used SQL statements as templates for quick and convenient SQL operations. Once a template is saved, you can ex",
"doc_type":"usermanual",
"kw":"Creating a SQL Job Template,Creating and Managing SQL Job Templates,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Creating a SQL Job Template",
"githuburl":""
},
{
"uri":"dli_01_0639.html",
"node_id":"dli_01_0639.xml",
"product_code":"dli",
"code":"117",
"des":"DLI allows you to create custom templates or save currently used SQL statements as templates for quick and convenient SQL operations. Once a template is saved, you can ex",
"doc_type":"usermanual",
"kw":"Developing and Submitting a SQL Job Using a SQL Job Template,Creating and Managing SQL Job Templates",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Developing and Submitting a SQL Job Using a SQL Job Template",
"githuburl":""
},
{
"uri":"dli_01_05111.html",
"node_id":"dli_01_05111.xml",
"product_code":"dli",
"code":"118",
"des":"TPC-H is a test set developed by the Transaction Processing Performance Council (TPC) to simulate decision-making support applications. It is widely used in academia and ",
"doc_type":"usermanual",
"kw":"TPC-H Sample Data in the SQL Templates Preset on DLI,Creating and Managing SQL Job Templates,User Gu",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"TPC-H Sample Data in the SQL Templates Preset on DLI",
"githuburl":""
},
{
"uri":"dli_01_0389.html",
"node_id":"dli_01_0389.xml",
"product_code":"dli",
"code":"119",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Submitting a Flink Job on the DLI Management Console",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Submitting a Flink Job on the DLI Management Console",
"githuburl":""
},
{
"uri":"dli_01_0403.html",
"node_id":"dli_01_0403.xml",
"product_code":"dli",
"code":"120",
"des":"DLI supports two types of Flink jobs:Flink OpenSource SQL job:It is fully compatible with Flink of the community edition, ensuring that jobs can run smoothly on these Fli",
"doc_type":"usermanual",
"kw":"Flink Job Overview,Submitting a Flink Job on the DLI Management Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Flink Job Overview",
"githuburl":""
},
{
"uri":"dli_01_0498.html",
"node_id":"dli_01_0498.xml",
"product_code":"dli",
"code":"121",
"des":"This section describes how to create a Flink OpenSource SQL job.DLI Flink OpenSource SQL jobs are fully compatible with the syntax of Flink provided by the community. In ",
"doc_type":"usermanual",
"kw":"Creating a Flink OpenSource SQL Job,Submitting a Flink Job on the DLI Management Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Creating a Flink OpenSource SQL Job",
"githuburl":""
},
{
"uri":"dli_01_0457.html",
"node_id":"dli_01_0457.xml",
"product_code":"dli",
"code":"122",
"des":"A Flink Jar job involves developing a custom application Jar package based on Flink's capabilities and submitting it to a DLI queue for execution.To create a Flink Jar jo",
"doc_type":"usermanual",
"kw":"Creating a Flink Jar Job,Submitting a Flink Job on the DLI Management Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Creating a Flink Jar Job",
"githuburl":""
},
{
"uri":"dli_01_0479.html",
"node_id":"dli_01_0479.xml",
"product_code":"dli",
"code":"123",
"des":"You can isolate Flink jobs allocated to different users by setting permissions to ensure data query performance.The administrator and job creator have all permissions, wh",
"doc_type":"usermanual",
"kw":"Configuring Flink Job Permissions,Submitting a Flink Job on the DLI Management Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Configuring Flink Job Permissions",
"githuburl":""
},
{
"uri":"dli_01_0377.html",
"node_id":"dli_01_0377.xml",
"product_code":"dli",
"code":"124",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Managing Flink Jobs",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Managing Flink Jobs",
"githuburl":""
},
{
"uri":"dli_01_0462.html",
"node_id":"dli_01_0462.xml",
"product_code":"dli",
"code":"125",
"des":"After creating a Flink job, you can check the basic information, job details, task list, and execution plan of the job on the DLI console.This section describes how to ch",
"doc_type":"usermanual",
"kw":"Viewing Flink Job Details,Managing Flink Jobs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Viewing Flink Job Details",
"githuburl":""
},
{
"uri":"dli_01_0650.html",
"node_id":"dli_01_0650.xml",
"product_code":"dli",
"code":"126",
"des":"In actual job running, it is necessary to prioritize and ensure the normal running of important and urgent tasks due to their varying levels of importance and urgency. Th",
"doc_type":"usermanual",
"kw":"Setting the Priority for a Flink Job,Managing Flink Jobs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Setting the Priority for a Flink Job",
"githuburl":""
},
{
"uri":"dli_01_0534.html",
"node_id":"dli_01_0534.xml",
"product_code":"dli",
"code":"127",
"des":"In actual job operations, the compute resources required by a job vary depending on the data volume. As a result, compute resources are wasted when the volume is small an",
"doc_type":"usermanual",
"kw":"Enabling Dynamic Scaling for Flink Jobs,Managing Flink Jobs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Enabling Dynamic Scaling for Flink Jobs",
"githuburl":""
},
{
"uri":"dli_01_0651.html",
"node_id":"dli_01_0651.xml",
"product_code":"dli",
"code":"128",
"des":"DLI job buckets are used to store temporary data generated during DLI job running, such as job logs and results.This section describes how to configure a bucket for DLI j",
"doc_type":"usermanual",
"kw":"Querying Logs for Flink Jobs,Managing Flink Jobs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Querying Logs for Flink Jobs",
"githuburl":""
},
{
"uri":"dli_01_0461.html",
"node_id":"dli_01_0461.xml",
"product_code":"dli",
"code":"129",
"des":"After creating a job, you can manage it by performing various operations such as editing its basic information, starting or stopping it, and importing or exporting it.You",
"doc_type":"usermanual",
"kw":"Common Operations of Flink Jobs,Managing Flink Jobs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Common Operations of Flink Jobs",
"githuburl":""
},
{
"uri":"dli_01_0464.html",
"node_id":"dli_01_0464.xml",
"product_code":"dli",
"code":"130",
"des":"Flink templates include sample templates and custom templates. You can modify an existing sample template to meet the actual job logic requirements and save time for edit",
"doc_type":"usermanual",
"kw":"Managing Flink Job Templates,Submitting a Flink Job on the DLI Management Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Managing Flink Job Templates",
"githuburl":""
},
{
"uri":"dli_01_0463.html",
"node_id":"dli_01_0463.xml",
"product_code":"dli",
"code":"131",
"des":"A tag is a user-defined key-value pair used to identify cloud resources, helping you classify and search for them. A tag consists of a tag key and a tag value.DLI allows ",
"doc_type":"usermanual",
"kw":"Adding Tags to a Flink Job,Submitting a Flink Job on the DLI Management Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Adding Tags to a Flink Job",
"githuburl":""
},
{
"uri":"dli_01_0465.html",
"node_id":"dli_01_0465.xml",
"product_code":"dli",
"code":"132",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Submitting a Spark Job on the DLI Management Console",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Submitting a Spark Job on the DLI Management Console",
"githuburl":""
},
{
"uri":"dli_01_0384.html",
"node_id":"dli_01_0384.xml",
"product_code":"dli",
"code":"133",
"des":"DLI Spark jobs provide fully managed Spark computing services.On the Overview page, click Create Job in the upper right corner of the Spark Jobs tab or click Create Job i",
"doc_type":"usermanual",
"kw":"Creating a Spark Job,Submitting a Spark Job on the DLI Management Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Creating a Spark Job",
"githuburl":""
},
{
"uri":"dli_01_0652.html",
"node_id":"dli_01_0652.xml",
"product_code":"dli",
"code":"134",
"des":"In actual job running, it is necessary to prioritize and ensure the normal running of important and urgent tasks due to their varying levels of importance and urgency. Th",
"doc_type":"usermanual",
"kw":"Setting the Priority for a Spark Job,Submitting a Spark Job on the DLI Management Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Setting the Priority for a Spark Job",
"githuburl":""
},
{
"uri":"dli_01_0379.html",
"node_id":"dli_01_0379.xml",
"product_code":"dli",
"code":"135",
"des":"DLI job buckets are used to store temporary data generated during DLI job running, such as job logs and results.This section describes how to configure a bucket for DLI j",
"doc_type":"usermanual",
"kw":"Querying Logs for Spark Jobs,Submitting a Spark Job on the DLI Management Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Querying Logs for Spark Jobs",
"githuburl":""
},
{
"uri":"dli_01_0385.html",
"node_id":"dli_01_0385.xml",
"product_code":"dli",
"code":"136",
"des":"To access the Spark job management page, click Spark Jobs on the Overview page or choose Job Management > Spark Jobs in the navigation pane on the left. The page displays",
"doc_type":"usermanual",
"kw":"Managing Spark Jobs,Submitting a Spark Job on the DLI Management Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Managing Spark Jobs",
"githuburl":""
},
{
"uri":"dli_01_0551.html",
"node_id":"dli_01_0551.xml",
"product_code":"dli",
"code":"137",
"des":"You can modify a sample template to meet the Spark job requirements, saving time for editing SQL statements.Currently, the cloud platform does not provide preset Spark te",
"doc_type":"usermanual",
"kw":"Managing Spark Job Templates,Submitting a Spark Job on the DLI Management Console,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Managing Spark Job Templates",
"githuburl":""
},
{
"uri":"dli_01_0445.html",
"node_id":"dli_01_0445.xml",
"product_code":"dli",
"code":"138",
"des":"This section describes metrics reported by DLI to Cloud Eye as well as their namespaces and dimensions. You can use the management console or APIs provided by Cloud Eye t",
"doc_type":"usermanual",
"kw":"Monitoring DLI Using Cloud Eye,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Monitoring DLI Using Cloud Eye",
"githuburl":""
},
{
"uri":"dli_01_0318.html",
"node_id":"dli_01_0318.xml",
"product_code":"dli",
"code":"139",
"des":"With CTS, you can log operations related to DLI, making it easier to search, audit, and trace in the future.",
"doc_type":"usermanual",
"kw":"Using CTS to Audit DLI,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Using CTS to Audit DLI",
"githuburl":""
},
{
"uri":"dli_01_0408.html",
"node_id":"dli_01_0408.xml",
"product_code":"dli",
"code":"140",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"DLI Permission Management",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"DLI Permission Management",
"githuburl":""
},
{
"uri":"dli_01_0440.html",
"node_id":"dli_01_0440.xml",
"product_code":"dli",
"code":"141",
"des":"DLI features two sets of permission systems. These two permission control mechanisms are used in conjunction, with their permissions overlapping and complementing each ot",
"doc_type":"usermanual",
"kw":"Overview of the DLI Permission System,DLI Permission Management,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Overview of the DLI Permission System",
"githuburl":""
},
{
"uri":"dli_01_0689.html",
"node_id":"dli_01_0689.xml",
"product_code":"dli",
"code":"142",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"DLI Permission Management",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"DLI Permission Management",
"githuburl":""
},
{
"uri":"dli_01_0690.html",
"node_id":"dli_01_0690.xml",
"product_code":"dli",
"code":"143",
"des":"The permission management function of DLI itself primarily applies to the permission control of internal DLI resources, rather than relying on the unified identity authen",
"doc_type":"usermanual",
"kw":"Overview,DLI Permission Management,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Overview",
"githuburl":""
},
{
"uri":"dli_01_0691.html",
"node_id":"dli_01_0691.xml",
"product_code":"dli",
"code":"144",
"des":"For details about authorization through the DLI console, see Managing Permissions.For details about authorization through the DLI console, see Queue Permission Management",
"doc_type":"usermanual",
"kw":"DLI Permissions,DLI Permission Management,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"DLI Permissions",
"githuburl":""
},
{
"uri":"dli_01_0692.html",
"node_id":"dli_01_0692.xml",
"product_code":"dli",
"code":"145",
"des":"This section describes how to authorize resources on the DLI console.",
"doc_type":"usermanual",
"kw":"DLI Authorization Operation Guide,DLI Permission Management,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"DLI Authorization Operation Guide",
"githuburl":""
},
{
"uri":"dli_01_0475.html",
"node_id":"dli_01_0475.xml",
"product_code":"dli",
"code":"146",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"IAM Permission Management",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"IAM Permission Management",
"githuburl":""
},
{
"uri":"dli_01_0417.html",
"node_id":"dli_01_0417.xml",
"product_code":"dli",
"code":"147",
"des":"IAM is a foundational service for permission management, offering functions like user identity authentication, permission allocation, and access control, enabling you to ",
"doc_type":"usermanual",
"kw":"Overview,IAM Permission Management,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Overview",
"githuburl":""
},
{
"uri":"dli_01_0693.html",
"node_id":"dli_01_0693.xml",
"product_code":"dli",
"code":"148",
"des":"In IAM, authorization entities are primarily categorized into users and user groups. Integration with enterprise projects enables resource isolation by group and facilita",
"doc_type":"usermanual",
"kw":"IAM Authorization Entity,IAM Permission Management,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"IAM Authorization Entity",
"githuburl":""
},
{
"uri":"dli_01_0441.html",
"node_id":"dli_01_0441.xml",
"product_code":"dli",
"code":"149",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"IAM Permissions,IAM Permission Management,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"IAM Permissions",
"githuburl":""
},
{
"uri":"dli_01_0451.html",
"node_id":"dli_01_0451.xml",
"product_code":"dli",
"code":"150",
"des":"The role/policy-based authorization model provided by Identity and Access Management (IAM) lets you control access to DLI resources. With IAM, you can:Based on the organi",
"doc_type":"usermanual",
"kw":"Using IAM Roles or Policies to Grant Access to DLI,IAM Permission Management,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Using IAM Roles or Policies to Grant Access to DLI",
"githuburl":""
},
{
"uri":"dli_01_0695.html",
"node_id":"dli_01_0695.xml",
"product_code":"dli",
"code":"151",
"des":"An e-commerce company conducts data analysis operations in region A. The marketing department's employees, user 1 and user 2, along with the technical department's employ",
"doc_type":"usermanual",
"kw":"Example Use Case: Creating a User Group and Granting Permissions for Using DLI Elastic Resource Pool",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Example Use Case: Creating a User Group and Granting Permissions for Using DLI Elastic Resource Pools and Databases",
"githuburl":""
},
{
"uri":"dli_01_0567.html",
"node_id":"dli_01_0567.xml",
"product_code":"dli",
"code":"152",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Common DLI Management Operations",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Common DLI Management Operations",
"githuburl":""
},
{
"uri":"dli_01_0494.html",
"node_id":"dli_01_0494.xml",
"product_code":"dli",
"code":"153",
"des":"To enhance the functions and performance of Spark and Flink jobs, you can create custom images by downloading the base images provided by DLI and adding dependencies (fil",
"doc_type":"usermanual",
"kw":"Enhancing the Job Runtime Environment Using a Custom Image,Common DLI Management Operations,User Gui",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Enhancing the Job Runtime Environment Using a Custom Image",
"githuburl":""
},
{
"uri":"dli_01_0476.html",
"node_id":"dli_01_0476.xml",
"product_code":"dli",
"code":"154",
"des":"DLI allows you to set variables that are frequently used during job development as global variables on the DLI management console. This avoids repeated definitions during",
"doc_type":"usermanual",
"kw":"Managing DLI Global Variables,Common DLI Management Operations,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Managing DLI Global Variables",
"githuburl":""
},
{
"uri":"dli_01_0366.html",
"node_id":"dli_01_0366.xml",
"product_code":"dli",
"code":"155",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Managing Program Packages of Jar Jobs",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Managing Program Packages of Jar Jobs",
"githuburl":""
},
{
"uri":"dli_01_0407.html",
"node_id":"dli_01_0407.xml",
"product_code":"dli",
"code":"156",
"des":"Before running DLI jobs, UDF JAR files or Jar job packages need to be uploaded to the cloud platform for unified management and maintenance.There are two ways to manage p",
"doc_type":"usermanual",
"kw":"Package Management Overview,Managing Program Packages of Jar Jobs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Package Management Overview",
"githuburl":""
},
{
"uri":"dli_01_0367.html",
"node_id":"dli_01_0367.xml",
"product_code":"dli",
"code":"157",
"des":"DLI allows you to submit program packages in batches to the general-use queue for running.If you need to update a package, you can use the same package or file to upload ",
"doc_type":"usermanual",
"kw":"Creating a DLI Package,Managing Program Packages of Jar Jobs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Creating a DLI Package",
"githuburl":""
},
{
"uri":"dli_01_0477.html",
"node_id":"dli_01_0477.xml",
"product_code":"dli",
"code":"158",
"des":"By configuring permissions, you can grant different package groups or packages to various users, ensuring that job efficiency remains unaffected and job performance is ma",
"doc_type":"usermanual",
"kw":"Configuring DLI Package Permissions,Managing Program Packages of Jar Jobs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Configuring DLI Package Permissions",
"githuburl":""
},
{
"uri":"dli_01_0478.html",
"node_id":"dli_01_0478.xml",
"product_code":"dli",
"code":"159",
"des":"DLI allows you to change the owner of a package group or package.Log in to the DLI management console and choose Data Management > Package Management.On the Package Manag",
"doc_type":"usermanual",
"kw":"Changing the DLI Package Owner,Managing Program Packages of Jar Jobs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"Changing the DLI Package Owner",
"githuburl":""
},
{
"uri":"dli_01_0369.html",
"node_id":"dli_01_0369.xml",
"product_code":"dli",
"code":"160",
"des":"Tags are key-value pairs that you can define to identify cloud resources. They assist you in categorizing and searching for cloud resources. A tag consists of a key and a",
"doc_type":"usermanual",
"kw":"Managing DLI Package Tags,Managing Program Packages of Jar Jobs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Managing DLI Package Tags",
"githuburl":""
},
{
"uri":"dli_01_0397.html",
"node_id":"dli_01_0397.xml",
"product_code":"dli",
"code":"161",
"des":"DLI built-in dependencies are provided by the platform by default. In case of conflicts, you do not need to upload them when packaging JAR packages of Spark or Flink Jar ",
"doc_type":"usermanual",
"kw":"DLI Built-in Dependencies,Managing Program Packages of Jar Jobs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"DLI Built-in Dependencies",
"githuburl":""
},
{
"uri":"dli_01_0550.html",
"node_id":"dli_01_0550.xml",
"product_code":"dli",
"code":"162",
"des":"Quotas are enforced for service resources on the platform to prevent unforeseen spikes in resource usage. Quotas can limit the quantity and capacity of resources availabl",
"doc_type":"usermanual",
"kw":"Managing DLI Resource Quotas,Common DLI Management Operations,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Managing DLI Resource Quotas",
"githuburl":""
},
{
"uri":"dli_01_0539.html",
"node_id":"dli_01_0539.xml",
"product_code":"dli",
"code":"163",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"FAQ",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"opensource":"true",
"documenttype":"usermanual",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes"
}
],
"title":"FAQ",
"githuburl":""
},
{
"uri":"dli_03_0001.html",
"node_id":"dli_03_0001.xml",
"product_code":"dli",
"code":"164",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"DLI Basics",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"DLI Basics",
"githuburl":""
},
{
"uri":"dli_03_0115.html",
"node_id":"dli_03_0115.xml",
"product_code":"dli",
"code":"165",
"des":"Both DLI and MRS support Spark, but there are some differences in service mode, interface, application scenarios, and performance characteristics.The Spark component of D",
"doc_type":"usermanual",
"kw":"What Are the Differences Between MRS Spark and DLI Spark?,DLI Basics,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"What Are the Differences Between MRS Spark and DLI Spark?",
"githuburl":""
},
{
"uri":"dli_03_0029.html",
"node_id":"dli_03_0029.xml",
"product_code":"dli",
"code":"166",
"des":"Supported data formats:ParquetCSVORCJSONAvroOBS: Data used by SQL jobs, Spark jobs, and Flink jobs can be stored in OBS, reducing storage costs.DLI: The column-based Parq",
"doc_type":"usermanual",
"kw":"Where Can Data Be Stored in DLI?,DLI Basics,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Where Can Data Be Stored in DLI?",
"githuburl":""
},
{
"uri":"dli_03_0129.html",
"node_id":"dli_03_0129.xml",
"product_code":"dli",
"code":"167",
"des":"DLI supports importing data from OBS buckets shared by IAM users under the same tenant, but not from OBS buckets shared by other tenants.This ensures data security and is",
"doc_type":"usermanual",
"kw":"Can I Import OBS Bucket Data Shared by Other Tenants into DLI?,DLI Basics,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Can I Import OBS Bucket Data Shared by Other Tenants into DLI?",
"githuburl":""
},
{
"uri":"dli_03_0263.html",
"node_id":"dli_03_0263.xml",
"product_code":"dli",
"code":"168",
"des":"No, a global variable can only be used by the user who created it. Global variables can be used to simplify complex parameters. For example, long and difficult variables ",
"doc_type":"usermanual",
"kw":"Can a Member Account Use Global Variables Created by Other Member Accounts?,DLI Basics,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Can a Member Account Use Global Variables Created by Other Member Accounts?",
"githuburl":""
},
{
"uri":"dli_03_0260.html",
"node_id":"dli_03_0260.xml",
"product_code":"dli",
"code":"169",
"des":"No.The spark.acls.enable configuration item is not used in DLI. The Apache Spark command injection vulnerability (CVE-2022-33891) does not exist in DLI.This vulnerability",
"doc_type":"usermanual",
"kw":"Is DLI Affected by the Apache Spark Command Injection Vulnerability (CVE-2022-33891)?,DLI Basics,Use",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Is DLI Affected by the Apache Spark Command Injection Vulnerability (CVE-2022-33891)?",
"githuburl":""
},
{
"uri":"dli_03_0126.html",
"node_id":"dli_03_0126.xml",
"product_code":"dli",
"code":"170",
"des":"To manage a large number of DLI jobs, you can use the following methods:Manage jobs by group.Group tens of thousands of jobs by type and run each group on a queue.Group t",
"doc_type":"usermanual",
"kw":"How Do I Manage Jobs Running on DLI?,DLI Basics,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Manage Jobs Running on DLI?",
"githuburl":""
},
{
"uri":"dli_03_0162.html",
"node_id":"dli_03_0162.xml",
"product_code":"dli",
"code":"171",
"des":"DLI does not support directly changing the field names of a table. However, you can solve this issue by migrating the table data using the following steps:Create a table:",
"doc_type":"usermanual",
"kw":"How Do I Change the Field Names of an Existing Table on DLI?,DLI Basics,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Change the Field Names of an Existing Table on DLI?",
"githuburl":""
},
{
"uri":"dli_03_0049.html",
"node_id":"dli_03_0049.xml",
"product_code":"dli",
"code":"172",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"DLI Elastic Resource Pools and Queues",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"DLI Elastic Resource Pools and Queues",
"githuburl":""
},
{
"uri":"dli_03_0276.html",
"node_id":"dli_03_0276.xml",
"product_code":"dli",
"code":"173",
"des":"In daily big data analysis work, it is important to allocate and manage compute resources properly to provide a good job execution environment.You can allocate resources ",
"doc_type":"usermanual",
"kw":"How Can I Check the Actual and Used CUs for an Elastic Resource Pool as Well as the Required CUs for",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Can I Check the Actual and Used CUs for an Elastic Resource Pool as Well as the Required CUs for a Job?",
"githuburl":""
},
{
"uri":"dli_03_0183.html",
"node_id":"dli_03_0183.xml",
"product_code":"dli",
"code":"174",
"des":"You need to check the large number of jobs in the Submitting and Running states on the queue.Use Cloud Eye to view jobs in different states on the queue. The procedure is",
"doc_type":"usermanual",
"kw":"How Do I Check for a Backlog of Jobs in the Current DLI Queue?,DLI Elastic Resource Pools and Queues",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Check for a Backlog of Jobs in the Current DLI Queue?",
"githuburl":""
},
{
"uri":"dli_03_0095.html",
"node_id":"dli_03_0095.xml",
"product_code":"dli",
"code":"175",
"des":"To check the running status of the DLI queue and determine whether to run more jobs on that queue, you need to check the queue load.Search for Cloud Eye on the console.In",
"doc_type":"usermanual",
"kw":"How Do I View the Load of a DLI Queue?,DLI Elastic Resource Pools and Queues,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I View the Load of a DLI Queue?",
"githuburl":""
},
{
"uri":"dli_03_0098.html",
"node_id":"dli_03_0098.xml",
"product_code":"dli",
"code":"176",
"des":"DLI allows you to subscribe to an SMN topic for failed jobs.Log in to the DLI console.In the navigation pane on the left, choose Queue Management.On the Queue Management ",
"doc_type":"usermanual",
"kw":"How Do I Monitor Job Exceptions on a DLI Queue?,DLI Elastic Resource Pools and Queues,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Monitor Job Exceptions on a DLI Queue?",
"githuburl":""
},
{
"uri":"dli_03_0065.html",
"node_id":"dli_03_0065.xml",
"product_code":"dli",
"code":"177",
"des":"Currently, DLI provides two types of queues, For SQL and For general use. SQL queues are used to run SQL jobs. General-use queues are compatible with Spark queues of earl",
"doc_type":"usermanual",
"kw":"How Do I Migrate an Old Version Spark Queue to a General-Purpose Queue?,DLI Elastic Resource Pools a",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Migrate an Old Version Spark Queue to a General-Purpose Queue?",
"githuburl":""
},
{
"uri":"dli_03_0171.html",
"node_id":"dli_03_0171.xml",
"product_code":"dli",
"code":"178",
"des":"After a SQL job was submitted to the default queue, the job runs abnormally. The job log reported that the execution timed out. The exception logs are as follows:[ERROR] ",
"doc_type":"usermanual",
"kw":"How Do I Do If I Encounter a Timeout Exception When Executing DLI SQL Statements on the default Queu",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Do If I Encounter a Timeout Exception When Executing DLI SQL Statements on the default Queue?",
"githuburl":""
},
{
"uri":"dli_03_0211.html",
"node_id":"dli_03_0211.xml",
"product_code":"dli",
"code":"179",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"DLI Databases and Tables",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"DLI Databases and Tables",
"githuburl":""
},
{
"uri":"dli_03_0184.html",
"node_id":"dli_03_0184.xml",
"product_code":"dli",
"code":"180",
"des":"A DLI table exists but cannot be queried on the DLI console.If a table exists but cannot be queried, there is a high probability that the current user does not have the p",
"doc_type":"usermanual",
"kw":"Why Am I Unable to Query a Table on the DLI Console?,DLI Databases and Tables,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Am I Unable to Query a Table on the DLI Console?",
"githuburl":""
},
{
"uri":"dli_03_0013.html",
"node_id":"dli_03_0013.xml",
"product_code":"dli",
"code":"181",
"des":"When submitting a job to import data into a DLI table, if the compression rate of the Parquet/ORC file corresponding to the OBS table is high, exceeding 5 times the compr",
"doc_type":"usermanual",
"kw":"How Do I Do If the Compression Rate of an OBS Table Is High?,DLI Databases and Tables,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Do If the Compression Rate of an OBS Table Is High?",
"githuburl":""
},
{
"uri":"dli_03_0009.html",
"node_id":"dli_03_0009.xml",
"product_code":"dli",
"code":"182",
"des":"To avoid garbled characters caused by inconsistent character encoding, you are advised to unify the encoding format of your data source when executing jobs in DLI.DLI onl",
"doc_type":"usermanual",
"kw":"How Do I Do If Inconsistent Character Encoding Leads to Garbled Characters?,DLI Databases and Tables",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Do If Inconsistent Character Encoding Leads to Garbled Characters?",
"githuburl":""
},
{
"uri":"dli_03_0175.html",
"node_id":"dli_03_0175.xml",
"product_code":"dli",
"code":"183",
"des":"User A created the testTable table in a database through a SQL job and granted user B the permission to insert and delete table data. User A deleted the testTable table a",
"doc_type":"usermanual",
"kw":"Do I Need to Regrant Permissions to Users and Projects After Deleting and Recreating a Table With th",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Do I Need to Regrant Permissions to Users and Projects After Deleting and Recreating a Table With the Same Name?",
"githuburl":""
},
{
"uri":"dli_03_0177.html",
"node_id":"dli_03_0177.xml",
"product_code":"dli",
"code":"184",
"des":"A CSV file is imported to a DLI partitioned table, but the imported file data does not contain the data in the partitioning column. The partitioning column needs to be sp",
"doc_type":"usermanual",
"kw":"How Do I Do If Files Imported Into a DLI Partitioned Table Lack Data for the Partition Columns, Caus",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Do If Files Imported Into a DLI Partitioned Table Lack Data for the Partition Columns, Causing Query Failures After the Import Is Completed?",
"githuburl":""
},
{
"uri":"dli_03_0181.html",
"node_id":"dli_03_0181.xml",
"product_code":"dli",
"code":"185",
"des":"When an OBS foreign table is created, a field in the specified OBS file contains a carriage return line feed (CRLF) character. As a result, the data is incorrect.The stat",
"doc_type":"usermanual",
"kw":"How Do I Fix Incorrect Data in an OBS Foreign Table Caused by Newline Characters in OBS File Fields?",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Fix Incorrect Data in an OBS Foreign Table Caused by Newline Characters in OBS File Fields?",
"githuburl":""
},
{
"uri":"dli_03_0187.html",
"node_id":"dli_03_0187.xml",
"product_code":"dli",
"code":"186",
"des":"The on clause was not added to the SQL statement for joining tables. As a result, the Cartesian product query occurs due to multi-table association, and the queue resourc",
"doc_type":"usermanual",
"kw":"How Do I Prevent a Cartesian Product Query and Resource Overload Due to Missing \"ON\" Conditions in T",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Prevent a Cartesian Product Query and Resource Overload Due to Missing \"ON\" Conditions in Table Joins?",
"githuburl":""
},
{
"uri":"dli_03_0190.html",
"node_id":"dli_03_0190.xml",
"product_code":"dli",
"code":"187",
"des":"Partition data is manually uploaded to a partition of an OBS table. However, the data cannot be queried using DLI SQL editor.After manually adding partition data, you nee",
"doc_type":"usermanual",
"kw":"How Do I Do If I Can't Query Data After Manually Adding It to the Partition Directory of an OBS Tabl",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Do If I Can't Query Data After Manually Adding It to the Partition Directory of an OBS Table?",
"githuburl":""
},
{
"uri":"dli_03_0212.html",
"node_id":"dli_03_0212.xml",
"product_code":"dli",
"code":"188",
"des":"When using the INSERT OVERWRITE statement to overwrite data in a partitioned table, if you find that it overwrites all data instead of the expected partitioned data, it m",
"doc_type":"usermanual",
"kw":"Why Does the \"insert overwrite\" Operation Affect All Data in a Partitioned Table Instead of Just the",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Does the \"insert overwrite\" Operation Affect All Data in a Partitioned Table Instead of Just the Targeted Partition?",
"githuburl":""
},
{
"uri":"dli_03_0214.html",
"node_id":"dli_03_0214.xml",
"product_code":"dli",
"code":"189",
"des":"Spark does not have the datetime type and uses the TIMESTAMP type instead.You can use a function to convert data types.The following is an example.select cast(create_date",
"doc_type":"usermanual",
"kw":"Why Does the \"create_date\" Field in an RDS Table (Datetime Data Type) Appear as a Timestamp in DLI Q",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Does the \"create_date\" Field in an RDS Table (Datetime Data Type) Appear as a Timestamp in DLI Queries?",
"githuburl":""
},
{
"uri":"dli_03_0215.html",
"node_id":"dli_03_0215.xml",
"product_code":"dli",
"code":"190",
"des":"Changing a table name immediately after executing a SQL job may result in an incorrect data size for the table.This is because DLI updates the metadata of the table when ",
"doc_type":"usermanual",
"kw":"How Do I Do If Renaming a Table After a SQL Job Causes Incorrect Data Size?,DLI Databases and Tables",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Do If Renaming a Table After a SQL Job Causes Incorrect Data Size?",
"githuburl":""
},
{
"uri":"dli_03_0231.html",
"node_id":"dli_03_0231.xml",
"product_code":"dli",
"code":"191",
"des":"When DLI is used to insert data into an OBS temporary table, only part of data is imported.Possible causes are as follows:The amount of data read during job execution is ",
"doc_type":"usermanual",
"kw":"How Can I Resolve Data Inconsistencies When Importing Data from DLI to OBS?,DLI Databases and Tables",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Can I Resolve Data Inconsistencies When Importing Data from DLI to OBS?",
"githuburl":""
},
{
"uri":"dli_03_0277.html",
"node_id":"dli_03_0277.xml",
"product_code":"dli",
"code":"192",
"des":"The Hudi table created using Flink SQL statements is not displayed on the DLI console, making it impossible to manage or perform query operations on the table through the",
"doc_type":"usermanual",
"kw":"Why Is a Hudi Table Not Displayed on the DLI Console?,DLI Databases and Tables,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is a Hudi Table Not Displayed on the DLI Console?",
"githuburl":""
},
{
"uri":"dli_03_0022.html",
"node_id":"dli_03_0022.xml",
"product_code":"dli",
"code":"193",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Enhanced Datasource Connections",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Enhanced Datasource Connections",
"githuburl":""
},
{
"uri":"dli_03_0238.html",
"node_id":"dli_03_0238.xml",
"product_code":"dli",
"code":"194",
"des":"The outbound rule had been configured for the security group of the queue associated with the enhanced datasource connection. The datasource authentication used a passwor",
"doc_type":"usermanual",
"kw":"How Do I Resolve a Failure in Connecting DLI to GaussDB(DWS) Through an Enhanced Datasource Connecti",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Resolve a Failure in Connecting DLI to GaussDB(DWS) Through an Enhanced Datasource Connection?",
"githuburl":""
},
{
"uri":"dli_03_0179.html",
"node_id":"dli_03_0179.xml",
"product_code":"dli",
"code":"195",
"des":"A datasource connection is created and bound to a queue. The connectivity test fails and the following error information is displayed:failed to connect to specified addre",
"doc_type":"usermanual",
"kw":"How Do I Do If the Datasource Connection Is Successfully Created but the Network Connectivity Test F",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Do If the Datasource Connection Is Successfully Created but the Network Connectivity Test Fails?",
"githuburl":""
},
{
"uri":"dli_03_0186.html",
"node_id":"dli_03_0186.xml",
"product_code":"dli",
"code":"196",
"des":"Configuring the Connection Between a DLI Queue and a Data Source in a Private NetworkIf your DLI job needs to connect to a data source, for example, MRS, RDS, CSS, Kafka,",
"doc_type":"usermanual",
"kw":"How Do I Configure Network Connectivity Between a DLI Queue and a Data Source?,Enhanced Datasource C",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Configure Network Connectivity Between a DLI Queue and a Data Source?",
"githuburl":""
},
{
"uri":"dli_03_0128.html",
"node_id":"dli_03_0128.xml",
"product_code":"dli",
"code":"197",
"des":"The main reason for creating a VPC peering connection for DLI's enhanced datasource connection is to establish network connectivity between DLI and data sources in differ",
"doc_type":"usermanual",
"kw":"Why Is Creating a VPC Peering Connection Necessary for Enhanced Datasource Connections in DLI?,Enhan",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is Creating a VPC Peering Connection Necessary for Enhanced Datasource Connections in DLI?",
"githuburl":""
},
{
"uri":"dli_03_0257.html",
"node_id":"dli_03_0257.xml",
"product_code":"dli",
"code":"198",
"des":"The possible causes and solutions are as follows:If you have created a queue, do not bind it to a datasource connection immediately. Wait for 5 to 10 minutes. After the c",
"doc_type":"usermanual",
"kw":"How Do I Do If Creating a Datasource Connection in DLI Gets Stuck in the \"Creating\" State When Bindi",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Do If Creating a Datasource Connection in DLI Gets Stuck in the \"Creating\" State When Binding It to a Queue?",
"githuburl":""
},
{
"uri":"dli_03_0047.html",
"node_id":"dli_03_0047.xml",
"product_code":"dli",
"code":"199",
"des":"The network connectivity is abnormal. Check whether the security group is correctly selected and whether the VPC is correctly configured.Example: When you create an RDS d",
"doc_type":"usermanual",
"kw":"How Do I Resolve the \"communication link failure\" Error When Using a Newly Created Datasource Connec",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Resolve the \"communication link failure\" Error When Using a Newly Created Datasource Connection That Appears to Be Activated?",
"githuburl":""
},
{
"uri":"dli_03_0080.html",
"node_id":"dli_03_0080.xml",
"product_code":"dli",
"code":"200",
"des":"If you have not added the cluster host information to the datasource connection, it can lead to KRB authentication failure, resulting in a connection timeout. In this cas",
"doc_type":"usermanual",
"kw":"How Do I Troubleshoot a Connection Timeout Issue That Isn't Recorded in Logs When Accessing MRS HBas",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Troubleshoot a Connection Timeout Issue That Isn't Recorded in Logs When Accessing MRS HBase Through a Datasource Connection?",
"githuburl":""
},
{
"uri":"dli_03_0239.html",
"node_id":"dli_03_0239.xml",
"product_code":"dli",
"code":"201",
"des":"A datasource RDS table was created in the DataArts Studio, and the insert overwrite statement was executed to write data into RDS. DLI.0999: BatchUpdateException: Incorre",
"doc_type":"usermanual",
"kw":"How Do I Do If I Encounter the \"Incorrect string value\" Error When Executing insert overwrite on a D",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Do If I Encounter the \"Incorrect string value\" Error When Executing insert overwrite on a Datasource RDS Table?",
"githuburl":""
},
{
"uri":"dli_03_0250.html",
"node_id":"dli_03_0250.xml",
"product_code":"dli",
"code":"202",
"des":"The system failed to create a datasource RDS table, and null pointer error was reported.The following table creation statement was used:The RDS database is in a PostGre c",
"doc_type":"usermanual",
"kw":"How Do I Resolve the Null Pointer Error When Creating an RDS Datasource Table?,Enhanced Datasource C",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Resolve the Null Pointer Error When Creating an RDS Datasource Table?",
"githuburl":""
},
{
"uri":"dli_03_0251.html",
"node_id":"dli_03_0251.xml",
"product_code":"dli",
"code":"203",
"des":"The system failed to execute insert overwrite on the datasource GaussDB(DWS) table, and org.postgresql.util.PSQLException: ERROR: tuple concurrently updated was displayed",
"doc_type":"usermanual",
"kw":"Error Message \"org.postgresql.util.PSQLException: ERROR: tuple concurrently updated\" Is Displayed Wh",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Error Message \"org.postgresql.util.PSQLException: ERROR: tuple concurrently updated\" Is Displayed When the System Executes insert overwrite on a Datasource GaussDB(DWS) Table",
"githuburl":""
},
{
"uri":"dli_03_0252.html",
"node_id":"dli_03_0252.xml",
"product_code":"dli",
"code":"204",
"des":"A datasource table was used to import data to a CloudTable HBase table. This HBase table contains a column family and a rowkey for 100 million simulating data records. Th",
"doc_type":"usermanual",
"kw":"RegionTooBusyException Is Reported When Data Is Imported to a CloudTable HBase Table Through a Datas",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"RegionTooBusyException Is Reported When Data Is Imported to a CloudTable HBase Table Through a Datasource Table",
"githuburl":""
},
{
"uri":"dli_03_0253.html",
"node_id":"dli_03_0253.xml",
"product_code":"dli",
"code":"205",
"des":"A table was created on GaussDB(DWS) and then a datasource connection was created on DLI to read and write data. An error message was displayed during data writing, indica",
"doc_type":"usermanual",
"kw":"How Do I Do If A Null Value Is Written Into a Non-Null Field When Using a DLI Datasource Connection ",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Do If A Null Value Is Written Into a Non-Null Field When Using a DLI Datasource Connection to Connect to a GaussDB(DWS) Table?",
"githuburl":""
},
{
"uri":"dli_03_0254.html",
"node_id":"dli_03_0254.xml",
"product_code":"dli",
"code":"206",
"des":"A datasource GaussDB(DWS) table and the datasource connection were created in DLI, and the schema of the source table in GaussDB(DWS) were updated. During the job executi",
"doc_type":"usermanual",
"kw":"How Do I Do If an Insert Operation Failed After the Schema of the GaussDB(DWS) Source Table Is Updat",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Do If an Insert Operation Failed After the Schema of the GaussDB(DWS) Source Table Is Updated?",
"githuburl":""
},
{
"uri":"dli_03_0028.html",
"node_id":"dli_03_0028.xml",
"product_code":"dli",
"code":"207",
"des":"When creating an associated RDS table in DLI, if the RDS table contains an auto-increment primary key or other auto-populated fields, you can take the following measures ",
"doc_type":"usermanual",
"kw":"How Do I Insert Data into an RDS Table with an Auto-Increment Primary Key Using DLI?,Enhanced Dataso",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Insert Data into an RDS Table with an Auto-Increment Primary Key Using DLI?",
"githuburl":""
},
{
"uri":"dli_03_0020.html",
"node_id":"dli_03_0020.xml",
"product_code":"dli",
"code":"208",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"SQL Jobs",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"SQL Jobs",
"githuburl":""
},
{
"uri":"dli_03_0204.html",
"node_id":"dli_03_0204.xml",
"product_code":"dli",
"code":"209",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"SQL Job Development",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"SQL Job Development",
"githuburl":""
},
{
"uri":"dli_03_0200.html",
"node_id":"dli_03_0200.xml",
"product_code":"dli",
"code":"210",
"des":"A temporary table is used to store intermediate results. When a transaction or session ends, the data in the temporary table can be automatically deleted. For example, in",
"doc_type":"usermanual",
"kw":"SQL Jobs,SQL Job Development,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"SQL Jobs",
"githuburl":""
},
{
"uri":"dli_03_0086.html",
"node_id":"dli_03_0086.xml",
"product_code":"dli",
"code":"211",
"des":"In distributed file systems, data is stored in blocks. A small file refers to a file whose size is significantly smaller than the block size of the storage system. Large ",
"doc_type":"usermanual",
"kw":"How Do I Merge Small Files?,SQL Job Development,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Merge Small Files?",
"githuburl":""
},
{
"uri":"dli_03_0092.html",
"node_id":"dli_03_0092.xml",
"product_code":"dli",
"code":"212",
"des":"When creating an OBS table, you must specify a table path in the database.The path format is as follows: obs://xxx/database name/table name.If the specified path is akdc.",
"doc_type":"usermanual",
"kw":"How Do I Specify an OBS Path When Creating an OBS Table?,SQL Job Development,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Specify an OBS Path When Creating an OBS Table?",
"githuburl":""
},
{
"uri":"dli_03_0108.html",
"node_id":"dli_03_0108.xml",
"product_code":"dli",
"code":"213",
"des":"To associate JSON data nested in an OBS bucket, you can create a table in asynchronous mode.The following is an example of a table creation statement that shows how to us",
"doc_type":"usermanual",
"kw":"How Do I Create a Table Using JSON Data in an OBS Bucket?,SQL Job Development,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Create a Table Using JSON Data in an OBS Bucket?",
"githuburl":""
},
{
"uri":"dli_03_0069.html",
"node_id":"dli_03_0069.xml",
"product_code":"dli",
"code":"214",
"des":"The correct method for using the count function to perform aggregation is as follows:OrIf an incorrect method is used, an error will be reported.",
"doc_type":"usermanual",
"kw":"How Can I Use the count Function to Perform Aggregation?,SQL Job Development,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Can I Use the count Function to Perform Aggregation?",
"githuburl":""
},
{
"uri":"dli_03_0072.html",
"node_id":"dli_03_0072.xml",
"product_code":"dli",
"code":"215",
"des":"You can use the cross-region replication function of OBS. The procedure is as follows:Export the DLI table data in region 1 to the user-defined OBS bucket.Use the OBS cro",
"doc_type":"usermanual",
"kw":"How Do I Synchronize DLI Table Data Across Regions?,SQL Job Development,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Synchronize DLI Table Data Across Regions?",
"githuburl":""
},
{
"uri":"dli_03_0191.html",
"node_id":"dli_03_0191.xml",
"product_code":"dli",
"code":"216",
"des":"If you need to insert data into a table but only want to specify certain fields, you can use the INSERT INTO statement combined with the SELECT clause.However, DLI curren",
"doc_type":"usermanual",
"kw":"How Do I Insert Table Data into Specific Fields of a Table Using a SQL Job?,SQL Job Development,User",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Insert Table Data into Specific Fields of a Table Using a SQL Job?",
"githuburl":""
},
{
"uri":"dli_03_0196.html",
"node_id":"dli_03_0196.xml",
"product_code":"dli",
"code":"217",
"des":"If the job runs slowly, perform the following steps to find the causes and rectify the fault:Check whether the problem is caused by FullGC.Log in to the DLI console. In t",
"doc_type":"usermanual",
"kw":"How Do I Troubleshoot Slow SQL Jobs?,SQL Job Development,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Troubleshoot Slow SQL Jobs?",
"githuburl":""
},
{
"uri":"dli_03_0091.html",
"node_id":"dli_03_0091.xml",
"product_code":"dli",
"code":"218",
"des":"You can view SQL job logs for routine O&M.Obtain the ID of the DLI job executed on the DataArts Studio console.Job IDOn the DLI console, choose Job Management > SQL Jobs.",
"doc_type":"usermanual",
"kw":"How Do I View DLI SQL Logs?,SQL Job Development,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I View DLI SQL Logs?",
"githuburl":""
},
{
"uri":"dli_03_0116.html",
"node_id":"dli_03_0116.xml",
"product_code":"dli",
"code":"219",
"des":"You can view the job execution records when a job is running.Log in to the DLI management console.In the navigation pane on the left, choose Job Management > SQL Jobs.Ent",
"doc_type":"usermanual",
"kw":"How Do I View SQL Execution Records in DLI?,SQL Job Development,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I View SQL Execution Records in DLI?",
"githuburl":""
},
{
"uri":"dli_03_0093.html",
"node_id":"dli_03_0093.xml",
"product_code":"dli",
"code":"220",
"des":"Data skew is a common issue during the execution of SQL jobs. When data is unevenly distributed, some compute nodes process significantly more data than others, which can",
"doc_type":"usermanual",
"kw":"How Do I Do When Data Skew Occurs During the Execution of a SQL Job?,SQL Job Development,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Do When Data Skew Occurs During the Execution of a SQL Job?",
"githuburl":""
},
{
"uri":"dli_03_0182.html",
"node_id":"dli_03_0182.xml",
"product_code":"dli",
"code":"221",
"des":"A SQL job contains join operations. After the job is submitted, it is stuck in the Running state and no result is returned.When a Spark SQL job has join operations on sma",
"doc_type":"usermanual",
"kw":"Why Does a SQL Job That Has Join Operations Stay in the Running State?,SQL Job Development,User Guid",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Does a SQL Job That Has Join Operations Stay in the Running State?",
"githuburl":""
},
{
"uri":"dli_03_0213.html",
"node_id":"dli_03_0213.xml",
"product_code":"dli",
"code":"222",
"des":"The possible causes and solutions are as follows:After you purchase a DLI queue and submit a SQL job for the first time, wait for 5 to 10 minutes. After the cluster is st",
"doc_type":"usermanual",
"kw":"Why Is a SQL Job Stuck in the Submitting State?,SQL Job Development,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is a SQL Job Stuck in the Submitting State?",
"githuburl":""
},
{
"uri":"dli_03_0206.html",
"node_id":"dli_03_0206.xml",
"product_code":"dli",
"code":"223",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"SQL Job O&M",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"SQL Job O&M",
"githuburl":""
},
{
"uri":"dli_03_0014.html",
"node_id":"dli_03_0014.xml",
"product_code":"dli",
"code":"224",
"des":"This message indicates that you are exporting data to an existing OBS path.Solution:Create an OBS directory.You can create an OBS directory that does not exist to store t",
"doc_type":"usermanual",
"kw":"Why Is Error \"path obs://xxx already exists\" Reported When Data Is Exported to OBS?,SQL Job O&M,User",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is Error \"path obs://xxx already exists\" Reported When Data Is Exported to OBS?",
"githuburl":""
},
{
"uri":"dli_03_0066.html",
"node_id":"dli_03_0066.xml",
"product_code":"dli",
"code":"225",
"des":"This message indicates that the two tables to be joined contain the same column, but the owner of the column is not specified when the command is executed.For example, ta",
"doc_type":"usermanual",
"kw":"Why Is Error \"SQL_ANALYSIS_ERROR: Reference 't.id' is ambiguous, could be: t.id, t.id.;\" Displayed W",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is Error \"SQL_ANALYSIS_ERROR: Reference 't.id' is ambiguous, could be: t.id, t.id.;\" Displayed When Two Tables Are Joined?",
"githuburl":""
},
{
"uri":"dli_03_0071.html",
"node_id":"dli_03_0071.xml",
"product_code":"dli",
"code":"226",
"des":"This message indicates that your operation is restricted because your account is in arrears or there is insufficient balance in your account.Solution:Check the account st",
"doc_type":"usermanual",
"kw":"Why Is Error \"The current account does not have permission to perform this operation,the current acc",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is Error \"The current account does not have permission to perform this operation,the current account was restricted. Restricted for no budget.\" Reported when a SQL Statement Is Executed?",
"githuburl":""
},
{
"uri":"dli_03_0145.html",
"node_id":"dli_03_0145.xml",
"product_code":"dli",
"code":"227",
"des":"When you query the partitioned table XX.YYY, the partition column is not specified in the search criteria.A partitioned table can be queried only when the query condition",
"doc_type":"usermanual",
"kw":"Why Is Error \"There should be at least one partition pruning predicate on partitioned table XX.YYY\" ",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is Error \"There should be at least one partition pruning predicate on partitioned table XX.YYY\" Reported When a Query Statement Is Executed?",
"githuburl":""
},
{
"uri":"dli_03_0169.html",
"node_id":"dli_03_0169.xml",
"product_code":"dli",
"code":"228",
"des":"The following error message is displayed when the LOAD DATA command is executed by a Spark SQL job to import data to a DLI table:In some cases ,the following error messag",
"doc_type":"usermanual",
"kw":"Why Is Error \"IllegalArgumentException: Buffer size too small. size\" Reported When Data Is Loaded to",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is Error \"IllegalArgumentException: Buffer size too small. size\" Reported When Data Is Loaded to an OBS Foreign Table?",
"githuburl":""
},
{
"uri":"dli_03_0189.html",
"node_id":"dli_03_0189.xml",
"product_code":"dli",
"code":"229",
"des":"An error is reported during SQL job execution:Please contact DLI service. DLI.0002: FileNotFoundException: getFileStatus on obs://xxx: status [404]Check whether there is ",
"doc_type":"usermanual",
"kw":"Why Is Error \"DLI.0002 FileNotFoundException\" Reported During SQL Job Running?,SQL Job O&M,User Guid",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is Error \"DLI.0002 FileNotFoundException\" Reported During SQL Job Running?",
"githuburl":""
},
{
"uri":"dli_03_0046.html",
"node_id":"dli_03_0046.xml",
"product_code":"dli",
"code":"230",
"des":"Currently, DLI supports the creation of TEXTFILE, SEQUENCEFILE, RCFILE, ORC, AVRO, and PARQUET tables using the Hive syntax.If you create a table using CTAS statements, s",
"doc_type":"usermanual",
"kw":"Why Is a Schema Parsing Error Reported When I Create a Hive Table Using CTAS?,SQL Job O&M,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is a Schema Parsing Error Reported When I Create a Hive Table Using CTAS?",
"githuburl":""
},
{
"uri":"dli_03_0173.html",
"node_id":"dli_03_0173.xml",
"product_code":"dli",
"code":"231",
"des":"When you run a DLI SQL script on DataArts Studio, the log shows that the statements fail to be executed. The error information is as follows:DLI.0999: RuntimeException: o",
"doc_type":"usermanual",
"kw":"Why Is Error \"org.apache.hadoop.fs.obs.OBSIOException\" Reported When I Run DLI SQL Scripts on DataAr",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is Error \"org.apache.hadoop.fs.obs.OBSIOException\" Reported When I Run DLI SQL Scripts on DataArts Studio?",
"githuburl":""
},
{
"uri":"dli_03_0207.html",
"node_id":"dli_03_0207.xml",
"product_code":"dli",
"code":"232",
"des":"Error message \"File not Found\" is displayed when a SQL job is accessed.The system may not be able to locate the specified file path or file due to an incorrect file path ",
"doc_type":"usermanual",
"kw":"Why Is Error \"File not Found\" Reported When I Access a SQL Job?,SQL Job O&M,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is Error \"File not Found\" Reported When I Access a SQL Job?",
"githuburl":""
},
{
"uri":"dli_03_0208.html",
"node_id":"dli_03_0208.xml",
"product_code":"dli",
"code":"233",
"des":"Error message \"DLI.0003: AccessControlException XXX\" is reported when a SQL job is accessed.Check the permissions of the OBS bucket to ensure that the account has access ",
"doc_type":"usermanual",
"kw":"Why Is Error \"DLI.0003: AccessControlException XXX\" Reported When I Access a SQL Job?,SQL Job O&M,Us",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is Error \"DLI.0003: AccessControlException XXX\" Reported When I Access a SQL Job?",
"githuburl":""
},
{
"uri":"dli_03_0209.html",
"node_id":"dli_03_0209.xml",
"product_code":"dli",
"code":"234",
"des":"Error message \"DLI.0001: org.apache.hadoop.security.AccessControlException: verifyBucketExists on {{bucket name}}: status [403]\" is reported when a SQL job is Accessed.Ch",
"doc_type":"usermanual",
"kw":"Why Is Error \"DLI.0001: org.apache.hadoop.security.AccessControlException: verifyBucketExists on {{b",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is Error \"DLI.0001: org.apache.hadoop.security.AccessControlException: verifyBucketExists on {{bucket name}}: status [403]\" Reported When I Access a SQL Job?",
"githuburl":""
},
{
"uri":"dli_03_0210.html",
"node_id":"dli_03_0210.xml",
"product_code":"dli",
"code":"235",
"des":"Error message \"The current account does not have permission to perform this operation,the current account was restricted.\" is reported during SQL statement execution.Chec",
"doc_type":"usermanual",
"kw":"Why Am I Seeing the Error Message \"The current account does not have permission to perform this oper",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Am I Seeing the Error Message \"The current account does not have permission to perform this operation,the current account was restricted. Restricted for no budget\" When Executing a SQL Statement?",
"githuburl":""
},
{
"uri":"dli_03_0037.html",
"node_id":"dli_03_0037.xml",
"product_code":"dli",
"code":"236",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Flink Jobs",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Flink Jobs",
"githuburl":""
},
{
"uri":"dli_03_0137.html",
"node_id":"dli_03_0137.xml",
"product_code":"dli",
"code":"237",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Flink Job Consulting",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Flink Job Consulting",
"githuburl":""
},
{
"uri":"dli_03_0139.html",
"node_id":"dli_03_0139.xml",
"product_code":"dli",
"code":"238",
"des":"A sub-user can view queues but cannot view Flink jobs. You can authorize the sub-user using DLI or IAM.Authorization on DLILog in to the DLI console using a tenant accoun",
"doc_type":"usermanual",
"kw":"How Do I Authorize a Subuser to View Flink Jobs?,Flink Job Consulting,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Authorize a Subuser to View Flink Jobs?",
"githuburl":""
},
{
"uri":"dli_03_0090.html",
"node_id":"dli_03_0090.xml",
"product_code":"dli",
"code":"239",
"des":"DLI Flink jobs are highly available. You can enable the automatic restart function to automatically restart your jobs after short-time faults of peripheral services are r",
"doc_type":"usermanual",
"kw":"How Do I Configure Auto Restart upon Exception for a Flink Job?,Flink Job Consulting,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Configure Auto Restart upon Exception for a Flink Job?",
"githuburl":""
},
{
"uri":"dli_03_0099.html",
"node_id":"dli_03_0099.xml",
"product_code":"dli",
"code":"240",
"des":"When you create a Flink SQL job or Flink Jar job, you can select Save Job Log on the job editing page to save job running logs to OBS.To set the OBS bucket for storing th",
"doc_type":"usermanual",
"kw":"How Do I Save Logs for Flink Jobs?,Flink Job Consulting,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Save Logs for Flink Jobs?",
"githuburl":""
},
{
"uri":"dli_03_0160.html",
"node_id":"dli_03_0160.xml",
"product_code":"dli",
"code":"241",
"des":"Choose Job Management > Flink Jobs. In the Operation column of the target job, choose More > Permissions. When a new user is authorized, No such user. userName:xxxx. is d",
"doc_type":"usermanual",
"kw":"Why Is Error \"No such user. userName:xxxx.\" Reported on the Flink Job Management Page When I Grant P",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is Error \"No such user. userName:xxxx.\" Reported on the Flink Job Management Page When I Grant Permission to a User?",
"githuburl":""
},
{
"uri":"dli_03_0180.html",
"node_id":"dli_03_0180.xml",
"product_code":"dli",
"code":"242",
"des":"Checkpoint was enabled when a Flink job is created, and the OBS bucket for storing checkpoints was specified. I am not sure how to restore a Flink job from a specific che",
"doc_type":"usermanual",
"kw":"How Do I Restore a Flink Job from a Specific Checkpoint After Manually Stopping the Job?,Flink Job C",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Restore a Flink Job from a Specific Checkpoint After Manually Stopping the Job?",
"githuburl":""
},
{
"uri":"dli_03_0036.html",
"node_id":"dli_03_0036.xml",
"product_code":"dli",
"code":"243",
"des":"When you set running parameters of a DLI Flink job, you can enable Alarm Generation upon Job Exception to receive alarms when the job runs abnormally or is in arrears.If ",
"doc_type":"usermanual",
"kw":"Why Is a Message Displayed Indicating That the SMN Topic Does Not Exist When I Use the SMN Topic in ",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is a Message Displayed Indicating That the SMN Topic Does Not Exist When I Use the SMN Topic in DLI?",
"githuburl":""
},
{
"uri":"dli_03_0131.html",
"node_id":"dli_03_0131.xml",
"product_code":"dli",
"code":"244",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Flink SQL Jobs",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Flink SQL Jobs",
"githuburl":""
},
{
"uri":"dli_03_0089.html",
"node_id":"dli_03_0089.xml",
"product_code":"dli",
"code":"245",
"des":"When using a Flink SQL job, you need to create an OBS partition table for subsequent batch processing.In the following example, the day field is used as the partition fie",
"doc_type":"usermanual",
"kw":"How Do I Map an OBS Table to a DLI Partitioned Table?,Flink SQL Jobs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Map an OBS Table to a DLI Partitioned Table?",
"githuburl":""
},
{
"uri":"dli_03_0120.html",
"node_id":"dli_03_0120.xml",
"product_code":"dli",
"code":"246",
"des":"You used Flink 1.10 to run a Flink Opensource SQL job. You set the number of Kafka partitions for the job a small value at the beginning and need to increase the number n",
"doc_type":"usermanual",
"kw":"How Do I Change the Number of Kafka Partitions in a Flink SQL Job Without Stopping It?,Flink SQL Job",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Change the Number of Kafka Partitions in a Flink SQL Job Without Stopping It?",
"githuburl":""
},
{
"uri":"dli_03_0167.html",
"node_id":"dli_03_0167.xml",
"product_code":"dli",
"code":"247",
"des":"When I run the creation statement with an EL expression in the table name in a Flink SQL job, the following error message is displayed:DLI.0005: AnalysisException: t_user",
"doc_type":"usermanual",
"kw":"How Do I Fix the DLI.0005 Error When Using EL Expressions to Create a Table in a Flink SQL Job?,Flin",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Fix the DLI.0005 Error When Using EL Expressions to Create a Table in a Flink SQL Job?",
"githuburl":""
},
{
"uri":"dli_03_0168.html",
"node_id":"dli_03_0168.xml",
"product_code":"dli",
"code":"248",
"des":"After data is written to OBS through the Flink job output stream, data cannot be queried from the DLI table created in the OBS file path.For example, use the following Fl",
"doc_type":"usermanual",
"kw":"Why Is No Data Queried in the DLI Table Created Using the OBS File Path When Data Is Written to OBS ",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is No Data Queried in the DLI Table Created Using the OBS File Path When Data Is Written to OBS by a Flink Job Output Stream?",
"githuburl":""
},
{
"uri":"dli_03_0174.html",
"node_id":"dli_03_0174.xml",
"product_code":"dli",
"code":"249",
"des":"After a Flink SQL job is submitted on DLI, the job fails to be executed. The following error information is displayed in the job log:connect to DIS failed java.lang.Illeg",
"doc_type":"usermanual",
"kw":"Why Does a Flink SQL Job Fails to Be Executed, and Is \"connect to DIS failed java.lang.IllegalArgume",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Does a Flink SQL Job Fails to Be Executed, and Is \"connect to DIS failed java.lang.IllegalArgumentException: Access key cannot be null\" Displayed in the Log?",
"githuburl":""
},
{
"uri":"dli_03_0232.html",
"node_id":"dli_03_0232.xml",
"product_code":"dli",
"code":"250",
"des":"After a Flink SQL job consumed Kafka and sent data to the Elasticsearch cluster, the job was successfully executed, but no data is available.Possible causes are as follow",
"doc_type":"usermanual",
"kw":"Data Writing Fails After a Flink SQL Job Consumed Kafka and Sank Data to the Elasticsearch Cluster,F",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Data Writing Fails After a Flink SQL Job Consumed Kafka and Sank Data to the Elasticsearch Cluster",
"githuburl":""
},
{
"uri":"dli_03_0121.html",
"node_id":"dli_03_0121.xml",
"product_code":"dli",
"code":"251",
"des":"You used Flink 1.10 to run a Flink Opensource SQL job. The job failed after the following error was reported when Flink Sink wrote data to Kafka.The CPU usage is too high",
"doc_type":"usermanual",
"kw":"How Do I Configure Connection Retries for Kafka Sink If it is Disconnected?,Flink SQL Jobs,User Guid",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Configure Connection Retries for Kafka Sink If it is Disconnected?",
"githuburl":""
},
{
"uri":"dli_03_0048.html",
"node_id":"dli_03_0048.xml",
"product_code":"dli",
"code":"252",
"des":"In a Flink job, you can use CREATE statements to define source and sink tables, and specify their connector types and related attributes.If you need to write data to diff",
"doc_type":"usermanual",
"kw":"How Do I Write Data to Different Elasticsearch Clusters in a Flink Job?,Flink SQL Jobs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Write Data to Different Elasticsearch Clusters in a Flink Job?",
"githuburl":""
},
{
"uri":"dli_03_0040.html",
"node_id":"dli_03_0040.xml",
"product_code":"dli",
"code":"253",
"des":"To rectify this fault, perform the following steps:Log in to the DIS management console. In the navigation pane, choose Stream Management. View the Flink job SQL statemen",
"doc_type":"usermanual",
"kw":"Why Does DIS Stream Not Exist During Job Semantic Check?,Flink SQL Jobs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Does DIS Stream Not Exist During Job Semantic Check?",
"githuburl":""
},
{
"uri":"dli_03_0265.html",
"node_id":"dli_03_0265.xml",
"product_code":"dli",
"code":"254",
"des":"If the Flink JobManager prompts \"Timeout expired while fetching topic metadata\", it means that the Flink job timed out while trying to fetch metadata for the Kafka topic.",
"doc_type":"usermanual",
"kw":"Why Is Error \"Timeout expired while fetching topic metadata\" Repeatedly Reported in Flink JobManager",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is Error \"Timeout expired while fetching topic metadata\" Repeatedly Reported in Flink JobManager Logs?",
"githuburl":""
},
{
"uri":"dli_03_0132.html",
"node_id":"dli_03_0132.xml",
"product_code":"dli",
"code":"255",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Flink Jar Jobs",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Flink Jar Jobs",
"githuburl":""
},
{
"uri":"dli_03_0044.html",
"node_id":"dli_03_0044.xml",
"product_code":"dli",
"code":"256",
"des":"You can upload configuration files for custom jobs (Jar).Upload the configuration file to DLI through Package Management.In the Other Dependencies area of the Flink Jar j",
"doc_type":"usermanual",
"kw":"Can I Upload Configuration Files for Flink Jar Jobs?,Flink Jar Jobs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Can I Upload Configuration Files for Flink Jar Jobs?",
"githuburl":""
},
{
"uri":"dli_03_0119.html",
"node_id":"dli_03_0119.xml",
"product_code":"dli",
"code":"257",
"des":"The dependency of your Flink job conflicts with a built-in dependency of the DLI Flink platform. As a result, the job submission fails.Check whether there are conflicting",
"doc_type":"usermanual",
"kw":"Why Does a Flink Jar Package Conflict Result in Job Submission Failure?,Flink Jar Jobs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Does a Flink Jar Package Conflict Result in Job Submission Failure?",
"githuburl":""
},
{
"uri":"dli_03_0161.html",
"node_id":"dli_03_0161.xml",
"product_code":"dli",
"code":"258",
"des":"When a Flink Jar job is submitted to access GaussDB(DWS), an error message is displayed indicating that the job fails to be started. The job log contains the following er",
"doc_type":"usermanual",
"kw":"Why Does a Flink Jar Job Fail to Access GaussDB(DWS) and a Message Is Displayed Indicating Too Many ",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Does a Flink Jar Job Fail to Access GaussDB(DWS) and a Message Is Displayed Indicating Too Many Client Connections?",
"githuburl":""
},
{
"uri":"dli_03_0233.html",
"node_id":"dli_03_0233.xml",
"product_code":"dli",
"code":"259",
"des":"The storage path of the Flink Jar job checkpoints was set to an OBS bucket. The job failed to be submitted, and an error message indicating an invalid OBS bucket name was",
"doc_type":"usermanual",
"kw":"Why Is Error Invalid OBS Bucket Name Reported After a Flink Job Submission Failed?,Flink Jar Jobs,Us",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is Error Invalid OBS Bucket Name Reported After a Flink Job Submission Failed?",
"githuburl":""
},
{
"uri":"dli_03_0234.html",
"node_id":"dli_03_0234.xml",
"product_code":"dli",
"code":"260",
"des":"Flink Job submission failed. The exception information is as follows:Flink JAR files conflicted. The submitted Flink JAR file conflicted with the HDFS JAR file of the DLI",
"doc_type":"usermanual",
"kw":"Why Does the Flink Submission Fail Due to Hadoop JAR File Conflict?,Flink Jar Jobs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Does the Flink Submission Fail Due to Hadoop JAR File Conflict?",
"githuburl":""
},
{
"uri":"dli_03_0103.html",
"node_id":"dli_03_0103.xml",
"product_code":"dli",
"code":"261",
"des":"On the Flink job management page, hover the cursor on the status of the job that fails to be submitted to view the brief information about the failure.The possible causes",
"doc_type":"usermanual",
"kw":"How Do I Locate a Flink Job Submission Error?,Flink Jar Jobs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Locate a Flink Job Submission Error?",
"githuburl":""
},
{
"uri":"dli_03_0133.html",
"node_id":"dli_03_0133.xml",
"product_code":"dli",
"code":"262",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Flink Job Performance Tuning",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Flink Job Performance Tuning",
"githuburl":""
},
{
"uri":"dli_03_0106.html",
"node_id":"dli_03_0106.xml",
"product_code":"dli",
"code":"263",
"des":"Data Stacking in a Consumer GroupThe accumulated data of a consumer group can be calculated by the following formula: Total amount of data to be consumed by the consumer ",
"doc_type":"usermanual",
"kw":"Flink Job Performance Tuning,Flink Job Performance Tuning,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Flink Job Performance Tuning",
"githuburl":""
},
{
"uri":"dli_03_0096.html",
"node_id":"dli_03_0096.xml",
"product_code":"dli",
"code":"264",
"des":"The DLI Flink checkpoint/savepoint mechanism is complete and reliable. You can use this mechanism to prevent data loss when a job is manually restarted or restarted due t",
"doc_type":"usermanual",
"kw":"How Do I Prevent Data Loss After Flink Job Restart?,Flink Job Performance Tuning,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Prevent Data Loss After Flink Job Restart?",
"githuburl":""
},
{
"uri":"dli_03_0105.html",
"node_id":"dli_03_0105.xml",
"product_code":"dli",
"code":"265",
"des":"On the Flink job management, click Edit in the Operation column of the target job. On the displayed page, check whether Save Job Log in the Running Parameters tab is enab",
"doc_type":"usermanual",
"kw":"How Do I Locate a Flink Job Running Error?,Flink Job Performance Tuning,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Locate a Flink Job Running Error?",
"githuburl":""
},
{
"uri":"dli_03_0136.html",
"node_id":"dli_03_0136.xml",
"product_code":"dli",
"code":"266",
"des":"Flink's checkpointing is a fault tolerance and recovery mechanism. This mechanism ensures that real-time programs can self-recover in case of exceptions or machine issues",
"doc_type":"usermanual",
"kw":"How Can I Check if a Flink Job Can Be Restored From a Checkpoint After Restarting It?,Flink Job Perf",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Can I Check if a Flink Job Can Be Restored From a Checkpoint After Restarting It?",
"githuburl":""
},
{
"uri":"dli_03_0064.html",
"node_id":"dli_03_0064.xml",
"product_code":"dli",
"code":"267",
"des":"Mode for storing generated job logs when a DLI Flink job fails to be submitted or executed. The options are as follows:If the submission fails, a submission log is genera",
"doc_type":"usermanual",
"kw":"Why Are Logs Not Written to the OBS Bucket After a DLI Flink Job Fails to Be Submitted for Running?,",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Are Logs Not Written to the OBS Bucket After a DLI Flink Job Fails to Be Submitted for Running?",
"githuburl":""
},
{
"uri":"dli_03_0236.html",
"node_id":"dli_03_0236.xml",
"product_code":"dli",
"code":"268",
"des":"JobManager and TaskManager heartbeats timed out. As a result, the Flink job is abnormal.Check whether the network is intermittently disconnected and whether the cluster l",
"doc_type":"usermanual",
"kw":"Why Is the Flink Job Abnormal Due to Heartbeat Timeout Between JobManager and TaskManager?,Flink Job",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is the Flink Job Abnormal Due to Heartbeat Timeout Between JobManager and TaskManager?",
"githuburl":""
},
{
"uri":"dli_03_0021.html",
"node_id":"dli_03_0021.xml",
"product_code":"dli",
"code":"269",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Spark Jobs",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Spark Jobs",
"githuburl":""
},
{
"uri":"dli_03_0217.html",
"node_id":"dli_03_0217.xml",
"product_code":"dli",
"code":"270",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Spark Job Development",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Spark Job Development",
"githuburl":""
},
{
"uri":"dli_03_0201.html",
"node_id":"dli_03_0201.xml",
"product_code":"dli",
"code":"271",
"des":"DLI Spark does not support job scheduling. You can use other services, such as DataArts Studio, or use APIs or SDKs to customize job schedule.The Spark SQL syntax does no",
"doc_type":"usermanual",
"kw":"Spark Jobs,Spark Job Development,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Spark Jobs",
"githuburl":""
},
{
"uri":"dli_03_0107.html",
"node_id":"dli_03_0107.xml",
"product_code":"dli",
"code":"272",
"des":"To use Spark to write data into a DLI table, configure the following parameters:fs.obs.access.keyfs.obs.secret.keyfs.obs.implfs.obs.endpointThe following is an example:",
"doc_type":"usermanual",
"kw":"How Do I Use Spark to Write Data into a DLI Table?,Spark Job Development,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Use Spark to Write Data into a DLI Table?",
"githuburl":""
},
{
"uri":"dli_03_0017.html",
"node_id":"dli_03_0017.xml",
"product_code":"dli",
"code":"273",
"des":"To obtain the AK/SK, set the parameters as follows:Create a SparkContext using code.val sc: SparkContext = new SparkContext()\nsc.hadoopConfiguration.set(\"fs.obs.access.ke",
"doc_type":"usermanual",
"kw":"How Do I Set Up AK/SK So That a General Queue Can Access Tables Stored in OBS?,Spark Job Development",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Set Up AK/SK So That a General Queue Can Access Tables Stored in OBS?",
"githuburl":""
},
{
"uri":"dli_03_0102.html",
"node_id":"dli_03_0102.xml",
"product_code":"dli",
"code":"274",
"des":"Log in to the DLI console. In the navigation pane, choose Job Management > Spark Jobs. In the job list, locate the target job and click next to Job ID to view the parame",
"doc_type":"usermanual",
"kw":"How Do I View the Resource Usage of DLI Spark Jobs?,Spark Job Development,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I View the Resource Usage of DLI Spark Jobs?",
"githuburl":""
},
{
"uri":"dli_03_0076.html",
"node_id":"dli_03_0076.xml",
"product_code":"dli",
"code":"275",
"des":"If the pymysql module is missing, check whether the corresponding EGG package exists. If the package does not exist, upload the pyFile package on the Package Management p",
"doc_type":"usermanual",
"kw":"How Do I Use Python Scripts to Access the MySQL Database If the pymysql Module Is Missing from the S",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Use Python Scripts to Access the MySQL Database If the pymysql Module Is Missing from the Spark Job Results Stored in MySQL?",
"githuburl":""
},
{
"uri":"dli_03_0082.html",
"node_id":"dli_03_0082.xml",
"product_code":"dli",
"code":"276",
"des":"DLI natively supports PySpark.For most cases, Python is preferred for data analysis, and PySpark is the best choice for big data analysis. Generally, JVM programs are pac",
"doc_type":"usermanual",
"kw":"How Do I Run a Complex PySpark Program in DLI?,Spark Job Development,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Run a Complex PySpark Program in DLI?",
"githuburl":""
},
{
"uri":"dli_03_0068.html",
"node_id":"dli_03_0068.xml",
"product_code":"dli",
"code":"277",
"des":"When shuffle statements, such as GROUP BY and JOIN, are executed in Spark jobs, data skew occurs, which slows down the job execution.To solve this problem, you can config",
"doc_type":"usermanual",
"kw":"How Do I Use JDBC to Set the spark.sql.shuffle.partitions Parameter to Improve the Task Concurrency?",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Use JDBC to Set the spark.sql.shuffle.partitions Parameter to Improve the Task Concurrency?",
"githuburl":""
},
{
"uri":"dli_03_0118.html",
"node_id":"dli_03_0118.xml",
"product_code":"dli",
"code":"278",
"des":"You can use SparkFiles to read the file submitted using –-file form a local path: SparkFiles.get(\"Name of the uploaded file\").The file path in the Driver is different fro",
"doc_type":"usermanual",
"kw":"How Do I Read Uploaded Files for a Spark Jar Job?,Spark Job Development,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Read Uploaded Files for a Spark Jar Job?",
"githuburl":""
},
{
"uri":"dli_03_0279.html",
"node_id":"dli_03_0279.xml",
"product_code":"dli",
"code":"279",
"des":"When running a job with Spark 3.3.1, certain fields have empty default attribute values when queried in the view attribute on the client. In contrast, when using Spark 3.",
"doc_type":"usermanual",
"kw":"Why Are View Attributes Empty in Spark 3.3.1 Client?,Spark Job Development,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Are View Attributes Empty in Spark 3.3.1 Client?",
"githuburl":""
},
{
"uri":"dli_03_0077.html",
"node_id":"dli_03_0077.xml",
"product_code":"dli",
"code":"280",
"des":"I cannot find the specified Python environment after adding the Python 3 package.Set spark.yarn.appMasterEnv.PYSPARK_PYTHON to python3 in the conf file to specify the Pyt",
"doc_type":"usermanual",
"kw":"Why Can't I Find the Specified Python Environment After Adding the Python Package?,Spark Job Develop",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Can't I Find the Specified Python Environment After Adding the Python Package?",
"githuburl":""
},
{
"uri":"dli_03_0220.html",
"node_id":"dli_03_0220.xml",
"product_code":"dli",
"code":"281",
"des":"The remaining CUs in the queue may be insufficient. As a result, the job cannot be submitted.To view the remaining CUs of a queue, perform the following steps:Check the C",
"doc_type":"usermanual",
"kw":"Why Is a Spark Jar Job Stuck in the Submitting State?,Spark Job Development,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is a Spark Jar Job Stuck in the Submitting State?",
"githuburl":""
},
{
"uri":"dli_03_0218.html",
"node_id":"dli_03_0218.xml",
"product_code":"dli",
"code":"282",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Spark Job O&M",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Spark Job O&M",
"githuburl":""
},
{
"uri":"dli_03_0156.html",
"node_id":"dli_03_0156.xml",
"product_code":"dli",
"code":"283",
"des":"The following error is reported when a Spark job accesses OBS data:Set the AK/SK to enable Spark jobs to access OBS data.For details, see How Do I Set Up AK/SK So That a ",
"doc_type":"usermanual",
"kw":"Why Do I Get \"ResponseCode: 403\" and \"ResponseStatus: Forbidden\" Errors When a Spark Job Accesses OB",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Do I Get \"ResponseCode: 403\" and \"ResponseStatus: Forbidden\" Errors When a Spark Job Accesses OBS Data?",
"githuburl":""
},
{
"uri":"dli_03_0164.html",
"node_id":"dli_03_0164.xml",
"product_code":"dli",
"code":"284",
"des":"This error message may be due to the OBS bucket being set as the DLI log bucket, which cannot be used for other purposes.You can follow these steps to check:Check if the ",
"doc_type":"usermanual",
"kw":"Why Do I Encounter the Error \"verifyBucketExists on XXXX: status [403]\" When Using a Spark Job to Ac",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Do I Encounter the Error \"verifyBucketExists on XXXX: status [403]\" When Using a Spark Job to Access an OBS Bucket That I Have Permission to Access?",
"githuburl":""
},
{
"uri":"dli_03_0157.html",
"node_id":"dli_03_0157.xml",
"product_code":"dli",
"code":"285",
"des":"When running large amounts of data in a Spark job, if a timeout exception error occurs, it is usually due to insufficient resource configuration, data skew, network issue",
"doc_type":"usermanual",
"kw":"Why Does a Job Running Timeout Occur When Processing a Large Amount of Data with a Spark Job?,Spark ",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Does a Job Running Timeout Occur When Processing a Large Amount of Data with a Spark Job?",
"githuburl":""
},
{
"uri":"dli_03_0188.html",
"node_id":"dli_03_0188.xml",
"product_code":"dli",
"code":"286",
"des":"Spark jobs cannot access SFTP. Upload the files you want to access to OBS and then you can analyze the data using Spark jobs.Upload data to an OBS bucket: Upload data sto",
"doc_type":"usermanual",
"kw":"Why Does a Spark Job Fail to Execute with an Abnormal Access Directory Error When Accessing Files in",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Does a Spark Job Fail to Execute with an Abnormal Access Directory Error When Accessing Files in SFTP?",
"githuburl":""
},
{
"uri":"dli_03_0192.html",
"node_id":"dli_03_0192.xml",
"product_code":"dli",
"code":"287",
"des":"When a Spark job is running, an error message is displayed, indicating that the user does not have the database permission. The error information is as follows:org.apache",
"doc_type":"usermanual",
"kw":"Why Does the Job Fail to Be Executed Due to Insufficient Database and Table Permissions?,Spark Job O",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Does the Job Fail to Be Executed Due to Insufficient Database and Table Permissions?",
"githuburl":""
},
{
"uri":"dli_03_0272.html",
"node_id":"dli_03_0272.xml",
"product_code":"dli",
"code":"288",
"des":"I cannot find the global_temp database in the Spark 3.x job log.The global_temp database is the default built-in database of Spark 3.x and is Spark's global temporary vie",
"doc_type":"usermanual",
"kw":"Why Is the global_temp Database Missing in the Job Log of Spark 3.x?,Spark Job O&M,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is the global_temp Database Missing in the Job Log of Spark 3.x?",
"githuburl":""
},
{
"uri":"dli_03_0275.html",
"node_id":"dli_03_0275.xml",
"product_code":"dli",
"code":"289",
"des":"I failed to use the DataSource syntax to create an OBS table in Avro format when selecting Spark to access metadata.Spark 2.3.x does not support creating OBS tables in Av",
"doc_type":"usermanual",
"kw":"Why Does Using DataSource Syntax to Create an OBS Table of Avro Type Fail When Accessing Metadata Wi",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Does Using DataSource Syntax to Create an OBS Table of Avro Type Fail When Accessing Metadata With Spark 2.3.x?",
"githuburl":""
},
{
"uri":"dli_03_0278.html",
"node_id":"dli_03_0278.xml",
"product_code":"dli",
"code":"290",
"des":"When the rand function is used in SQL statements of Spark 3.3.1, the error message \"Input argument to rand must be a constant\" is displayed.In Spark 3.3.1, the rand funct",
"doc_type":"usermanual",
"kw":"How Do I Resolve the \"Input argument to rand must be a constant\" Error in Spark 3.3.1 SQL Statements",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Resolve the \"Input argument to rand must be a constant\" Error in Spark 3.3.1 SQL Statements?",
"githuburl":""
},
{
"uri":"dli_03_0273.html",
"node_id":"dli_03_0273.xml",
"product_code":"dli",
"code":"291",
"des":"When using Spark 3.3.1 client to create a subquery view with aggregate functions, an error occurs when attempting to write the data, stating \"Not allowed to create a perm",
"doc_type":"usermanual",
"kw":"When Using Spark 3.3.1 Client to Create a View and Perform a Join Query, an Error Occurs Stating \"No",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"When Using Spark 3.3.1 Client to Create a View and Perform a Join Query, an Error Occurs Stating \"Not allowed to create a permanent view\" When Attempting to Write the Data",
"githuburl":""
},
{
"uri":"dli_03_0053.html",
"node_id":"dli_03_0053.xml",
"product_code":"dli",
"code":"292",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"DLI Resource Quotas",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"DLI Resource Quotas",
"githuburl":""
},
{
"uri":"dli_03_0031.html",
"node_id":"dli_03_0031.xml",
"product_code":"dli",
"code":"293",
"des":"Log in to the management console.Click in the upper left corner and select a region and a project.Click the My Quota icon in the upper right corner of the page.This wil",
"doc_type":"usermanual",
"kw":"How Do I View My Quotas?,DLI Resource Quotas,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I View My Quotas?",
"githuburl":""
},
{
"uri":"dli_03_0032.html",
"node_id":"dli_03_0032.xml",
"product_code":"dli",
"code":"294",
"des":"The system currently does not support online quota adjustments. If you need to modify your quota, please contact our customer service team via phone or email. They will p",
"doc_type":"usermanual",
"kw":"How Do I Apply for a Higher Quota?,DLI Resource Quotas,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Apply for a Higher Quota?",
"githuburl":""
},
{
"uri":"dli_03_0054.html",
"node_id":"dli_03_0054.xml",
"product_code":"dli",
"code":"295",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"DLI Permissions Management",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"DLI Permissions Management",
"githuburl":""
},
{
"uri":"dli_03_0008.html",
"node_id":"dli_03_0008.xml",
"product_code":"dli",
"code":"296",
"des":"You are unable to perform permission operations on the partition columns of partitioned tables.However, when you grant the permission of any non-partition column in a par",
"doc_type":"usermanual",
"kw":"What Is Column-Level Authorization for DLI Partitioned Tables?,DLI Permissions Management,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"What Is Column-Level Authorization for DLI Partitioned Tables?",
"githuburl":""
},
{
"uri":"dli_03_0195.html",
"node_id":"dli_03_0195.xml",
"product_code":"dli",
"code":"297",
"des":"When the user update an existing program package, the following error information is displayed:\"error_code\"*DLI.0003\",\"error_msg\":\"Permission denied for resource 'resourc",
"doc_type":"usermanual",
"kw":"How Do I Do If I Encounter Insufficient Permissions While Updating Packages?,DLI Permissions Managem",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Do If I Encounter Insufficient Permissions While Updating Packages?",
"githuburl":""
},
{
"uri":"dli_03_0227.html",
"node_id":"dli_03_0227.xml",
"product_code":"dli",
"code":"298",
"des":"When the SQL query statement is executed, the system displays a message indicating that the user does not have the permission to query resources.Error information: DLI.00",
"doc_type":"usermanual",
"kw":"Why Is Error \"DLI.0003: Permission denied for resource...\" Reported When I Run a SQL Statement?,DLI ",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Is Error \"DLI.0003: Permission denied for resource...\" Reported When I Run a SQL Statement?",
"githuburl":""
},
{
"uri":"dli_03_0228.html",
"node_id":"dli_03_0228.xml",
"product_code":"dli",
"code":"299",
"des":"If you have already granted authorization to a table and a test query was successful, but you encounter an error when trying to query it again after some time, you should",
"doc_type":"usermanual",
"kw":"How Do I Do If I Can't Query Table Data After Being Granted Table Permissions?,DLI Permissions Manag",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Do If I Can't Query Table Data After Being Granted Table Permissions?",
"githuburl":""
},
{
"uri":"dli_03_0057.html",
"node_id":"dli_03_0057.xml",
"product_code":"dli",
"code":"300",
"des":"If a table inherits database permissions, you do not need to regrant the inherited permissions to the table.Re-authorizing may cause confusion in table permission managem",
"doc_type":"usermanual",
"kw":"Will Granting Duplicate Permissions to a Table After Inheriting Database Permissions Cause an Error?",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Will Granting Duplicate Permissions to a Table After Inheriting Database Permissions Cause an Error?",
"githuburl":""
},
{
"uri":"dli_03_0067.html",
"node_id":"dli_03_0067.xml",
"product_code":"dli",
"code":"301",
"des":"User A created a table named Table1.User B created a view named View1 based on Table1.After granting user C the select permission on Table1, user C failed to query the vi",
"doc_type":"usermanual",
"kw":"Why Can't I Query a View Despite Having the Select Permission?,DLI Permissions Management,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Can't I Query a View Despite Having the Select Permission?",
"githuburl":""
},
{
"uri":"dli_03_0225.html",
"node_id":"dli_03_0225.xml",
"product_code":"dli",
"code":"302",
"des":"Despite configuring a job bucket and authorizing DLI to access it, I still receive an error message stating that DLI is not authorized to access the bucket when attemptin",
"doc_type":"usermanual",
"kw":"How Do I Do If I Receive a Message Saying I Don't Have Sufficient Permissions to Submit My Jobs to t",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"How Do I Do If I Receive a Message Saying I Don't Have Sufficient Permissions to Submit My Jobs to the Job Bucket?",
"githuburl":""
},
{
"uri":"dli_03_0056.html",
"node_id":"dli_03_0056.xml",
"product_code":"dli",
"code":"303",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"DLI APIs",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"DLI APIs",
"githuburl":""
},
{
"uri":"dli_03_0060.html",
"node_id":"dli_03_0060.xml",
"product_code":"dli",
"code":"304",
"des":"In the REST API provided by DLI, the request header can be added to the request URI, for example, Content-Type.Content-Type indicates the request body type or format. The",
"doc_type":"usermanual",
"kw":"Why Am I Getting an \"unsupported media Type\" Error When Submitting a SQL Job?,DLI APIs,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"Why Am I Getting an \"unsupported media Type\" Error When Submitting a SQL Job?",
"githuburl":""
},
{
"uri":"dli_03_0178.html",
"node_id":"dli_03_0178.xml",
"product_code":"dli",
"code":"305",
"des":"When the API call for submitting a SQL job times out, and the following error information is displayed:There are currently no resources tracked in the state, so there is ",
"doc_type":"usermanual",
"kw":"What Can I Do If an Error Is Reported When the Execution of the API for Creating a SQL Job Times Out",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No",
"documenttype":"usermanual",
"IsBot":"Yes"
}
],
"title":"What Can I Do If an Error Is Reported When the Execution of the API for Creating a SQL Job Times Out?",
"githuburl":""
},
{
"uri":"dli_01_00006.html",
"node_id":"dli_01_00006.xml",
"product_code":"dli",
"code":"306",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"usermanual",
"kw":"Change History,User Guide",
"search_title":"",
"metedata":[
{
"prodname":"dli",
"IsMulti":"No;Yes;NO",
"IsBot":"No;Yes",
"opensource":"true",
"documenttype":"usermanual"
}
],
"title":"Change History",
"githuburl":""
}
]
View Git Blame Copy Permalink