yexinru/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
Files
d8e1c23e3b8fad5191d84bc016363fd4c3907107
doc-exports/docs/dli/dev/ALL_META.TXT.json
Hasko, Vladimir cfc48b3aed dli_dev_0104_version 
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Co-authored-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-committed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
2024-05-06 09:14:57 +00:00

1304 lines
37 KiB
JSON
Raw Blame History

[
{
"dockw":"Developer Guide"
},
{
"uri":"dli_09_0120.html",
"node_id":"dli_09_0120.xml",
"product_code":"dli",
"code":"1",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"devg",
"kw":"SQL Jobs",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli"
}
],
"title":"SQL Jobs",
"githuburl":""
},
{
"uri":"dli_05_0044.html",
"node_id":"dli_05_0044.xml",
"product_code":"dli",
"code":"2",
"des":"DLI allows you to use data stored on OBS. You can create OBS tables on DLI to access and process data in your OBS bucket.This section describes how to create an OBS table",
"doc_type":"devg",
"kw":"Using Spark SQL Jobs to Analyze OBS Data,SQL Jobs,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Using Spark SQL Jobs to Analyze OBS Data",
"githuburl":""
},
{
"uri":"dli_09_0171.html",
"node_id":"dli_09_0171.xml",
"product_code":"dli",
"code":"3",
"des":"DLI allows you to use Hive user-defined functions (UDFs) to query data. UDFs take effect only on a single row of data and are applicable to inserting and deleting a singl",
"doc_type":"devg",
"kw":"Calling UDFs in Spark SQL Jobs,SQL Jobs,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Calling UDFs in Spark SQL Jobs",
"githuburl":""
},
{
"uri":"dli_09_0204.html",
"node_id":"dli_09_0204.xml",
"product_code":"dli",
"code":"4",
"des":"You can use Hive User-Defined Table-Generating Functions (UDTF) to customize table-valued functions. Hive UDTFs are used for the one-in-multiple-out data operations. UDTF",
"doc_type":"devg",
"kw":"Calling UDTFs in Spark SQL Jobs,SQL Jobs,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Calling UDTFs in Spark SQL Jobs",
"githuburl":""
},
{
"uri":"dli_05_0062.html",
"node_id":"dli_05_0062.xml",
"product_code":"dli",
"code":"5",
"des":"DLI allows you to use a Hive User Defined Aggregation Function (UDAF) to process multiple rows of data. Hive UDAF is usually used together with groupBy. It is equivalent ",
"doc_type":"devg",
"kw":"Calling UDAFs in Spark SQL Jobs,SQL Jobs,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Calling UDAFs in Spark SQL Jobs",
"githuburl":""
},
{
"uri":"dli_09_0123.html",
"node_id":"dli_09_0123.xml",
"product_code":"dli",
"code":"6",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"devg",
"kw":"Submitting a Spark SQL Job Using JDBC",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Submitting a Spark SQL Job Using JDBC",
"githuburl":""
},
{
"uri":"dli_09_0124.html",
"node_id":"dli_09_0124.xml",
"product_code":"dli",
"code":"7",
"des":"On DLI, you can connect to the server for data query in the Internet environment. In this case, you need to first obtain the connection information, including the endpoin",
"doc_type":"devg",
"kw":"Obtaining the Server Connection Address,Submitting a Spark SQL Job Using JDBC,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Obtaining the Server Connection Address",
"githuburl":""
},
{
"uri":"dli_09_0125.html",
"node_id":"dli_09_0125.xml",
"product_code":"dli",
"code":"8",
"des":"To connect to DLI, JDBC is utilized. You can obtain the JDBC installation package from Maven or download the JDBC driver file from the DLI management console.JDBC driver ",
"doc_type":"devg",
"kw":"Downloading the JDBC Driver Package,Submitting a Spark SQL Job Using JDBC,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Downloading the JDBC Driver Package",
"githuburl":""
},
{
"uri":"dli_09_0121.html",
"node_id":"dli_09_0121.xml",
"product_code":"dli",
"code":"9",
"des":"You need to be authenticated when using JDBC to create DLI driver connections.Currently, the JDBC supports authentication using the Access Key/Secret Key (AK/SK) or token",
"doc_type":"devg",
"kw":"Performing Authentication,Submitting a Spark SQL Job Using JDBC,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Performing Authentication",
"githuburl":""
},
{
"uri":"dli_09_0127.html",
"node_id":"dli_09_0127.xml",
"product_code":"dli",
"code":"10",
"des":"In Linux or Windows, you can connect to the DLI server using JDBC.Jobs submitted to DLI using JDBC are executed on the Spark engine.Once JDBC 2.X has undergone function r",
"doc_type":"devg",
"kw":"Submitting a Job Using JDBC,Submitting a Spark SQL Job Using JDBC,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Submitting a Job Using JDBC",
"githuburl":""
},
{
"uri":"dli_09_0129.html",
"node_id":"dli_09_0129.xml",
"product_code":"dli",
"code":"11",
"des":"Relational Database Service (RDS) is a cloud-based web service that is reliable, scalable, easy to manage, and immediately ready for use. It can be deployed in single-nod",
"doc_type":"devg",
"kw":"Introduction to RDS,Submitting a Spark SQL Job Using JDBC,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Introduction to RDS",
"githuburl":""
},
{
"uri":"dli_09_0006.html",
"node_id":"dli_09_0006.xml",
"product_code":"dli",
"code":"12",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"devg",
"kw":"Flink OpenSource SQL Jobs",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Flink OpenSource SQL Jobs",
"githuburl":""
},
{
"uri":"dli_09_0009.html",
"node_id":"dli_09_0009.xml",
"product_code":"dli",
"code":"13",
"des":"This guide provides reference for Flink 1.12 only.In this example, we aim to query information about top three most-clicked offerings in each hour from a set of real-time",
"doc_type":"devg",
"kw":"Reading Data from Kafka and Writing Data to RDS,Flink OpenSource SQL Jobs,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Reading Data from Kafka and Writing Data to RDS",
"githuburl":""
},
{
"uri":"dli_09_0010.html",
"node_id":"dli_09_0010.xml",
"product_code":"dli",
"code":"14",
"des":"This guide provides reference for Flink 1.12 only.This example analyzes real-time vehicle driving data and collects statistics on data results that meet specific conditio",
"doc_type":"devg",
"kw":"Reading Data from Kafka and Writing Data to GaussDB(DWS),Flink OpenSource SQL Jobs,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Reading Data from Kafka and Writing Data to GaussDB(DWS)",
"githuburl":""
},
{
"uri":"dli_09_0011.html",
"node_id":"dli_09_0011.xml",
"product_code":"dli",
"code":"15",
"des":"This guide provides reference for Flink 1.12 only.This example analyzes offering purchase data and collects statistics on data results that meet specific conditions. The ",
"doc_type":"devg",
"kw":"Reading Data from Kafka and Writing Data to Elasticsearch,Flink OpenSource SQL Jobs,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Reading Data from Kafka and Writing Data to Elasticsearch",
"githuburl":""
},
{
"uri":"dli_09_0012.html",
"node_id":"dli_09_0012.xml",
"product_code":"dli",
"code":"16",
"des":"This guide provides reference for Flink 1.12 only.Change Data Capture (CDC) can synchronize incremental changes from the source database to one or more destinations. Duri",
"doc_type":"devg",
"kw":"Reading Data from MySQL CDC and Writing Data to GaussDB(DWS),Flink OpenSource SQL Jobs,Developer Gui",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Reading Data from MySQL CDC and Writing Data to GaussDB(DWS)",
"githuburl":""
},
{
"uri":"dli_09_0013.html",
"node_id":"dli_09_0013.xml",
"product_code":"dli",
"code":"17",
"des":"This guide provides reference for Flink 1.12 only.Change Data Capture (CDC) can synchronize incremental changes from the source database to one or more destinations. Duri",
"doc_type":"devg",
"kw":"Reading Data from PostgreSQL CDC and Writing Data to GaussDB(DWS),Flink OpenSource SQL Jobs,Develope",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Reading Data from PostgreSQL CDC and Writing Data to GaussDB(DWS)",
"githuburl":""
},
{
"uri":"dli_09_0207.html",
"node_id":"dli_09_0207.xml",
"product_code":"dli",
"code":"18",
"des":"If you need to configure high reliability for a Flink application, you can set the parameters when creating your Flink jobs.Create an SMN topic and add an email address o",
"doc_type":"devg",
"kw":"Configuring High-Reliability Flink Jobs (Automatic Restart upon Exceptions),Flink OpenSource SQL Job",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Configuring High-Reliability Flink Jobs (Automatic Restart upon Exceptions)",
"githuburl":""
},
{
"uri":"dli_09_0202.html",
"node_id":"dli_09_0202.xml",
"product_code":"dli",
"code":"19",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"devg",
"kw":"Flink Jar Jobs",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Flink Jar Jobs",
"githuburl":""
},
{
"uri":"dli_09_0162.html",
"node_id":"dli_09_0162.xml",
"product_code":"dli",
"code":"20",
"des":"Built on Flink and Spark, the stream ecosystem is fully compatible with the open-source Flink, Storm, and Spark APIs. It is enhanced in features and improved in performan",
"doc_type":"devg",
"kw":"Stream Ecosystem,Flink Jar Jobs,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Stream Ecosystem",
"githuburl":""
},
{
"uri":"dli_09_0150.html",
"node_id":"dli_09_0150.xml",
"product_code":"dli",
"code":"21",
"des":"You can perform secondary development based on Flink APIs to build your own Jar packages and submit them to the DLI queues to interact with data sources such as MRS Kafka",
"doc_type":"devg",
"kw":"Flink Jar Job Examples,Flink Jar Jobs,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Flink Jar Job Examples",
"githuburl":""
},
{
"uri":"dli_09_0191.html",
"node_id":"dli_09_0191.xml",
"product_code":"dli",
"code":"22",
"des":"DLI allows you to use a custom JAR package to run Flink jobs and write data to OBS. This section describes how to write processed Kafka data to OBS. You need to modify th",
"doc_type":"devg",
"kw":"Writing Data to OBS Using Flink Jar,Flink Jar Jobs,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Writing Data to OBS Using Flink Jar",
"githuburl":""
},
{
"uri":"dli_09_0203.html",
"node_id":"dli_09_0203.xml",
"product_code":"dli",
"code":"23",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"devg",
"kw":"Spark Jar Jobs",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Spark Jar Jobs",
"githuburl":""
},
{
"uri":"dli_09_0205.html",
"node_id":"dli_09_0205.xml",
"product_code":"dli",
"code":"24",
"des":"DLI is fully compatible with open-source Apache Spark and allows you to import, query, analyze, and process job data by programming. This section describes how to write a",
"doc_type":"devg",
"kw":"Using Spark Jar Jobs to Read and Query OBS Data,Spark Jar Jobs,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Using Spark Jar Jobs to Read and Query OBS Data",
"githuburl":""
},
{
"uri":"dli_09_0176.html",
"node_id":"dli_09_0176.xml",
"product_code":"dli",
"code":"25",
"des":"DLI allows you to develop a program to create Spark jobs for operations related to databases, DLI or OBS tables, and table data. This example demonstrates how to develop ",
"doc_type":"devg",
"kw":"Using the Spark Job to Access DLI Metadata,Spark Jar Jobs,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Using the Spark Job to Access DLI Metadata",
"githuburl":""
},
{
"uri":"dli_09_0122.html",
"node_id":"dli_09_0122.xml",
"product_code":"dli",
"code":"26",
"des":"DLI Spark-submit is a command line tool used to submit Spark jobs to the DLI server. This tool provides command lines compatible with open-source Spark.Getting authorized",
"doc_type":"devg",
"kw":"Using Spark-submit to Submit a Spark Jar Job,Spark Jar Jobs,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Using Spark-submit to Submit a Spark Jar Job",
"githuburl":""
},
{
"uri":"dli_09_0019.html",
"node_id":"dli_09_0019.xml",
"product_code":"dli",
"code":"27",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"devg",
"kw":"Using Spark Jobs to Access Data Sources of Datasource Connections",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Using Spark Jobs to Access Data Sources of Datasource Connections",
"githuburl":""
},
{
"uri":"dli_09_0020.html",
"node_id":"dli_09_0020.xml",
"product_code":"dli",
"code":"28",
"des":"DLI supports the native Spark DataSource capability and other extended capabilities. You can use SQL statements or Spark jobs to access other data storage services and im",
"doc_type":"devg",
"kw":"Overview,Using Spark Jobs to Access Data Sources of Datasource Connections,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Overview",
"githuburl":""
},
{
"uri":"dli_09_0089.html",
"node_id":"dli_09_0089.xml",
"product_code":"dli",
"code":"29",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"devg",
"kw":"Connecting to CSS",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Connecting to CSS",
"githuburl":""
},
{
"uri":"dli_09_0189.html",
"node_id":"dli_09_0189.xml",
"product_code":"dli",
"code":"30",
"des":"The Elasticsearch 6.5.4 and later versions provided by CSS provides the security settings. Once the function is enabled, CSS provides identity authentication, authorizati",
"doc_type":"devg",
"kw":"CSS Security Cluster Configuration,Connecting to CSS,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"CSS Security Cluster Configuration",
"githuburl":""
},
{
"uri":"dli_09_0061.html",
"node_id":"dli_09_0061.xml",
"product_code":"dli",
"code":"31",
"des":"A datasource connection has been created on the DLI management console.Development descriptionConstructing dependency information and creating a Spark sessionImport depen",
"doc_type":"devg",
"kw":"Scala Example Code,Connecting to CSS,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Scala Example Code",
"githuburl":""
},
{
"uri":"dli_09_0090.html",
"node_id":"dli_09_0090.xml",
"product_code":"dli",
"code":"32",
"des":"A datasource connection has been created on the DLI management console.Development descriptionCode implementationImport dependency packages.from __future__ import print_f",
"doc_type":"devg",
"kw":"PySpark Example Code,Connecting to CSS,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"PySpark Example Code",
"githuburl":""
},
{
"uri":"dli_09_0190.html",
"node_id":"dli_09_0190.xml",
"product_code":"dli",
"code":"33",
"des":"A datasource connection has been created on the DLI management console.Development descriptionCode implementationConstructing dependency information and creating a Spark ",
"doc_type":"devg",
"kw":"Java Example Code,Connecting to CSS,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Java Example Code",
"githuburl":""
},
{
"uri":"dli_09_0086.html",
"node_id":"dli_09_0086.xml",
"product_code":"dli",
"code":"34",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"devg",
"kw":"Connecting to GaussDB(DWS)",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Connecting to GaussDB(DWS)",
"githuburl":""
},
{
"uri":"dli_09_0069.html",
"node_id":"dli_09_0069.xml",
"product_code":"dli",
"code":"35",
"des":"This section provides Scala example code that demonstrates how to use a Spark job to access data from the GaussDB(DWS) data source.A datasource connection has been create",
"doc_type":"devg",
"kw":"Scala Example Code,Connecting to GaussDB(DWS),Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Scala Example Code",
"githuburl":""
},
{
"uri":"dli_09_0087.html",
"node_id":"dli_09_0087.xml",
"product_code":"dli",
"code":"36",
"des":"This section provides PySpark example code that demonstrates how to use a Spark job to access data from the GaussDB(DWS) data source.A datasource connection has been crea",
"doc_type":"devg",
"kw":"PySpark Example Code,Connecting to GaussDB(DWS),Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"PySpark Example Code",
"githuburl":""
},
{
"uri":"dli_09_0199.html",
"node_id":"dli_09_0199.xml",
"product_code":"dli",
"code":"37",
"des":"This section provides Java example code that demonstrates how to use a Spark job to access data from the GaussDB(DWS) data source.A datasource connection has been created",
"doc_type":"devg",
"kw":"Java Example Code,Connecting to GaussDB(DWS),Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Java Example Code",
"githuburl":""
},
{
"uri":"dli_09_0077.html",
"node_id":"dli_09_0077.xml",
"product_code":"dli",
"code":"38",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"devg",
"kw":"Connecting to HBase",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Connecting to HBase",
"githuburl":""
},
{
"uri":"dli_09_0196.html",
"node_id":"dli_09_0196.xml",
"product_code":"dli",
"code":"39",
"des":"Create a datasource connection on the DLI management console.Add the /etc/hosts information of MRS cluster nodes to the host file of the DLI queue.For details, see sectio",
"doc_type":"devg",
"kw":"MRS Configuration,Connecting to HBase,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"MRS Configuration",
"githuburl":""
},
{
"uri":"dli_09_0063.html",
"node_id":"dli_09_0063.xml",
"product_code":"dli",
"code":"40",
"des":"The CloudTable HBase and MRS HBase can be connected to DLI as data sources.PrerequisitesA datasource connection has been created on the DLI management console.Hard-coded ",
"doc_type":"devg",
"kw":"Scala Example Code,Connecting to HBase,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Scala Example Code",
"githuburl":""
},
{
"uri":"dli_09_0078.html",
"node_id":"dli_09_0078.xml",
"product_code":"dli",
"code":"41",
"des":"The CloudTable HBase and MRS HBase can be connected to DLI as data sources.PrerequisitesA datasource connection has been created on the DLI management console.Hard-coded ",
"doc_type":"devg",
"kw":"PySpark Example Code,Connecting to HBase,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"PySpark Example Code",
"githuburl":""
},
{
"uri":"dli_09_0197.html",
"node_id":"dli_09_0197.xml",
"product_code":"dli",
"code":"42",
"des":"This example applies only to MRS HBase.PrerequisitesA datasource connection has been created and bound to a queue on the DLI management console.Hard-coded or plaintext pa",
"doc_type":"devg",
"kw":"Java Example Code,Connecting to HBase,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Java Example Code",
"githuburl":""
},
{
"uri":"dli_09_0198.html",
"node_id":"dli_09_0198.xml",
"product_code":"dli",
"code":"43",
"des":"SymptomThe Spark job fails to be executed, and the job log indicates that the Java server connection or container fails to be started.The Spark job fails to be executed, ",
"doc_type":"devg",
"kw":"Troubleshooting,Connecting to HBase,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Troubleshooting",
"githuburl":""
},
{
"uri":"dli_09_0080.html",
"node_id":"dli_09_0080.xml",
"product_code":"dli",
"code":"44",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"devg",
"kw":"Connecting to OpenTSDB",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Connecting to OpenTSDB",
"githuburl":""
},
{
"uri":"dli_09_0065.html",
"node_id":"dli_09_0065.xml",
"product_code":"dli",
"code":"45",
"des":"The CloudTable OpenTSDB and MRS OpenTSDB can be connected to DLI as data sources.PrerequisitesA datasource connection has been created on the DLI management console.Hard-",
"doc_type":"devg",
"kw":"Scala Example Code,Connecting to OpenTSDB,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Scala Example Code",
"githuburl":""
},
{
"uri":"dli_09_0081.html",
"node_id":"dli_09_0081.xml",
"product_code":"dli",
"code":"46",
"des":"The CloudTable OpenTSDB and MRS OpenTSDB can be connected to DLI as data sources.PrerequisitesA datasource connection has been created on the DLI management console.Hard-",
"doc_type":"devg",
"kw":"PySpark Example Code,Connecting to OpenTSDB,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"PySpark Example Code",
"githuburl":""
},
{
"uri":"dli_09_0193.html",
"node_id":"dli_09_0193.xml",
"product_code":"dli",
"code":"47",
"des":"This example applies only to MRS OpenTSDB.PrerequisitesA datasource connection has been created and bound to a queue on the DLI management console.Hard-coded or plaintext",
"doc_type":"devg",
"kw":"Java Example Code,Connecting to OpenTSDB,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Java Example Code",
"githuburl":""
},
{
"uri":"dli_09_0195.html",
"node_id":"dli_09_0195.xml",
"product_code":"dli",
"code":"48",
"des":"SymptomA Spark job fails to be executed and \"No respond\" is displayed in the job log.A Spark job fails to be executed and \"No respond\" is displayed in the job log.Solutio",
"doc_type":"devg",
"kw":"Troubleshooting,Connecting to OpenTSDB,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Troubleshooting",
"githuburl":""
},
{
"uri":"dli_09_0083.html",
"node_id":"dli_09_0083.xml",
"product_code":"dli",
"code":"49",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"devg",
"kw":"Connecting to RDS",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Connecting to RDS",
"githuburl":""
},
{
"uri":"dli_09_0067.html",
"node_id":"dli_09_0067.xml",
"product_code":"dli",
"code":"50",
"des":"PrerequisitesA datasource connection has been created and bound to a queue on the DLI management console.Hard-coded or plaintext passwords pose significant security risks",
"doc_type":"devg",
"kw":"Scala Example Code,Connecting to RDS,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Scala Example Code",
"githuburl":""
},
{
"uri":"dli_09_0084.html",
"node_id":"dli_09_0084.xml",
"product_code":"dli",
"code":"51",
"des":"PrerequisitesA datasource connection has been created and bound to a queue on the DLI management console.Hard-coded or plaintext passwords pose significant security risks",
"doc_type":"devg",
"kw":"PySpark Example Code,Connecting to RDS,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"PySpark Example Code",
"githuburl":""
},
{
"uri":"dli_09_0187.html",
"node_id":"dli_09_0187.xml",
"product_code":"dli",
"code":"52",
"des":"PrerequisitesA datasource connection has been created and bound to a queue on the DLI management console.Hard-coded or plaintext passwords pose significant security risks",
"doc_type":"devg",
"kw":"Java Example Code,Connecting to RDS,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Java Example Code",
"githuburl":""
},
{
"uri":"dli_09_0093.html",
"node_id":"dli_09_0093.xml",
"product_code":"dli",
"code":"53",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"devg",
"kw":"Connecting to Redis",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Connecting to Redis",
"githuburl":""
},
{
"uri":"dli_09_0094.html",
"node_id":"dli_09_0094.xml",
"product_code":"dli",
"code":"54",
"des":"Redis supports only enhanced datasource connections.PrerequisitesAn enhanced datasource connection has been created on the DLI management console and bound to a queue in ",
"doc_type":"devg",
"kw":"Scala Example Code,Connecting to Redis,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Scala Example Code",
"githuburl":""
},
{
"uri":"dli_09_0097.html",
"node_id":"dli_09_0097.xml",
"product_code":"dli",
"code":"55",
"des":"Redis supports only enhanced datasource connections.PrerequisitesAn enhanced datasource connection has been created on the DLI management console and bound to a queue in ",
"doc_type":"devg",
"kw":"PySpark Example Code,Connecting to Redis,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"PySpark Example Code",
"githuburl":""
},
{
"uri":"dli_09_0100.html",
"node_id":"dli_09_0100.xml",
"product_code":"dli",
"code":"56",
"des":"Redis supports only enhanced datasource connections.PrerequisitesAn enhanced datasource connection has been created on the DLI management console and bound to a queue in ",
"doc_type":"devg",
"kw":"Java Example Code,Connecting to Redis,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Java Example Code",
"githuburl":""
},
{
"uri":"dli_09_0188.html",
"node_id":"dli_09_0188.xml",
"product_code":"dli",
"code":"57",
"des":"SymptomAfter the code is directly copied to the .py file, unexpected characters may exist after the backslashes (\\).After the code is directly copied to the .py file, une",
"doc_type":"devg",
"kw":"Troubleshooting,Connecting to Redis,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"opensource":"true",
"IsBot":"Yes",
"IsMulti":"No",
"doc_type":"devg",
"product_code":"dli"
}
],
"title":"Troubleshooting",
"githuburl":""
},
{
"uri":"dli_09_0113.html",
"node_id":"dli_09_0113.xml",
"product_code":"dli",
"code":"58",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"devg",
"kw":"Connecting to Mongo",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Connecting to Mongo",
"githuburl":""
},
{
"uri":"dli_09_0114.html",
"node_id":"dli_09_0114.xml",
"product_code":"dli",
"code":"59",
"des":"Mongo can be connected only through enhanced datasource connections.DDS is compatible with the MongoDB protocol.An enhanced datasource connection has been created on the ",
"doc_type":"devg",
"kw":"Scala Example Code,Connecting to Mongo,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Scala Example Code",
"githuburl":""
},
{
"uri":"dli_09_0117.html",
"node_id":"dli_09_0117.xml",
"product_code":"dli",
"code":"60",
"des":"Mongo can be connected only through enhanced datasource connections.DDS is compatible with the MongoDB protocol.PrerequisitesAn enhanced datasource connection has been cr",
"doc_type":"devg",
"kw":"PySpark Example Code,Connecting to Mongo,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"PySpark Example Code",
"githuburl":""
},
{
"uri":"dli_09_0110.html",
"node_id":"dli_09_0110.xml",
"product_code":"dli",
"code":"61",
"des":"Mongo can be connected only through enhanced datasource connections.DDS is compatible with the MongoDB protocol.PrerequisitesAn enhanced datasource connection has been cr",
"doc_type":"devg",
"kw":"Java Example Code,Connecting to Mongo,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli",
"IsMulti":"No",
"IsBot":"Yes"
}
],
"title":"Java Example Code",
"githuburl":""
},
{
"uri":"dli_09_00001.html",
"node_id":"dli_09_00001.xml",
"product_code":"dli",
"code":"62",
"des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.",
"doc_type":"devg",
"kw":"Change History,Developer Guide",
"search_title":"",
"metedata":[
{
"documenttype":"devg",
"prodname":"dli"
}
],
"title":"Change History",
"githuburl":""
}
]
View Git Blame Copy Permalink