diff --git a/docs/dli/sqlreference/ALL_META.TXT.json b/docs/dli/sqlreference/ALL_META.TXT.json index e15b31ea0..86e129a9f 100644 --- a/docs/dli/sqlreference/ALL_META.TXT.json +++ b/docs/dli/sqlreference/ALL_META.TXT.json @@ -49,17 +49,17 @@ "code":"3", "des":"This section describes the Spark SQL syntax list provided by DLI. For details about the parameters and examples, see the syntax description.", "doc_type":"sqlreference", - "kw":"SQL Syntax Overview of Batch Jobs,Spark SQL Syntax Reference,SQL Syntax Reference", + "kw":"SQL Syntax Overview for Batch Jobs,Spark SQL Syntax Reference,SQL Syntax Reference", "search_title":"", "metedata":[ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], - "title":"SQL Syntax Overview of Batch Jobs", + "title":"SQL Syntax Overview for Batch Jobs", "githuburl":"" }, { @@ -215,8 +215,8 @@ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], "title":"Creating an OBS Table Using the DataSource Syntax", @@ -235,8 +235,8 @@ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], "title":"Creating an OBS Table Using the Hive Syntax", @@ -275,8 +275,8 @@ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], "title":"Creating a DLI Table Using the DataSource Syntax", @@ -527,19 +527,19 @@ "node_id":"dli_08_0354.xml", "product_code":"dli", "code":"27", - "des":"DLI controls multiple versions of backup data for restoration. After the multiversion function is enabled, the system automatically backs up table data when you delete or", + "des":"The multi-versioning feature is to be deprecated and is not recommended.DLI controls multiple versions of backup data for restoration. After the multiversion function is ", "doc_type":"sqlreference", - "kw":"Enabling or Disabling Multiversion Backup,Modifying a Table,SQL Syntax Reference", + "kw":"Enabling or Disabling Data Multi-Versioning (Deprecated, Not Recommended),Modifying a Table,SQL Synt", "search_title":"", "metedata":[ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], - "title":"Enabling or Disabling Multiversion Backup", + "title":"Enabling or Disabling Data Multi-Versioning (Deprecated, Not Recommended)", "githuburl":"" }, { @@ -727,7 +727,7 @@ "node_id":"dli_08_0095.xml", "product_code":"dli", "code":"37", - "des":"This statement is used to insert the SELECT query result or a certain data record into a table.The INSERT OVERWRITE syntax is not suitable for \"read-write\" scenarios, whe", + "des":"This statement is used to insert the SELECT query result or a certain data record into a table.The insert overwrite syntax does not apply to self-read and self-write scen", "doc_type":"sqlreference", "kw":"Inserting Data,Spark SQL Syntax Reference,SQL Syntax Reference", "search_title":"", @@ -735,8 +735,8 @@ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], "title":"Inserting Data", @@ -809,17 +809,17 @@ "code":"41", "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "doc_type":"sqlreference", - "kw":"Backing Up and Restoring Data of Multiple Versions", + "kw":"Backing Up and Restoring Multi-Versioning Data (Deprecated, Not Recommended)", "search_title":"", "metedata":[ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], - "title":"Backing Up and Restoring Data of Multiple Versions", + "title":"Backing Up and Restoring Multi-Versioning Data (Deprecated, Not Recommended)", "githuburl":"" }, { @@ -827,19 +827,19 @@ "node_id":"dli_08_0350.xml", "product_code":"dli", "code":"42", - "des":"After multiversion is enabled, backup data is retained for seven days by default. You can change the retention period by setting system parameterdli.multi.version.retenti", + "des":"The multi-versioning feature is to be deprecated and is not recommended.After multiversion is enabled, backup data is retained for seven days by default. You can change t", "doc_type":"sqlreference", - "kw":"Setting the Retention Period for Multiversion Backup Data,Backing Up and Restoring Data of Multiple ", + "kw":"Setting the Retention Period of Multi-Versioning Backup Data (Deprecated, Not Recommended),Backing U", "search_title":"", "metedata":[ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], - "title":"Setting the Retention Period for Multiversion Backup Data", + "title":"Setting the Retention Period of Multi-Versioning Backup Data (Deprecated, Not Recommended)", "githuburl":"" }, { @@ -847,19 +847,19 @@ "node_id":"dli_08_0351.xml", "product_code":"dli", "code":"43", - "des":"After the multiversion function is enabled, you can run the SHOW HISTORY command to view the backup data of a table. For details about the syntax for enabling or disablin", + "des":"The multi-versioning feature is to be deprecated and is not recommended.After the multiversion function is enabled, you can run the SHOW HISTORY command to view the backu", "doc_type":"sqlreference", - "kw":"Checking Multiversion Backup Data,Backing Up and Restoring Data of Multiple Versions,SQL Syntax Refe", + "kw":"Viewing Multi-Versioning Backup Data (Deprecated, Not Recommended),Backing Up and Restoring Multi-Ve", "search_title":"", "metedata":[ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], - "title":"Checking Multiversion Backup Data", + "title":"Viewing Multi-Versioning Backup Data (Deprecated, Not Recommended)", "githuburl":"" }, { @@ -867,19 +867,19 @@ "node_id":"dli_08_0352.xml", "product_code":"dli", "code":"44", - "des":"After the multiversion function is enabled, you can run the RESTORE TABLE statement to restore a table or partition of a specified version. For details about the syntax f", + "des":"The multi-versioning feature is to be deprecated and is not recommended.After the multiversion function is enabled, you can run the RESTORE TABLE statement to restore a t", "doc_type":"sqlreference", - "kw":"Restoring Multiversion Backup Data,Backing Up and Restoring Data of Multiple Versions,SQL Syntax Ref", + "kw":"Restoring Multi-Versioning Backup Data (Deprecated, Not Recommended),Backing Up and Restoring Multi-", "search_title":"", "metedata":[ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], - "title":"Restoring Multiversion Backup Data", + "title":"Restoring Multi-Versioning Backup Data (Deprecated, Not Recommended)", "githuburl":"" }, { @@ -887,19 +887,19 @@ "node_id":"dli_08_0353.xml", "product_code":"dli", "code":"45", - "des":"After the multiversion function is enabled, expired backup data will be directly deleted by the system when theinsert overwrite or truncate statement is executed. You can", + "des":"The multi-versioning feature is to be deprecated and is not recommended.After the multiversion function is enabled, expired backup data will be directly deleted by the sy", "doc_type":"sqlreference", - "kw":"Configuring the Trash Bin for Expired Multiversion Data,Backing Up and Restoring Data of Multiple Ve", + "kw":"Configuring the Recycle Bin for Expired Multi-Versioning Data (Deprecated, Not Recommended),Backing ", "search_title":"", "metedata":[ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], - "title":"Configuring the Trash Bin for Expired Multiversion Data", + "title":"Configuring the Recycle Bin for Expired Multi-Versioning Data (Deprecated, Not Recommended)", "githuburl":"" }, { @@ -907,19 +907,19 @@ "node_id":"dli_08_0355.xml", "product_code":"dli", "code":"46", - "des":"The retention period of multiversion backup data takes effect each time the insert overwrite or truncate statement is executed. If neither statement is executed for the t", + "des":"The multi-versioning feature is to be deprecated and is not recommended.The retention period of multiversion backup data takes effect each time the insert overwrite or tr", "doc_type":"sqlreference", - "kw":"Deleting Multiversion Backup Data,Backing Up and Restoring Data of Multiple Versions,SQL Syntax Refe", + "kw":"Clearing Multi-Versioning Data (Deprecated, Not Recommended),Backing Up and Restoring Multi-Versioni", "search_title":"", "metedata":[ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], - "title":"Deleting Multiversion Backup Data", + "title":"Clearing Multi-Versioning Data (Deprecated, Not Recommended)", "githuburl":"" }, { @@ -955,8 +955,8 @@ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], "title":"Specifying the Lifecycle of a Table When Creating the Table", @@ -1967,7 +1967,7 @@ "node_id":"dli_08_0057.xml", "product_code":"dli", "code":"99", - "des":"Data type is a basic attribute of data. It is used to distinguish different types of data. Different data types occupy different storage space and support different opera", + "des":"Data type is a basic attribute of data and used to distinguish different types of data. Different data types occupy different storage space and support different operatio", "doc_type":"sqlreference", "kw":"Overview,Data Types,SQL Syntax Reference", "search_title":"", @@ -1975,8 +1975,8 @@ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], "title":"Overview", @@ -2275,8 +2275,8 @@ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], "title":"dateadd", @@ -3075,8 +3075,8 @@ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], "title":"instr1", @@ -5235,8 +5235,8 @@ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], "title":"url_decode", @@ -5255,8 +5255,8 @@ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], "title":"url_encode", @@ -6083,8 +6083,8 @@ "githuburl":"" }, { - "uri":"en-us_topic_0000002172127506.html", - "node_id":"en-us_topic_0000002172127506.xml", + "uri":"dli_08_15000.html", + "node_id":"dli_08_15000.xml", "product_code":"dli", "code":"305", "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", @@ -6431,7 +6431,7 @@ "node_id":"dli_08_15020.xml", "product_code":"dli", "code":"324", - "des":"Debezium is a Changelog Data Capture (CDC) tool that can stream changes in real-time from MySQL, PostgreSQL, Oracle, Microsoft SQL Server and many other databases into Ka", + "des":"Debezium is a Changelog Data Capture (CDC) tool that can stream changes in real-time from other databases into Kafka. Debezium provides a unified format schema for change", "doc_type":"sqlreference", "kw":"Debezium,Formats,SQL Syntax Reference", "search_title":"", @@ -6665,7 +6665,7 @@ "node_id":"dli_08_15033.xml", "product_code":"dli", "code":"337", - "des":"The Flink Doris Connector can support operations (read, insert, modify, delete) data stored in Doris through Flink.Only tables in the Unique Key model can be modified or ", + "des":"The Flink Doris Connector can support operations (read, insert, modify, delete) data stored in Doris through Flink. For details, see Flink Doris Connector.Only tables in ", "doc_type":"sqlreference", "kw":"Overview,Doris,SQL Syntax Reference", "search_title":"", @@ -10343,7 +10343,7 @@ "node_id":"dli_08_0333.xml", "product_code":"dli", "code":"528", - "des":"SyntaxExampleTest input data.Test the data source kafka. The message content is as follows:\"{name:James,age:24,gender:male,grade:{math:95,science:[80,85],english:100}}\"\n\"", + "des":"DLI offers a wide range of string functions for processing and transforming string data. These functions include concatenation, case conversion, substring extraction, rep", "doc_type":"sqlreference", "kw":"String Functions,Built-In Functions,SQL Syntax Reference", "search_title":"", @@ -11223,7 +11223,7 @@ "node_id":"dli_08_0261.xml", "product_code":"dli", "code":"572", - "des":"Create an RDS/DWS table to connect to the source stream.For details about the JOIN syntax, see JOIN.Ensure that you have created a PostgreSQL or MySQL RDS instance in RDS", + "des":"Create an RDS or GaussDB(DWS) table to connect to the source stream.For details about the JOIN syntax, see JOIN.Ensure that you have created a PostgreSQL or MySQL RDS ins", "doc_type":"sqlreference", "kw":"Creating an RDS Table,Creating a Dimension Table,SQL Syntax Reference", "search_title":"", @@ -11231,8 +11231,8 @@ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], "title":"Creating an RDS Table", @@ -12751,8 +12751,8 @@ { "prodname":"dli", "documenttype":"sqlreference", - "opensource":"true", - "IsBot":"Yes" + "IsBot":"Yes", + "opensource":"true" } ], "title":"Change History", diff --git a/docs/dli/sqlreference/CLASS.TXT.json b/docs/dli/sqlreference/CLASS.TXT.json index 734d2c19b..899fb072c 100644 --- a/docs/dli/sqlreference/CLASS.TXT.json +++ b/docs/dli/sqlreference/CLASS.TXT.json @@ -20,7 +20,7 @@ { "desc":"This section describes the Spark SQL syntax list provided by DLI. For details about the parameters and examples, see the syntax description.", "product_code":"dli", - "title":"SQL Syntax Overview of Batch Jobs", + "title":"SQL Syntax Overview for Batch Jobs", "uri":"dli_08_0219.html", "doc_type":"sqlreference", "p_code":"1", @@ -234,9 +234,9 @@ "code":"26" }, { - "desc":"DLI controls multiple versions of backup data for restoration. After the multiversion function is enabled, the system automatically backs up table data when you delete or", + "desc":"The multi-versioning feature is to be deprecated and is not recommended.DLI controls multiple versions of backup data for restoration. After the multiversion function is ", "product_code":"dli", - "title":"Enabling or Disabling Multiversion Backup", + "title":"Enabling or Disabling Data Multi-Versioning (Deprecated, Not Recommended)", "uri":"dli_08_0354.html", "doc_type":"sqlreference", "p_code":"24", @@ -324,7 +324,7 @@ "code":"36" }, { - "desc":"This statement is used to insert the SELECT query result or a certain data record into a table.The INSERT OVERWRITE syntax is not suitable for \"read-write\" scenarios, whe", + "desc":"This statement is used to insert the SELECT query result or a certain data record into a table.The insert overwrite syntax does not apply to self-read and self-write scen", "product_code":"dli", "title":"Inserting Data", "uri":"dli_08_0095.html", @@ -362,52 +362,52 @@ { "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "product_code":"dli", - "title":"Backing Up and Restoring Data of Multiple Versions", + "title":"Backing Up and Restoring Multi-Versioning Data (Deprecated, Not Recommended)", "uri":"dli_08_0349.html", "doc_type":"sqlreference", "p_code":"1", "code":"41" }, { - "desc":"After multiversion is enabled, backup data is retained for seven days by default. You can change the retention period by setting system parameterdli.multi.version.retenti", + "desc":"The multi-versioning feature is to be deprecated and is not recommended.After multiversion is enabled, backup data is retained for seven days by default. You can change t", "product_code":"dli", - "title":"Setting the Retention Period for Multiversion Backup Data", + "title":"Setting the Retention Period of Multi-Versioning Backup Data (Deprecated, Not Recommended)", "uri":"dli_08_0350.html", "doc_type":"sqlreference", "p_code":"41", "code":"42" }, { - "desc":"After the multiversion function is enabled, you can run the SHOW HISTORY command to view the backup data of a table. For details about the syntax for enabling or disablin", + "desc":"The multi-versioning feature is to be deprecated and is not recommended.After the multiversion function is enabled, you can run the SHOW HISTORY command to view the backu", "product_code":"dli", - "title":"Checking Multiversion Backup Data", + "title":"Viewing Multi-Versioning Backup Data (Deprecated, Not Recommended)", "uri":"dli_08_0351.html", "doc_type":"sqlreference", "p_code":"41", "code":"43" }, { - "desc":"After the multiversion function is enabled, you can run the RESTORE TABLE statement to restore a table or partition of a specified version. For details about the syntax f", + "desc":"The multi-versioning feature is to be deprecated and is not recommended.After the multiversion function is enabled, you can run the RESTORE TABLE statement to restore a t", "product_code":"dli", - "title":"Restoring Multiversion Backup Data", + "title":"Restoring Multi-Versioning Backup Data (Deprecated, Not Recommended)", "uri":"dli_08_0352.html", "doc_type":"sqlreference", "p_code":"41", "code":"44" }, { - "desc":"After the multiversion function is enabled, expired backup data will be directly deleted by the system when theinsert overwrite or truncate statement is executed. You can", + "desc":"The multi-versioning feature is to be deprecated and is not recommended.After the multiversion function is enabled, expired backup data will be directly deleted by the sy", "product_code":"dli", - "title":"Configuring the Trash Bin for Expired Multiversion Data", + "title":"Configuring the Recycle Bin for Expired Multi-Versioning Data (Deprecated, Not Recommended)", "uri":"dli_08_0353.html", "doc_type":"sqlreference", "p_code":"41", "code":"45" }, { - "desc":"The retention period of multiversion backup data takes effect each time the insert overwrite or truncate statement is executed. If neither statement is executed for the t", + "desc":"The multi-versioning feature is to be deprecated and is not recommended.The retention period of multiversion backup data takes effect each time the insert overwrite or tr", "product_code":"dli", - "title":"Deleting Multiversion Backup Data", + "title":"Clearing Multi-Versioning Data (Deprecated, Not Recommended)", "uri":"dli_08_0355.html", "doc_type":"sqlreference", "p_code":"41", @@ -882,7 +882,7 @@ "code":"98" }, { - "desc":"Data type is a basic attribute of data. It is used to distinguish different types of data. Different data types occupy different storage space and support different opera", + "desc":"Data type is a basic attribute of data and used to distinguish different types of data. Different data types occupy different storage space and support different operatio", "product_code":"dli", "title":"Overview", "uri":"dli_08_0057.html", @@ -2739,7 +2739,7 @@ "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "product_code":"dli", "title":"Flink OpenSource SQL 1.15 Syntax Reference", - "uri":"en-us_topic_0000002172127506.html", + "uri":"dli_08_15000.html", "doc_type":"sqlreference", "p_code":"", "code":"305" @@ -2907,7 +2907,7 @@ "code":"323" }, { - "desc":"Debezium is a Changelog Data Capture (CDC) tool that can stream changes in real-time from MySQL, PostgreSQL, Oracle, Microsoft SQL Server and many other databases into Ka", + "desc":"Debezium is a Changelog Data Capture (CDC) tool that can stream changes in real-time from other databases into Kafka. Debezium provides a unified format schema for change", "product_code":"dli", "title":"Debezium", "uri":"dli_08_15020.html", @@ -3024,7 +3024,7 @@ "code":"336" }, { - "desc":"The Flink Doris Connector can support operations (read, insert, modify, delete) data stored in Doris through Flink.Only tables in the Unique Key model can be modified or ", + "desc":"The Flink Doris Connector can support operations (read, insert, modify, delete) data stored in Doris through Flink. For details, see Flink Doris Connector.Only tables in ", "product_code":"dli", "title":"Overview", "uri":"dli_08_15033.html", @@ -4743,7 +4743,7 @@ "code":"527" }, { - "desc":"SyntaxExampleTest input data.Test the data source kafka. The message content is as follows:\"{name:James,age:24,gender:male,grade:{math:95,science:[80,85],english:100}}\"\n\"", + "desc":"DLI offers a wide range of string functions for processing and transforming string data. These functions include concatenation, case conversion, substring extraction, rep", "product_code":"dli", "title":"String Functions", "uri":"dli_08_0333.html", @@ -5139,7 +5139,7 @@ "code":"571" }, { - "desc":"Create an RDS/DWS table to connect to the source stream.For details about the JOIN syntax, see JOIN.Ensure that you have created a PostgreSQL or MySQL RDS instance in RDS", + "desc":"Create an RDS or GaussDB(DWS) table to connect to the source stream.For details about the JOIN syntax, see JOIN.Ensure that you have created a PostgreSQL or MySQL RDS ins", "product_code":"dli", "title":"Creating an RDS Table", "uri":"dli_08_0261.html", diff --git a/docs/dli/sqlreference/dli_08_00005.html b/docs/dli/sqlreference/dli_08_00005.html index 1fa43ed79..bfc316926 100644 --- a/docs/dli/sqlreference/dli_08_00005.html +++ b/docs/dli/sqlreference/dli_08_00005.html @@ -8,9 +8,14 @@ -
2025-03-04
+2025-04-30
Added descriptions that data multi-versioning will be deprecated and is no longer recommended to Backing Up and Restoring Multi-Versioning Data (Deprecated, Not Recommended).
+2025-03-04
+2025-02-08
diff --git a/docs/dli/sqlreference/dli_08_0057.html b/docs/dli/sqlreference/dli_08_0057.html index cbfa2709d..600e3f2db 100644 --- a/docs/dli/sqlreference/dli_08_0057.html +++ b/docs/dli/sqlreference/dli_08_0057.html @@ -1,7 +1,8 @@Data type is a basic attribute of data. It is used to distinguish different types of data. Different data types occupy different storage space and support different operations. Data is stored in data tables in the database. A data type is specified for each column of a data table. Therefore, data to be stored in a data table must comply with the attribute of the specific data type. Otherwise, errors may occur.
+Data type is a basic attribute of data and used to distinguish different types of data. Different data types occupy different storage space and support different operations.
+Data is stored in data tables in the database. Each column of a table defines the data type. During storage, data must be stored according to data types.
DLI only supports primitive data types.
Create an OBS table using the DataSource syntax.
The main differences between the DataSource and the Hive syntax lie in the supported data formats and the number of supported partitions. For details, see syntax and precautions.
-
You are advised to use the OBS parallel file system for storage. A parallel file system is a high-performance file system that provides latency in milliseconds, TB/s-level bandwidth, and millions of IOPS. It applies to interactive big data analysis scenarios.
+
You are advised to use an OBS parallel file system for storage. A parallel file system is a high-performance file system that provides latency in milliseconds, TB/s-level bandwidth, and millions of IOPS. It applies to interactive big data analysis scenarios.
If you specify an OBS directory that contains subdirectories when creating a table, all file types and content within those subdirectories will also be included as table content.
@@ -448,6 +448,10 @@Ensure that you use Spark 3.3.1 or a later version when creating such a table. If the error message appears, use the Hive syntax to create the table. For details, see Creating an OBS Table Using the Hive Syntax.
+This error message indicates that table operations cannot be performed when Spark 3.3.1 is used to execute the Jar job. Use the Hive syntax to recreate the tables' data structure. For example, you can use [STORED AS file_format] CTAS to recreate the table and then run the job. For details, see Creating an OBS Table Using the Hive Syntax.
+When creating an OBS table, you can use TBLPROPERTIES ("dli.multi.version.enable"="true") to enable multiversion. For details, see the following example.
+When creating an OBS table, you can use TBLPROPERTIES ("dli.multi.version.enable"="true") to enable multiversion. For details, see the following example.
Key |
diff --git a/docs/dli/sqlreference/dli_08_0095.html b/docs/dli/sqlreference/dli_08_0095.html
index 173d56bdd..acaf026fc 100644
--- a/docs/dli/sqlreference/dli_08_0095.html
+++ b/docs/dli/sqlreference/dli_08_0095.html
@@ -3,7 +3,11 @@
Create a datasource connection before you can obtain this RDS connection URL. After an enhanced datasource connection is created, use the internal network domain name or internal network address and database port number provided by RDS to connect to DLI. If MySQL is used, the format is protocol header://internal IP address:internal network port number. If PostgreSQL is used, the format is protocol header://internal IP address:internal network port number/database name. -For example: jdbc:mysql://192.168.0.193:3306 or jdbc:postgresql://192.168.0.193:3306/postgres. +For example: jdbc:mysql://192.168.0.193:3306 or jdbc:postgresql://192.168.0.193:5432/postgres. |
|---|---|
driver @@ -128,7 +128,8 @@ |
When creating a table associated with RDS, you do not need to specify the Schema of the associated table. DLI automatically obtains the schema of the table in the dbtable parameter of RDS.
+When creating up an RDS association table for the first time, there is no need to define the table's schema. DLI will automatically retrieve the schema from the RDS parameter dbtable to create the association table.
+If you make changes to the fields in the RDS table, the associated table will not update automatically. In such cases, you need to recreate the association table to ensure its schema matches the modified RDS table.
Accessing MySQL
1 @@ -156,7 +157,7 @@ 6 7 | CREATE TABLE IF NOT EXISTS dli_to_rds USING JDBC OPTIONS ( - 'url'='jdbc:postgresql://to-rds-1174405119-oLRHAGE7.datasource.com:3306/postgreDB', + 'url'='jdbc:postgresql://to-rds-1174405119-oLRHAGE7.datasource.com:5432/postgreDB', 'driver'='org.postgresql.Driver', 'dbtable'='pg_schema.test1', 'passwdauth' = 'xxx', diff --git a/docs/dli/sqlreference/dli_08_0219.html b/docs/dli/sqlreference/dli_08_0219.html index 80a0acdb1..d035bb63b 100644 --- a/docs/dli/sqlreference/dli_08_0219.html +++ b/docs/dli/sqlreference/dli_08_0219.html @@ -1,6 +1,6 @@ - To create a DWS dimension table, set the database connection address to a DWS database address. If the DWS database version is later than 8.1.0, the open-source PostgreSQL driver cannot be used for connection. You need to use the GaussDB driver for connection. + To create a GaussDB(DWS) dimension table, set the database connection address to a GaussDB(DWS) database address. If the GaussDB(DWS) database version is later than 8.1.0, the open-source PostgreSQL driver cannot be used for connection. You need to use the GaussDB driver for connection. + | false |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
spark.sql.optimizer.dynamicPartitionPruning.enabled + | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
spark.sql.dli.job.shareLevel |
-true + | Queue |
-This parameter is used to control whether to enable dynamic partition pruning. Dynamic partition pruning can help reduce the amount of data that needs to be scanned and improve query performance when executing SQL queries. -
|
SQL Function +String FunctionsDLI offers a wide range of string functions for processing and transforming string data. These functions include concatenation, case conversion, substring extraction, replacement, regex matching, encoding and decoding, format conversion, and more. Additionally, it supports string length calculation, position searching, padding, reversing, and even extracting values from JSON strings using the JSON_VAL function. These features are widely used in data cleansing, text processing, and data analysis scenarios, providing developers with powerful tool support. +For detailed string functions, see Table 1. For more information, see Apache Flink. + +
JSON_VAL Function
|
|---|