From f7012547450f5b48fb5c7be2c5f1e4c3cffd72f8 Mon Sep 17 00:00:00 2001 From: "Su, Xiaomeng" Date: Sat, 20 May 2023 10:20:05 +0000 Subject: [PATCH] dli_umn_0519_version Reviewed-by: Pruthi, Vineet Co-authored-by: Su, Xiaomeng Co-committed-by: Su, Xiaomeng --- docs/dli/umn/ALL_META.TXT.json | 1172 ++++++++++------ docs/dli/umn/CLASS.TXT.json | 1220 +++++++++++------ docs/dli/umn/dli_01_00006.html | 8 +- docs/dli/umn/dli_01_0002.html | 45 +- docs/dli/umn/dli_01_0005.html | 20 +- docs/dli/umn/dli_01_0006.html | 30 +- docs/dli/umn/dli_01_0010.html | 46 +- docs/dli/umn/dli_01_0017.html | 2 +- docs/dli/umn/dli_01_0021.html | 5 +- docs/dli/umn/dli_01_0228.html | 1 - docs/dli/umn/dli_01_0253.html | 9 +- docs/dli/umn/dli_01_0318.html | 478 +++++++ docs/dli/umn/dli_01_0320.html | 299 ++-- docs/dli/umn/dli_01_0363.html | 2 +- docs/dli/umn/dli_01_0375.html | 43 +- docs/dli/umn/dli_01_0377.html | 94 +- docs/dli/umn/dli_01_0378.html | 10 +- docs/dli/umn/dli_01_0379.html | 6 +- docs/dli/umn/dli_01_0384.html | 326 ++--- docs/dli/umn/dli_01_0389.html | 2 +- docs/dli/umn/dli_01_0390.html | 4 +- docs/dli/umn/dli_01_0397.html | 8 +- docs/dli/umn/dli_01_0410.html | 3 +- docs/dli/umn/dli_01_0417.html | 7 + docs/dli/umn/dli_01_0418.html | 2 +- docs/dli/umn/dli_01_0420.html | 23 + docs/dli/umn/dli_01_0421.html | 11 +- docs/dli/umn/dli_01_0427.html | 57 +- docs/dli/umn/dli_01_0440.html | 2 +- docs/dli/umn/dli_01_0441.html | 2 +- docs/dli/umn/dli_01_0445.html | 363 +++++ docs/dli/umn/dli_01_0447.html | 4 +- docs/dli/umn/dli_01_0448.html | 12 +- docs/dli/umn/dli_01_0451.html | 71 +- docs/dli/umn/dli_01_0455.html | 8 +- docs/dli/umn/dli_01_0457.html | 118 +- docs/dli/umn/dli_01_0458.html | 11 +- docs/dli/umn/dli_01_0461.html | 8 +- docs/dli/umn/dli_01_0464.html | 75 +- docs/dli/umn/dli_01_0475.html | 56 +- docs/dli/umn/dli_01_0479.html | 4 +- docs/dli/umn/dli_01_0488.html | 56 +- docs/dli/umn/dli_01_0498.html | 79 +- docs/dli/umn/dli_01_05111.html | 2 +- docs/dli/umn/dli_01_0512.html | 13 +- docs/dli/umn/dli_01_0513.html | 21 + docs/dli/umn/dli_01_0531.html | 63 +- docs/dli/umn/dli_01_0538.html | 4 +- docs/dli/umn/dli_01_0539.html | 6 +- docs/dli/umn/dli_01_0550.html | 24 + docs/dli/umn/dli_01_0551.html | 16 + docs/dli/umn/dli_03_0001.html | 26 +- docs/dli/umn/dli_03_0002.html | 2 +- docs/dli/umn/dli_03_0008.html | 2 +- docs/dli/umn/dli_03_0009.html | 2 +- docs/dli/umn/dli_03_0010.html | 2 +- docs/dli/umn/dli_03_0011.html | 2 +- docs/dli/umn/dli_03_0013.html | 2 +- docs/dli/umn/dli_03_0014.html | 4 +- docs/dli/umn/dli_03_0017.html | 2 +- docs/dli/umn/dli_03_0020.html | 80 +- docs/dli/umn/dli_03_0021.html | 36 +- docs/dli/umn/dli_03_0022.html | 42 +- docs/dli/umn/dli_03_0023.html | 31 - docs/dli/umn/dli_03_0025.html | 2 +- docs/dli/umn/dli_03_0028.html | 2 +- docs/dli/umn/dli_03_0029.html | 2 +- docs/dli/umn/dli_03_0036.html | 12 + docs/dli/umn/dli_03_0037.html | 80 +- docs/dli/umn/dli_03_0038.html | 8 +- docs/dli/umn/dli_03_0040.html | 4 +- docs/dli/umn/dli_03_0043.html | 4 +- docs/dli/umn/dli_03_0044.html | 2 +- docs/dli/umn/dli_03_0045.html | 4 +- docs/dli/umn/dli_03_0046.html | 4 +- docs/dli/umn/dli_03_0047.html | 2 +- docs/dli/umn/dli_03_0048.html | 2 +- docs/dli/umn/dli_03_0049.html | 24 +- docs/dli/umn/dli_03_0053.html | 2 +- docs/dli/umn/dli_03_0054.html | 18 +- docs/dli/umn/dli_03_0056.html | 20 + docs/dli/umn/dli_03_0057.html | 13 + docs/dli/umn/dli_03_0058.html | 17 + docs/dli/umn/dli_03_0060.html | 14 + docs/dli/umn/dli_03_0061.html | 2 +- docs/dli/umn/dli_03_0064.html | 4 +- docs/dli/umn/dli_03_0065.html | 2 +- docs/dli/umn/dli_03_0066.html | 4 +- docs/dli/umn/dli_03_0067.html | 18 + docs/dli/umn/dli_03_0068.html | 4 +- docs/dli/umn/dli_03_0069.html | 2 +- docs/dli/umn/dli_03_0071.html | 4 +- docs/dli/umn/dli_03_0072.html | 4 +- docs/dli/umn/dli_03_0073.html | 12 + docs/dli/umn/dli_03_0075.html | 6 +- docs/dli/umn/dli_03_0076.html | 6 +- docs/dli/umn/dli_03_0077.html | 10 +- docs/dli/umn/dli_03_0080.html | 4 +- docs/dli/umn/dli_03_0082.html | 4 +- docs/dli/umn/dli_03_0083.html | 2 +- docs/dli/umn/dli_03_0085.html | 2 +- docs/dli/umn/dli_03_0086.html | 2 +- docs/dli/umn/dli_03_0087.html | 2 +- docs/dli/umn/dli_03_0088.html | 2 +- docs/dli/umn/dli_03_0089.html | 4 +- docs/dli/umn/dli_03_0090.html | 2 +- docs/dli/umn/dli_03_0091.html | 2 +- docs/dli/umn/dli_03_0092.html | 2 +- docs/dli/umn/dli_03_0093.html | 2 +- docs/dli/umn/dli_03_0095.html | 2 +- docs/dli/umn/dli_03_0096.html | 4 +- docs/dli/umn/dli_03_0098.html | 2 +- docs/dli/umn/dli_03_0099.html | 2 +- docs/dli/umn/dli_03_0100.html | 2 +- docs/dli/umn/dli_03_0101.html | 89 -- docs/dli/umn/dli_03_0102.html | 4 +- docs/dli/umn/dli_03_0103.html | 4 +- docs/dli/umn/dli_03_0105.html | 2 +- docs/dli/umn/dli_03_0106.html | 2 +- docs/dli/umn/dli_03_0107.html | 2 +- docs/dli/umn/dli_03_0108.html | 2 +- docs/dli/umn/dli_03_0109.html | 2 +- docs/dli/umn/dli_03_0110.html | 30 + docs/dli/umn/dli_03_0111.html | 4 +- docs/dli/umn/dli_03_0112.html | 20 + docs/dli/umn/dli_03_0115.html | 2 +- docs/dli/umn/dli_03_0116.html | 2 +- docs/dli/umn/dli_03_0117.html | 2 +- docs/dli/umn/dli_03_0118.html | 2 +- docs/dli/umn/dli_03_0119.html | 6 +- docs/dli/umn/dli_03_0120.html | 2 +- docs/dli/umn/dli_03_0121.html | 4 +- docs/dli/umn/dli_03_0125.html | 11 + docs/dli/umn/dli_03_0126.html | 2 +- docs/dli/umn/dli_03_0127.html | 4 +- docs/dli/umn/dli_03_0128.html | 2 +- docs/dli/umn/dli_03_0129.html | 2 +- docs/dli/umn/dli_03_0130.html | 2 +- docs/dli/umn/dli_03_0131.html | 35 + docs/dli/umn/dli_03_0132.html | 29 + docs/dli/umn/dli_03_0133.html | 20 + docs/dli/umn/dli_03_0135.html | 34 + docs/dli/umn/dli_03_0136.html | 2 +- docs/dli/umn/dli_03_0137.html | 30 + docs/dli/umn/dli_03_0138.html | 4 +- docs/dli/umn/dli_03_0139.html | 2 +- docs/dli/umn/dli_03_0140.html | 4 +- docs/dli/umn/dli_03_0145.html | 4 +- docs/dli/umn/dli_03_0156.html | 6 +- docs/dli/umn/dli_03_0157.html | 4 +- docs/dli/umn/dli_03_0159.html | 4 +- docs/dli/umn/dli_03_0160.html | 4 +- docs/dli/umn/dli_03_0161.html | 4 +- docs/dli/umn/dli_03_0162.html | 2 +- docs/dli/umn/dli_03_0163.html | 16 + docs/dli/umn/dli_03_0164.html | 4 +- docs/dli/umn/dli_03_0165.html | 4 +- docs/dli/umn/dli_03_0166.html | 2 +- docs/dli/umn/dli_03_0167.html | 4 +- docs/dli/umn/dli_03_0168.html | 4 +- docs/dli/umn/dli_03_0169.html | 6 +- docs/dli/umn/dli_03_0170.html | 2 +- docs/dli/umn/dli_03_0171.html | 6 +- docs/dli/umn/dli_03_0172.html | 6 +- docs/dli/umn/dli_03_0173.html | 6 +- docs/dli/umn/dli_03_0174.html | 6 +- docs/dli/umn/dli_03_0175.html | 4 +- docs/dli/umn/dli_03_0176.html | 6 +- docs/dli/umn/dli_03_0177.html | 6 +- docs/dli/umn/dli_03_0178.html | 18 + docs/dli/umn/dli_03_0179.html | 4 +- docs/dli/umn/dli_03_0180.html | 2 +- docs/dli/umn/dli_03_0181.html | 2 +- docs/dli/umn/dli_03_0182.html | 6 +- docs/dli/umn/dli_03_0183.html | 2 +- docs/dli/umn/dli_03_0184.html | 4 +- docs/dli/umn/dli_03_0186.html | 2 +- docs/dli/umn/dli_03_0187.html | 2 +- docs/dli/umn/dli_03_0188.html | 4 +- docs/dli/umn/dli_03_0189.html | 4 +- docs/dli/umn/dli_03_0190.html | 4 +- docs/dli/umn/dli_03_0191.html | 2 +- docs/dli/umn/dli_03_0192.html | 4 +- docs/dli/umn/dli_03_0193.html | 2 +- docs/dli/umn/dli_03_0195.html | 4 +- docs/dli/umn/dli_03_0196.html | 6 +- docs/dli/umn/dli_03_0200.html | 4 +- docs/dli/umn/dli_03_0201.html | 6 +- docs/dli/umn/dli_03_0204.html | 28 + docs/dli/umn/dli_03_0206.html | 40 + docs/dli/umn/dli_03_0207.html | 4 +- docs/dli/umn/dli_03_0208.html | 4 +- docs/dli/umn/dli_03_0209.html | 4 +- docs/dli/umn/dli_03_0210.html | 4 +- docs/dli/umn/dli_03_0211.html | 50 + docs/dli/umn/dli_03_0212.html | 2 +- docs/dli/umn/dli_03_0213.html | 2 +- docs/dli/umn/dli_03_0214.html | 2 +- docs/dli/umn/dli_03_0215.html | 2 +- docs/dli/umn/dli_03_0216.html | 16 + docs/dli/umn/dli_03_0217.html | 30 + docs/dli/umn/dli_03_0218.html | 24 + docs/dli/umn/dli_03_0219.html | 18 + docs/dli/umn/dli_03_0220.html | 2 +- docs/dli/umn/dli_03_0221.html | 32 + docs/dli/umn/dli_03_0222.html | 18 + docs/dli/umn/dli_03_0223.html | 17 + docs/dli/umn/dli_03_0225.html | 11 - docs/dli/umn/dli_03_0226.html | 26 + docs/dli/umn/dli_03_0227.html | 4 +- docs/dli/umn/dli_03_0228.html | 4 +- docs/dli/umn/dli_03_0229.html | 22 + docs/dli/umn/dli_03_0230.html | 28 + docs/dli/umn/dli_03_0231.html | 2 +- docs/dli/umn/dli_03_0232.html | 6 +- docs/dli/umn/dli_03_0233.html | 6 +- docs/dli/umn/dli_03_0234.html | 6 +- docs/dli/umn/dli_03_0235.html | 4 +- docs/dli/umn/dli_03_0236.html | 4 +- docs/dli/umn/dli_03_0237.html | 2 +- docs/dli/umn/dli_03_0238.html | 4 +- docs/dli/umn/dli_03_0239.html | 6 +- docs/dli/umn/dli_03_0250.html | 10 +- docs/dli/umn/dli_03_0251.html | 6 +- docs/dli/umn/dli_03_0252.html | 6 +- docs/dli/umn/dli_03_0253.html | 2 +- docs/dli/umn/dli_03_0254.html | 10 +- docs/dli/umn/dli_03_0255.html | 12 + docs/dli/umn/dli_03_0256.html | 32 + docs/dli/umn/dli_03_0257.html | 2 +- docs/dli/umn/dli_03_0258.html | 2 +- docs/dli/umn/dli_03_0259.html | 2 +- docs/dli/umn/dli_03_0260.html | 2 +- docs/dli/umn/dli_03_0261.html | 16 + docs/dli/umn/dli_03_0263.html | 2 +- docs/dli/umn/dli_03_0264.html | 4 +- docs/dli/umn/dli_03_0265.html | 4 +- docs/dli/umn/dli_03_0266.html | 2 +- docs/dli/umn/dli_07_0002.html | 8 +- docs/dli/umn/dli_07_0003.html | 4 +- docs/dli/umn/dli_07_0005.html | 2 +- docs/dli/umn/dli_07_0006.html | 104 +- docs/dli/umn/dli_07_0007.html | 4 +- docs/dli/umn/en-us_image_0000001209640030.png | Bin 547 -> 0 bytes docs/dli/umn/en-us_image_0000001254569529.png | Bin 79613 -> 0 bytes docs/dli/umn/en-us_image_0000001377545298.png | Bin 25906 -> 24201 bytes docs/dli/umn/en-us_image_0000001391378486.png | Bin 64242 -> 8916 bytes docs/dli/umn/en-us_image_0000001427744557.png | Bin 39743 -> 35291 bytes ...7.png => en-us_image_0000001478148728.png} | Bin ...8.png => en-us_image_0000001529468213.png} | Bin docs/dli/umn/en-us_image_0269598720.png | Bin 633 -> 0 bytes docs/dli/umn/en-us_image_0269598721.png | Bin 509 -> 0 bytes docs/dli/umn/en-us_image_0269598722.png | Bin 1057 -> 0 bytes docs/dli/umn/en-us_image_0269598723.png | Bin 456 -> 0 bytes docs/dli/umn/en-us_image_0269598724.png | Bin 602 -> 0 bytes docs/dli/umn/en-us_image_0269598745.png | Bin 932 -> 0 bytes 256 files changed, 4317 insertions(+), 2449 deletions(-) create mode 100644 docs/dli/umn/dli_01_0318.html create mode 100644 docs/dli/umn/dli_01_0420.html create mode 100644 docs/dli/umn/dli_01_0445.html create mode 100644 docs/dli/umn/dli_01_0513.html create mode 100644 docs/dli/umn/dli_01_0550.html create mode 100644 docs/dli/umn/dli_01_0551.html delete mode 100644 docs/dli/umn/dli_03_0023.html create mode 100644 docs/dli/umn/dli_03_0036.html create mode 100644 docs/dli/umn/dli_03_0056.html create mode 100644 docs/dli/umn/dli_03_0057.html create mode 100644 docs/dli/umn/dli_03_0058.html create mode 100644 docs/dli/umn/dli_03_0060.html create mode 100644 docs/dli/umn/dli_03_0067.html create mode 100644 docs/dli/umn/dli_03_0073.html delete mode 100644 docs/dli/umn/dli_03_0101.html create mode 100644 docs/dli/umn/dli_03_0110.html create mode 100644 docs/dli/umn/dli_03_0112.html create mode 100644 docs/dli/umn/dli_03_0125.html create mode 100644 docs/dli/umn/dli_03_0131.html create mode 100644 docs/dli/umn/dli_03_0132.html create mode 100644 docs/dli/umn/dli_03_0133.html create mode 100644 docs/dli/umn/dli_03_0135.html create mode 100644 docs/dli/umn/dli_03_0137.html create mode 100644 docs/dli/umn/dli_03_0163.html create mode 100644 docs/dli/umn/dli_03_0178.html create mode 100644 docs/dli/umn/dli_03_0204.html create mode 100644 docs/dli/umn/dli_03_0206.html create mode 100644 docs/dli/umn/dli_03_0211.html create mode 100644 docs/dli/umn/dli_03_0216.html create mode 100644 docs/dli/umn/dli_03_0217.html create mode 100644 docs/dli/umn/dli_03_0218.html create mode 100644 docs/dli/umn/dli_03_0219.html create mode 100644 docs/dli/umn/dli_03_0221.html create mode 100644 docs/dli/umn/dli_03_0222.html create mode 100644 docs/dli/umn/dli_03_0223.html delete mode 100644 docs/dli/umn/dli_03_0225.html create mode 100644 docs/dli/umn/dli_03_0226.html create mode 100644 docs/dli/umn/dli_03_0229.html create mode 100644 docs/dli/umn/dli_03_0230.html create mode 100644 docs/dli/umn/dli_03_0255.html create mode 100644 docs/dli/umn/dli_03_0256.html create mode 100644 docs/dli/umn/dli_03_0261.html delete mode 100644 docs/dli/umn/en-us_image_0000001209640030.png delete mode 100644 docs/dli/umn/en-us_image_0000001254569529.png rename docs/dli/umn/{en-us_image_0000001254569657.png => en-us_image_0000001478148728.png} (100%) rename docs/dli/umn/{en-us_image_0000001209329768.png => en-us_image_0000001529468213.png} (100%) delete mode 100644 docs/dli/umn/en-us_image_0269598720.png delete mode 100644 docs/dli/umn/en-us_image_0269598721.png delete mode 100644 docs/dli/umn/en-us_image_0269598722.png delete mode 100644 docs/dli/umn/en-us_image_0269598723.png delete mode 100644 docs/dli/umn/en-us_image_0269598724.png delete mode 100644 docs/dli/umn/en-us_image_0269598745.png diff --git a/docs/dli/umn/ALL_META.TXT.json b/docs/dli/umn/ALL_META.TXT.json index 703592157..e26c39534 100644 --- a/docs/dli/umn/ALL_META.TXT.json +++ b/docs/dli/umn/ALL_META.TXT.json @@ -15,8 +15,8 @@ "code":"2", "des":"Data Lake Insight (DLI) is a serverless data processing and analysis service fully compatible with Apache Spark and Apache Flink ecosystems. It frees you from managing an", "doc_type":"usermanual", - "kw":"DLI Introduction,Service Overview,User Guide", - "title":"DLI Introduction", + "kw":"What Is Data Lake Insight?,Service Overview,User Guide", + "title":"What Is Data Lake Insight?", "githuburl":"" }, { @@ -33,7 +33,7 @@ "uri":"dli_07_0002.html", "product_code":"dli", "code":"4", - "des":"DLI is applicable to large-scale log analysis, federated analysis of heterogeneous data sources, and big data ETL processing.Gaming operation data analysisDifferent depar", + "des":"DLI is applicable to large-scale log analysis, federated analysis of heterogeneous data sources, and big data ETL processing.Gaming operations data analysisDifferent depa", "doc_type":"usermanual", "kw":"Application Scenarios,Service Overview,User Guide", "title":"Application Scenarios", @@ -45,8 +45,8 @@ "code":"5", "des":"When using DLI, you may need to make adjustments according to the following restrictions:Recommended browsers for logging in to DLI:Google Chrome 43.0 or laterMozilla Fir", "doc_type":"usermanual", - "kw":"Constraints and Limitations on Using DLI,Service Overview,User Guide", - "title":"Constraints and Limitations on Using DLI", + "kw":"Prerequisites,Service Overview,User Guide", + "title":"Prerequisites", "githuburl":"" }, { @@ -83,7 +83,7 @@ "uri":"dli_01_0002.html", "product_code":"dli", "code":"9", - "des":"You can use DLI to submit a Spark SQL job to query data. The general procedure is as follows:Step 1: Logging in to the Cloud PlatformStep 2: Uploading Data to OBSStep 3: ", + "des":"DLI can query data stored in OBS. This section describes how to us a Spark SQL job on DLI to query OBS data.You can use DLI to submit a Spark SQL job to query data. The g", "doc_type":"usermanual", "kw":"Creating and Submitting a Spark SQL Job,Getting Started,User Guide", "title":"Creating and Submitting a Spark SQL Job", @@ -103,7 +103,7 @@ "uri":"dli_01_0375.html", "product_code":"dli", "code":"11", - "des":"You can use DLI to submit Spark jobs for real-time computing. The general procedure is as follows:Step 1: Logging in to the CloudStep 2: Uploading Data to OBSStep 3: Logg", + "des":"DLI can query data stored in OBS. This section describes how to use a Spark Jar job on DLI to query OBS data in real time.You can use DLI to submit Spark jobs for real-ti", "doc_type":"usermanual", "kw":"Creating and Submitting a Spark Jar Job,Getting Started,User Guide", "title":"Creating and Submitting a Spark Jar Job", @@ -113,7 +113,7 @@ "uri":"dli_01_0531.html", "product_code":"dli", "code":"12", - "des":"This section describes how to submit a Flink OpenSource SQL job on the DLI console for real-time computing. The general procedure is as follows:Step 1: Log In to the Clou", + "des":"DLI Flink jobs can use other cloud services as data sources and sink streams for real-time compute. This example describes how to create and submit a Flink Opensource SQL", "doc_type":"usermanual", "kw":"Creating and Submitting a Flink OpenSource SQL Job,Getting Started,User Guide", "title":"Creating and Submitting a Flink OpenSource SQL Job", @@ -123,7 +123,7 @@ "uri":"dli_01_0377.html", "product_code":"dli", "code":"13", - "des":"Log in to DLI and go to the Overview page.The following table describes the functional areas of the Overview page.", + "des":"The Overview page of the DLI console provides you with the DLI workflow and resource usage.The process of using DLI is as follows:Create a queue.Queues are computing reso", "doc_type":"usermanual", "kw":"DLI Console Overview,User Guide", "title":"DLI Console Overview", @@ -133,7 +133,7 @@ "uri":"dli_01_0320.html", "product_code":"dli", "code":"14", - "des":"You can use SQL statements in the SQL job editor to execute data query. DLI supports SQL 2003 and complies with Spark SQL.On the Overview page, click SQL Editor in the na", + "des":"You can edit and run SQL statements in the SQL job editor to execute data query.DLI supports SQL 2003 and complies with Spark SQL.To access the SQL editor, click SQL Edit", "doc_type":"usermanual", "kw":"SQL Editor,User Guide", "title":"SQL Editor", @@ -203,7 +203,7 @@ "uri":"dli_01_0498.html", "product_code":"dli", "code":"21", - "des":"This section describes how to create a Flink OpenSource SQL job. DLI Flink OpenSource SQL jobs are fully compatible with the syntax of Flink 1.10 and 1.12 provided by the", + "des":"This section describes how to create a Flink OpenSource SQL job.DLI Flink OpenSource SQL jobs are fully compatible with the syntax of Flink 1.10 and 1.12 provided by the ", "doc_type":"usermanual", "kw":"(Recommended) Creating a Flink OpenSource SQL Job,Flink Job Management,User Guide", "title":"(Recommended) Creating a Flink OpenSource SQL Job", @@ -215,8 +215,8 @@ "code":"22", "des":"This section describes how to create a Flink SQL job. You can use Flink SQLs to develop jobs to meet your service requirements. Using SQL statements simplifies logic impl", "doc_type":"usermanual", - "kw":"Creating a Flink SQL job,Flink Job Management,User Guide", - "title":"Creating a Flink SQL job", + "kw":"Creating a Flink SQL Job,Flink Job Management,User Guide", + "title":"Creating a Flink SQL Job", "githuburl":"" }, { @@ -425,8 +425,8 @@ "code":"43", "des":"You can isolate databases allocated to different users by setting permissions to ensure data query performance.The administrator and database owner have all permissions, ", "doc_type":"usermanual", - "kw":"Database Permission Management,Databases and Tables,User Guide", - "title":"Database Permission Management", + "kw":"Managing Database Permissions,Databases and Tables,User Guide", + "title":"Managing Database Permissions", "githuburl":"" }, { @@ -435,8 +435,8 @@ "code":"44", "des":"You can isolate databases allocated to different users by setting permissions to ensure data query performance.The administrator and database owner have all permissions, ", "doc_type":"usermanual", - "kw":"Table Permission Management,Databases and Tables,User Guide", - "title":"Table Permission Management", + "kw":"Managing Table Permissions,Databases and Tables,User Guide", + "title":"Managing Table Permissions", "githuburl":"" }, { @@ -595,8 +595,8 @@ "code":"60", "des":"To facilitate SQL operation execution, DLI allows you to customize query templates or save the SQL statements in use as templates. After templates are saved, you do not n", "doc_type":"usermanual", - "kw":"SQL Template Management,Job Templates,User Guide", - "title":"SQL Template Management", + "kw":"Managing SQL Templates,Job Templates,User Guide", + "title":"Managing SQL Templates", "githuburl":"" }, { @@ -605,14 +605,24 @@ "code":"61", "des":"Flink templates include sample templates and custom templates. You can modify an existing sample template to meet the actual job logic requirements and save time for edit", "doc_type":"usermanual", - "kw":"Flink Template Management,Job Templates,User Guide", - "title":"Flink Template Management", + "kw":"Managing Flink Templates,Job Templates,User Guide", + "title":"Managing Flink Templates", + "githuburl":"" + }, + { + "uri":"dli_01_0551.html", + "product_code":"dli", + "code":"62", + "des":"You can modify a sample template to meet the Spark job requirements, saving time for editing SQL statements.Currently, the cloud platform does not provide preset Spark te", + "doc_type":"usermanual", + "kw":"Managing Spark SQL Templates,Job Templates,User Guide", + "title":"Managing Spark SQL Templates", "githuburl":"" }, { "uri":"dli_01_05110.html", "product_code":"dli", - "code":"62", + "code":"63", "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "doc_type":"usermanual", "kw":"Appendix", @@ -622,7 +632,7 @@ { "uri":"dli_01_05111.html", "product_code":"dli", - "code":"63", + "code":"64", "des":"TPC-H is a test set developed by the Transaction Processing Performance Council (TPC) to simulate decision-making support applications. It is widely used in academia and ", "doc_type":"usermanual", "kw":"TPC-H Sample Data in the SQL Template,Appendix,User Guide", @@ -632,7 +642,7 @@ { "uri":"dli_01_0422.html", "product_code":"dli", - "code":"64", + "code":"65", "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "doc_type":"usermanual", "kw":"Datasource Connections", @@ -642,7 +652,7 @@ { "uri":"dli_01_0410.html", "product_code":"dli", - "code":"65", + "code":"66", "des":"DLI supports the datasource capability of the native Spark and extends it. With DLI datasource connection, you can access other data storage services through SQL statemen", "doc_type":"usermanual", "kw":"Datasource Connection and Cross-Source Analysis,Datasource Connections,User Guide", @@ -652,7 +662,7 @@ { "uri":"dli_01_0426.html", "product_code":"dli", - "code":"66", + "code":"67", "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "doc_type":"usermanual", "kw":"Enhanced Datasource Connections", @@ -662,7 +672,7 @@ { "uri":"dli_01_0003.html", "product_code":"dli", - "code":"67", + "code":"68", "des":"The enhanced datasource connection uses VPC peering at the bottom layer to directly connect the VPC network between the DLI cluster and the destination datasource. Data i", "doc_type":"usermanual", "kw":"Overview,Enhanced Datasource Connections,User Guide", @@ -672,7 +682,7 @@ { "uri":"dli_01_0006.html", "product_code":"dli", - "code":"68", + "code":"69", "des":"The following describes how to create a datasource HBase connection for MRS.Only enhanced datasource connection to MRS HBase is supported.Apply for a cluster in MRS.If a ", "doc_type":"usermanual", "kw":"Creating, Querying, and Deleting an Enhanced Datasource Connection,Enhanced Datasource Connections,U", @@ -682,7 +692,7 @@ { "uri":"dli_01_0009.html", "product_code":"dli", - "code":"69", + "code":"70", "des":"The CIDR block of the DLI queue that is bound with a datasource connection cannot overlap with that of the data source.The default queue cannot be bound with a connection", "doc_type":"usermanual", "kw":"Binding and Unbinding a Queue,Enhanced Datasource Connections,User Guide", @@ -692,7 +702,7 @@ { "uri":"dli_01_0013.html", "product_code":"dli", - "code":"70", + "code":"71", "des":"Method 1: Copy hosts information in /etc/hosts of an MRS node.cat /etc/hostsMethod 2: Log in to FusionInsight Manager to obtain MRS hosts information.The host information", "doc_type":"usermanual", "kw":"Modifying Host Information,Enhanced Datasource Connections,User Guide", @@ -702,7 +712,7 @@ { "uri":"dli_01_0014.html", "product_code":"dli", - "code":"71", + "code":"72", "des":"After an enhanced datasource connection is created and bound to a queue, the system automatically configures route information. You can also add a custom route for the qu", "doc_type":"usermanual", "kw":"Custom Route Information,Enhanced Datasource Connections,User Guide", @@ -712,7 +722,7 @@ { "uri":"dli_01_0018.html", "product_code":"dli", - "code":"72", + "code":"73", "des":"You can grant or revoke permissions for enhanced datasource connections of other projects.AuthorizationLog in to the DLI management console, choose Datasource Connections", "doc_type":"usermanual", "kw":"Enhanced Datasource Connection Permission Management,Enhanced Datasource Connections,User Guide", @@ -722,7 +732,7 @@ { "uri":"dli_01_0480.html", "product_code":"dli", - "code":"73", + "code":"74", "des":"You can isolate datasource connections allocated to different users by setting permissions to ensure data query performance.The administrator and datasource connection ow", "doc_type":"usermanual", "kw":"Managing Datasource Connection Permissions,Datasource Connections,User Guide", @@ -732,7 +742,7 @@ { "uri":"dli_01_0427.html", "product_code":"dli", - "code":"74", + "code":"75", "des":"Datasource authentication is used to manage authentication information for accessing CSS and MRS security environments and encrypt passwords for accessing DWS, RDS, DDS, ", "doc_type":"usermanual", "kw":"Creating and Managing Datasource Authentication,Datasource Connections,User Guide", @@ -742,7 +752,7 @@ { "uri":"dli_01_0485.html", "product_code":"dli", - "code":"75", + "code":"76", "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "doc_type":"usermanual", "kw":"Global Configuration", @@ -752,7 +762,7 @@ { "uri":"dli_01_0476.html", "product_code":"dli", - "code":"76", + "code":"77", "des":"Global variables can be used to simplify complex parameters. For example, long and difficult variables can be replaced to improve the readability of SQL statements.In the", "doc_type":"usermanual", "kw":"Global Variables,Global Configuration,User Guide", @@ -762,7 +772,7 @@ { "uri":"dli_01_0486.html", "product_code":"dli", - "code":"77", + "code":"78", "des":"Only the tenant account or a subaccount of user group admin can authorize access.After entering the DLI management console, you are advised to set agency permissions to e", "doc_type":"usermanual", "kw":"Service Authorization,Global Configuration,User Guide", @@ -772,7 +782,7 @@ { "uri":"dli_01_0408.html", "product_code":"dli", - "code":"78", + "code":"79", "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "doc_type":"usermanual", "kw":"Permissions Management", @@ -782,7 +792,7 @@ { "uri":"dli_01_0440.html", "product_code":"dli", - "code":"79", + "code":"80", "des":"DLI has a comprehensive permission control mechanism and supports fine-grained authentication through Identity and Access Management (IAM). You can create policies in IAM", "doc_type":"usermanual", "kw":"Overview,Permissions Management,User Guide", @@ -792,7 +802,7 @@ { "uri":"dli_01_0418.html", "product_code":"dli", - "code":"80", + "code":"81", "des":"You can use Identity and Access Management (IAM) to implement fine-grained permissions control on DLI resources. For details, see Overview.If your cloud account does not ", "doc_type":"usermanual", "kw":"Creating an IAM User and Granting Permissions,Permissions Management,User Guide", @@ -802,7 +812,7 @@ { "uri":"dli_01_0451.html", "product_code":"dli", - "code":"81", + "code":"82", "des":"Custom policies can be created as a supplement to the system policies of DLI. You can add actions to custom policies. For the actions supported for custom policies, see \"", "doc_type":"usermanual", "kw":"Creating a Custom Policy,Permissions Management,User Guide", @@ -812,7 +822,7 @@ { "uri":"dli_01_0417.html", "product_code":"dli", - "code":"82", + "code":"83", "des":"A resource is an object that exists within a service. You can select DLI resources by specifying their paths.", "doc_type":"usermanual", "kw":"DLI Resources,Permissions Management,User Guide", @@ -822,7 +832,7 @@ { "uri":"dli_01_0475.html", "product_code":"dli", - "code":"83", + "code":"84", "des":"Request conditions are useful in determining when a custom policy takes effect. A request condition consists of a condition key and operator. Condition keys are either gl", "doc_type":"usermanual", "kw":"DLI Request Conditions,Permissions Management,User Guide", @@ -832,7 +842,7 @@ { "uri":"dli_01_0441.html", "product_code":"dli", - "code":"84", + "code":"85", "des":"Table 1 lists the common operations supported by each system policy of DLI. Choose proper system policies according to this table. For details about the SQL statement per", "doc_type":"usermanual", "kw":"Common Operations Supported by DLI System Policy,Permissions Management,User Guide", @@ -840,109 +850,189 @@ "githuburl":"" }, { - "uri":"dli_01_0539.html", + "uri":"dli_01_0513.html", "product_code":"dli", - "code":"85", + "code":"86", "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "doc_type":"usermanual", - "kw":"FAQs", - "title":"FAQs", + "kw":"Other Common Operations", + "title":"Other Common Operations", + "githuburl":"" + }, + { + "uri":"dli_01_0420.html", + "product_code":"dli", + "code":"87", + "des":"On the DLI management console, you can import data stored on OBS to DLI tables from Data Management > Databases and Tables > Table Management and SQL Editor pages. For de", + "doc_type":"usermanual", + "kw":"Importing Data to a DLI Table,Other Common Operations,User Guide", + "title":"Importing Data to a DLI Table", + "githuburl":"" + }, + { + "uri":"dli_01_0445.html", + "product_code":"dli", + "code":"88", + "des":"This section describes metrics reported by DLI to Cloud Eye as well as their namespaces and dimensions. You can use the management console or APIs provided by Cloud Eye t", + "doc_type":"usermanual", + "kw":"Viewing Monitoring Metrics,Other Common Operations,User Guide", + "title":"Viewing Monitoring Metrics", + "githuburl":"" + }, + { + "uri":"dli_01_0318.html", + "product_code":"dli", + "code":"89", + "des":"With CTS, you can record operations associated with DLI for later query, audit, and backtrack operations.", + "doc_type":"usermanual", + "kw":"DLI Operations That Can Be Recorded by CTS,Other Common Operations,User Guide", + "title":"DLI Operations That Can Be Recorded by CTS", + "githuburl":"" + }, + { + "uri":"dli_01_0550.html", + "product_code":"dli", + "code":"90", + "des":"A quota limits the quantity of a resource available to users, thereby preventing spikes in the usage of the resource.You can also request for an increased quota if your e", + "doc_type":"usermanual", + "kw":"Quotas,Other Common Operations,User Guide", + "title":"Quotas", + "githuburl":"" + }, + { + "uri":"dli_01_0539.html", + "product_code":"dli", + "code":"91", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"FAQ", + "title":"FAQ", "githuburl":"" }, { "uri":"dli_03_0037.html", "product_code":"dli", - "code":"86", + "code":"92", "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "doc_type":"usermanual", "kw":"Flink Jobs", "title":"Flink Jobs", "githuburl":"" }, + { + "uri":"dli_03_0137.html", + "product_code":"dli", + "code":"93", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Usage", + "title":"Usage", + "githuburl":"" + }, { "uri":"dli_03_0083.html", "product_code":"dli", - "code":"87", + "code":"94", "des":"DLI Flink jobs support the following data formats:Avro, Avro_merge, BLOB, CSV, EMAIL, JSON, ORC, Parquet, and XML.DLI Flink jobs support data from the following data sour", "doc_type":"usermanual", - "kw":"What Data Formats and Data Sources Are Supported by DLI Flink Jobs?,Flink Jobs,User Guide", + "kw":"What Data Formats and Data Sources Are Supported by DLI Flink Jobs?,Usage,User Guide", "title":"What Data Formats and Data Sources Are Supported by DLI Flink Jobs?", "githuburl":"" }, { "uri":"dli_03_0139.html", "product_code":"dli", - "code":"88", + "code":"95", "des":"A sub-user can view queues but cannot view Flink jobs. You can authorize the sub-user using DLI or IAM.Authorization on DLILog in to the DLI console using a tenant accoun", "doc_type":"usermanual", - "kw":"How Do I Authorize a Subuser to View Flink Jobs?,Flink Jobs,User Guide", + "kw":"How Do I Authorize a Subuser to View Flink Jobs?,Usage,User Guide", "title":"How Do I Authorize a Subuser to View Flink Jobs?", "githuburl":"" }, { "uri":"dli_03_0090.html", "product_code":"dli", - "code":"89", + "code":"96", "des":"DLI Flink jobs are highly available. You can enable the automatic restart function to automatically restart your jobs after short-time faults of peripheral services are r", "doc_type":"usermanual", - "kw":"How Do I Set Auto Restart upon Exception for a Flink Job?,Flink Jobs,User Guide", + "kw":"How Do I Set Auto Restart upon Exception for a Flink Job?,Usage,User Guide", "title":"How Do I Set Auto Restart upon Exception for a Flink Job?", "githuburl":"" }, { "uri":"dli_03_0099.html", "product_code":"dli", - "code":"90", + "code":"97", "des":"When you create a Flink SQL job or Flink Jar job, you can select Save Job Log on the job editing page to save job running logs to OBS.To set the OBS bucket for storing th", "doc_type":"usermanual", - "kw":"How Do I Save Flink Job Logs?,Flink Jobs,User Guide", + "kw":"How Do I Save Flink Job Logs?,Usage,User Guide", "title":"How Do I Save Flink Job Logs?", "githuburl":"" }, { "uri":"dli_03_0043.html", "product_code":"dli", - "code":"91", - "des":"DLI can output Flink job results to DIS. You can view the results in DIS. For details, see Retrieving Data from DIS in the Data Ingestion Service User Guide.DLI can outpu", + "code":"98", + "des":"DLI can output Flink job results to DIS. You can view the results in DIS. For details, see \"Obtaining Data from DIS\" in Data Ingestion Service User Guide.DLI can output F", "doc_type":"usermanual", - "kw":"How Can I Check Flink Job Results?,Flink Jobs,User Guide", + "kw":"How Can I Check Flink Job Results?,Usage,User Guide", "title":"How Can I Check Flink Job Results?", "githuburl":"" }, { "uri":"dli_03_0160.html", "product_code":"dli", - "code":"92", + "code":"99", "des":"Choose Job Management > Flink Jobs. In the Operation column of the target job, choose More > Permissions. When a new user is authorized, No such user. userName:xxxx. is d", "doc_type":"usermanual", - "kw":"What Should I Do if \"No such user. userName:xxxx.\" Is Displayed on the Flink Job Management Page Whe", - "title":"What Should I Do if \"No such user. userName:xxxx.\" Is Displayed on the Flink Job Management Page When I Grant Permission to a User?", + "kw":"Why Is Error \"No such user. userName:xxxx.\" Reported on the Flink Job Management Page When I Grant P", + "title":"Why Is Error \"No such user. userName:xxxx.\" Reported on the Flink Job Management Page When I Grant Permission to a User?", "githuburl":"" }, { "uri":"dli_03_0180.html", "product_code":"dli", - "code":"93", + "code":"100", "des":"Checkpoint was enabled when a Flink job is created, and the OBS bucket for storing checkpoints was specified. After a Flink job is manually stopped, no message is display", "doc_type":"usermanual", "kw":"How Do I Know Which Checkpoint the Flink Job I Stopped Will Be Restored to When I Start the Job Agai", "title":"How Do I Know Which Checkpoint the Flink Job I Stopped Will Be Restored to When I Start the Job Again?", "githuburl":"" }, + { + "uri":"dli_03_0036.html", + "product_code":"dli", + "code":"101", + "des":"When you set running parameters of a DLI Flink job, you can enable Alarm Generation upon Job Exception to receive alarms when the job runs abnormally or is in arrears.If ", + "doc_type":"usermanual", + "kw":"How Is a Message Displayed Indicating That the SMN Topic Does Not Exist When I Use the SMN Topic in ", + "title":"How Is a Message Displayed Indicating That the SMN Topic Does Not Exist When I Use the SMN Topic in DLI?", + "githuburl":"" + }, + { + "uri":"dli_03_0131.html", + "product_code":"dli", + "code":"102", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Flink SQL", + "title":"Flink SQL", + "githuburl":"" + }, { "uri":"dli_03_0130.html", "product_code":"dli", - "code":"94", + "code":"103", "des":"The consumption capability of a Flink SQL job depends on the data source transmission, queue size, and job parameter settings. The peak consumption is 10 Mbit/s.", "doc_type":"usermanual", - "kw":"How Much Data Can Be Processed in a Day by a Flink SQL Job?,Flink Jobs,User Guide", + "kw":"How Much Data Can Be Processed in a Day by a Flink SQL Job?,Flink SQL,User Guide", "title":"How Much Data Can Be Processed in a Day by a Flink SQL Job?", "githuburl":"" }, { "uri":"dli_03_0061.html", "product_code":"dli", - "code":"95", + "code":"104", "des":"The temp stream in Flink SQL is similar to a subquery. It is a logical stream used to simplify the SQL logic and does not generate data storage. Therefore, there is no ne", "doc_type":"usermanual", "kw":"Does Data in the Temporary Stream of Flink SQL Need to Be Cleared Periodically? How Do I Clear the D", @@ -952,107 +1042,117 @@ { "uri":"dli_03_0138.html", "product_code":"dli", - "code":"96", + "code":"105", "des":"SymptomWhen you create a Flink SQL job and configure the parameters, you select an OBS bucket you have created. The system displays a message indicating that the OBS buck", "doc_type":"usermanual", - "kw":"What Should I Do if a Message Is Displayed Indicating that the OBS Bucket Is Not Authorized When I S", - "title":"What Should I Do if a Message Is Displayed Indicating that the OBS Bucket Is Not Authorized When I Select an OBS Bucket for a Flink SQL Job?", + "kw":"Why Is a Message Displayed Indicating That the OBS Bucket Is Not Authorized When I Select an OBS Buc", + "title":"Why Is a Message Displayed Indicating That the OBS Bucket Is Not Authorized When I Select an OBS Bucket for a Flink SQL Job?", "githuburl":"" }, { "uri":"dli_03_0089.html", "product_code":"dli", - "code":"97", + "code":"106", "des":"When using a Flink SQL job, you need to create an OBS partition table for subsequent batch processing.In the following example, the day field is used as the partition fie", "doc_type":"usermanual", - "kw":"How Do I Map an OBS Table to a Partitioned DLI Table?,Flink Jobs,User Guide", - "title":"How Do I Map an OBS Table to a Partitioned DLI Table?", + "kw":"How Do I Create an OBS Partitioned Table for a Flink SQL Job?,Flink SQL,User Guide", + "title":"How Do I Create an OBS Partitioned Table for a Flink SQL Job?", "githuburl":"" }, { "uri":"dli_03_0120.html", "product_code":"dli", - "code":"98", + "code":"107", "des":"SymptomYou used Flink 1.10 to run a Flink Opensource SQL job. You set the number of Kafka partitions for the job a small value at the beginning and need to increase the n", "doc_type":"usermanual", - "kw":"How Do I Change the Number of Kafka Partitions of a Flink SQL Job Without Stopping It?,Flink Jobs,Us", + "kw":"How Do I Change the Number of Kafka Partitions of a Flink SQL Job Without Stopping It?,Flink SQL,Use", "title":"How Do I Change the Number of Kafka Partitions of a Flink SQL Job Without Stopping It?", "githuburl":"" }, { "uri":"dli_03_0075.html", "product_code":"dli", - "code":"99", + "code":"108", "des":"In this example, the day field is used as the partition field with the parquet encoding format (only the parquet format is supported currently) to dump car_info data to O", "doc_type":"usermanual", - "kw":"How Can I Map an OBS Table to a DLI Partition Table?,Flink Jobs,User Guide", - "title":"How Can I Map an OBS Table to a DLI Partition Table?", + "kw":"How Do I Dump Data to OBS and Create an OBS Partitioned Table?,Flink SQL,User Guide", + "title":"How Do I Dump Data to OBS and Create an OBS Partitioned Table?", "githuburl":"" }, { "uri":"dli_03_0167.html", "product_code":"dli", - "code":"100", + "code":"109", "des":"When I run the creation statement with an EL expression in the table name in a Flink SQL job, the following error message is displayed:DLI.0005: AnalysisException: t_user", "doc_type":"usermanual", - "kw":"What Should I Do If Error Message DLI.0005 Is Displayed When I Use an EL Expression to Create a Tabl", - "title":"What Should I Do If Error Message DLI.0005 Is Displayed When I Use an EL Expression to Create a Table in a Flink SQL Job?", + "kw":"Why Is Error Message \"DLI.0005\" Displayed When I Use an EL Expression to Create a Table in a Flink S", + "title":"Why Is Error Message \"DLI.0005\" Displayed When I Use an EL Expression to Create a Table in a Flink SQL Job?", "githuburl":"" }, { "uri":"dli_03_0168.html", "product_code":"dli", - "code":"101", + "code":"110", "des":"After data is written to OBS through the Flink job output stream, data cannot be queried from the DLI table created in the OBS file path.For example, use the following Fl", "doc_type":"usermanual", - "kw":"What Should I Do If No Data Is Found in the DLI Table Created Using the OBS File Path That Stores th", - "title":"What Should I Do If No Data Is Found in the DLI Table Created Using the OBS File Path That Stores the Output of a Flink job?", + "kw":"Why Is No Data Queried in the DLI Table Created Using the OBS File Path When Data Is Written to OBS ", + "title":"Why Is No Data Queried in the DLI Table Created Using the OBS File Path When Data Is Written to OBS by a Flink Job Output Stream?", "githuburl":"" }, { "uri":"dli_03_0174.html", "product_code":"dli", - "code":"102", + "code":"111", "des":"After a Flink SQL job is submitted on DLI, the job fails to be executed. The following error information is displayed in the job log:connect to DIS failed java.lang.Illeg", "doc_type":"usermanual", - "kw":"What Should I Do If a Flink SQL Job Fails to Be Executed, and \"connect to DIS failed java.lang.Illeg", - "title":"What Should I Do If a Flink SQL Job Fails to Be Executed, and \"connect to DIS failed java.lang.IllegalArgumentException: Access key cannot be null\" Is Recorded in the Log?", + "kw":"Why Does a Flink SQL Job Fails to Be Executed, and Is \"connect to DIS failed java.lang.IllegalArgume", + "title":"Why Does a Flink SQL Job Fails to Be Executed, and Is \"connect to DIS failed java.lang.IllegalArgumentException: Access key cannot be null\" Displayed in the Log?", "githuburl":"" }, { "uri":"dli_03_0176.html", "product_code":"dli", - "code":"103", + "code":"112", "des":"Semantic verification for a Flink SQL job (reading DIS data) fails. The following information is displayed when the job fails:Get dis channel xxxinfo failed. error info: ", "doc_type":"usermanual", - "kw":"What Should I Do If \"Not authorized\" Is Reported When a Flink SQL Job Reads DIS Data?,Flink Jobs,Use", - "title":"What Should I Do If \"Not authorized\" Is Reported When a Flink SQL Job Reads DIS Data?", + "kw":"Why Is Error \"Not authorized\" Reported When a Flink SQL Job Reads DIS Data?,Flink SQL,User Guide", + "title":"Why Is Error \"Not authorized\" Reported When a Flink SQL Job Reads DIS Data?", "githuburl":"" }, { "uri":"dli_03_0232.html", "product_code":"dli", - "code":"104", - "des":"After a Flink SQL job consumed Kafka and sank data to the Elasticsearch cluster, the job was successfully executed, but no data is available.Possible causes are as follow", + "code":"113", + "des":"After a Flink SQL job consumed Kafka and sent data to the Elasticsearch cluster, the job was successfully executed, but no data is available.Possible causes are as follow", "doc_type":"usermanual", "kw":"Data Writing Fails After a Flink SQL Job Consumed Kafka and Sank Data to the Elasticsearch Cluster,F", "title":"Data Writing Fails After a Flink SQL Job Consumed Kafka and Sank Data to the Elasticsearch Cluster", "githuburl":"" }, + { + "uri":"dli_03_0132.html", + "product_code":"dli", + "code":"114", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Flink Jar Jobs", + "title":"Flink Jar Jobs", + "githuburl":"" + }, { "uri":"dli_03_0038.html", "product_code":"dli", - "code":"105", - "des":"The procedure is as follows:Add the following code to the JAR package code of the Flink Jar job:// Configure the pom file on which the StreamExecutionEnvironment depends.", + "code":"115", + "des":"The procedure is as follows:Add the following code to the JAR file code of the Flink Jar job:// Configure the pom file on which the StreamExecutionEnvironment depends.\nSt", "doc_type":"usermanual", - "kw":"How Do I Configure Checkpoints for Flink Jar Jobs and Save the Checkpoints to OBS?,Flink Jobs,User G", + "kw":"How Do I Configure Checkpoints for Flink Jar Jobs and Save the Checkpoints to OBS?,Flink Jar Jobs,Us", "title":"How Do I Configure Checkpoints for Flink Jar Jobs and Save the Checkpoints to OBS?", "githuburl":"" }, { "uri":"dli_03_0044.html", "product_code":"dli", - "code":"106", + "code":"116", "des":"Configuration files can be uploaded for user-defined jobs (JAR).Upload the configuration file to DLI through Package Management.In the Other Dependencies area of the Flin", "doc_type":"usermanual", "kw":"Does a Flink JAR Job Support Configuration File Upload? How Do I Upload a Configuration File?,Flink ", @@ -1062,487 +1162,547 @@ { "uri":"dli_03_0119.html", "product_code":"dli", - "code":"107", - "des":"The dependency of your Flink job conflicts with a built-in dependency of the DLI Flink platform. As a result, the job submission fails.Delete your JAR package that is the", + "code":"117", + "des":"The dependency of your Flink job conflicts with a built-in dependency of the DLI Flink platform. As a result, the job submission fails.Delete your JAR file that is the sa", "doc_type":"usermanual", - "kw":"What Should I Do If Job Submission Fails Due to Flink JAR Package Conflict?,Flink Jobs,User Guide", - "title":"What Should I Do If Job Submission Fails Due to Flink JAR Package Conflict?", + "kw":"Why Does the Submission Fail Due to Flink JAR File Conflict?,Flink Jar Jobs,User Guide", + "title":"Why Does the Submission Fail Due to Flink JAR File Conflict?", "githuburl":"" }, { "uri":"dli_03_0161.html", "product_code":"dli", - "code":"108", + "code":"118", "des":"When a Flink Jar job is submitted to access GaussDB(DWS), an error message is displayed indicating that the job fails to be started. The job log contains the following er", "doc_type":"usermanual", - "kw":"What Should I Do If GaussDB(DWS) Fails to Be Started When a Flink Jar Job Accesses GaussDB(DWS), and", - "title":"What Should I Do If GaussDB(DWS) Fails to Be Started When a Flink Jar Job Accesses GaussDB(DWS), and a Message Indicating Too Many Client Connections is Displayed?", + "kw":"Why Does a Flink Jar Job Fail to Access GaussDB(DWS) and a Message Is Displayed Indicating Too Many ", + "title":"Why Does a Flink Jar Job Fail to Access GaussDB(DWS) and a Message Is Displayed Indicating Too Many Client Connections?", "githuburl":"" }, { "uri":"dli_03_0165.html", "product_code":"dli", - "code":"109", + "code":"119", "des":"An exception occurred when a Flink Jar job is running. The following error information is displayed in the job log:org.apache.flink.shaded.curator.org.apache.curator.Conn", "doc_type":"usermanual", - "kw":"What Should I Do If Error Message \"Authentication failed\" Is Displayed When a Flink Jar Job Is Runni", - "title":"What Should I Do If Error Message \"Authentication failed\" Is Displayed When a Flink Jar Job Is Running?", + "kw":"Why Is Error Message \"Authentication failed\" Displayed During Flink Jar Job Running?,Flink Jar Jobs,", + "title":"Why Is Error Message \"Authentication failed\" Displayed During Flink Jar Job Running?", "githuburl":"" }, { "uri":"dli_03_0233.html", "product_code":"dli", - "code":"110", + "code":"120", "des":"The storage path of the Flink Jar job checkpoints was set to an OBS bucket. The job failed to be submitted, and an error message indicating an invalid OBS bucket name was", "doc_type":"usermanual", - "kw":"What Should I Do If Invalid OBS Bucket Name Is Reported After a Flink Job Submission Failed?,Flink J", - "title":"What Should I Do If Invalid OBS Bucket Name Is Reported After a Flink Job Submission Failed?", + "kw":"Why Is Error Invalid OBS Bucket Name Reported After a Flink Job Submission Failed?,Flink Jar Jobs,Us", + "title":"Why Is Error Invalid OBS Bucket Name Reported After a Flink Job Submission Failed?", "githuburl":"" }, { "uri":"dli_03_0234.html", "product_code":"dli", - "code":"111", - "des":"Flink Job submission failed. The exception information is as follows:Flink JAR packages conflicted. The submitted Flink JAR package conflicted with the HDFS JAR package o", + "code":"121", + "des":"Flink Job submission failed. The exception information is as follows:Flink JAR files conflicted. The submitted Flink JAR file conflicted with the HDFS JAR file of the DLI", "doc_type":"usermanual", - "kw":"Flink Job Submission Fails Due to Hadoop JAR Package Conflicts,Flink Jobs,User Guide", - "title":"Flink Job Submission Fails Due to Hadoop JAR Package Conflicts", + "kw":"Why Does the Flink Submission Fail Due to Hadoop JAR File Conflict?,Flink Jar Jobs,User Guide", + "title":"Why Does the Flink Submission Fail Due to Hadoop JAR File Conflict?", "githuburl":"" }, { "uri":"dli_03_0266.html", "product_code":"dli", - "code":"112", + "code":"122", "des":"You can use Flink Jar to connect to Kafka with SASL SSL authentication enabled.", "doc_type":"usermanual", - "kw":"How Do I Connect a Flink jar Job to SASL_SSL?,Flink Jobs,User Guide", + "kw":"How Do I Connect a Flink jar Job to SASL_SSL?,Flink Jar Jobs,User Guide", "title":"How Do I Connect a Flink jar Job to SASL_SSL?", "githuburl":"" }, + { + "uri":"dli_03_0133.html", + "product_code":"dli", + "code":"123", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Performance Tuning", + "title":"Performance Tuning", + "githuburl":"" + }, { "uri":"dli_03_0106.html", "product_code":"dli", - "code":"113", + "code":"124", "des":"Data Stacking in a Consumer GroupThe accumulated data of a consumer group can be calculated by the following formula: Total amount of data to be consumed by the consumer ", "doc_type":"usermanual", - "kw":"How Do I Optimize Performance of a Flink Job?,Flink Jobs,User Guide", + "kw":"How Do I Optimize Performance of a Flink Job?,Performance Tuning,User Guide", "title":"How Do I Optimize Performance of a Flink Job?", "githuburl":"" }, { "uri":"dli_03_0048.html", "product_code":"dli", - "code":"114", + "code":"125", "des":"Add the following SQL statements to the Flink job:", "doc_type":"usermanual", - "kw":"How Do I Write Data to Different Elasticsearch Clusters in a Flink Job?,Flink Jobs,User Guide", + "kw":"How Do I Write Data to Different Elasticsearch Clusters in a Flink Job?,Performance Tuning,User Guid", "title":"How Do I Write Data to Different Elasticsearch Clusters in a Flink Job?", "githuburl":"" }, { "uri":"dli_03_0096.html", "product_code":"dli", - "code":"115", + "code":"126", "des":"The DLI Flink checkpoint/savepoint mechanism is complete and reliable. You can use this mechanism to prevent data loss when a job is manually restarted or restarted due t", "doc_type":"usermanual", - "kw":"How Do I Prevent Data Loss After Flink Job Restart?,Flink Jobs,User Guide", + "kw":"How Do I Prevent Data Loss After Flink Job Restart?,Performance Tuning,User Guide", "title":"How Do I Prevent Data Loss After Flink Job Restart?", "githuburl":"" }, + { + "uri":"dli_03_0135.html", + "product_code":"dli", + "code":"127", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"O&M Guide", + "title":"O&M Guide", + "githuburl":"" + }, { "uri":"dli_03_0103.html", "product_code":"dli", - "code":"116", + "code":"128", "des":"On the Flink job management page, hover the cursor on the status of the job that fails to be submitted to view the brief information about the failure.The possible causes", "doc_type":"usermanual", - "kw":"How Do I Locate a Flink Job Submission Error?,Flink Jobs,User Guide", + "kw":"How Do I Locate a Flink Job Submission Error?,O&M Guide,User Guide", "title":"How Do I Locate a Flink Job Submission Error?", "githuburl":"" }, { "uri":"dli_03_0105.html", "product_code":"dli", - "code":"117", + "code":"129", "des":"On the Flink job management, click Edit in the Operation column of the target job. On the displayed page, check whether Save Job Log in the Running Parameters tab is enab", "doc_type":"usermanual", - "kw":"How Do I Locate a Flink Job Running Error?,Flink Jobs,User Guide", + "kw":"How Do I Locate a Flink Job Running Error?,O&M Guide,User Guide", "title":"How Do I Locate a Flink Job Running Error?", "githuburl":"" }, { "uri":"dli_03_0136.html", "product_code":"dli", - "code":"118", + "code":"130", "des":"Check the following operations:Adjusting or adding optimization parameters or the number of concurrent threads of a job, or modifying Flink SQL statements or a Flink Jar ", "doc_type":"usermanual", - "kw":"How Do I Know Whether a Flink Job Can Be Restored from a Checkpoint After Being Restarted?,Flink Job", + "kw":"How Do I Know Whether a Flink Job Can Be Restored from a Checkpoint After Being Restarted?,O&M Guide", "title":"How Do I Know Whether a Flink Job Can Be Restored from a Checkpoint After Being Restarted?", "githuburl":"" }, { "uri":"dli_03_0040.html", "product_code":"dli", - "code":"119", + "code":"131", "des":"To rectify this fault, perform the following steps:Log in to the DIS management console. In the navigation pane, choose Stream Management. View the Flink job SQL statemen", "doc_type":"usermanual", - "kw":"What Should I Do If the DIS Stream Does Not Exist During the Semantic Check?,Flink Jobs,User Guide", - "title":"What Should I Do If the DIS Stream Does Not Exist During the Semantic Check?", + "kw":"Why Does DIS Stream Not Exist During Job Semantic Check?,O&M Guide,User Guide", + "title":"Why Does DIS Stream Not Exist During Job Semantic Check?", "githuburl":"" }, { "uri":"dli_03_0045.html", "product_code":"dli", - "code":"120", + "code":"132", "des":"If the OBS bucket selected for a job is not authorized, perform the following steps:Select Enable Checkpointing or Save Job Log.Specify OBS Bucket.Select Authorize OBS.", "doc_type":"usermanual", - "kw":"What Should I Do If the OBS Bucket Selected for a Job Is Not Authorized?,Flink Jobs,User Guide", - "title":"What Should I Do If the OBS Bucket Selected for a Job Is Not Authorized?", + "kw":"Why Is the OBS Bucket Selected for Job Not Authorized?,O&M Guide,User Guide", + "title":"Why Is the OBS Bucket Selected for Job Not Authorized?", "githuburl":"" }, { "uri":"dli_03_0064.html", "product_code":"dli", - "code":"121", + "code":"133", "des":"Mode for storing generated job logs when a DLI Flink job fails to be submitted or executed. The options are as follows:If the submission fails, a submission log is genera", "doc_type":"usermanual", - "kw":"What Should I Do If Logs Are Not Written to the OBS Bucket After a DLI Flink Job Fails to Be Submitt", - "title":"What Should I Do If Logs Are Not Written to the OBS Bucket After a DLI Flink Job Fails to Be Submitted for Running?", + "kw":"Why Are Logs Not Written to the OBS Bucket After a DLI Flink Job Fails to Be Submitted for Running?,", + "title":"Why Are Logs Not Written to the OBS Bucket After a DLI Flink Job Fails to Be Submitted for Running?", "githuburl":"" }, { "uri":"dli_03_0121.html", "product_code":"dli", - "code":"122", + "code":"134", "des":"SymptomYou used Flink 1.10 to run a Flink Opensource SQL job. The job failed after the following error was reported when Flink Sink wrote data to Kafka.Caused by: org.apa", "doc_type":"usermanual", - "kw":"How Do I Configure Connection Retries for Kafka Sink If it is Disconnected?,Flink Jobs,User Guide", + "kw":"How Do I Configure Connection Retries for Kafka Sink If it is Disconnected?,O&M Guide,User Guide", "title":"How Do I Configure Connection Retries for Kafka Sink If it is Disconnected?", "githuburl":"" }, { "uri":"dli_03_0235.html", "product_code":"dli", - "code":"123", + "code":"135", "des":"The Flink/Spark UI was displayed with incomplete information.When a pay-per-use queue is used to run a job, the system releases the cluster and takes about 10 minutes to ", "doc_type":"usermanual", - "kw":"What Should I Do If the Flink/Spark UI Page Cannot Be Displayed Properly?,Flink Jobs,User Guide", - "title":"What Should I Do If the Flink/Spark UI Page Cannot Be Displayed Properly?", + "kw":"Why Is Information Displayed on the FlinkUI/Spark UI Page Incomplete?,O&M Guide,User Guide", + "title":"Why Is Information Displayed on the FlinkUI/Spark UI Page Incomplete?", "githuburl":"" }, { "uri":"dli_03_0236.html", "product_code":"dli", - "code":"124", + "code":"136", "des":"JobManager and TaskManager heartbeats timed out. As a result, the Flink job is abnormal.Check whether the network is intermittently disconnected and whether the cluster l", "doc_type":"usermanual", - "kw":"Wha should I Do If JobManager and TaskManager Heartbeats Timed Out and the Flink Job Is Abnormal?,Fl", - "title":"Wha should I Do If JobManager and TaskManager Heartbeats Timed Out and the Flink Job Is Abnormal?", + "kw":"Why Is the Flink Job Abnormal Due to Heartbeat Timeout Between JobManager and TaskManager?,O&M Guide", + "title":"Why Is the Flink Job Abnormal Due to Heartbeat Timeout Between JobManager and TaskManager?", "githuburl":"" }, { "uri":"dli_03_0265.html", "product_code":"dli", - "code":"125", + "code":"137", "des":"Test address connectivity.If the network is unreachable, rectify the network connection first. Ensure that the network connection between the DLI queue and the external d", "doc_type":"usermanual", - "kw":"What Can I Do If \"Timeout expired while fetching topic metadata\" Is Repeatedly Reported in Flink Job", - "title":"What Can I Do If \"Timeout expired while fetching topic metadata\" Is Repeatedly Reported in Flink JobManager Logs?", + "kw":"Why Is Error \"Timeout expired while fetching topic metadata\" Repeatedly Reported in Flink JobManager", + "title":"Why Is Error \"Timeout expired while fetching topic metadata\" Repeatedly Reported in Flink JobManager Logs?", "githuburl":"" }, { "uri":"dli_03_0020.html", "product_code":"dli", - "code":"126", + "code":"138", "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "doc_type":"usermanual", "kw":"Problems Related to SQL Jobs", "title":"Problems Related to SQL Jobs", "githuburl":"" }, + { + "uri":"dli_03_0216.html", + "product_code":"dli", + "code":"139", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Usage", + "title":"Usage", + "githuburl":"" + }, { "uri":"dli_03_0200.html", "product_code":"dli", - "code":"127", + "code":"140", "des":"A temporary table is used to store intermediate results. When a transaction or session ends, the data in the temporary table can be automatically deleted. For example, in", "doc_type":"usermanual", - "kw":"SQL Jobs,Problems Related to SQL Jobs,User Guide", + "kw":"SQL Jobs,Usage,User Guide", "title":"SQL Jobs", "githuburl":"" }, + { + "uri":"dli_03_0204.html", + "product_code":"dli", + "code":"141", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Job Development", + "title":"Job Development", + "githuburl":"" + }, { "uri":"dli_03_0086.html", "product_code":"dli", - "code":"128", + "code":"142", "des":"If a large number of small files are generated during SQL execution, job execution and table query will take a long time. In this case, you should merge small files.Set t", "doc_type":"usermanual", - "kw":"How Do I Merge Small Files?,Problems Related to SQL Jobs,User Guide", + "kw":"How Do I Merge Small Files?,Job Development,User Guide", "title":"How Do I Merge Small Files?", "githuburl":"" }, { "uri":"dli_03_0092.html", "product_code":"dli", - "code":"129", + "code":"143", "des":"When creating an OBS table, you must specify a table path in the database. The path format is as follows: obs://xxx/database name/table name.If the specified path is akdc", "doc_type":"usermanual", - "kw":"How Do I Specify an OBS Path When Creating an OBS Table?,Problems Related to SQL Jobs,User Guide", + "kw":"How Do I Specify an OBS Path When Creating an OBS Table?,Job Development,User Guide", "title":"How Do I Specify an OBS Path When Creating an OBS Table?", "githuburl":"" }, { "uri":"dli_03_0108.html", "product_code":"dli", - "code":"130", + "code":"144", "des":"DLI allows you to associate JSON data in an OBS bucket to create tables in asynchronous mode.The statement for creating the table is as follows:", "doc_type":"usermanual", - "kw":"How Do I Create a Table Using JSON Data in an OBS Bucket?,Problems Related to SQL Jobs,User Guide", + "kw":"How Do I Create a Table Using JSON Data in an OBS Bucket?,Job Development,User Guide", "title":"How Do I Create a Table Using JSON Data in an OBS Bucket?", "githuburl":"" }, { "uri":"dli_03_0087.html", "product_code":"dli", - "code":"131", + "code":"145", "des":"You can use the where condition statement in the select statement to filter data. For example:", "doc_type":"usermanual", - "kw":"How Do I Set Local Variables in SQL Statements?,Problems Related to SQL Jobs,User Guide", + "kw":"How Do I Set Local Variables in SQL Statements?,Job Development,User Guide", "title":"How Do I Set Local Variables in SQL Statements?", "githuburl":"" }, { "uri":"dli_03_0069.html", "product_code":"dli", - "code":"132", + "code":"146", "des":"The correct method for using the count function to perform aggregation is as follows:OrIf an incorrect method is used, an error will be reported.", "doc_type":"usermanual", - "kw":"How Can I Use the count Function to Perform Aggregation?,Problems Related to SQL Jobs,User Guide", + "kw":"How Can I Use the count Function to Perform Aggregation?,Job Development,User Guide", "title":"How Can I Use the count Function to Perform Aggregation?", "githuburl":"" }, { "uri":"dli_03_0072.html", "product_code":"dli", - "code":"133", + "code":"147", "des":"You can use the cross-region replication function of OBS. The procedure is as follows:Export the DLI table data in region 1 to the user-defined OBS bucket. For details, s", "doc_type":"usermanual", - "kw":"How Do I Synchronize DLI Table Data from One Region to Another?,Problems Related to SQL Jobs,User Gu", + "kw":"How Do I Synchronize DLI Table Data from One Region to Another?,Job Development,User Guide", "title":"How Do I Synchronize DLI Table Data from One Region to Another?", "githuburl":"" }, { "uri":"dli_03_0191.html", "product_code":"dli", - "code":"134", + "code":"148", "des":"Currently, DLI does not allow you to insert table data into specific fields. To insert table data, you must insert data of all table fields at a time.", "doc_type":"usermanual", - "kw":"How Do I Insert Table Data into Specific Fields of a Table Using a SQL Job?,Problems Related to SQL ", + "kw":"How Do I Insert Table Data into Specific Fields of a Table Using a SQL Job?,Job Development,User Gui", "title":"How Do I Insert Table Data into Specific Fields of a Table Using a SQL Job?", "githuburl":"" }, + { + "uri":"dli_03_0206.html", + "product_code":"dli", + "code":"149", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Job O&M Errors", + "title":"Job O&M Errors", + "githuburl":"" + }, { "uri":"dli_03_0014.html", "product_code":"dli", - "code":"135", + "code":"150", "des":"Create an OBS directory with a unique name. Alternatively, you can manually delete the existing OBS directory and submit the job again. However, exercise caution when del", "doc_type":"usermanual", - "kw":"What Should I Do If Error \"path obs://xxx already exists\" Is Reported When Data Is Exported to OBS?,", - "title":"What Should I Do If Error \"path obs://xxx already exists\" Is Reported When Data Is Exported to OBS?", + "kw":"Why Is Error \"path obs://xxx already exists\" Reported When Data Is Exported to OBS?,Job O&M Errors,U", + "title":"Why Is Error \"path obs://xxx already exists\" Reported When Data Is Exported to OBS?", "githuburl":"" }, { "uri":"dli_03_0066.html", "product_code":"dli", - "code":"136", + "code":"151", "des":"This message indicates that the two tables to be joined contain the same column, but the owner of the column is not specified when the command is executed.For example, ta", "doc_type":"usermanual", - "kw":"What Should I Do If \"SQL_ANALYSIS_ERROR: Reference 't.id' is ambiguous, could be: t.id, t.id.;\" Is D", - "title":"What Should I Do If \"SQL_ANALYSIS_ERROR: Reference 't.id' is ambiguous, could be: t.id, t.id.;\" Is Displayed When Two Tables Are Joined", + "kw":"Why Is Error \"SQL_ANALYSIS_ERROR: Reference 't.id' is ambiguous, could be: t.id, t.id.;\" Displayed W", + "title":"Why Is Error \"SQL_ANALYSIS_ERROR: Reference 't.id' is ambiguous, could be: t.id, t.id.;\" Displayed When Two Tables Are Joined?", "githuburl":"" }, { "uri":"dli_03_0071.html", "product_code":"dli", - "code":"137", + "code":"152", "des":"Check whether the account is in arrears. If yes, recharge the account.If the error persists, log out and log in again.", "doc_type":"usermanual", - "kw":"What Should I Do If the System Notify Me that I Have No Permission to Execute the Query Statement Be", - "title":"What Should I Do If the System Notify Me that I Have No Permission to Execute the Query Statement Because the Current Account Was Restricted?", + "kw":"Why Is Error \"The current account does not have permission to perform this operation,the current acc", + "title":"Why Is Error \"The current account does not have permission to perform this operation,the current account was restricted. Restricted for no budget.\" Reported when a SQL Statement Is Executed?", "githuburl":"" }, { "uri":"dli_03_0145.html", "product_code":"dli", - "code":"138", + "code":"153", "des":"Cause AnalysisWhen you query the partitioned table XX.YYY, the partition column is not specified in the search criteria.A partitioned table can be queried only when the q", "doc_type":"usermanual", - "kw":"What Should I Do If Error Message \"There should be at least one partition pruning predicate on parti", - "title":"What Should I Do If Error Message \"There should be at least one partition pruning predicate on partitioned table XX.YYY\" Is Displayed When a Query Statement Is Executed?", + "kw":"Why Is Error \"There should be at least one partition pruning predicate on partitioned table XX.YYY\" ", + "title":"Why Is Error \"There should be at least one partition pruning predicate on partitioned table XX.YYY\" Reported When a Query Statement Is Executed?", "githuburl":"" }, { "uri":"dli_03_0169.html", "product_code":"dli", - "code":"139", + "code":"154", "des":"The following error message is displayed when the LOAD DATA command is executed by a Spark SQL job to import data to a DLI table:In some cases ,the following error messag", "doc_type":"usermanual", - "kw":"What Should I Do If Error Message IllegalArgumentException: Buffer size too small. size is Displayed", - "title":"What Should I Do If Error Message IllegalArgumentException: Buffer size too small. size is Displayed When Data Is Loaded to an OBS Foreign Table", + "kw":"Why Is Error \"IllegalArgumentException: Buffer size too small. size\" Reported When Data Is Loaded to", + "title":"Why Is Error \"IllegalArgumentException: Buffer size too small. size\" Reported When Data Is Loaded to an OBS Foreign Table?", "githuburl":"" }, { "uri":"dli_03_0189.html", "product_code":"dli", - "code":"140", + "code":"155", "des":"An error is reported during SQL job execution:Please contact DLI service. DLI.0002: FileNotFoundException: getFileStatus on obs://xxx: status [404]Check whether there is ", "doc_type":"usermanual", - "kw":"What Should I Do If \"DLI.0002 FileNotFoundException\" Is Reported During SQL Job Running,Problems Rel", - "title":"What Should I Do If \"DLI.0002 FileNotFoundException\" Is Reported During SQL Job Running", + "kw":"Why Is Error \"DLI.0002 FileNotFoundException\" Reported During SQL Job Running?,Job O&M Errors,User G", + "title":"Why Is Error \"DLI.0002 FileNotFoundException\" Reported During SQL Job Running?", "githuburl":"" }, { "uri":"dli_03_0046.html", "product_code":"dli", - "code":"141", + "code":"156", "des":"Currently, DLI supports the Hive syntax for creating tables of the TEXTFILE, SEQUENCEFILE, RCFILE, ORC, AVRO, and PARQUET file types. If the file format specified for cre", "doc_type":"usermanual", - "kw":"What Should I Do If A Schema Parsing Error Is Reported When I Create a Hive Table Using CTAS,Problem", - "title":"What Should I Do If A Schema Parsing Error Is Reported When I Create a Hive Table Using CTAS", + "kw":"Why Is a Schema Parsing Error Reported When I Create a Hive Table Using CTAS?,Job O&M Errors,User Gu", + "title":"Why Is a Schema Parsing Error Reported When I Create a Hive Table Using CTAS?", "githuburl":"" }, { "uri":"dli_03_0173.html", "product_code":"dli", - "code":"142", + "code":"157", "des":"When you run a DLI SQL script on DataArts Studio, the log shows that the statements fail to be executed. The error information is as follows:DLI.0999: RuntimeException: o", "doc_type":"usermanual", - "kw":"What Should I Do If \"org.apache.hadoop.fs.obs.OBSIOException\" Is Reported If DLI SQL Scripts Are Exe", - "title":"What Should I Do If \"org.apache.hadoop.fs.obs.OBSIOException\" Is Reported If DLI SQL Scripts Are Executed on DataArts Studio?", + "kw":"Why Is Error \"org.apache.hadoop.fs.obs.OBSIOException\" Reported When I Run DLI SQL Scripts on DataAr", + "title":"Why Is Error \"org.apache.hadoop.fs.obs.OBSIOException\" Reported When I Run DLI SQL Scripts on DataArts Studio?", "githuburl":"" }, { "uri":"dli_03_0172.html", "product_code":"dli", - "code":"143", + "code":"158", "des":"After the migration job is submitted, the following error information is displayed in the log:org.apache.sqoop.common.SqoopException:UQUERY_CONNECTOR_0001:Invoke DLI serv", "doc_type":"usermanual", - "kw":"What Should I Do If \"UQUERY_CONNECTOR_0001:Invoke DLI service api failed\" Is Reported in the Job Log", - "title":"What Should I Do If \"UQUERY_CONNECTOR_0001:Invoke DLI service api failed\" Is Reported in the Job Log When I Use CDM to Migrate Data to DLI?", + "kw":"Why Is Error \"UQUERY_CONNECTOR_0001:Invoke DLI service api failed\" Reported in the Job Log When I Us", + "title":"Why Is Error \"UQUERY_CONNECTOR_0001:Invoke DLI service api failed\" Reported in the Job Log When I Use CDM to Migrate Data to DLI?", "githuburl":"" }, { "uri":"dli_03_0207.html", "product_code":"dli", - "code":"144", + "code":"159", "des":"Error message \"File not Found\" is displayed when a SQL job is accessed.Generally, the file cannot be found due to a read/write conflict. Check whether a job is overwritin", "doc_type":"usermanual", - "kw":"What Should I Do If \"File not Found\" Is Displayed When I Access a SQL Job?,Problems Related to SQL J", - "title":"What Should I Do If \"File not Found\" Is Displayed When I Access a SQL Job?", + "kw":"Why Is Error \"File not Found\" Reported When I Access a SQL Job?,Job O&M Errors,User Guide", + "title":"Why Is Error \"File not Found\" Reported When I Access a SQL Job?", "githuburl":"" }, { "uri":"dli_03_0208.html", "product_code":"dli", - "code":"145", + "code":"160", "des":"Error message \"DLI.0003: AccessControlException XXX\" is reported when a SQL job is accessed.View the OBS bucket in the AccessControlException and check whether you are us", "doc_type":"usermanual", - "kw":"What Should I Do If \"DLI.0003: AccessControlException XXX\" Is Reported When I Access a SQL Job?,Prob", - "title":"What Should I Do If \"DLI.0003: AccessControlException XXX\" Is Reported When I Access a SQL Job?", + "kw":"Why Is Error \"DLI.0003: AccessControlException XXX\" Reported When I Access a SQL Job?,Job O&M Errors", + "title":"Why Is Error \"DLI.0003: AccessControlException XXX\" Reported When I Access a SQL Job?", "githuburl":"" }, { "uri":"dli_03_0209.html", "product_code":"dli", - "code":"146", + "code":"161", "des":"Error message \"DLI.0001: org.apache.hadoop.security.AccessControlException: verifyBucketExists on {{bucket name}}: status [403]\" is reported when a SQL job is Accessed.Th", "doc_type":"usermanual", - "kw":"What Should I Do If \"DLI.0001: org.apache.hadoop.security.AccessControlException: verifyBucketExists", - "title":"What Should I Do If \"DLI.0001: org.apache.hadoop.security.AccessControlException: verifyBucketExists on {{bucket name}}: status [403]\" Is Reported When I Access a SQL Job?", + "kw":"Why Is Error \"DLI.0001: org.apache.hadoop.security.AccessControlException: verifyBucketExists on {{b", + "title":"Why Is Error \"DLI.0001: org.apache.hadoop.security.AccessControlException: verifyBucketExists on {{bucket name}}: status [403]\" Reported When I Access a SQL Job?", "githuburl":"" }, { "uri":"dli_03_0210.html", "product_code":"dli", - "code":"147", + "code":"162", "des":"Error message \"The current account does not have permission to perform this operation,the current account was restricted.\" is reported during SQL statement execution.Chec", "doc_type":"usermanual", - "kw":"What Should I Do If \"The current account does not have permission to perform this operation,the curr", - "title":"What Should I Do If \"The current account does not have permission to perform this operation,the current account was restricted. Restricted for no budget\" Is Reported During SQL Statement Execution? Restricted for no budget.", + "kw":"Why Is Error \"The current account does not have permission to perform this operation,the current acc", + "title":"Why Is Error \"The current account does not have permission to perform this operation,the current account was restricted. Restricted for no budget\" Reported During SQL Statement Execution? Restricted for no budget.", + "githuburl":"" + }, + { + "uri":"dli_03_0211.html", + "product_code":"dli", + "code":"163", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"O&M Guide", + "title":"O&M Guide", "githuburl":"" }, { "uri":"dli_03_0196.html", "product_code":"dli", - "code":"148", + "code":"164", "des":"If the job runs slowly, perform the following steps to find the causes and rectify the fault:Check whether the problem is caused by FullGC.Log in to the DLI console. In t", "doc_type":"usermanual", - "kw":"How Do I Troubleshoot Slow SQL Jobs?,Problems Related to SQL Jobs,User Guide", + "kw":"How Do I Troubleshoot Slow SQL Jobs?,O&M Guide,User Guide", "title":"How Do I Troubleshoot Slow SQL Jobs?", "githuburl":"" }, { "uri":"dli_03_0091.html", "product_code":"dli", - "code":"149", + "code":"165", "des":"You can view SQL job logs for routine O&M.Obtain the ID of the DLI job executed on the DataArts Studio console.Job IDOn the DLI console, choose Job Management > SQL Jobs.", "doc_type":"usermanual", - "kw":"How Do I View DLI SQL Logs?,Problems Related to SQL Jobs,User Guide", + "kw":"How Do I View DLI SQL Logs?,O&M Guide,User Guide", "title":"How Do I View DLI SQL Logs?", "githuburl":"" }, { "uri":"dli_03_0116.html", "product_code":"dli", - "code":"150", + "code":"166", "des":"You can view the job execution records when a job is running.Log in to the DLI management console.In the navigation pane on the left, choose Job Management > SQL Jobs.Ent", "doc_type":"usermanual", - "kw":"How Do I View SQL Execution Records?,Problems Related to SQL Jobs,User Guide", + "kw":"How Do I View SQL Execution Records?,O&M Guide,User Guide", "title":"How Do I View SQL Execution Records?", "githuburl":"" }, { "uri":"dli_03_0093.html", "product_code":"dli", - "code":"151", + "code":"167", "des":"If the execution of an SQL statement takes a long time, you need to access the Spark UI to check the execution status.If data skew occurs, the running time of a stage exc", "doc_type":"usermanual", - "kw":"How Do I Eliminate Data Skew by Configuring AE Parameters?,Problems Related to SQL Jobs,User Guide", + "kw":"How Do I Eliminate Data Skew by Configuring AE Parameters?,O&M Guide,User Guide", "title":"How Do I Eliminate Data Skew by Configuring AE Parameters?", "githuburl":"" }, { "uri":"dli_03_0184.html", "product_code":"dli", - "code":"152", + "code":"168", "des":"A DLI table exists but cannot be queried on the DLI console.If a table exists but cannot be queried, there is a high probability that the current user does not have the p", "doc_type":"usermanual", - "kw":"What Can I Do If a Table Cannot Be Queried on the DLI Console?,Problems Related to SQL Jobs,User Gui", + "kw":"What Can I Do If a Table Cannot Be Queried on the DLI Console?,O&M Guide,User Guide", "title":"What Can I Do If a Table Cannot Be Queried on the DLI Console?", "githuburl":"" }, { "uri":"dli_03_0013.html", "product_code":"dli", - "code":"153", + "code":"169", "des":"A high compression ratio of OBS tables in the Parquet or ORC format (for example, a compression ratio of 5 or higher compared with text compression) will lead to large da", "doc_type":"usermanual", - "kw":"The Compression Ratio of OBS Tables Is Too High,Problems Related to SQL Jobs,User Guide", + "kw":"The Compression Ratio of OBS Tables Is Too High,O&M Guide,User Guide", "title":"The Compression Ratio of OBS Tables Is Too High", "githuburl":"" }, { "uri":"dli_03_0009.html", "product_code":"dli", - "code":"154", + "code":"170", "des":"DLI supports only UTF-8-encoded texts. Ensure that data is encoded using UTF-8 during table creation and import.", "doc_type":"usermanual", - "kw":"How Can I Avoid Garbled Characters Caused by Inconsistent Character Codes?,Problems Related to SQL J", + "kw":"How Can I Avoid Garbled Characters Caused by Inconsistent Character Codes?,O&M Guide,User Guide", "title":"How Can I Avoid Garbled Characters Caused by Inconsistent Character Codes?", "githuburl":"" }, { "uri":"dli_03_0175.html", "product_code":"dli", - "code":"155", + "code":"171", "des":"User A created the testTable table in a database through a SQL job and granted user B the permission to insert and delete table data. User A deleted the testTable table a", "doc_type":"usermanual", "kw":"Do I Need to Grant Table Permissions to a User and Project After I Delete a Table and Create One wit", @@ -1552,17 +1712,17 @@ { "uri":"dli_03_0177.html", "product_code":"dli", - "code":"156", + "code":"172", "des":"A CSV file is imported to a DLI partitioned table, but the imported file data does not contain the data in the partitioning column. The partitioning column needs to be sp", "doc_type":"usermanual", - "kw":"What Should I Do If Table Data Fails to Be Queried After Data Is Imported to a DLI Partitioned Table", - "title":"What Should I Do If Table Data Fails to Be Queried After Data Is Imported to a DLI Partitioned Table Because the File to Be Imported Does Not Contain Data in the Partitioning Column?", + "kw":"Why Can't I Query Table Data After Data Is Imported to a DLI Partitioned Table Because the File to B", + "title":"Why Can't I Query Table Data After Data Is Imported to a DLI Partitioned Table Because the File to Be Imported Does Not Contain Data in the Partitioning Column?", "githuburl":"" }, { "uri":"dli_03_0181.html", "product_code":"dli", - "code":"157", + "code":"173", "des":"When an OBS foreign table is created, a field in the specified OBS file contains a carriage return line feed (CRLF) character. As a result, the data is incorrect.The stat", "doc_type":"usermanual", "kw":"How Do I Fix the Data Error Caused by CRLF Characters in a Field of the OBS File Used to Create an E", @@ -1572,17 +1732,17 @@ { "uri":"dli_03_0182.html", "product_code":"dli", - "code":"158", + "code":"174", "des":"A SQL job contains join operations. After the job is submitted, it is stuck in the Running state and no result is returned.When a Spark SQL job has join operations on sma", "doc_type":"usermanual", - "kw":"What Should I Do If a SQL Job That Has Join Operations Stays in the Running State?,Problems Related ", - "title":"What Should I Do If a SQL Job That Has Join Operations Stays in the Running State?", + "kw":"Why Does a SQL Job That Has Join Operations Stay in the Running State?,O&M Guide,User Guide", + "title":"Why Does a SQL Job That Has Join Operations Stay in the Running State?", "githuburl":"" }, { "uri":"dli_03_0187.html", "product_code":"dli", - "code":"159", + "code":"175", "des":"The on clause was not added to the SQL statement for joining tables. As a result, the Cartesian product query occurs due to multi-table association, and the queue resourc", "doc_type":"usermanual", "kw":"The on Clause Is Not Added When Tables Are Joined. Cartesian Product Query Causes High Resource Usag", @@ -1592,117 +1752,137 @@ { "uri":"dli_03_0190.html", "product_code":"dli", - "code":"160", + "code":"176", "des":"Partition data is manually uploaded to a partition of an OBS table. However, the data cannot be queried using DLI SQL editor.After manually adding partition data, you nee", "doc_type":"usermanual", - "kw":"What Should I Do If Manually Added Data in a Partition of an OBS Table Cannot Be Queried?,Problems R", - "title":"What Should I Do If Manually Added Data in a Partition of an OBS Table Cannot Be Queried?", + "kw":"Why Can't I Query Data After I Manually Add Data to the Partition Directory of an OBS Table?,O&M Gui", + "title":"Why Can't I Query Data After I Manually Add Data to the Partition Directory of an OBS Table?", "githuburl":"" }, { "uri":"dli_03_0212.html", "product_code":"dli", - "code":"161", + "code":"177", "des":"To dynamically overwrite the specified partitioned data in the DataSource table, set dli.sql.dynamicPartitionOverwrite.enabled to true and then run the insert overwrite s", "doc_type":"usermanual", - "kw":"Why Is All Data Overwritten When insert overwrite Is Used to Overwrite Partitioned Table?,Problems R", + "kw":"Why Is All Data Overwritten When insert overwrite Is Used to Overwrite Partitioned Table?,O&M Guide,", "title":"Why Is All Data Overwritten When insert overwrite Is Used to Overwrite Partitioned Table?", "githuburl":"" }, { "uri":"dli_03_0213.html", "product_code":"dli", - "code":"162", + "code":"178", "des":"The possible causes and solutions are as follows:After you purchase a DLI queue and submit a SQL job for the first time, wait for 5 to 10 minutes. After the cluster is st", "doc_type":"usermanual", - "kw":"Why Is a SQL Job Stuck in the Submitting State?,Problems Related to SQL Jobs,User Guide", + "kw":"Why Is a SQL Job Stuck in the Submitting State?,O&M Guide,User Guide", "title":"Why Is a SQL Job Stuck in the Submitting State?", "githuburl":"" }, { "uri":"dli_03_0214.html", "product_code":"dli", - "code":"163", + "code":"179", "des":"Spark does not have the datetime type and uses the TIMESTAMP type instead.You can use a function to convert data types.The following is an example.select cast(create_date", "doc_type":"usermanual", - "kw":"Why Is the create_date Field in the RDS Table Is a Timestamp in the DLI query result?,Problems Relat", + "kw":"Why Is the create_date Field in the RDS Table Is a Timestamp in the DLI query result?,O&M Guide,User", "title":"Why Is the create_date Field in the RDS Table Is a Timestamp in the DLI query result?", "githuburl":"" }, { "uri":"dli_03_0215.html", "product_code":"dli", - "code":"164", + "code":"180", "des":"If the table name is changed immediately after SQL statements are executed, the data size of the table may be incorrect.If you need to change the table name, change it 5 ", "doc_type":"usermanual", - "kw":"What Can I Do If datasize Cannot Be Changed After the Table Name Is Changed in a Finished SQL Job?,P", + "kw":"What Can I Do If datasize Cannot Be Changed After the Table Name Is Changed in a Finished SQL Job?,O", "title":"What Can I Do If datasize Cannot Be Changed After the Table Name Is Changed in a Finished SQL Job?", "githuburl":"" }, { "uri":"dli_03_0231.html", "product_code":"dli", - "code":"165", + "code":"181", "des":"When DLI is used to insert data into an OBS temporary table, only part of data is imported.Possible causes are as follows:The amount of data read during job execution is ", "doc_type":"usermanual", - "kw":"Why Is the Data Volume Changes When Data Is Imported from DLI to OBS?,Problems Related to SQL Jobs,U", + "kw":"Why Is the Data Volume Changes When Data Is Imported from DLI to OBS?,O&M Guide,User Guide", "title":"Why Is the Data Volume Changes When Data Is Imported from DLI to OBS?", "githuburl":"" }, { "uri":"dli_03_0021.html", "product_code":"dli", - "code":"166", + "code":"182", "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "doc_type":"usermanual", "kw":"Problems Related to Spark Jobs", "title":"Problems Related to Spark Jobs", "githuburl":"" }, + { + "uri":"dli_03_0163.html", + "product_code":"dli", + "code":"183", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Usage", + "title":"Usage", + "githuburl":"" + }, { "uri":"dli_03_0201.html", "product_code":"dli", - "code":"167", + "code":"184", "des":"DLI Spark does not support job scheduling. You can use other services, such as DataArts Studio, or use APIs or SDKs to customize job schedule.The Spark SQL syntax does no", "doc_type":"usermanual", - "kw":"Spark Jobs,Problems Related to Spark Jobs,User Guide", + "kw":"Spark Jobs,Usage,User Guide", "title":"Spark Jobs", "githuburl":"" }, + { + "uri":"dli_03_0217.html", + "product_code":"dli", + "code":"185", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Job Development", + "title":"Job Development", + "githuburl":"" + }, { "uri":"dli_03_0107.html", "product_code":"dli", - "code":"168", + "code":"186", "des":"To use Spark to write data into a DLI table, configure the following parameters:fs.obs.access.keyfs.obs.secret.keyfs.obs.implfs.obs.endpointThe following is an example:", "doc_type":"usermanual", - "kw":"How Do I Use Spark to Write Data into a DLI Table?,Problems Related to Spark Jobs,User Guide", + "kw":"How Do I Use Spark to Write Data into a DLI Table?,Job Development,User Guide", "title":"How Do I Use Spark to Write Data into a DLI Table?", "githuburl":"" }, { "uri":"dli_03_0017.html", "product_code":"dli", - "code":"169", + "code":"187", "des":"If the AK and SK are obtained, set the parameters as follows:Create SparkContext using codeval sc: SparkContext = new SparkContext()\nsc.hadoopConfiguration.set(\"fs.obs.ac", "doc_type":"usermanual", - "kw":"How Do I Set the AK/SK for a Queue to Operate an OBS Table?,Problems Related to Spark Jobs,User Guid", + "kw":"How Do I Set the AK/SK for a Queue to Operate an OBS Table?,Job Development,User Guide", "title":"How Do I Set the AK/SK for a Queue to Operate an OBS Table?", "githuburl":"" }, { "uri":"dli_03_0102.html", "product_code":"dli", - "code":"170", + "code":"188", "des":"Log in to the DLI console. In the navigation pane, choose Job Management > Spark Jobs. In the job list, locate the target job and click next to Job ID to view the parame", "doc_type":"usermanual", - "kw":"How Do I View the Resource Usage of DLI Spark Jobs?,Problems Related to Spark Jobs,User Guide", + "kw":"How Do I View the Resource Usage of DLI Spark Jobs?,Job Development,User Guide", "title":"How Do I View the Resource Usage of DLI Spark Jobs?", "githuburl":"" }, { "uri":"dli_03_0076.html", "product_code":"dli", - "code":"171", + "code":"189", "des":"If the pymysql module is missing, check whether the corresponding EGG package exists. If the package does not exist, upload the pyFile package on the Package Management p", "doc_type":"usermanual", "kw":"How Do I Use Python Scripts to Access the MySQL Database If the pymysql Module Is Missing from the S", @@ -1712,27 +1892,27 @@ { "uri":"dli_03_0082.html", "product_code":"dli", - "code":"172", + "code":"190", "des":"DLI natively supports PySpark.For most cases, Python is preferred for data analysis, and PySpark is the best choice for big data analysis. Generally, JVM programs are pac", "doc_type":"usermanual", - "kw":"How Do I Run a Complex PySpark Program in DLI?,Problems Related to Spark Jobs,User Guide", + "kw":"How Do I Run a Complex PySpark Program in DLI?,Job Development,User Guide", "title":"How Do I Run a Complex PySpark Program in DLI?", "githuburl":"" }, { "uri":"dli_03_0127.html", "product_code":"dli", - "code":"173", + "code":"191", "des":"You can use DLI Spark jobs to access data in the MySQL database using either of the following methods:Solution 1: Purchase a pay-per-use queue, create an enhanced datasou", "doc_type":"usermanual", - "kw":"How Does a Spark Job Access a MySQL Database?,Problems Related to Spark Jobs,User Guide", + "kw":"How Does a Spark Job Access a MySQL Database?,Job Development,User Guide", "title":"How Does a Spark Job Access a MySQL Database?", "githuburl":"" }, { "uri":"dli_03_0068.html", "product_code":"dli", - "code":"174", + "code":"192", "des":"When shuffle statements, such as GROUP BY and JOIN, are executed in Spark jobs, data skew occurs, which slows down the job execution.To solve this problem, you can config", "doc_type":"usermanual", "kw":"How Do I Use JDBC to Set the spark.sql.shuffle.partitions Parameter to Improve the Task Concurrency?", @@ -1742,227 +1922,267 @@ { "uri":"dli_03_0118.html", "product_code":"dli", - "code":"175", + "code":"193", "des":"You can use SparkFiles to read the file submitted using –-file form a local path: SparkFiles.get(\"Name of the uploaded file\").The file path in the Driver is different fro", "doc_type":"usermanual", - "kw":"How Do I Read Uploaded Files for a Spark Jar Job?,Problems Related to Spark Jobs,User Guide", + "kw":"How Do I Read Uploaded Files for a Spark Jar Job?,Job Development,User Guide", "title":"How Do I Read Uploaded Files for a Spark Jar Job?", "githuburl":"" }, { - "uri":"dli_03_0023.html", + "uri":"dli_03_0218.html", "product_code":"dli", - "code":"176", - "des":"The Spark 2.3 has changed the behavior of the internal interface Logging. If the user code directly inherits the Logging and the earlier version Spark is used during comp", + "code":"194", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "doc_type":"usermanual", - "kw":"What Can I Do When Receiving java.lang.AbstractMethodError in the Spark Job?,Problems Related to Spa", - "title":"What Can I Do When Receiving java.lang.AbstractMethodError in the Spark Job?", + "kw":"Job O&M Errors", + "title":"Job O&M Errors", "githuburl":"" }, { "uri":"dli_03_0156.html", "product_code":"dli", - "code":"177", + "code":"195", "des":"The following error is reported when a Spark job accesses OBS data:Set the AK/SK to enable Spark jobs to access OBS data. For details, see How Do I Set the AK/SK for a Qu", "doc_type":"usermanual", - "kw":"What Should I Do If Errors \"ResponseCode: 403\" and \"ResponseStatus: Forbidden\" Are Reported When a S", - "title":"What Should I Do If Errors \"ResponseCode: 403\" and \"ResponseStatus: Forbidden\" Are Reported When a Spark Job Accesses OBS Data", + "kw":"Why Are Errors \"ResponseCode: 403\" and \"ResponseStatus: Forbidden\" Reported When a Spark Job Accesse", + "title":"Why Are Errors \"ResponseCode: 403\" and \"ResponseStatus: Forbidden\" Reported When a Spark Job Accesses OBS Data?", "githuburl":"" }, { "uri":"dli_03_0164.html", "product_code":"dli", - "code":"178", + "code":"196", "des":"Check whether the OBS bucket is used to store DLI logs on the Global Configuration > Job Configurations page. The job log bucket cannot be used for other purpose.", "doc_type":"usermanual", - "kw":"Why is Error \"verifyBucketExists on XXXX: status [403]\" Is Reported When I Run a Spark Job with a Us", - "title":"Why is Error \"verifyBucketExists on XXXX: status [403]\" Is Reported When I Run a Spark Job with a User that has the Permission to Access the OBS Bucket?", + "kw":"Why Is Error \"verifyBucketExists on XXXX: status [403]\" Reported When I Use a Spark Job to Access an", + "title":"Why Is Error \"verifyBucketExists on XXXX: status [403]\" Reported When I Use a Spark Job to Access an OBS Bucket That I Have Access Permission?", "githuburl":"" }, { "uri":"dli_03_0157.html", "product_code":"dli", - "code":"179", + "code":"197", "des":"When a Spark job accesses a large amount of data, for example, accessing data in a GaussDB(DWS) database, you are advised to set the number of concurrent tasks and enable", "doc_type":"usermanual", - "kw":"What Should I Do if a Running Timeout Error Is Reported When a Spark Job Runs a Large Amount of Data", - "title":"What Should I Do if a Running Timeout Error Is Reported When a Spark Job Runs a Large Amount of Data?", + "kw":"Why Is a Job Running Timeout Reported When a Spark Job Runs a Large Amount of Data?,Job O&M Errors,U", + "title":"Why Is a Job Running Timeout Reported When a Spark Job Runs a Large Amount of Data?", "githuburl":"" }, { "uri":"dli_03_0188.html", "product_code":"dli", - "code":"180", + "code":"198", "des":"Spark jobs cannot access SFTP. Upload the files you want to access to OBS and then you can analyze the data using Spark jobs.", "doc_type":"usermanual", - "kw":"What Should I Do If a Spark job Used to Access Files in SFTP Fails and the Log Shows that the File D", - "title":"What Should I Do If a Spark job Used to Access Files in SFTP Fails and the Log Shows that the File Directory Is Abnormal?", + "kw":"Why Does the Job Fail to Be Executed and the Log Shows that the File Directory Is Abnormal When I Us", + "title":"Why Does the Job Fail to Be Executed and the Log Shows that the File Directory Is Abnormal When I Use a Spark Job to Access Files in SFTP?", "githuburl":"" }, { "uri":"dli_03_0192.html", "product_code":"dli", - "code":"181", + "code":"199", "des":"When a Spark job is running, an error message is displayed, indicating that the user does not have the database permission. The error information is as follows:org.apache", "doc_type":"usermanual", - "kw":"What Should I Do If a Job Fails Because the Job User Does Not Have the Database and Table Permission", - "title":"What Should I Do If a Job Fails Because the Job User Does Not Have the Database and Table Permission?", + "kw":"Why Does the Job Fail to Be Executed Due to Insufficient Database and Table Permissions?,Job O&M Err", + "title":"Why Does the Job Fail to Be Executed Due to Insufficient Database and Table Permissions?", + "githuburl":"" + }, + { + "uri":"dli_03_0219.html", + "product_code":"dli", + "code":"200", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"O&M Guide", + "title":"O&M Guide", "githuburl":"" }, { "uri":"dli_03_0077.html", "product_code":"dli", - "code":"182", - "des":"If the specified Python environment cannot be found after a Python3 package is added, the current compute cluster environment is Python2 by default.You can set spark.yarn", + "code":"201", + "des":"I cannot find the specified Python environment after adding the Python 3 package.Set spark.yarn.appMasterEnv.PYSPARK_PYTHON to python3 in the conf file to specify the Pyt", "doc_type":"usermanual", - "kw":"What Can I Do If the Specified Python Environment Cannot Be Found After a Python Package Is Added?,P", - "title":"What Can I Do If the Specified Python Environment Cannot Be Found After a Python Package Is Added?", + "kw":"Why Can't I Find the Specified Python Environment After Adding the Python Package?,O&M Guide,User Gu", + "title":"Why Can't I Find the Specified Python Environment After Adding the Python Package?", "githuburl":"" }, { "uri":"dli_03_0220.html", "product_code":"dli", - "code":"183", + "code":"202", "des":"The remaining CUs in the queue may be insufficient. As a result, the job cannot be submitted.To view the remaining CUs of a queue, perform the following steps:Check the C", "doc_type":"usermanual", - "kw":"Why Is a Spark Jar Job Stuck in the Submitting State?,Problems Related to Spark Jobs,User Guide", + "kw":"Why Is a Spark Jar Job Stuck in the Submitting State?,O&M Guide,User Guide", "title":"Why Is a Spark Jar Job Stuck in the Submitting State?", "githuburl":"" }, { "uri":"dli_03_0001.html", "product_code":"dli", - "code":"184", + "code":"203", "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "doc_type":"usermanual", "kw":"Product Consultation", "title":"Product Consultation", "githuburl":"" }, + { + "uri":"dli_03_0221.html", + "product_code":"dli", + "code":"204", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Usage", + "title":"Usage", + "githuburl":"" + }, { "uri":"dli_03_0002.html", "product_code":"dli", - "code":"185", + "code":"205", "des":"Data Lake Insight (DLI) is a serverless data processing and analysis service fully compatible with Apache Spark, and Flink ecosystems. It frees you from managing any serv", "doc_type":"usermanual", - "kw":"What Is DLI?,Product Consultation,User Guide", + "kw":"What Is DLI?,Usage,User Guide", "title":"What Is DLI?", "githuburl":"" }, { "uri":"dli_03_0025.html", "product_code":"dli", - "code":"186", + "code":"206", "des":"DLI supports the following data formats:ParquetCSVORCJsonAvro", "doc_type":"usermanual", - "kw":"Which Data Formats Does DLI Support?,Product Consultation,User Guide", + "kw":"Which Data Formats Does DLI Support?,Usage,User Guide", "title":"Which Data Formats Does DLI Support?", "githuburl":"" }, { "uri":"dli_03_0115.html", "product_code":"dli", - "code":"187", + "code":"207", "des":"The Spark component of DLI is a fully managed service. You can only use the DLI Spark through its APIs. .The Spark component of MRS is built on the VM in an MRS cluster. ", "doc_type":"usermanual", - "kw":"What Are the Differences Between MRS Spark and DLI Spark?,Product Consultation,User Guide", + "kw":"What Are the Differences Between MRS Spark and DLI Spark?,Usage,User Guide", "title":"What Are the Differences Between MRS Spark and DLI Spark?", "githuburl":"" }, { "uri":"dli_03_0029.html", "product_code":"dli", - "code":"188", + "code":"208", "des":"DLI data can be stored in either of the following:OBS: Data used by SQL jobs, Spark jobs, and Flink jobs can be stored in OBS, reducing storage costs.DLI: The column-base", "doc_type":"usermanual", - "kw":"Where Can DLI Data Be Stored?,Product Consultation,User Guide", + "kw":"Where Can DLI Data Be Stored?,Usage,User Guide", "title":"Where Can DLI Data Be Stored?", "githuburl":"" }, { "uri":"dli_03_0117.html", "product_code":"dli", - "code":"189", + "code":"209", "des":"DLI tables store data within the DLI service, and you do not need to know the data storage path.OBS tables store data in your OBS buckets, and you need to manage the sour", "doc_type":"usermanual", - "kw":"What Are the Differences Between DLI Tables and OBS Tables?,Product Consultation,User Guide", + "kw":"What Are the Differences Between DLI Tables and OBS Tables?,Usage,User Guide", "title":"What Are the Differences Between DLI Tables and OBS Tables?", "githuburl":"" }, { "uri":"dli_03_0010.html", "product_code":"dli", - "code":"190", + "code":"210", "des":"Currently, DLI supports analysis only on the data uploaded to the cloud. In scenarios where regular (for example, on a per day basis) one-off analysis on incremental data", "doc_type":"usermanual", - "kw":"How Can I Use DLI If Data Is Not Uploaded to OBS?,Product Consultation,User Guide", + "kw":"How Can I Use DLI If Data Is Not Uploaded to OBS?,Usage,User Guide", "title":"How Can I Use DLI If Data Is Not Uploaded to OBS?", "githuburl":"" }, { "uri":"dli_03_0129.html", "product_code":"dli", - "code":"191", + "code":"211", "des":"Data in the OBS bucket shared by IAM users under the same account can be imported. You cannot import data in the OBS bucket shared with other IAM account.", "doc_type":"usermanual", - "kw":"Can I Import OBS Bucket Data Shared by Other Tenants into DLI?,Product Consultation,User Guide", + "kw":"Can I Import OBS Bucket Data Shared by Other Tenants into DLI?,Usage,User Guide", "title":"Can I Import OBS Bucket Data Shared by Other Tenants into DLI?", "githuburl":"" }, { "uri":"dli_03_0264.html", "product_code":"dli", - "code":"192", + "code":"212", "des":"Log in to the management console.Click in the upper left corner and select Region and Project.Click (the My Quotas icon) in the upper right corner.The Service Quota pag", "doc_type":"usermanual", - "kw":"What Should I do If the System Failed to Create a Database and {\"error_code\":\"DLI.1028\";\"error_msg\":", - "title":"What Should I do If the System Failed to Create a Database and {\"error_code\":\"DLI.1028\";\"error_msg\":\"Already reached the maximum quota of databases:XXX\" Is Displayed Indicating that the Quota Is Insufficient?", + "kw":"Why Is Error \"Failed to create the database. {\"error_code\":\"DLI.1028\";\"error_msg\":\"Already reached t", + "title":"Why Is Error \"Failed to create the database. {\"error_code\":\"DLI.1028\";\"error_msg\":\"Already reached the maximum quota of databases:XXX\".\" Reported?", "githuburl":"" }, { "uri":"dli_03_0263.html", "product_code":"dli", - "code":"193", + "code":"213", "des":"No, a global variable can only be used by the user who created it. Global variables can be used to simplify complex parameters. For example, long and difficult variables ", "doc_type":"usermanual", - "kw":"Can a Member Account Use Global Variables Created by Other Member Accounts?,Product Consultation,Use", + "kw":"Can a Member Account Use Global Variables Created by Other Member Accounts?,Usage,User Guide", "title":"Can a Member Account Use Global Variables Created by Other Member Accounts?", "githuburl":"" }, + { + "uri":"dli_03_0222.html", + "product_code":"dli", + "code":"214", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Job Management", + "title":"Job Management", + "githuburl":"" + }, { "uri":"dli_03_0126.html", "product_code":"dli", - "code":"194", + "code":"215", "des":"If you are suggested to perform following operations to run a large number of DLI jobs:Group the DLI jobs by type, and run each group on a queue.Alternatively, create IAM", "doc_type":"usermanual", - "kw":"How Do I Manage Tens of Thousands of Jobs Running on DLI?,Product Consultation,User Guide", + "kw":"How Do I Manage Tens of Thousands of Jobs Running on DLI?,Job Management,User Guide", "title":"How Do I Manage Tens of Thousands of Jobs Running on DLI?", "githuburl":"" }, { "uri":"dli_03_0162.html", "product_code":"dli", - "code":"195", + "code":"216", "des":"The field names of tables that have been created cannot be changed.You can create a table, define new table fields, and migrate data from the old table to the new one.", "doc_type":"usermanual", - "kw":"How Do I Change the Name of a Field in a Created Table?,Product Consultation,User Guide", + "kw":"How Do I Change the Name of a Field in a Created Table?,Job Management,User Guide", "title":"How Do I Change the Name of a Field in a Created Table?", "githuburl":"" }, + { + "uri":"dli_03_0261.html", + "product_code":"dli", + "code":"217", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Privacy and Security", + "title":"Privacy and Security", + "githuburl":"" + }, { "uri":"dli_03_0260.html", "product_code":"dli", - "code":"196", + "code":"218", "des":"No. The spark.acls.enable configuration item is not used in DLI. The Apache Spark command injection vulnerability (CVE-2022-33891) does not exist in DLI.", "doc_type":"usermanual", - "kw":"Does DLI Have the Apache Spark Command Injection Vulnerability (CVE-2022-33891)?,Product Consultatio", + "kw":"Does DLI Have the Apache Spark Command Injection Vulnerability (CVE-2022-33891)?,Privacy and Securit", "title":"Does DLI Have the Apache Spark Command Injection Vulnerability (CVE-2022-33891)?", "githuburl":"" }, { "uri":"dli_03_0053.html", "product_code":"dli", - "code":"197", + "code":"219", "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "doc_type":"usermanual", "kw":"Quota", @@ -1972,7 +2192,7 @@ { "uri":"dli_03_0031.html", "product_code":"dli", - "code":"198", + "code":"220", "des":"Log in to the management console.Click in the upper left corner and select Region and Project.Click (the My Quotas icon) in the upper right corner.The Service Quota pag", "doc_type":"usermanual", "kw":"How Do I View My Quotas?,Quota,User Guide", @@ -1982,7 +2202,7 @@ { "uri":"dli_03_0032.html", "product_code":"dli", - "code":"199", + "code":"221", "des":"The system does not support online quota adjustment. To increase a resource quota, dial the hotline or send an email to the customer service. We will process your applica", "doc_type":"usermanual", "kw":"How Do I Increase a Quota?,Quota,User Guide", @@ -1992,217 +2212,267 @@ { "uri":"dli_03_0054.html", "product_code":"dli", - "code":"200", + "code":"222", "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "doc_type":"usermanual", "kw":"Permission", "title":"Permission", "githuburl":"" }, + { + "uri":"dli_03_0223.html", + "product_code":"dli", + "code":"223", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Usage", + "title":"Usage", + "githuburl":"" + }, { "uri":"dli_03_0100.html", "product_code":"dli", - "code":"201", + "code":"224", "des":"DLI has a comprehensive permission control mechanism and supports fine-grained authentication through Identity and Access Management (IAM). You can create policies in IAM", "doc_type":"usermanual", - "kw":"How Do I Manage Fine-Grained DLI Permissions?,Permission,User Guide", + "kw":"How Do I Manage Fine-Grained DLI Permissions?,Usage,User Guide", "title":"How Do I Manage Fine-Grained DLI Permissions?", "githuburl":"" }, { "uri":"dli_03_0008.html", "product_code":"dli", - "code":"202", + "code":"225", "des":"You cannot perform permission-related operations on the partition column of a partition table. However, when you grant the permission of any non-partition column in a par", "doc_type":"usermanual", - "kw":"What Is Column Permission Granting of a DLI Partition Table?,Permission,User Guide", + "kw":"What Is Column Permission Granting of a DLI Partition Table?,Usage,User Guide", "title":"What Is Column Permission Granting of a DLI Partition Table?", "githuburl":"" }, { - "uri":"dli_03_0101.html", + "uri":"dli_03_0226.html", "product_code":"dli", - "code":"203", - "des":"You can set actions and resources of different levels for various scenarios.Define an action.The format is Service name:Resource type:Action. You can use wildcard *. The ", + "code":"226", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "doc_type":"usermanual", - "kw":"How Do I Create a Custom Policy?,Permission,User Guide", - "title":"How Do I Create a Custom Policy?", - "githuburl":"" - }, - { - "uri":"dli_03_0225.html", - "product_code":"dli", - "code":"204", - "des":"You can isolate queues allocated to different users by setting permissions to ensure data query performance.", - "doc_type":"usermanual", - "kw":"How Do I Manage Queue Permissions?,Permission,User Guide", - "title":"How Do I Manage Queue Permissions?", + "kw":"O&M Guide", + "title":"O&M Guide", "githuburl":"" }, { "uri":"dli_03_0140.html", "product_code":"dli", - "code":"205", + "code":"227", "des":"When you submit a job, a message is displayed indicating that the job fails to be submitted due to insufficient permission caused by arrears. In this case, you need to ch", "doc_type":"usermanual", - "kw":"What Should I Do When My Account Does Not Have Permission Due To Arrears?,Permission,User Guide", - "title":"What Should I Do When My Account Does Not Have Permission Due To Arrears?", + "kw":"Why Does My Account Have Insufficient Permissions Due to Arrears?,O&M Guide,User Guide", + "title":"Why Does My Account Have Insufficient Permissions Due to Arrears?", "githuburl":"" }, { "uri":"dli_03_0195.html", "product_code":"dli", - "code":"206", + "code":"228", "des":"When the user update an existing program package, the following error information is displayed:\"error_code\"*CLI.0003\",\"error_msg\":\"Permission denied for resource 'resourc", "doc_type":"usermanual", - "kw":"What Should I Do If the Permission Is Required to Update a Program Package?,Permission,User Guide", - "title":"What Should I Do If the Permission Is Required to Update a Program Package?", + "kw":"Why Does the System Display a Message Indicating Insufficient Permissions When I Update a Program Pa", + "title":"Why Does the System Display a Message Indicating Insufficient Permissions When I Update a Program Package?", "githuburl":"" }, { "uri":"dli_03_0227.html", "product_code":"dli", - "code":"207", + "code":"229", "des":"When the SQL query statement is executed, the system displays a message indicating that the user does not have the permission to query resources.Error information: DLI.00", "doc_type":"usermanual", - "kw":"What Should I Do If \"DLI.0003: Permission denied for resource...\" Is Reported When I Run a SQL State", - "title":"What Should I Do If \"DLI.0003: Permission denied for resource...\" Is Reported When I Run a SQL Statement?", + "kw":"Why Is Error \"DLI.0003: Permission denied for resource...\" Reported When I Run a SQL Statement?,O&M ", + "title":"Why Is Error \"DLI.0003: Permission denied for resource...\" Reported When I Run a SQL Statement?", "githuburl":"" }, { "uri":"dli_03_0228.html", "product_code":"dli", - "code":"208", + "code":"230", "des":"The table permission has been granted and verified. However, after a period of time, an error is reported indicating that the table query fails.There are two possible rea", "doc_type":"usermanual", - "kw":"What Should I Do If the Table Permission Has Been Granted But the Table Still Cannot Be Queried?,Per", - "title":"What Should I Do If the Table Permission Has Been Granted But the Table Still Cannot Be Queried?", + "kw":"Why Can't I Query Table Data After I've Been Granted Table Permissions?,O&M Guide,User Guide", + "title":"Why Can't I Query Table Data After I've Been Granted Table Permissions?", + "githuburl":"" + }, + { + "uri":"dli_03_0057.html", + "product_code":"dli", + "code":"231", + "des":"If a table inherits database permissions, you do not need to regrant the inherited permissions to the table.When you grant permissions on a table on the console:If you se", + "doc_type":"usermanual", + "kw":"Will an Error Be Reported if the Inherited Permissions Are Regranted to a Table That Inherits Databa", + "title":"Will an Error Be Reported if the Inherited Permissions Are Regranted to a Table That Inherits Database Permissions?", + "githuburl":"" + }, + { + "uri":"dli_03_0067.html", + "product_code":"dli", + "code":"232", + "des":"User A created Table1.User B created View1 based on Table1.After the Select Table permission on Table1 is granted to user C, user C fails to query View1.User B does not h", + "doc_type":"usermanual", + "kw":"Why Can't I Query a View After I'm Granted the Select Table Permission on the View?,O&M Guide,User G", + "title":"Why Can't I Query a View After I'm Granted the Select Table Permission on the View?", "githuburl":"" }, { "uri":"dli_03_0049.html", "product_code":"dli", - "code":"209", + "code":"233", "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "doc_type":"usermanual", "kw":"Queue", "title":"Queue", "githuburl":"" }, + { + "uri":"dli_03_0229.html", + "product_code":"dli", + "code":"234", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Usage", + "title":"Usage", + "githuburl":"" + }, { "uri":"dli_03_0109.html", "product_code":"dli", - "code":"210", + "code":"235", "des":"Currently, you are not allowed to modify the description of a created queue. You can add the description when purchasing the queue.", "doc_type":"usermanual", - "kw":"Does the Description of a DLI Queue Can Be Modified?,Queue,User Guide", + "kw":"Does the Description of a DLI Queue Can Be Modified?,Usage,User Guide", "title":"Does the Description of a DLI Queue Can Be Modified?", "githuburl":"" }, { "uri":"dli_03_0166.html", "product_code":"dli", - "code":"211", + "code":"236", "des":"Deleting a queue does not cause table data loss in your database.", "doc_type":"usermanual", - "kw":"Will Table Data in My Database Be Lost If I Delete a Queue?,Queue,User Guide", + "kw":"Will Table Data in My Database Be Lost If I Delete a Queue?,Usage,User Guide", "title":"Will Table Data in My Database Be Lost If I Delete a Queue?", "githuburl":"" }, { "uri":"dli_03_0170.html", "product_code":"dli", - "code":"212", + "code":"237", "des":"You need to develop a mechanism to retry failed jobs. When a faulty queue is recovered, your application tries to submit the failed jobs to the queue again.", "doc_type":"usermanual", - "kw":"How Does DLI Ensure the Reliability of Spark Jobs When a Queue Is Abnormal?,Queue,User Guide", + "kw":"How Does DLI Ensure the Reliability of Spark Jobs When a Queue Is Abnormal?,Usage,User Guide", "title":"How Does DLI Ensure the Reliability of Spark Jobs When a Queue Is Abnormal?", "githuburl":"" }, { "uri":"dli_03_0098.html", "product_code":"dli", - "code":"213", + "code":"238", "des":"DLI allows you to subscribe to an SMN topic for failed jobs.Log in to the DLI console.In the navigation pane on the left, choose Queue Management.On the Queue Management ", "doc_type":"usermanual", - "kw":"How Do I Monitor Queue Exceptions?,Queue,User Guide", + "kw":"How Do I Monitor Queue Exceptions?,Usage,User Guide", "title":"How Do I Monitor Queue Exceptions?", "githuburl":"" }, + { + "uri":"dli_03_0230.html", + "product_code":"dli", + "code":"239", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"O&M Guide", + "title":"O&M Guide", + "githuburl":"" + }, { "uri":"dli_03_0095.html", "product_code":"dli", - "code":"214", + "code":"240", "des":"To check the running status of the DLI queue and determine whether to run more jobs on that queue, you need to check the queue load.Search for Cloud Eye on the console.In", "doc_type":"usermanual", - "kw":"How Do I View DLI Queue Load?,Queue,User Guide", + "kw":"How Do I View DLI Queue Load?,O&M Guide,User Guide", "title":"How Do I View DLI Queue Load?", "githuburl":"" }, { "uri":"dli_03_0183.html", "product_code":"dli", - "code":"215", + "code":"241", "des":"You need to check the large number of jobs in the Submitting and Running states on the queue.Use Cloud Eye to view jobs in different states on the queue. The procedure is", "doc_type":"usermanual", - "kw":"How Do I Determine Whether There Are Too Many Jobs in the Current Queue?,Queue,User Guide", + "kw":"How Do I Determine Whether There Are Too Many Jobs in the Current Queue?,O&M Guide,User Guide", "title":"How Do I Determine Whether There Are Too Many Jobs in the Current Queue?", "githuburl":"" }, { "uri":"dli_03_0065.html", "product_code":"dli", - "code":"216", + "code":"242", "des":"Currently, DLI provides two types of queues, For SQL and For general use. SQL queues are used to run SQL jobs. General-use queues are compatible with Spark queues of earl", "doc_type":"usermanual", - "kw":"How Do I Switch an Earlier-Version Spark Queue to a General-Purpose Queue?,Queue,User Guide", + "kw":"How Do I Switch an Earlier-Version Spark Queue to a General-Purpose Queue?,O&M Guide,User Guide", "title":"How Do I Switch an Earlier-Version Spark Queue to a General-Purpose Queue?", "githuburl":"" }, { "uri":"dli_03_0193.html", "product_code":"dli", - "code":"217", + "code":"243", "des":"DLI queues do not use resources or bandwidth when no job is running. In this case, the running status of DLI queues is not displayed on CES.", "doc_type":"usermanual", - "kw":"Why Cannot I View the Resource Running Status of DLI Queues on Cloud Eye?,Queue,User Guide", + "kw":"Why Cannot I View the Resource Running Status of DLI Queues on Cloud Eye?,O&M Guide,User Guide", "title":"Why Cannot I View the Resource Running Status of DLI Queues on Cloud Eye?", "githuburl":"" }, { "uri":"dli_03_0088.html", "product_code":"dli", - "code":"218", + "code":"244", "des":"In DLI, 64 CU = 64 cores and 256 GB memory.In a Spark job, if the driver occupies 4 cores and 16 GB memory, the executor can occupy 60 cores and 240 GB memory.", "doc_type":"usermanual", - "kw":"How Do I Allocate Queue Resources for Running Spark Jobs If I Have Purchased 64 CUs?,Queue,User Guid", + "kw":"How Do I Allocate Queue Resources for Running Spark Jobs If I Have Purchased 64 CUs?,O&M Guide,User ", "title":"How Do I Allocate Queue Resources for Running Spark Jobs If I Have Purchased 64 CUs?", "githuburl":"" }, { "uri":"dli_03_0159.html", "product_code":"dli", - "code":"219", + "code":"245", "des":"Queue plans create failed. The plan xxx target cu is out of quota is displayed when you create a scheduled scaling task.The CU quota of the current account is insufficien", "doc_type":"usermanual", - "kw":"What Should I Do If \"Queue plans create failed. The plan xxx target cu is out of quota\" Is Displayed", - "title":"What Should I Do If \"Queue plans create failed. The plan xxx target cu is out of quota\" Is Displayed When I Schedule CU Changes?", + "kw":"Why Is Error \"Queue plans create failed. The plan xxx target cu is out of quota\" Reported When I Sch", + "title":"Why Is Error \"Queue plans create failed. The plan xxx target cu is out of quota\" Reported When I Schedule CU Changes?", "githuburl":"" }, { "uri":"dli_03_0171.html", "product_code":"dli", - "code":"220", + "code":"246", "des":"After a SQL job was submitted to the default queue, the job runs abnormally. The job log reported that the execution timed out. The exception logs are as follows:[ERROR] ", "doc_type":"usermanual", - "kw":"What Should I Do If SQL Statements Fails to be Executed on the Default Queue, and a Timeout Exceptio", - "title":"What Should I Do If SQL Statements Fails to be Executed on the Default Queue, and a Timeout Exception is Reported?", + "kw":"Why Is a Timeout Exception Reported When a DLI SQL Statement Fails to Be Executed on the Default Que", + "title":"Why Is a Timeout Exception Reported When a DLI SQL Statement Fails to Be Executed on the Default Queue?", "githuburl":"" }, { "uri":"dli_03_0022.html", "product_code":"dli", - "code":"221", + "code":"247", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Datasource Connections", + "title":"Datasource Connections", + "githuburl":"" + }, + { + "uri":"dli_03_0110.html", + "product_code":"dli", + "code":"248", "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "doc_type":"usermanual", "kw":"Datasource Connections", @@ -2212,7 +2482,7 @@ { "uri":"dli_03_0128.html", "product_code":"dli", - "code":"222", + "code":"249", "des":"You need to create a VPC peering connection to enable network connectivity. Take MRS as an example. If DLI and MRS clusters are in the same VPC, and the security group is", "doc_type":"usermanual", "kw":"Why Do I Need to Create a VPC Peering Connection for an Enhanced Datasource Connection?,Datasource C", @@ -2222,7 +2492,7 @@ { "uri":"dli_03_0237.html", "product_code":"dli", - "code":"223", + "code":"250", "des":"An enhanced datasource connection failed to pass the network connectivity test. Datasource connection cannot be bound to a queue. The following error information is displ", "doc_type":"usermanual", "kw":"Failed to Bind a Queue to an Enhanced Datasource Connection,Datasource Connections,User Guide", @@ -2232,7 +2502,7 @@ { "uri":"dli_03_0238.html", "product_code":"dli", - "code":"224", + "code":"251", "des":"The outbound rule had been configured for the security group of the queue associated with the enhanced datasource connection. The datasource authentication used a passwor", "doc_type":"usermanual", "kw":"DLI Failed to Connect to GaussDB(DWS) Through an Enhanced Datasource Connection,Datasource Connectio", @@ -2242,7 +2512,7 @@ { "uri":"dli_03_0179.html", "product_code":"dli", - "code":"225", + "code":"252", "des":"A datasource connection is created and bound to a queue. The connectivity test fails and the following error information is displayed:failed to connect to specified addre", "doc_type":"usermanual", "kw":"What Can I Do If the Datasource Connection is Created But the Network Connectivity Test Fails?,Datas", @@ -2252,7 +2522,7 @@ { "uri":"dli_03_0186.html", "product_code":"dli", - "code":"226", + "code":"253", "des":"Configuring the Connection Between a DLI Queue and a Data Source in a Private NetworkIf your DLI job needs to connect to a data source, for example, MRS, RDS, CSS, Kafka,", "doc_type":"usermanual", "kw":"How Do I Configure the Network Between a DLI Queue and a Data Source?,Datasource Connections,User Gu", @@ -2262,7 +2532,7 @@ { "uri":"dli_03_0257.html", "product_code":"dli", - "code":"227", + "code":"254", "des":"The possible causes and solutions are as follows:If you have created a queue, do not bind it to a datasource connection immediately. Wait for 5 to 10 minutes. After the c", "doc_type":"usermanual", "kw":"What Can I Do If a Datasource Connection Is Stuck in Creating State When I Try to Bind a Queue to It", @@ -2272,7 +2542,7 @@ { "uri":"dli_03_0258.html", "product_code":"dli", - "code":"228", + "code":"255", "des":"Enhanced datasource connections support only yearly/monthly and pay-per-use queues.You can bind a datasource connection only when you select Dedicated Resource Mode when ", "doc_type":"usermanual", "kw":"How Do I Bind a Datasource Connection to a Pay-per-Use Queue?,Datasource Connections,User Guide", @@ -2282,47 +2552,67 @@ { "uri":"dli_03_0259.html", "product_code":"dli", - "code":"229", + "code":"256", "des":"DLI enhanced datasource connection uses VPC peering to directly connect the VPC networks of the desired data sources for point-to-point data exchanges.", "doc_type":"usermanual", "kw":"How Do I Connect DLI to Data Sources?,Datasource Connections,User Guide", "title":"How Do I Connect DLI to Data Sources?", "githuburl":"" }, + { + "uri":"dli_03_0112.html", + "product_code":"dli", + "code":"257", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Cross-Source Analysis", + "title":"Cross-Source Analysis", + "githuburl":"" + }, { "uri":"dli_03_0011.html", "product_code":"dli", - "code":"230", + "code":"258", "des":"To perform query on data stored on services rather than DLI, perform the following steps:Assume that the data to be queried is stored on multiple services (for example, O", "doc_type":"usermanual", - "kw":"How Can I Perform Query on Data Stored on Services Rather Than DLI?,Datasource Connections,User Guid", + "kw":"How Can I Perform Query on Data Stored on Services Rather Than DLI?,Cross-Source Analysis,User Guide", "title":"How Can I Perform Query on Data Stored on Services Rather Than DLI?", "githuburl":"" }, { "uri":"dli_03_0085.html", "product_code":"dli", - "code":"231", + "code":"259", "des":"Connect VPCs in different regions.Create an enhanced datasource connection on DLI and bind it to a queue.Add a DLI route.", "doc_type":"usermanual", - "kw":"How Can I Access Data Across Regions?,Datasource Connections,User Guide", + "kw":"How Can I Access Data Across Regions?,Cross-Source Analysis,User Guide", "title":"How Can I Access Data Across Regions?", "githuburl":"" }, { "uri":"dli_03_0028.html", "product_code":"dli", - "code":"232", + "code":"260", "des":"When data is inserted into DLI, set the ID field to NULL.", "doc_type":"usermanual", "kw":"How Do I Set the Auto-increment Primary Key or Other Fields That Are Automatically Filled in the RDS", "title":"How Do I Set the Auto-increment Primary Key or Other Fields That Are Automatically Filled in the RDS Table When Creating a DLI and Associating It with the RDS Table?", "githuburl":"" }, + { + "uri":"dli_03_0256.html", + "product_code":"dli", + "code":"261", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"Datasource Connection O&M", + "title":"Datasource Connection O&M", + "githuburl":"" + }, { "uri":"dli_03_0047.html", "product_code":"dli", - "code":"233", + "code":"262", "des":"Possible CausesThe network connectivity is abnormal. Check whether the security group is correctly selected and whether the VPC is correctly configured.The network connec", "doc_type":"usermanual", "kw":"Why Is the Error Message \"communication link failure\" Displayed When I Use a Newly Activated Datasou", @@ -2332,7 +2622,7 @@ { "uri":"dli_03_0080.html", "product_code":"dli", - "code":"234", + "code":"263", "des":"The cluster host information is not added to the datasource connection. As a result, the KRB authentication fails, the connection times out, and no error is recorded in l", "doc_type":"usermanual", "kw":"Connection Times Out During MRS HBase Datasource Connection, and No Error Is Recorded in Logs,Dataso", @@ -2342,57 +2632,57 @@ { "uri":"dli_03_0111.html", "product_code":"dli", - "code":"235", + "code":"264", "des":"When you create a VPC peering connection for the datasource connection, the following error information is displayed:Before you create a datasource connection, check whet", "doc_type":"usermanual", - "kw":"What Should I Do If the Subnet Cannot Be Found When I Create a DLI Datasource Connection?,Datasource", - "title":"What Should I Do If the Subnet Cannot Be Found When I Create a DLI Datasource Connection?", + "kw":"Why Can't I Find the Subnet When Creating a DLI Datasource Connection?,Datasource Connection O&M,Use", + "title":"Why Can't I Find the Subnet When Creating a DLI Datasource Connection?", "githuburl":"" }, { "uri":"dli_03_0239.html", "product_code":"dli", - "code":"236", - "des":"A cross-source RDS table was created in the DataArts Studio, and the insert overwrite statement was executed to write data into RDS. DLI.0999: BatchUpdateException: Incor", + "code":"265", + "des":"A datasource RDS table was created in the DataArts Studio, and the insert overwrite statement was executed to write data into RDS. DLI.0999: BatchUpdateException: Incorre", "doc_type":"usermanual", - "kw":"Error Message \"Incorrect string value\" Is Displayed When insert overwrite Is Executed on a Cross-Sou", - "title":"Error Message \"Incorrect string value\" Is Displayed When insert overwrite Is Executed on a Cross-Source RDS Table", + "kw":"Error Message \"Incorrect string value\" Is Displayed When insert overwrite Is Executed on a Datasourc", + "title":"Error Message \"Incorrect string value\" Is Displayed When insert overwrite Is Executed on a Datasource RDS Table", "githuburl":"" }, { "uri":"dli_03_0250.html", "product_code":"dli", - "code":"237", - "des":"The system failed to create a cross-source RDS table, and null pointer error was reported.The following table creation statement was used:The RDS database is in a PostGre", + "code":"266", + "des":"The system failed to create a datasource RDS table, and null pointer error was reported.The following table creation statement was used:The RDS database is in a PostGre c", "doc_type":"usermanual", - "kw":"Null Pointer Error Is Displayed When the System Creates a Cross-Source RDS Table,Datasource Connecti", - "title":"Null Pointer Error Is Displayed When the System Creates a Cross-Source RDS Table", + "kw":"Null Pointer Error Is Displayed When the System Creates a Datasource RDS Table,Datasource Connection", + "title":"Null Pointer Error Is Displayed When the System Creates a Datasource RDS Table", "githuburl":"" }, { "uri":"dli_03_0251.html", "product_code":"dli", - "code":"238", - "des":"The system failed to execute insert overwrite on the cross-source GaussDB(DWS) table, and org.postgresql.util.PSQLException: ERROR: tuple concurrently updated was display", + "code":"267", + "des":"The system failed to execute insert overwrite on the datasource GaussDB(DWS) table, and org.postgresql.util.PSQLException: ERROR: tuple concurrently updated was displayed", "doc_type":"usermanual", "kw":"Error Message \"org.postgresql.util.PSQLException: ERROR: tuple concurrently updated\" Is Displayed Wh", - "title":"Error Message \"org.postgresql.util.PSQLException: ERROR: tuple concurrently updated\" Is Displayed When the System Executes insert overwrite on a Cross-Source GaussDB(DWS) Table", + "title":"Error Message \"org.postgresql.util.PSQLException: ERROR: tuple concurrently updated\" Is Displayed When the System Executes insert overwrite on a Datasource GaussDB(DWS) Table", "githuburl":"" }, { "uri":"dli_03_0252.html", "product_code":"dli", - "code":"239", - "des":"A cross-source table was used to import data to a CloudTable HBase table. This HBase table contains a column family and a rowkey for 100 million simulating data records. ", + "code":"268", + "des":"A datasource table was used to import data to a CloudTable HBase table. This HBase table contains a column family and a rowkey for 100 million simulating data records. Th", "doc_type":"usermanual", - "kw":"RegionTooBusyException Is Reported When Data Is Imported to a CloudTable HBase Table Through a Cross", - "title":"RegionTooBusyException Is Reported When Data Is Imported to a CloudTable HBase Table Through a Cross-Source Table", + "kw":"RegionTooBusyException Is Reported When Data Is Imported to a CloudTable HBase Table Through a Datas", + "title":"RegionTooBusyException Is Reported When Data Is Imported to a CloudTable HBase Table Through a Datasource Table", "githuburl":"" }, { "uri":"dli_03_0253.html", "product_code":"dli", - "code":"240", + "code":"269", "des":"A table was created on GaussDB(DWS) and then a datasource connection was created on DLI to read and write data. An error message was displayed during data writing, indica", "doc_type":"usermanual", "kw":"A Null Value Is Written Into a Non-Null Field When a DLI Datasource Connection Is Used to Connect to", @@ -2402,17 +2692,87 @@ { "uri":"dli_03_0254.html", "product_code":"dli", - "code":"241", - "des":"A cross-source GaussDB(DWS) table and the datasource connection were created in DLI, and the schema of the source table in GaussDB(DWS) were updated. During the job execu", + "code":"270", + "des":"A datasource GaussDB(DWS) table and the datasource connection were created in DLI, and the schema of the source table in GaussDB(DWS) were updated. During the job executi", "doc_type":"usermanual", "kw":"An Insert Operation Failed After the Schema of the GaussDB(DWS) Source Table Is Updated,Datasource C", "title":"An Insert Operation Failed After the Schema of the GaussDB(DWS) Source Table Is Updated", "githuburl":"" }, + { + "uri":"dli_03_0056.html", + "product_code":"dli", + "code":"271", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"APIs", + "title":"APIs", + "githuburl":"" + }, + { + "uri":"dli_03_0060.html", + "product_code":"dli", + "code":"272", + "des":"In the REST API provided by DLI, the request header can be added to the request URI, for example, Content-Type.Content-Type indicates the request body type or format. The", + "doc_type":"usermanual", + "kw":"Why Is Error \"unsupported media Type\" Reported When I Subimt a SQL Job?,APIs,User Guide", + "title":"Why Is Error \"unsupported media Type\" Reported When I Subimt a SQL Job?", + "githuburl":"" + }, + { + "uri":"dli_03_0125.html", + "product_code":"dli", + "code":"273", + "des":"If different IAM accounts call APIs in the same enterprise project in the same region, the accounts use the same project ID.", + "doc_type":"usermanual", + "kw":"Are Project IDs of Different Accounts the Same When They Are Used to Call APIs?,APIs,User Guide", + "title":"Are Project IDs of Different Accounts the Same When They Are Used to Call APIs?", + "githuburl":"" + }, + { + "uri":"dli_03_0178.html", + "product_code":"dli", + "code":"274", + "des":"When the API call for submitting a SQL job times out, and the following error information is displayed:There are currently no resources tracked in the state, so there is ", + "doc_type":"usermanual", + "kw":"What Can I Do If an Error Is Reported When the Execution of the API for Creating a SQL Job Times Out", + "title":"What Can I Do If an Error Is Reported When the Execution of the API for Creating a SQL Job Times Out?", + "githuburl":"" + }, + { + "uri":"dli_03_0058.html", + "product_code":"dli", + "code":"275", + "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "doc_type":"usermanual", + "kw":"SDKs", + "title":"SDKs", + "githuburl":"" + }, + { + "uri":"dli_03_0073.html", + "product_code":"dli", + "code":"276", + "des":"When you query the SQL job results using SDK, the system checks the job status when the job is submitted. The timeout interval set in the system is 300s. If the job is no", + "doc_type":"usermanual", + "kw":"How Do I Set the Timeout Duration for Querying SQL Job Results Using SDK?,SDKs,User Guide", + "title":"How Do I Set the Timeout Duration for Querying SQL Job Results Using SDK?", + "githuburl":"" + }, + { + "uri":"dli_03_0255.html", + "product_code":"dli", + "code":"277", + "des":"Run the ping command to check whether dli.xxx can be accessed.If dli.xxx can be accessed, check whether DNS resolution is correctly configured.If dli.xxx can be accessed,", + "doc_type":"usermanual", + "kw":"How Do I Handle the dli.xxx,unable to resolve host address Error?,SDKs,User Guide", + "title":"How Do I Handle the dli.xxx,unable to resolve host address Error?", + "githuburl":"" + }, { "uri":"dli_01_00006.html", "product_code":"dli", - "code":"242", + "code":"278", "des":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "doc_type":"usermanual", "kw":"Change History,User Guide", diff --git a/docs/dli/umn/CLASS.TXT.json b/docs/dli/umn/CLASS.TXT.json index c1a7318ba..46a0f13df 100644 --- a/docs/dli/umn/CLASS.TXT.json +++ b/docs/dli/umn/CLASS.TXT.json @@ -11,7 +11,7 @@ { "desc":"Data Lake Insight (DLI) is a serverless data processing and analysis service fully compatible with Apache Spark and Apache Flink ecosystems. It frees you from managing an", "product_code":"dli", - "title":"DLI Introduction", + "title":"What Is Data Lake Insight?", "uri":"dli_01_0378.html", "doc_type":"usermanual", "p_code":"1", @@ -27,7 +27,7 @@ "code":"3" }, { - "desc":"DLI is applicable to large-scale log analysis, federated analysis of heterogeneous data sources, and big data ETL processing.Gaming operation data analysisDifferent depar", + "desc":"DLI is applicable to large-scale log analysis, federated analysis of heterogeneous data sources, and big data ETL processing.Gaming operations data analysisDifferent depa", "product_code":"dli", "title":"Application Scenarios", "uri":"dli_07_0002.html", @@ -38,7 +38,7 @@ { "desc":"When using DLI, you may need to make adjustments according to the following restrictions:Recommended browsers for logging in to DLI:Google Chrome 43.0 or laterMozilla Fir", "product_code":"dli", - "title":"Constraints and Limitations on Using DLI", + "title":"Prerequisites", "uri":"dli_07_0005.html", "doc_type":"usermanual", "p_code":"1", @@ -72,7 +72,7 @@ "code":"8" }, { - "desc":"You can use DLI to submit a Spark SQL job to query data. The general procedure is as follows:Step 1: Logging in to the Cloud PlatformStep 2: Uploading Data to OBSStep 3: ", + "desc":"DLI can query data stored in OBS. This section describes how to us a Spark SQL job on DLI to query OBS data.You can use DLI to submit a Spark SQL job to query data. The g", "product_code":"dli", "title":"Creating and Submitting a Spark SQL Job", "uri":"dli_01_0002.html", @@ -90,7 +90,7 @@ "code":"10" }, { - "desc":"You can use DLI to submit Spark jobs for real-time computing. The general procedure is as follows:Step 1: Logging in to the CloudStep 2: Uploading Data to OBSStep 3: Logg", + "desc":"DLI can query data stored in OBS. This section describes how to use a Spark Jar job on DLI to query OBS data in real time.You can use DLI to submit Spark jobs for real-ti", "product_code":"dli", "title":"Creating and Submitting a Spark Jar Job", "uri":"dli_01_0375.html", @@ -99,7 +99,7 @@ "code":"11" }, { - "desc":"This section describes how to submit a Flink OpenSource SQL job on the DLI console for real-time computing. The general procedure is as follows:Step 1: Log In to the Clou", + "desc":"DLI Flink jobs can use other cloud services as data sources and sink streams for real-time compute. This example describes how to create and submit a Flink Opensource SQL", "product_code":"dli", "title":"Creating and Submitting a Flink OpenSource SQL Job", "uri":"dli_01_0531.html", @@ -108,7 +108,7 @@ "code":"12" }, { - "desc":"Log in to DLI and go to the Overview page.The following table describes the functional areas of the Overview page.", + "desc":"The Overview page of the DLI console provides you with the DLI workflow and resource usage.The process of using DLI is as follows:Create a queue.Queues are computing reso", "product_code":"dli", "title":"DLI Console Overview", "uri":"dli_01_0377.html", @@ -117,7 +117,7 @@ "code":"13" }, { - "desc":"You can use SQL statements in the SQL job editor to execute data query. DLI supports SQL 2003 and complies with Spark SQL.On the Overview page, click SQL Editor in the na", + "desc":"You can edit and run SQL statements in the SQL job editor to execute data query.DLI supports SQL 2003 and complies with Spark SQL.To access the SQL editor, click SQL Edit", "product_code":"dli", "title":"SQL Editor", "uri":"dli_01_0320.html", @@ -180,7 +180,7 @@ "code":"20" }, { - "desc":"This section describes how to create a Flink OpenSource SQL job. DLI Flink OpenSource SQL jobs are fully compatible with the syntax of Flink 1.10 and 1.12 provided by the", + "desc":"This section describes how to create a Flink OpenSource SQL job.DLI Flink OpenSource SQL jobs are fully compatible with the syntax of Flink 1.10 and 1.12 provided by the ", "product_code":"dli", "title":"(Recommended) Creating a Flink OpenSource SQL Job", "uri":"dli_01_0498.html", @@ -191,7 +191,7 @@ { "desc":"This section describes how to create a Flink SQL job. You can use Flink SQLs to develop jobs to meet your service requirements. Using SQL statements simplifies logic impl", "product_code":"dli", - "title":"Creating a Flink SQL job", + "title":"Creating a Flink SQL Job", "uri":"dli_01_0455.html", "doc_type":"usermanual", "p_code":"17", @@ -380,7 +380,7 @@ { "desc":"You can isolate databases allocated to different users by setting permissions to ensure data query performance.The administrator and database owner have all permissions, ", "product_code":"dli", - "title":"Database Permission Management", + "title":"Managing Database Permissions", "uri":"dli_01_0447.html", "doc_type":"usermanual", "p_code":"41", @@ -389,7 +389,7 @@ { "desc":"You can isolate databases allocated to different users by setting permissions to ensure data query performance.The administrator and database owner have all permissions, ", "product_code":"dli", - "title":"Table Permission Management", + "title":"Managing Table Permissions", "uri":"dli_01_0448.html", "doc_type":"usermanual", "p_code":"41", @@ -533,7 +533,7 @@ { "desc":"To facilitate SQL operation execution, DLI allows you to customize query templates or save the SQL statements in use as templates. After templates are saved, you do not n", "product_code":"dli", - "title":"SQL Template Management", + "title":"Managing SQL Templates", "uri":"dli_01_0021.html", "doc_type":"usermanual", "p_code":"59", @@ -542,12 +542,21 @@ { "desc":"Flink templates include sample templates and custom templates. You can modify an existing sample template to meet the actual job logic requirements and save time for edit", "product_code":"dli", - "title":"Flink Template Management", + "title":"Managing Flink Templates", "uri":"dli_01_0464.html", "doc_type":"usermanual", "p_code":"59", "code":"61" }, + { + "desc":"You can modify a sample template to meet the Spark job requirements, saving time for editing SQL statements.Currently, the cloud platform does not provide preset Spark te", + "product_code":"dli", + "title":"Managing Spark SQL Templates", + "uri":"dli_01_0551.html", + "doc_type":"usermanual", + "p_code":"59", + "code":"62" + }, { "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "product_code":"dli", @@ -555,7 +564,7 @@ "uri":"dli_01_05110.html", "doc_type":"usermanual", "p_code":"59", - "code":"62" + "code":"63" }, { "desc":"TPC-H is a test set developed by the Transaction Processing Performance Council (TPC) to simulate decision-making support applications. It is widely used in academia and ", @@ -563,8 +572,8 @@ "title":"TPC-H Sample Data in the SQL Template", "uri":"dli_01_05111.html", "doc_type":"usermanual", - "p_code":"62", - "code":"63" + "p_code":"63", + "code":"64" }, { "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", @@ -573,7 +582,7 @@ "uri":"dli_01_0422.html", "doc_type":"usermanual", "p_code":"", - "code":"64" + "code":"65" }, { "desc":"DLI supports the datasource capability of the native Spark and extends it. With DLI datasource connection, you can access other data storage services through SQL statemen", @@ -581,8 +590,8 @@ "title":"Datasource Connection and Cross-Source Analysis", "uri":"dli_01_0410.html", "doc_type":"usermanual", - "p_code":"64", - "code":"65" + "p_code":"65", + "code":"66" }, { "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", @@ -590,8 +599,8 @@ "title":"Enhanced Datasource Connections", "uri":"dli_01_0426.html", "doc_type":"usermanual", - "p_code":"64", - "code":"66" + "p_code":"65", + "code":"67" }, { "desc":"The enhanced datasource connection uses VPC peering at the bottom layer to directly connect the VPC network between the DLI cluster and the destination datasource. Data i", @@ -599,8 +608,8 @@ "title":"Overview", "uri":"dli_01_0003.html", "doc_type":"usermanual", - "p_code":"66", - "code":"67" + "p_code":"67", + "code":"68" }, { "desc":"The following describes how to create a datasource HBase connection for MRS.Only enhanced datasource connection to MRS HBase is supported.Apply for a cluster in MRS.If a ", @@ -608,8 +617,8 @@ "title":"Creating, Querying, and Deleting an Enhanced Datasource Connection", "uri":"dli_01_0006.html", "doc_type":"usermanual", - "p_code":"66", - "code":"68" + "p_code":"67", + "code":"69" }, { "desc":"The CIDR block of the DLI queue that is bound with a datasource connection cannot overlap with that of the data source.The default queue cannot be bound with a connection", @@ -617,8 +626,8 @@ "title":"Binding and Unbinding a Queue", "uri":"dli_01_0009.html", "doc_type":"usermanual", - "p_code":"66", - "code":"69" + "p_code":"67", + "code":"70" }, { "desc":"Method 1: Copy hosts information in /etc/hosts of an MRS node.cat /etc/hostsMethod 2: Log in to FusionInsight Manager to obtain MRS hosts information.The host information", @@ -626,8 +635,8 @@ "title":"Modifying Host Information", "uri":"dli_01_0013.html", "doc_type":"usermanual", - "p_code":"66", - "code":"70" + "p_code":"67", + "code":"71" }, { "desc":"After an enhanced datasource connection is created and bound to a queue, the system automatically configures route information. You can also add a custom route for the qu", @@ -635,8 +644,8 @@ "title":"Custom Route Information", "uri":"dli_01_0014.html", "doc_type":"usermanual", - "p_code":"66", - "code":"71" + "p_code":"67", + "code":"72" }, { "desc":"You can grant or revoke permissions for enhanced datasource connections of other projects.AuthorizationLog in to the DLI management console, choose Datasource Connections", @@ -644,8 +653,8 @@ "title":"Enhanced Datasource Connection Permission Management", "uri":"dli_01_0018.html", "doc_type":"usermanual", - "p_code":"66", - "code":"72" + "p_code":"67", + "code":"73" }, { "desc":"You can isolate datasource connections allocated to different users by setting permissions to ensure data query performance.The administrator and datasource connection ow", @@ -653,8 +662,8 @@ "title":"Managing Datasource Connection Permissions", "uri":"dli_01_0480.html", "doc_type":"usermanual", - "p_code":"64", - "code":"73" + "p_code":"65", + "code":"74" }, { "desc":"Datasource authentication is used to manage authentication information for accessing CSS and MRS security environments and encrypt passwords for accessing DWS, RDS, DDS, ", @@ -662,8 +671,8 @@ "title":"Creating and Managing Datasource Authentication", "uri":"dli_01_0427.html", "doc_type":"usermanual", - "p_code":"64", - "code":"74" + "p_code":"65", + "code":"75" }, { "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", @@ -672,7 +681,7 @@ "uri":"dli_01_0485.html", "doc_type":"usermanual", "p_code":"", - "code":"75" + "code":"76" }, { "desc":"Global variables can be used to simplify complex parameters. For example, long and difficult variables can be replaced to improve the readability of SQL statements.In the", @@ -680,8 +689,8 @@ "title":"Global Variables", "uri":"dli_01_0476.html", "doc_type":"usermanual", - "p_code":"75", - "code":"76" + "p_code":"76", + "code":"77" }, { "desc":"Only the tenant account or a subaccount of user group admin can authorize access.After entering the DLI management console, you are advised to set agency permissions to e", @@ -689,8 +698,8 @@ "title":"Service Authorization", "uri":"dli_01_0486.html", "doc_type":"usermanual", - "p_code":"75", - "code":"77" + "p_code":"76", + "code":"78" }, { "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", @@ -699,7 +708,7 @@ "uri":"dli_01_0408.html", "doc_type":"usermanual", "p_code":"", - "code":"78" + "code":"79" }, { "desc":"DLI has a comprehensive permission control mechanism and supports fine-grained authentication through Identity and Access Management (IAM). You can create policies in IAM", @@ -707,8 +716,8 @@ "title":"Overview", "uri":"dli_01_0440.html", "doc_type":"usermanual", - "p_code":"78", - "code":"79" + "p_code":"79", + "code":"80" }, { "desc":"You can use Identity and Access Management (IAM) to implement fine-grained permissions control on DLI resources. For details, see Overview.If your cloud account does not ", @@ -716,8 +725,8 @@ "title":"Creating an IAM User and Granting Permissions", "uri":"dli_01_0418.html", "doc_type":"usermanual", - "p_code":"78", - "code":"80" + "p_code":"79", + "code":"81" }, { "desc":"Custom policies can be created as a supplement to the system policies of DLI. You can add actions to custom policies. For the actions supported for custom policies, see \"", @@ -725,8 +734,8 @@ "title":"Creating a Custom Policy", "uri":"dli_01_0451.html", "doc_type":"usermanual", - "p_code":"78", - "code":"81" + "p_code":"79", + "code":"82" }, { "desc":"A resource is an object that exists within a service. You can select DLI resources by specifying their paths.", @@ -734,8 +743,8 @@ "title":"DLI Resources", "uri":"dli_01_0417.html", "doc_type":"usermanual", - "p_code":"78", - "code":"82" + "p_code":"79", + "code":"83" }, { "desc":"Request conditions are useful in determining when a custom policy takes effect. A request condition consists of a condition key and operator. Condition keys are either gl", @@ -743,8 +752,8 @@ "title":"DLI Request Conditions", "uri":"dli_01_0475.html", "doc_type":"usermanual", - "p_code":"78", - "code":"83" + "p_code":"79", + "code":"84" }, { "desc":"Table 1 lists the common operations supported by each system policy of DLI. Choose proper system policies according to this table. For details about the SQL statement per", @@ -752,17 +761,62 @@ "title":"Common Operations Supported by DLI System Policy", "uri":"dli_01_0441.html", "doc_type":"usermanual", - "p_code":"78", - "code":"84" + "p_code":"79", + "code":"85" }, { "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "product_code":"dli", - "title":"FAQs", + "title":"Other Common Operations", + "uri":"dli_01_0513.html", + "doc_type":"usermanual", + "p_code":"", + "code":"86" + }, + { + "desc":"On the DLI management console, you can import data stored on OBS to DLI tables from Data Management > Databases and Tables > Table Management and SQL Editor pages. For de", + "product_code":"dli", + "title":"Importing Data to a DLI Table", + "uri":"dli_01_0420.html", + "doc_type":"usermanual", + "p_code":"86", + "code":"87" + }, + { + "desc":"This section describes metrics reported by DLI to Cloud Eye as well as their namespaces and dimensions. You can use the management console or APIs provided by Cloud Eye t", + "product_code":"dli", + "title":"Viewing Monitoring Metrics", + "uri":"dli_01_0445.html", + "doc_type":"usermanual", + "p_code":"86", + "code":"88" + }, + { + "desc":"With CTS, you can record operations associated with DLI for later query, audit, and backtrack operations.", + "product_code":"dli", + "title":"DLI Operations That Can Be Recorded by CTS", + "uri":"dli_01_0318.html", + "doc_type":"usermanual", + "p_code":"86", + "code":"89" + }, + { + "desc":"A quota limits the quantity of a resource available to users, thereby preventing spikes in the usage of the resource.You can also request for an increased quota if your e", + "product_code":"dli", + "title":"Quotas", + "uri":"dli_01_0550.html", + "doc_type":"usermanual", + "p_code":"86", + "code":"90" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"FAQ", "uri":"dli_01_0539.html", "doc_type":"usermanual", "p_code":"", - "code":"85" + "code":"91" }, { "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", @@ -770,8 +824,17 @@ "title":"Flink Jobs", "uri":"dli_03_0037.html", "doc_type":"usermanual", - "p_code":"85", - "code":"86" + "p_code":"91", + "code":"92" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"Usage", + "uri":"dli_03_0137.html", + "doc_type":"usermanual", + "p_code":"92", + "code":"93" }, { "desc":"DLI Flink jobs support the following data formats:Avro, Avro_merge, BLOB, CSV, EMAIL, JSON, ORC, Parquet, and XML.DLI Flink jobs support data from the following data sour", @@ -779,8 +842,8 @@ "title":"What Data Formats and Data Sources Are Supported by DLI Flink Jobs?", "uri":"dli_03_0083.html", "doc_type":"usermanual", - "p_code":"86", - "code":"87" + "p_code":"93", + "code":"94" }, { "desc":"A sub-user can view queues but cannot view Flink jobs. You can authorize the sub-user using DLI or IAM.Authorization on DLILog in to the DLI console using a tenant accoun", @@ -788,8 +851,8 @@ "title":"How Do I Authorize a Subuser to View Flink Jobs?", "uri":"dli_03_0139.html", "doc_type":"usermanual", - "p_code":"86", - "code":"88" + "p_code":"93", + "code":"95" }, { "desc":"DLI Flink jobs are highly available. You can enable the automatic restart function to automatically restart your jobs after short-time faults of peripheral services are r", @@ -797,8 +860,8 @@ "title":"How Do I Set Auto Restart upon Exception for a Flink Job?", "uri":"dli_03_0090.html", "doc_type":"usermanual", - "p_code":"86", - "code":"89" + "p_code":"93", + "code":"96" }, { "desc":"When you create a Flink SQL job or Flink Jar job, you can select Save Job Log on the job editing page to save job running logs to OBS.To set the OBS bucket for storing th", @@ -806,26 +869,26 @@ "title":"How Do I Save Flink Job Logs?", "uri":"dli_03_0099.html", "doc_type":"usermanual", - "p_code":"86", - "code":"90" + "p_code":"93", + "code":"97" }, { - "desc":"DLI can output Flink job results to DIS. You can view the results in DIS. For details, see Retrieving Data from DIS in the Data Ingestion Service User Guide.DLI can outpu", + "desc":"DLI can output Flink job results to DIS. You can view the results in DIS. For details, see \"Obtaining Data from DIS\" in Data Ingestion Service User Guide.DLI can output F", "product_code":"dli", "title":"How Can I Check Flink Job Results?", "uri":"dli_03_0043.html", "doc_type":"usermanual", - "p_code":"86", - "code":"91" + "p_code":"93", + "code":"98" }, { "desc":"Choose Job Management > Flink Jobs. In the Operation column of the target job, choose More > Permissions. When a new user is authorized, No such user. userName:xxxx. is d", "product_code":"dli", - "title":"What Should I Do if \"No such user. userName:xxxx.\" Is Displayed on the Flink Job Management Page When I Grant Permission to a User?", + "title":"Why Is Error \"No such user. userName:xxxx.\" Reported on the Flink Job Management Page When I Grant Permission to a User?", "uri":"dli_03_0160.html", "doc_type":"usermanual", - "p_code":"86", - "code":"92" + "p_code":"93", + "code":"99" }, { "desc":"Checkpoint was enabled when a Flink job is created, and the OBS bucket for storing checkpoints was specified. After a Flink job is manually stopped, no message is display", @@ -833,8 +896,26 @@ "title":"How Do I Know Which Checkpoint the Flink Job I Stopped Will Be Restored to When I Start the Job Again?", "uri":"dli_03_0180.html", "doc_type":"usermanual", - "p_code":"86", - "code":"93" + "p_code":"93", + "code":"100" + }, + { + "desc":"When you set running parameters of a DLI Flink job, you can enable Alarm Generation upon Job Exception to receive alarms when the job runs abnormally or is in arrears.If ", + "product_code":"dli", + "title":"How Is a Message Displayed Indicating That the SMN Topic Does Not Exist When I Use the SMN Topic in DLI?", + "uri":"dli_03_0036.html", + "doc_type":"usermanual", + "p_code":"93", + "code":"101" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"Flink SQL", + "uri":"dli_03_0131.html", + "doc_type":"usermanual", + "p_code":"92", + "code":"102" }, { "desc":"The consumption capability of a Flink SQL job depends on the data source transmission, queue size, and job parameter settings. The peak consumption is 10 Mbit/s.", @@ -842,8 +923,8 @@ "title":"How Much Data Can Be Processed in a Day by a Flink SQL Job?", "uri":"dli_03_0130.html", "doc_type":"usermanual", - "p_code":"86", - "code":"94" + "p_code":"102", + "code":"103" }, { "desc":"The temp stream in Flink SQL is similar to a subquery. It is a logical stream used to simplify the SQL logic and does not generate data storage. Therefore, there is no ne", @@ -851,26 +932,26 @@ "title":"Does Data in the Temporary Stream of Flink SQL Need to Be Cleared Periodically? How Do I Clear the Data?", "uri":"dli_03_0061.html", "doc_type":"usermanual", - "p_code":"86", - "code":"95" + "p_code":"102", + "code":"104" }, { "desc":"SymptomWhen you create a Flink SQL job and configure the parameters, you select an OBS bucket you have created. The system displays a message indicating that the OBS buck", "product_code":"dli", - "title":"What Should I Do if a Message Is Displayed Indicating that the OBS Bucket Is Not Authorized When I Select an OBS Bucket for a Flink SQL Job?", + "title":"Why Is a Message Displayed Indicating That the OBS Bucket Is Not Authorized When I Select an OBS Bucket for a Flink SQL Job?", "uri":"dli_03_0138.html", "doc_type":"usermanual", - "p_code":"86", - "code":"96" + "p_code":"102", + "code":"105" }, { "desc":"When using a Flink SQL job, you need to create an OBS partition table for subsequent batch processing.In the following example, the day field is used as the partition fie", "product_code":"dli", - "title":"How Do I Map an OBS Table to a Partitioned DLI Table?", + "title":"How Do I Create an OBS Partitioned Table for a Flink SQL Job?", "uri":"dli_03_0089.html", "doc_type":"usermanual", - "p_code":"86", - "code":"97" + "p_code":"102", + "code":"106" }, { "desc":"SymptomYou used Flink 1.10 to run a Flink Opensource SQL job. You set the number of Kafka partitions for the job a small value at the beginning and need to increase the n", @@ -878,71 +959,80 @@ "title":"How Do I Change the Number of Kafka Partitions of a Flink SQL Job Without Stopping It?", "uri":"dli_03_0120.html", "doc_type":"usermanual", - "p_code":"86", - "code":"98" + "p_code":"102", + "code":"107" }, { "desc":"In this example, the day field is used as the partition field with the parquet encoding format (only the parquet format is supported currently) to dump car_info data to O", "product_code":"dli", - "title":"How Can I Map an OBS Table to a DLI Partition Table?", + "title":"How Do I Dump Data to OBS and Create an OBS Partitioned Table?", "uri":"dli_03_0075.html", "doc_type":"usermanual", - "p_code":"86", - "code":"99" + "p_code":"102", + "code":"108" }, { "desc":"When I run the creation statement with an EL expression in the table name in a Flink SQL job, the following error message is displayed:DLI.0005: AnalysisException: t_user", "product_code":"dli", - "title":"What Should I Do If Error Message DLI.0005 Is Displayed When I Use an EL Expression to Create a Table in a Flink SQL Job?", + "title":"Why Is Error Message \"DLI.0005\" Displayed When I Use an EL Expression to Create a Table in a Flink SQL Job?", "uri":"dli_03_0167.html", "doc_type":"usermanual", - "p_code":"86", - "code":"100" + "p_code":"102", + "code":"109" }, { "desc":"After data is written to OBS through the Flink job output stream, data cannot be queried from the DLI table created in the OBS file path.For example, use the following Fl", "product_code":"dli", - "title":"What Should I Do If No Data Is Found in the DLI Table Created Using the OBS File Path That Stores the Output of a Flink job?", + "title":"Why Is No Data Queried in the DLI Table Created Using the OBS File Path When Data Is Written to OBS by a Flink Job Output Stream?", "uri":"dli_03_0168.html", "doc_type":"usermanual", - "p_code":"86", - "code":"101" + "p_code":"102", + "code":"110" }, { "desc":"After a Flink SQL job is submitted on DLI, the job fails to be executed. The following error information is displayed in the job log:connect to DIS failed java.lang.Illeg", "product_code":"dli", - "title":"What Should I Do If a Flink SQL Job Fails to Be Executed, and \"connect to DIS failed java.lang.IllegalArgumentException: Access key cannot be null\" Is Recorded in the Log?", + "title":"Why Does a Flink SQL Job Fails to Be Executed, and Is \"connect to DIS failed java.lang.IllegalArgumentException: Access key cannot be null\" Displayed in the Log?", "uri":"dli_03_0174.html", "doc_type":"usermanual", - "p_code":"86", - "code":"102" + "p_code":"102", + "code":"111" }, { "desc":"Semantic verification for a Flink SQL job (reading DIS data) fails. The following information is displayed when the job fails:Get dis channel xxxinfo failed. error info: ", "product_code":"dli", - "title":"What Should I Do If \"Not authorized\" Is Reported When a Flink SQL Job Reads DIS Data?", + "title":"Why Is Error \"Not authorized\" Reported When a Flink SQL Job Reads DIS Data?", "uri":"dli_03_0176.html", "doc_type":"usermanual", - "p_code":"86", - "code":"103" + "p_code":"102", + "code":"112" }, { - "desc":"After a Flink SQL job consumed Kafka and sank data to the Elasticsearch cluster, the job was successfully executed, but no data is available.Possible causes are as follow", + "desc":"After a Flink SQL job consumed Kafka and sent data to the Elasticsearch cluster, the job was successfully executed, but no data is available.Possible causes are as follow", "product_code":"dli", "title":"Data Writing Fails After a Flink SQL Job Consumed Kafka and Sank Data to the Elasticsearch Cluster", "uri":"dli_03_0232.html", "doc_type":"usermanual", - "p_code":"86", - "code":"104" + "p_code":"102", + "code":"113" }, { - "desc":"The procedure is as follows:Add the following code to the JAR package code of the Flink Jar job:// Configure the pom file on which the StreamExecutionEnvironment depends.", + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"Flink Jar Jobs", + "uri":"dli_03_0132.html", + "doc_type":"usermanual", + "p_code":"92", + "code":"114" + }, + { + "desc":"The procedure is as follows:Add the following code to the JAR file code of the Flink Jar job:// Configure the pom file on which the StreamExecutionEnvironment depends.\nSt", "product_code":"dli", "title":"How Do I Configure Checkpoints for Flink Jar Jobs and Save the Checkpoints to OBS?", "uri":"dli_03_0038.html", "doc_type":"usermanual", - "p_code":"86", - "code":"105" + "p_code":"114", + "code":"115" }, { "desc":"Configuration files can be uploaded for user-defined jobs (JAR).Upload the configuration file to DLI through Package Management.In the Other Dependencies area of the Flin", @@ -950,53 +1040,53 @@ "title":"Does a Flink JAR Job Support Configuration File Upload? How Do I Upload a Configuration File?", "uri":"dli_03_0044.html", "doc_type":"usermanual", - "p_code":"86", - "code":"106" + "p_code":"114", + "code":"116" }, { - "desc":"The dependency of your Flink job conflicts with a built-in dependency of the DLI Flink platform. As a result, the job submission fails.Delete your JAR package that is the", + "desc":"The dependency of your Flink job conflicts with a built-in dependency of the DLI Flink platform. As a result, the job submission fails.Delete your JAR file that is the sa", "product_code":"dli", - "title":"What Should I Do If Job Submission Fails Due to Flink JAR Package Conflict?", + "title":"Why Does the Submission Fail Due to Flink JAR File Conflict?", "uri":"dli_03_0119.html", "doc_type":"usermanual", - "p_code":"86", - "code":"107" + "p_code":"114", + "code":"117" }, { "desc":"When a Flink Jar job is submitted to access GaussDB(DWS), an error message is displayed indicating that the job fails to be started. The job log contains the following er", "product_code":"dli", - "title":"What Should I Do If GaussDB(DWS) Fails to Be Started When a Flink Jar Job Accesses GaussDB(DWS), and a Message Indicating Too Many Client Connections is Displayed?", + "title":"Why Does a Flink Jar Job Fail to Access GaussDB(DWS) and a Message Is Displayed Indicating Too Many Client Connections?", "uri":"dli_03_0161.html", "doc_type":"usermanual", - "p_code":"86", - "code":"108" + "p_code":"114", + "code":"118" }, { "desc":"An exception occurred when a Flink Jar job is running. The following error information is displayed in the job log:org.apache.flink.shaded.curator.org.apache.curator.Conn", "product_code":"dli", - "title":"What Should I Do If Error Message \"Authentication failed\" Is Displayed When a Flink Jar Job Is Running?", + "title":"Why Is Error Message \"Authentication failed\" Displayed During Flink Jar Job Running?", "uri":"dli_03_0165.html", "doc_type":"usermanual", - "p_code":"86", - "code":"109" + "p_code":"114", + "code":"119" }, { "desc":"The storage path of the Flink Jar job checkpoints was set to an OBS bucket. The job failed to be submitted, and an error message indicating an invalid OBS bucket name was", "product_code":"dli", - "title":"What Should I Do If Invalid OBS Bucket Name Is Reported After a Flink Job Submission Failed?", + "title":"Why Is Error Invalid OBS Bucket Name Reported After a Flink Job Submission Failed?", "uri":"dli_03_0233.html", "doc_type":"usermanual", - "p_code":"86", - "code":"110" + "p_code":"114", + "code":"120" }, { - "desc":"Flink Job submission failed. The exception information is as follows:Flink JAR packages conflicted. The submitted Flink JAR package conflicted with the HDFS JAR package o", + "desc":"Flink Job submission failed. The exception information is as follows:Flink JAR files conflicted. The submitted Flink JAR file conflicted with the HDFS JAR file of the DLI", "product_code":"dli", - "title":"Flink Job Submission Fails Due to Hadoop JAR Package Conflicts", + "title":"Why Does the Flink Submission Fail Due to Hadoop JAR File Conflict?", "uri":"dli_03_0234.html", "doc_type":"usermanual", - "p_code":"86", - "code":"111" + "p_code":"114", + "code":"121" }, { "desc":"You can use Flink Jar to connect to Kafka with SASL SSL authentication enabled.", @@ -1004,8 +1094,17 @@ "title":"How Do I Connect a Flink jar Job to SASL_SSL?", "uri":"dli_03_0266.html", "doc_type":"usermanual", - "p_code":"86", - "code":"112" + "p_code":"114", + "code":"122" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"Performance Tuning", + "uri":"dli_03_0133.html", + "doc_type":"usermanual", + "p_code":"92", + "code":"123" }, { "desc":"Data Stacking in a Consumer GroupThe accumulated data of a consumer group can be calculated by the following formula: Total amount of data to be consumed by the consumer ", @@ -1013,8 +1112,8 @@ "title":"How Do I Optimize Performance of a Flink Job?", "uri":"dli_03_0106.html", "doc_type":"usermanual", - "p_code":"86", - "code":"113" + "p_code":"123", + "code":"124" }, { "desc":"Add the following SQL statements to the Flink job:", @@ -1022,8 +1121,8 @@ "title":"How Do I Write Data to Different Elasticsearch Clusters in a Flink Job?", "uri":"dli_03_0048.html", "doc_type":"usermanual", - "p_code":"86", - "code":"114" + "p_code":"123", + "code":"125" }, { "desc":"The DLI Flink checkpoint/savepoint mechanism is complete and reliable. You can use this mechanism to prevent data loss when a job is manually restarted or restarted due t", @@ -1031,8 +1130,17 @@ "title":"How Do I Prevent Data Loss After Flink Job Restart?", "uri":"dli_03_0096.html", "doc_type":"usermanual", - "p_code":"86", - "code":"115" + "p_code":"123", + "code":"126" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"O&M Guide", + "uri":"dli_03_0135.html", + "doc_type":"usermanual", + "p_code":"92", + "code":"127" }, { "desc":"On the Flink job management page, hover the cursor on the status of the job that fails to be submitted to view the brief information about the failure.The possible causes", @@ -1040,8 +1148,8 @@ "title":"How Do I Locate a Flink Job Submission Error?", "uri":"dli_03_0103.html", "doc_type":"usermanual", - "p_code":"86", - "code":"116" + "p_code":"127", + "code":"128" }, { "desc":"On the Flink job management, click Edit in the Operation column of the target job. On the displayed page, check whether Save Job Log in the Running Parameters tab is enab", @@ -1049,8 +1157,8 @@ "title":"How Do I Locate a Flink Job Running Error?", "uri":"dli_03_0105.html", "doc_type":"usermanual", - "p_code":"86", - "code":"117" + "p_code":"127", + "code":"129" }, { "desc":"Check the following operations:Adjusting or adding optimization parameters or the number of concurrent threads of a job, or modifying Flink SQL statements or a Flink Jar ", @@ -1058,35 +1166,35 @@ "title":"How Do I Know Whether a Flink Job Can Be Restored from a Checkpoint After Being Restarted?", "uri":"dli_03_0136.html", "doc_type":"usermanual", - "p_code":"86", - "code":"118" + "p_code":"127", + "code":"130" }, { "desc":"To rectify this fault, perform the following steps:Log in to the DIS management console. In the navigation pane, choose Stream Management. View the Flink job SQL statemen", "product_code":"dli", - "title":"What Should I Do If the DIS Stream Does Not Exist During the Semantic Check?", + "title":"Why Does DIS Stream Not Exist During Job Semantic Check?", "uri":"dli_03_0040.html", "doc_type":"usermanual", - "p_code":"86", - "code":"119" + "p_code":"127", + "code":"131" }, { "desc":"If the OBS bucket selected for a job is not authorized, perform the following steps:Select Enable Checkpointing or Save Job Log.Specify OBS Bucket.Select Authorize OBS.", "product_code":"dli", - "title":"What Should I Do If the OBS Bucket Selected for a Job Is Not Authorized?", + "title":"Why Is the OBS Bucket Selected for Job Not Authorized?", "uri":"dli_03_0045.html", "doc_type":"usermanual", - "p_code":"86", - "code":"120" + "p_code":"127", + "code":"132" }, { "desc":"Mode for storing generated job logs when a DLI Flink job fails to be submitted or executed. The options are as follows:If the submission fails, a submission log is genera", "product_code":"dli", - "title":"What Should I Do If Logs Are Not Written to the OBS Bucket After a DLI Flink Job Fails to Be Submitted for Running?", + "title":"Why Are Logs Not Written to the OBS Bucket After a DLI Flink Job Fails to Be Submitted for Running?", "uri":"dli_03_0064.html", "doc_type":"usermanual", - "p_code":"86", - "code":"121" + "p_code":"127", + "code":"133" }, { "desc":"SymptomYou used Flink 1.10 to run a Flink Opensource SQL job. The job failed after the following error was reported when Flink Sink wrote data to Kafka.Caused by: org.apa", @@ -1094,35 +1202,35 @@ "title":"How Do I Configure Connection Retries for Kafka Sink If it is Disconnected?", "uri":"dli_03_0121.html", "doc_type":"usermanual", - "p_code":"86", - "code":"122" + "p_code":"127", + "code":"134" }, { "desc":"The Flink/Spark UI was displayed with incomplete information.When a pay-per-use queue is used to run a job, the system releases the cluster and takes about 10 minutes to ", "product_code":"dli", - "title":"What Should I Do If the Flink/Spark UI Page Cannot Be Displayed Properly?", + "title":"Why Is Information Displayed on the FlinkUI/Spark UI Page Incomplete?", "uri":"dli_03_0235.html", "doc_type":"usermanual", - "p_code":"86", - "code":"123" + "p_code":"127", + "code":"135" }, { "desc":"JobManager and TaskManager heartbeats timed out. As a result, the Flink job is abnormal.Check whether the network is intermittently disconnected and whether the cluster l", "product_code":"dli", - "title":"Wha should I Do If JobManager and TaskManager Heartbeats Timed Out and the Flink Job Is Abnormal?", + "title":"Why Is the Flink Job Abnormal Due to Heartbeat Timeout Between JobManager and TaskManager?", "uri":"dli_03_0236.html", "doc_type":"usermanual", - "p_code":"86", - "code":"124" + "p_code":"127", + "code":"136" }, { "desc":"Test address connectivity.If the network is unreachable, rectify the network connection first. Ensure that the network connection between the DLI queue and the external d", "product_code":"dli", - "title":"What Can I Do If \"Timeout expired while fetching topic metadata\" Is Repeatedly Reported in Flink JobManager Logs?", + "title":"Why Is Error \"Timeout expired while fetching topic metadata\" Repeatedly Reported in Flink JobManager Logs?", "uri":"dli_03_0265.html", "doc_type":"usermanual", - "p_code":"86", - "code":"125" + "p_code":"127", + "code":"137" }, { "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", @@ -1130,8 +1238,17 @@ "title":"Problems Related to SQL Jobs", "uri":"dli_03_0020.html", "doc_type":"usermanual", - "p_code":"85", - "code":"126" + "p_code":"91", + "code":"138" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"Usage", + "uri":"dli_03_0216.html", + "doc_type":"usermanual", + "p_code":"138", + "code":"139" }, { "desc":"A temporary table is used to store intermediate results. When a transaction or session ends, the data in the temporary table can be automatically deleted. For example, in", @@ -1139,8 +1256,17 @@ "title":"SQL Jobs", "uri":"dli_03_0200.html", "doc_type":"usermanual", - "p_code":"126", - "code":"127" + "p_code":"139", + "code":"140" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"Job Development", + "uri":"dli_03_0204.html", + "doc_type":"usermanual", + "p_code":"138", + "code":"141" }, { "desc":"If a large number of small files are generated during SQL execution, job execution and table query will take a long time. In this case, you should merge small files.Set t", @@ -1148,8 +1274,8 @@ "title":"How Do I Merge Small Files?", "uri":"dli_03_0086.html", "doc_type":"usermanual", - "p_code":"126", - "code":"128" + "p_code":"141", + "code":"142" }, { "desc":"When creating an OBS table, you must specify a table path in the database. The path format is as follows: obs://xxx/database name/table name.If the specified path is akdc", @@ -1157,8 +1283,8 @@ "title":"How Do I Specify an OBS Path When Creating an OBS Table?", "uri":"dli_03_0092.html", "doc_type":"usermanual", - "p_code":"126", - "code":"129" + "p_code":"141", + "code":"143" }, { "desc":"DLI allows you to associate JSON data in an OBS bucket to create tables in asynchronous mode.The statement for creating the table is as follows:", @@ -1166,8 +1292,8 @@ "title":"How Do I Create a Table Using JSON Data in an OBS Bucket?", "uri":"dli_03_0108.html", "doc_type":"usermanual", - "p_code":"126", - "code":"130" + "p_code":"141", + "code":"144" }, { "desc":"You can use the where condition statement in the select statement to filter data. For example:", @@ -1175,8 +1301,8 @@ "title":"How Do I Set Local Variables in SQL Statements?", "uri":"dli_03_0087.html", "doc_type":"usermanual", - "p_code":"126", - "code":"131" + "p_code":"141", + "code":"145" }, { "desc":"The correct method for using the count function to perform aggregation is as follows:OrIf an incorrect method is used, an error will be reported.", @@ -1184,8 +1310,8 @@ "title":"How Can I Use the count Function to Perform Aggregation?", "uri":"dli_03_0069.html", "doc_type":"usermanual", - "p_code":"126", - "code":"132" + "p_code":"141", + "code":"146" }, { "desc":"You can use the cross-region replication function of OBS. The procedure is as follows:Export the DLI table data in region 1 to the user-defined OBS bucket. For details, s", @@ -1193,8 +1319,8 @@ "title":"How Do I Synchronize DLI Table Data from One Region to Another?", "uri":"dli_03_0072.html", "doc_type":"usermanual", - "p_code":"126", - "code":"133" + "p_code":"141", + "code":"147" }, { "desc":"Currently, DLI does not allow you to insert table data into specific fields. To insert table data, you must insert data of all table fields at a time.", @@ -1202,125 +1328,143 @@ "title":"How Do I Insert Table Data into Specific Fields of a Table Using a SQL Job?", "uri":"dli_03_0191.html", "doc_type":"usermanual", - "p_code":"126", - "code":"134" + "p_code":"141", + "code":"148" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"Job O&M Errors", + "uri":"dli_03_0206.html", + "doc_type":"usermanual", + "p_code":"138", + "code":"149" }, { "desc":"Create an OBS directory with a unique name. Alternatively, you can manually delete the existing OBS directory and submit the job again. However, exercise caution when del", "product_code":"dli", - "title":"What Should I Do If Error \"path obs://xxx already exists\" Is Reported When Data Is Exported to OBS?", + "title":"Why Is Error \"path obs://xxx already exists\" Reported When Data Is Exported to OBS?", "uri":"dli_03_0014.html", "doc_type":"usermanual", - "p_code":"126", - "code":"135" + "p_code":"149", + "code":"150" }, { "desc":"This message indicates that the two tables to be joined contain the same column, but the owner of the column is not specified when the command is executed.For example, ta", "product_code":"dli", - "title":"What Should I Do If \"SQL_ANALYSIS_ERROR: Reference 't.id' is ambiguous, could be: t.id, t.id.;\" Is Displayed When Two Tables Are Joined", + "title":"Why Is Error \"SQL_ANALYSIS_ERROR: Reference 't.id' is ambiguous, could be: t.id, t.id.;\" Displayed When Two Tables Are Joined?", "uri":"dli_03_0066.html", "doc_type":"usermanual", - "p_code":"126", - "code":"136" + "p_code":"149", + "code":"151" }, { "desc":"Check whether the account is in arrears. If yes, recharge the account.If the error persists, log out and log in again.", "product_code":"dli", - "title":"What Should I Do If the System Notify Me that I Have No Permission to Execute the Query Statement Because the Current Account Was Restricted?", + "title":"Why Is Error \"The current account does not have permission to perform this operation,the current account was restricted. Restricted for no budget.\" Reported when a SQL Statement Is Executed?", "uri":"dli_03_0071.html", "doc_type":"usermanual", - "p_code":"126", - "code":"137" + "p_code":"149", + "code":"152" }, { "desc":"Cause AnalysisWhen you query the partitioned table XX.YYY, the partition column is not specified in the search criteria.A partitioned table can be queried only when the q", "product_code":"dli", - "title":"What Should I Do If Error Message \"There should be at least one partition pruning predicate on partitioned table XX.YYY\" Is Displayed When a Query Statement Is Executed?", + "title":"Why Is Error \"There should be at least one partition pruning predicate on partitioned table XX.YYY\" Reported When a Query Statement Is Executed?", "uri":"dli_03_0145.html", "doc_type":"usermanual", - "p_code":"126", - "code":"138" + "p_code":"149", + "code":"153" }, { "desc":"The following error message is displayed when the LOAD DATA command is executed by a Spark SQL job to import data to a DLI table:In some cases ,the following error messag", "product_code":"dli", - "title":"What Should I Do If Error Message IllegalArgumentException: Buffer size too small. size is Displayed When Data Is Loaded to an OBS Foreign Table", + "title":"Why Is Error \"IllegalArgumentException: Buffer size too small. size\" Reported When Data Is Loaded to an OBS Foreign Table?", "uri":"dli_03_0169.html", "doc_type":"usermanual", - "p_code":"126", - "code":"139" + "p_code":"149", + "code":"154" }, { "desc":"An error is reported during SQL job execution:Please contact DLI service. DLI.0002: FileNotFoundException: getFileStatus on obs://xxx: status [404]Check whether there is ", "product_code":"dli", - "title":"What Should I Do If \"DLI.0002 FileNotFoundException\" Is Reported During SQL Job Running", + "title":"Why Is Error \"DLI.0002 FileNotFoundException\" Reported During SQL Job Running?", "uri":"dli_03_0189.html", "doc_type":"usermanual", - "p_code":"126", - "code":"140" + "p_code":"149", + "code":"155" }, { "desc":"Currently, DLI supports the Hive syntax for creating tables of the TEXTFILE, SEQUENCEFILE, RCFILE, ORC, AVRO, and PARQUET file types. If the file format specified for cre", "product_code":"dli", - "title":"What Should I Do If A Schema Parsing Error Is Reported When I Create a Hive Table Using CTAS", + "title":"Why Is a Schema Parsing Error Reported When I Create a Hive Table Using CTAS?", "uri":"dli_03_0046.html", "doc_type":"usermanual", - "p_code":"126", - "code":"141" + "p_code":"149", + "code":"156" }, { "desc":"When you run a DLI SQL script on DataArts Studio, the log shows that the statements fail to be executed. The error information is as follows:DLI.0999: RuntimeException: o", "product_code":"dli", - "title":"What Should I Do If \"org.apache.hadoop.fs.obs.OBSIOException\" Is Reported If DLI SQL Scripts Are Executed on DataArts Studio?", + "title":"Why Is Error \"org.apache.hadoop.fs.obs.OBSIOException\" Reported When I Run DLI SQL Scripts on DataArts Studio?", "uri":"dli_03_0173.html", "doc_type":"usermanual", - "p_code":"126", - "code":"142" + "p_code":"149", + "code":"157" }, { "desc":"After the migration job is submitted, the following error information is displayed in the log:org.apache.sqoop.common.SqoopException:UQUERY_CONNECTOR_0001:Invoke DLI serv", "product_code":"dli", - "title":"What Should I Do If \"UQUERY_CONNECTOR_0001:Invoke DLI service api failed\" Is Reported in the Job Log When I Use CDM to Migrate Data to DLI?", + "title":"Why Is Error \"UQUERY_CONNECTOR_0001:Invoke DLI service api failed\" Reported in the Job Log When I Use CDM to Migrate Data to DLI?", "uri":"dli_03_0172.html", "doc_type":"usermanual", - "p_code":"126", - "code":"143" + "p_code":"149", + "code":"158" }, { "desc":"Error message \"File not Found\" is displayed when a SQL job is accessed.Generally, the file cannot be found due to a read/write conflict. Check whether a job is overwritin", "product_code":"dli", - "title":"What Should I Do If \"File not Found\" Is Displayed When I Access a SQL Job?", + "title":"Why Is Error \"File not Found\" Reported When I Access a SQL Job?", "uri":"dli_03_0207.html", "doc_type":"usermanual", - "p_code":"126", - "code":"144" + "p_code":"149", + "code":"159" }, { "desc":"Error message \"DLI.0003: AccessControlException XXX\" is reported when a SQL job is accessed.View the OBS bucket in the AccessControlException and check whether you are us", "product_code":"dli", - "title":"What Should I Do If \"DLI.0003: AccessControlException XXX\" Is Reported When I Access a SQL Job?", + "title":"Why Is Error \"DLI.0003: AccessControlException XXX\" Reported When I Access a SQL Job?", "uri":"dli_03_0208.html", "doc_type":"usermanual", - "p_code":"126", - "code":"145" + "p_code":"149", + "code":"160" }, { "desc":"Error message \"DLI.0001: org.apache.hadoop.security.AccessControlException: verifyBucketExists on {{bucket name}}: status [403]\" is reported when a SQL job is Accessed.Th", "product_code":"dli", - "title":"What Should I Do If \"DLI.0001: org.apache.hadoop.security.AccessControlException: verifyBucketExists on {{bucket name}}: status [403]\" Is Reported When I Access a SQL Job?", + "title":"Why Is Error \"DLI.0001: org.apache.hadoop.security.AccessControlException: verifyBucketExists on {{bucket name}}: status [403]\" Reported When I Access a SQL Job?", "uri":"dli_03_0209.html", "doc_type":"usermanual", - "p_code":"126", - "code":"146" + "p_code":"149", + "code":"161" }, { "desc":"Error message \"The current account does not have permission to perform this operation,the current account was restricted.\" is reported during SQL statement execution.Chec", "product_code":"dli", - "title":"What Should I Do If \"The current account does not have permission to perform this operation,the current account was restricted. Restricted for no budget\" Is Reported During SQL Statement Execution? Restricted for no budget.", + "title":"Why Is Error \"The current account does not have permission to perform this operation,the current account was restricted. Restricted for no budget\" Reported During SQL Statement Execution? Restricted for no budget.", "uri":"dli_03_0210.html", "doc_type":"usermanual", - "p_code":"126", - "code":"147" + "p_code":"149", + "code":"162" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"O&M Guide", + "uri":"dli_03_0211.html", + "doc_type":"usermanual", + "p_code":"138", + "code":"163" }, { "desc":"If the job runs slowly, perform the following steps to find the causes and rectify the fault:Check whether the problem is caused by FullGC.Log in to the DLI console. In t", @@ -1328,8 +1472,8 @@ "title":"How Do I Troubleshoot Slow SQL Jobs?", "uri":"dli_03_0196.html", "doc_type":"usermanual", - "p_code":"126", - "code":"148" + "p_code":"163", + "code":"164" }, { "desc":"You can view SQL job logs for routine O&M.Obtain the ID of the DLI job executed on the DataArts Studio console.Job IDOn the DLI console, choose Job Management > SQL Jobs.", @@ -1337,8 +1481,8 @@ "title":"How Do I View DLI SQL Logs?", "uri":"dli_03_0091.html", "doc_type":"usermanual", - "p_code":"126", - "code":"149" + "p_code":"163", + "code":"165" }, { "desc":"You can view the job execution records when a job is running.Log in to the DLI management console.In the navigation pane on the left, choose Job Management > SQL Jobs.Ent", @@ -1346,8 +1490,8 @@ "title":"How Do I View SQL Execution Records?", "uri":"dli_03_0116.html", "doc_type":"usermanual", - "p_code":"126", - "code":"150" + "p_code":"163", + "code":"166" }, { "desc":"If the execution of an SQL statement takes a long time, you need to access the Spark UI to check the execution status.If data skew occurs, the running time of a stage exc", @@ -1355,8 +1499,8 @@ "title":"How Do I Eliminate Data Skew by Configuring AE Parameters?", "uri":"dli_03_0093.html", "doc_type":"usermanual", - "p_code":"126", - "code":"151" + "p_code":"163", + "code":"167" }, { "desc":"A DLI table exists but cannot be queried on the DLI console.If a table exists but cannot be queried, there is a high probability that the current user does not have the p", @@ -1364,8 +1508,8 @@ "title":"What Can I Do If a Table Cannot Be Queried on the DLI Console?", "uri":"dli_03_0184.html", "doc_type":"usermanual", - "p_code":"126", - "code":"152" + "p_code":"163", + "code":"168" }, { "desc":"A high compression ratio of OBS tables in the Parquet or ORC format (for example, a compression ratio of 5 or higher compared with text compression) will lead to large da", @@ -1373,8 +1517,8 @@ "title":"The Compression Ratio of OBS Tables Is Too High", "uri":"dli_03_0013.html", "doc_type":"usermanual", - "p_code":"126", - "code":"153" + "p_code":"163", + "code":"169" }, { "desc":"DLI supports only UTF-8-encoded texts. Ensure that data is encoded using UTF-8 during table creation and import.", @@ -1382,8 +1526,8 @@ "title":"How Can I Avoid Garbled Characters Caused by Inconsistent Character Codes?", "uri":"dli_03_0009.html", "doc_type":"usermanual", - "p_code":"126", - "code":"154" + "p_code":"163", + "code":"170" }, { "desc":"User A created the testTable table in a database through a SQL job and granted user B the permission to insert and delete table data. User A deleted the testTable table a", @@ -1391,17 +1535,17 @@ "title":"Do I Need to Grant Table Permissions to a User and Project After I Delete a Table and Create One with the Same Name?", "uri":"dli_03_0175.html", "doc_type":"usermanual", - "p_code":"126", - "code":"155" + "p_code":"163", + "code":"171" }, { "desc":"A CSV file is imported to a DLI partitioned table, but the imported file data does not contain the data in the partitioning column. The partitioning column needs to be sp", "product_code":"dli", - "title":"What Should I Do If Table Data Fails to Be Queried After Data Is Imported to a DLI Partitioned Table Because the File to Be Imported Does Not Contain Data in the Partitioning Column?", + "title":"Why Can't I Query Table Data After Data Is Imported to a DLI Partitioned Table Because the File to Be Imported Does Not Contain Data in the Partitioning Column?", "uri":"dli_03_0177.html", "doc_type":"usermanual", - "p_code":"126", - "code":"156" + "p_code":"163", + "code":"172" }, { "desc":"When an OBS foreign table is created, a field in the specified OBS file contains a carriage return line feed (CRLF) character. As a result, the data is incorrect.The stat", @@ -1409,17 +1553,17 @@ "title":"How Do I Fix the Data Error Caused by CRLF Characters in a Field of the OBS File Used to Create an External OBS Table?", "uri":"dli_03_0181.html", "doc_type":"usermanual", - "p_code":"126", - "code":"157" + "p_code":"163", + "code":"173" }, { "desc":"A SQL job contains join operations. After the job is submitted, it is stuck in the Running state and no result is returned.When a Spark SQL job has join operations on sma", "product_code":"dli", - "title":"What Should I Do If a SQL Job That Has Join Operations Stays in the Running State?", + "title":"Why Does a SQL Job That Has Join Operations Stay in the Running State?", "uri":"dli_03_0182.html", "doc_type":"usermanual", - "p_code":"126", - "code":"158" + "p_code":"163", + "code":"174" }, { "desc":"The on clause was not added to the SQL statement for joining tables. As a result, the Cartesian product query occurs due to multi-table association, and the queue resourc", @@ -1427,17 +1571,17 @@ "title":"The on Clause Is Not Added When Tables Are Joined. Cartesian Product Query Causes High Resource Usage of the Queue, and the Job Fails to Be Executed", "uri":"dli_03_0187.html", "doc_type":"usermanual", - "p_code":"126", - "code":"159" + "p_code":"163", + "code":"175" }, { "desc":"Partition data is manually uploaded to a partition of an OBS table. However, the data cannot be queried using DLI SQL editor.After manually adding partition data, you nee", "product_code":"dli", - "title":"What Should I Do If Manually Added Data in a Partition of an OBS Table Cannot Be Queried?", + "title":"Why Can't I Query Data After I Manually Add Data to the Partition Directory of an OBS Table?", "uri":"dli_03_0190.html", "doc_type":"usermanual", - "p_code":"126", - "code":"160" + "p_code":"163", + "code":"176" }, { "desc":"To dynamically overwrite the specified partitioned data in the DataSource table, set dli.sql.dynamicPartitionOverwrite.enabled to true and then run the insert overwrite s", @@ -1445,8 +1589,8 @@ "title":"Why Is All Data Overwritten When insert overwrite Is Used to Overwrite Partitioned Table?", "uri":"dli_03_0212.html", "doc_type":"usermanual", - "p_code":"126", - "code":"161" + "p_code":"163", + "code":"177" }, { "desc":"The possible causes and solutions are as follows:After you purchase a DLI queue and submit a SQL job for the first time, wait for 5 to 10 minutes. After the cluster is st", @@ -1454,8 +1598,8 @@ "title":"Why Is a SQL Job Stuck in the Submitting State?", "uri":"dli_03_0213.html", "doc_type":"usermanual", - "p_code":"126", - "code":"162" + "p_code":"163", + "code":"178" }, { "desc":"Spark does not have the datetime type and uses the TIMESTAMP type instead.You can use a function to convert data types.The following is an example.select cast(create_date", @@ -1463,8 +1607,8 @@ "title":"Why Is the create_date Field in the RDS Table Is a Timestamp in the DLI query result?", "uri":"dli_03_0214.html", "doc_type":"usermanual", - "p_code":"126", - "code":"163" + "p_code":"163", + "code":"179" }, { "desc":"If the table name is changed immediately after SQL statements are executed, the data size of the table may be incorrect.If you need to change the table name, change it 5 ", @@ -1472,8 +1616,8 @@ "title":"What Can I Do If datasize Cannot Be Changed After the Table Name Is Changed in a Finished SQL Job?", "uri":"dli_03_0215.html", "doc_type":"usermanual", - "p_code":"126", - "code":"164" + "p_code":"163", + "code":"180" }, { "desc":"When DLI is used to insert data into an OBS temporary table, only part of data is imported.Possible causes are as follows:The amount of data read during job execution is ", @@ -1481,8 +1625,8 @@ "title":"Why Is the Data Volume Changes When Data Is Imported from DLI to OBS?", "uri":"dli_03_0231.html", "doc_type":"usermanual", - "p_code":"126", - "code":"165" + "p_code":"163", + "code":"181" }, { "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", @@ -1490,8 +1634,17 @@ "title":"Problems Related to Spark Jobs", "uri":"dli_03_0021.html", "doc_type":"usermanual", - "p_code":"85", - "code":"166" + "p_code":"91", + "code":"182" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"Usage", + "uri":"dli_03_0163.html", + "doc_type":"usermanual", + "p_code":"182", + "code":"183" }, { "desc":"DLI Spark does not support job scheduling. You can use other services, such as DataArts Studio, or use APIs or SDKs to customize job schedule.The Spark SQL syntax does no", @@ -1499,8 +1652,17 @@ "title":"Spark Jobs", "uri":"dli_03_0201.html", "doc_type":"usermanual", - "p_code":"166", - "code":"167" + "p_code":"183", + "code":"184" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"Job Development", + "uri":"dli_03_0217.html", + "doc_type":"usermanual", + "p_code":"182", + "code":"185" }, { "desc":"To use Spark to write data into a DLI table, configure the following parameters:fs.obs.access.keyfs.obs.secret.keyfs.obs.implfs.obs.endpointThe following is an example:", @@ -1508,8 +1670,8 @@ "title":"How Do I Use Spark to Write Data into a DLI Table?", "uri":"dli_03_0107.html", "doc_type":"usermanual", - "p_code":"166", - "code":"168" + "p_code":"185", + "code":"186" }, { "desc":"If the AK and SK are obtained, set the parameters as follows:Create SparkContext using codeval sc: SparkContext = new SparkContext()\nsc.hadoopConfiguration.set(\"fs.obs.ac", @@ -1517,8 +1679,8 @@ "title":"How Do I Set the AK/SK for a Queue to Operate an OBS Table?", "uri":"dli_03_0017.html", "doc_type":"usermanual", - "p_code":"166", - "code":"169" + "p_code":"185", + "code":"187" }, { "desc":"Log in to the DLI console. In the navigation pane, choose Job Management > Spark Jobs. In the job list, locate the target job and click next to Job ID to view the parame", @@ -1526,8 +1688,8 @@ "title":"How Do I View the Resource Usage of DLI Spark Jobs?", "uri":"dli_03_0102.html", "doc_type":"usermanual", - "p_code":"166", - "code":"170" + "p_code":"185", + "code":"188" }, { "desc":"If the pymysql module is missing, check whether the corresponding EGG package exists. If the package does not exist, upload the pyFile package on the Package Management p", @@ -1535,8 +1697,8 @@ "title":"How Do I Use Python Scripts to Access the MySQL Database If the pymysql Module Is Missing from the Spark Job Results Stored in MySQL?", "uri":"dli_03_0076.html", "doc_type":"usermanual", - "p_code":"166", - "code":"171" + "p_code":"185", + "code":"189" }, { "desc":"DLI natively supports PySpark.For most cases, Python is preferred for data analysis, and PySpark is the best choice for big data analysis. Generally, JVM programs are pac", @@ -1544,8 +1706,8 @@ "title":"How Do I Run a Complex PySpark Program in DLI?", "uri":"dli_03_0082.html", "doc_type":"usermanual", - "p_code":"166", - "code":"172" + "p_code":"185", + "code":"190" }, { "desc":"You can use DLI Spark jobs to access data in the MySQL database using either of the following methods:Solution 1: Purchase a pay-per-use queue, create an enhanced datasou", @@ -1553,8 +1715,8 @@ "title":"How Does a Spark Job Access a MySQL Database?", "uri":"dli_03_0127.html", "doc_type":"usermanual", - "p_code":"166", - "code":"173" + "p_code":"185", + "code":"191" }, { "desc":"When shuffle statements, such as GROUP BY and JOIN, are executed in Spark jobs, data skew occurs, which slows down the job execution.To solve this problem, you can config", @@ -1562,8 +1724,8 @@ "title":"How Do I Use JDBC to Set the spark.sql.shuffle.partitions Parameter to Improve the Task Concurrency?", "uri":"dli_03_0068.html", "doc_type":"usermanual", - "p_code":"166", - "code":"174" + "p_code":"185", + "code":"192" }, { "desc":"You can use SparkFiles to read the file submitted using –-file form a local path: SparkFiles.get(\"Name of the uploaded file\").The file path in the Driver is different fro", @@ -1571,71 +1733,80 @@ "title":"How Do I Read Uploaded Files for a Spark Jar Job?", "uri":"dli_03_0118.html", "doc_type":"usermanual", - "p_code":"166", - "code":"175" + "p_code":"185", + "code":"193" }, { - "desc":"The Spark 2.3 has changed the behavior of the internal interface Logging. If the user code directly inherits the Logging and the earlier version Spark is used during comp", + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "product_code":"dli", - "title":"What Can I Do When Receiving java.lang.AbstractMethodError in the Spark Job?", - "uri":"dli_03_0023.html", + "title":"Job O&M Errors", + "uri":"dli_03_0218.html", "doc_type":"usermanual", - "p_code":"166", - "code":"176" + "p_code":"182", + "code":"194" }, { "desc":"The following error is reported when a Spark job accesses OBS data:Set the AK/SK to enable Spark jobs to access OBS data. For details, see How Do I Set the AK/SK for a Qu", "product_code":"dli", - "title":"What Should I Do If Errors \"ResponseCode: 403\" and \"ResponseStatus: Forbidden\" Are Reported When a Spark Job Accesses OBS Data", + "title":"Why Are Errors \"ResponseCode: 403\" and \"ResponseStatus: Forbidden\" Reported When a Spark Job Accesses OBS Data?", "uri":"dli_03_0156.html", "doc_type":"usermanual", - "p_code":"166", - "code":"177" + "p_code":"194", + "code":"195" }, { "desc":"Check whether the OBS bucket is used to store DLI logs on the Global Configuration > Job Configurations page. The job log bucket cannot be used for other purpose.", "product_code":"dli", - "title":"Why is Error \"verifyBucketExists on XXXX: status [403]\" Is Reported When I Run a Spark Job with a User that has the Permission to Access the OBS Bucket?", + "title":"Why Is Error \"verifyBucketExists on XXXX: status [403]\" Reported When I Use a Spark Job to Access an OBS Bucket That I Have Access Permission?", "uri":"dli_03_0164.html", "doc_type":"usermanual", - "p_code":"166", - "code":"178" + "p_code":"194", + "code":"196" }, { "desc":"When a Spark job accesses a large amount of data, for example, accessing data in a GaussDB(DWS) database, you are advised to set the number of concurrent tasks and enable", "product_code":"dli", - "title":"What Should I Do if a Running Timeout Error Is Reported When a Spark Job Runs a Large Amount of Data?", + "title":"Why Is a Job Running Timeout Reported When a Spark Job Runs a Large Amount of Data?", "uri":"dli_03_0157.html", "doc_type":"usermanual", - "p_code":"166", - "code":"179" + "p_code":"194", + "code":"197" }, { "desc":"Spark jobs cannot access SFTP. Upload the files you want to access to OBS and then you can analyze the data using Spark jobs.", "product_code":"dli", - "title":"What Should I Do If a Spark job Used to Access Files in SFTP Fails and the Log Shows that the File Directory Is Abnormal?", + "title":"Why Does the Job Fail to Be Executed and the Log Shows that the File Directory Is Abnormal When I Use a Spark Job to Access Files in SFTP?", "uri":"dli_03_0188.html", "doc_type":"usermanual", - "p_code":"166", - "code":"180" + "p_code":"194", + "code":"198" }, { "desc":"When a Spark job is running, an error message is displayed, indicating that the user does not have the database permission. The error information is as follows:org.apache", "product_code":"dli", - "title":"What Should I Do If a Job Fails Because the Job User Does Not Have the Database and Table Permission?", + "title":"Why Does the Job Fail to Be Executed Due to Insufficient Database and Table Permissions?", "uri":"dli_03_0192.html", "doc_type":"usermanual", - "p_code":"166", - "code":"181" + "p_code":"194", + "code":"199" }, { - "desc":"If the specified Python environment cannot be found after a Python3 package is added, the current compute cluster environment is Python2 by default.You can set spark.yarn", + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "product_code":"dli", - "title":"What Can I Do If the Specified Python Environment Cannot Be Found After a Python Package Is Added?", + "title":"O&M Guide", + "uri":"dli_03_0219.html", + "doc_type":"usermanual", + "p_code":"182", + "code":"200" + }, + { + "desc":"I cannot find the specified Python environment after adding the Python 3 package.Set spark.yarn.appMasterEnv.PYSPARK_PYTHON to python3 in the conf file to specify the Pyt", + "product_code":"dli", + "title":"Why Can't I Find the Specified Python Environment After Adding the Python Package?", "uri":"dli_03_0077.html", "doc_type":"usermanual", - "p_code":"166", - "code":"182" + "p_code":"200", + "code":"201" }, { "desc":"The remaining CUs in the queue may be insufficient. As a result, the job cannot be submitted.To view the remaining CUs of a queue, perform the following steps:Check the C", @@ -1643,8 +1814,8 @@ "title":"Why Is a Spark Jar Job Stuck in the Submitting State?", "uri":"dli_03_0220.html", "doc_type":"usermanual", - "p_code":"166", - "code":"183" + "p_code":"200", + "code":"202" }, { "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", @@ -1652,8 +1823,17 @@ "title":"Product Consultation", "uri":"dli_03_0001.html", "doc_type":"usermanual", - "p_code":"85", - "code":"184" + "p_code":"91", + "code":"203" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"Usage", + "uri":"dli_03_0221.html", + "doc_type":"usermanual", + "p_code":"203", + "code":"204" }, { "desc":"Data Lake Insight (DLI) is a serverless data processing and analysis service fully compatible with Apache Spark, and Flink ecosystems. It frees you from managing any serv", @@ -1661,8 +1841,8 @@ "title":"What Is DLI?", "uri":"dli_03_0002.html", "doc_type":"usermanual", - "p_code":"184", - "code":"185" + "p_code":"204", + "code":"205" }, { "desc":"DLI supports the following data formats:ParquetCSVORCJsonAvro", @@ -1670,8 +1850,8 @@ "title":"Which Data Formats Does DLI Support?", "uri":"dli_03_0025.html", "doc_type":"usermanual", - "p_code":"184", - "code":"186" + "p_code":"204", + "code":"206" }, { "desc":"The Spark component of DLI is a fully managed service. You can only use the DLI Spark through its APIs. .The Spark component of MRS is built on the VM in an MRS cluster. ", @@ -1679,8 +1859,8 @@ "title":"What Are the Differences Between MRS Spark and DLI Spark?", "uri":"dli_03_0115.html", "doc_type":"usermanual", - "p_code":"184", - "code":"187" + "p_code":"204", + "code":"207" }, { "desc":"DLI data can be stored in either of the following:OBS: Data used by SQL jobs, Spark jobs, and Flink jobs can be stored in OBS, reducing storage costs.DLI: The column-base", @@ -1688,8 +1868,8 @@ "title":"Where Can DLI Data Be Stored?", "uri":"dli_03_0029.html", "doc_type":"usermanual", - "p_code":"184", - "code":"188" + "p_code":"204", + "code":"208" }, { "desc":"DLI tables store data within the DLI service, and you do not need to know the data storage path.OBS tables store data in your OBS buckets, and you need to manage the sour", @@ -1697,8 +1877,8 @@ "title":"What Are the Differences Between DLI Tables and OBS Tables?", "uri":"dli_03_0117.html", "doc_type":"usermanual", - "p_code":"184", - "code":"189" + "p_code":"204", + "code":"209" }, { "desc":"Currently, DLI supports analysis only on the data uploaded to the cloud. In scenarios where regular (for example, on a per day basis) one-off analysis on incremental data", @@ -1706,8 +1886,8 @@ "title":"How Can I Use DLI If Data Is Not Uploaded to OBS?", "uri":"dli_03_0010.html", "doc_type":"usermanual", - "p_code":"184", - "code":"190" + "p_code":"204", + "code":"210" }, { "desc":"Data in the OBS bucket shared by IAM users under the same account can be imported. You cannot import data in the OBS bucket shared with other IAM account.", @@ -1715,17 +1895,17 @@ "title":"Can I Import OBS Bucket Data Shared by Other Tenants into DLI?", "uri":"dli_03_0129.html", "doc_type":"usermanual", - "p_code":"184", - "code":"191" + "p_code":"204", + "code":"211" }, { "desc":"Log in to the management console.Click in the upper left corner and select Region and Project.Click (the My Quotas icon) in the upper right corner.The Service Quota pag", "product_code":"dli", - "title":"What Should I do If the System Failed to Create a Database and {\"error_code\":\"DLI.1028\";\"error_msg\":\"Already reached the maximum quota of databases:XXX\" Is Displayed Indicating that the Quota Is Insufficient?", + "title":"Why Is Error \"Failed to create the database. {\"error_code\":\"DLI.1028\";\"error_msg\":\"Already reached the maximum quota of databases:XXX\".\" Reported?", "uri":"dli_03_0264.html", "doc_type":"usermanual", - "p_code":"184", - "code":"192" + "p_code":"204", + "code":"212" }, { "desc":"No, a global variable can only be used by the user who created it. Global variables can be used to simplify complex parameters. For example, long and difficult variables ", @@ -1733,8 +1913,17 @@ "title":"Can a Member Account Use Global Variables Created by Other Member Accounts?", "uri":"dli_03_0263.html", "doc_type":"usermanual", - "p_code":"184", - "code":"193" + "p_code":"204", + "code":"213" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"Job Management", + "uri":"dli_03_0222.html", + "doc_type":"usermanual", + "p_code":"203", + "code":"214" }, { "desc":"If you are suggested to perform following operations to run a large number of DLI jobs:Group the DLI jobs by type, and run each group on a queue.Alternatively, create IAM", @@ -1742,8 +1931,8 @@ "title":"How Do I Manage Tens of Thousands of Jobs Running on DLI?", "uri":"dli_03_0126.html", "doc_type":"usermanual", - "p_code":"184", - "code":"194" + "p_code":"214", + "code":"215" }, { "desc":"The field names of tables that have been created cannot be changed.You can create a table, define new table fields, and migrate data from the old table to the new one.", @@ -1751,8 +1940,17 @@ "title":"How Do I Change the Name of a Field in a Created Table?", "uri":"dli_03_0162.html", "doc_type":"usermanual", - "p_code":"184", - "code":"195" + "p_code":"214", + "code":"216" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"Privacy and Security", + "uri":"dli_03_0261.html", + "doc_type":"usermanual", + "p_code":"203", + "code":"217" }, { "desc":"No. The spark.acls.enable configuration item is not used in DLI. The Apache Spark command injection vulnerability (CVE-2022-33891) does not exist in DLI.", @@ -1760,8 +1958,8 @@ "title":"Does DLI Have the Apache Spark Command Injection Vulnerability (CVE-2022-33891)?", "uri":"dli_03_0260.html", "doc_type":"usermanual", - "p_code":"184", - "code":"196" + "p_code":"217", + "code":"218" }, { "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", @@ -1769,8 +1967,8 @@ "title":"Quota", "uri":"dli_03_0053.html", "doc_type":"usermanual", - "p_code":"85", - "code":"197" + "p_code":"91", + "code":"219" }, { "desc":"Log in to the management console.Click in the upper left corner and select Region and Project.Click (the My Quotas icon) in the upper right corner.The Service Quota pag", @@ -1778,8 +1976,8 @@ "title":"How Do I View My Quotas?", "uri":"dli_03_0031.html", "doc_type":"usermanual", - "p_code":"197", - "code":"198" + "p_code":"219", + "code":"220" }, { "desc":"The system does not support online quota adjustment. To increase a resource quota, dial the hotline or send an email to the customer service. We will process your applica", @@ -1787,8 +1985,8 @@ "title":"How Do I Increase a Quota?", "uri":"dli_03_0032.html", "doc_type":"usermanual", - "p_code":"197", - "code":"199" + "p_code":"219", + "code":"221" }, { "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", @@ -1796,8 +1994,17 @@ "title":"Permission", "uri":"dli_03_0054.html", "doc_type":"usermanual", - "p_code":"85", - "code":"200" + "p_code":"91", + "code":"222" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"Usage", + "uri":"dli_03_0223.html", + "doc_type":"usermanual", + "p_code":"222", + "code":"223" }, { "desc":"DLI has a comprehensive permission control mechanism and supports fine-grained authentication through Identity and Access Management (IAM). You can create policies in IAM", @@ -1805,8 +2012,8 @@ "title":"How Do I Manage Fine-Grained DLI Permissions?", "uri":"dli_03_0100.html", "doc_type":"usermanual", - "p_code":"200", - "code":"201" + "p_code":"223", + "code":"224" }, { "desc":"You cannot perform permission-related operations on the partition column of a partition table. However, when you grant the permission of any non-partition column in a par", @@ -1814,62 +2021,71 @@ "title":"What Is Column Permission Granting of a DLI Partition Table?", "uri":"dli_03_0008.html", "doc_type":"usermanual", - "p_code":"200", - "code":"202" + "p_code":"223", + "code":"225" }, { - "desc":"You can set actions and resources of different levels for various scenarios.Define an action.The format is Service name:Resource type:Action. You can use wildcard *. The ", + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", "product_code":"dli", - "title":"How Do I Create a Custom Policy?", - "uri":"dli_03_0101.html", + "title":"O&M Guide", + "uri":"dli_03_0226.html", "doc_type":"usermanual", - "p_code":"200", - "code":"203" - }, - { - "desc":"You can isolate queues allocated to different users by setting permissions to ensure data query performance.", - "product_code":"dli", - "title":"How Do I Manage Queue Permissions?", - "uri":"dli_03_0225.html", - "doc_type":"usermanual", - "p_code":"200", - "code":"204" + "p_code":"222", + "code":"226" }, { "desc":"When you submit a job, a message is displayed indicating that the job fails to be submitted due to insufficient permission caused by arrears. In this case, you need to ch", "product_code":"dli", - "title":"What Should I Do When My Account Does Not Have Permission Due To Arrears?", + "title":"Why Does My Account Have Insufficient Permissions Due to Arrears?", "uri":"dli_03_0140.html", "doc_type":"usermanual", - "p_code":"200", - "code":"205" + "p_code":"226", + "code":"227" }, { "desc":"When the user update an existing program package, the following error information is displayed:\"error_code\"*CLI.0003\",\"error_msg\":\"Permission denied for resource 'resourc", "product_code":"dli", - "title":"What Should I Do If the Permission Is Required to Update a Program Package?", + "title":"Why Does the System Display a Message Indicating Insufficient Permissions When I Update a Program Package?", "uri":"dli_03_0195.html", "doc_type":"usermanual", - "p_code":"200", - "code":"206" + "p_code":"226", + "code":"228" }, { "desc":"When the SQL query statement is executed, the system displays a message indicating that the user does not have the permission to query resources.Error information: DLI.00", "product_code":"dli", - "title":"What Should I Do If \"DLI.0003: Permission denied for resource...\" Is Reported When I Run a SQL Statement?", + "title":"Why Is Error \"DLI.0003: Permission denied for resource...\" Reported When I Run a SQL Statement?", "uri":"dli_03_0227.html", "doc_type":"usermanual", - "p_code":"200", - "code":"207" + "p_code":"226", + "code":"229" }, { "desc":"The table permission has been granted and verified. However, after a period of time, an error is reported indicating that the table query fails.There are two possible rea", "product_code":"dli", - "title":"What Should I Do If the Table Permission Has Been Granted But the Table Still Cannot Be Queried?", + "title":"Why Can't I Query Table Data After I've Been Granted Table Permissions?", "uri":"dli_03_0228.html", "doc_type":"usermanual", - "p_code":"200", - "code":"208" + "p_code":"226", + "code":"230" + }, + { + "desc":"If a table inherits database permissions, you do not need to regrant the inherited permissions to the table.When you grant permissions on a table on the console:If you se", + "product_code":"dli", + "title":"Will an Error Be Reported if the Inherited Permissions Are Regranted to a Table That Inherits Database Permissions?", + "uri":"dli_03_0057.html", + "doc_type":"usermanual", + "p_code":"226", + "code":"231" + }, + { + "desc":"User A created Table1.User B created View1 based on Table1.After the Select Table permission on Table1 is granted to user C, user C fails to query View1.User B does not h", + "product_code":"dli", + "title":"Why Can't I Query a View After I'm Granted the Select Table Permission on the View?", + "uri":"dli_03_0067.html", + "doc_type":"usermanual", + "p_code":"226", + "code":"232" }, { "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", @@ -1877,8 +2093,17 @@ "title":"Queue", "uri":"dli_03_0049.html", "doc_type":"usermanual", - "p_code":"85", - "code":"209" + "p_code":"91", + "code":"233" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"Usage", + "uri":"dli_03_0229.html", + "doc_type":"usermanual", + "p_code":"233", + "code":"234" }, { "desc":"Currently, you are not allowed to modify the description of a created queue. You can add the description when purchasing the queue.", @@ -1886,8 +2111,8 @@ "title":"Does the Description of a DLI Queue Can Be Modified?", "uri":"dli_03_0109.html", "doc_type":"usermanual", - "p_code":"209", - "code":"210" + "p_code":"234", + "code":"235" }, { "desc":"Deleting a queue does not cause table data loss in your database.", @@ -1895,8 +2120,8 @@ "title":"Will Table Data in My Database Be Lost If I Delete a Queue?", "uri":"dli_03_0166.html", "doc_type":"usermanual", - "p_code":"209", - "code":"211" + "p_code":"234", + "code":"236" }, { "desc":"You need to develop a mechanism to retry failed jobs. When a faulty queue is recovered, your application tries to submit the failed jobs to the queue again.", @@ -1904,8 +2129,8 @@ "title":"How Does DLI Ensure the Reliability of Spark Jobs When a Queue Is Abnormal?", "uri":"dli_03_0170.html", "doc_type":"usermanual", - "p_code":"209", - "code":"212" + "p_code":"234", + "code":"237" }, { "desc":"DLI allows you to subscribe to an SMN topic for failed jobs.Log in to the DLI console.In the navigation pane on the left, choose Queue Management.On the Queue Management ", @@ -1913,8 +2138,17 @@ "title":"How Do I Monitor Queue Exceptions?", "uri":"dli_03_0098.html", "doc_type":"usermanual", - "p_code":"209", - "code":"213" + "p_code":"234", + "code":"238" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"O&M Guide", + "uri":"dli_03_0230.html", + "doc_type":"usermanual", + "p_code":"233", + "code":"239" }, { "desc":"To check the running status of the DLI queue and determine whether to run more jobs on that queue, you need to check the queue load.Search for Cloud Eye on the console.In", @@ -1922,8 +2156,8 @@ "title":"How Do I View DLI Queue Load?", "uri":"dli_03_0095.html", "doc_type":"usermanual", - "p_code":"209", - "code":"214" + "p_code":"239", + "code":"240" }, { "desc":"You need to check the large number of jobs in the Submitting and Running states on the queue.Use Cloud Eye to view jobs in different states on the queue. The procedure is", @@ -1931,8 +2165,8 @@ "title":"How Do I Determine Whether There Are Too Many Jobs in the Current Queue?", "uri":"dli_03_0183.html", "doc_type":"usermanual", - "p_code":"209", - "code":"215" + "p_code":"239", + "code":"241" }, { "desc":"Currently, DLI provides two types of queues, For SQL and For general use. SQL queues are used to run SQL jobs. General-use queues are compatible with Spark queues of earl", @@ -1940,8 +2174,8 @@ "title":"How Do I Switch an Earlier-Version Spark Queue to a General-Purpose Queue?", "uri":"dli_03_0065.html", "doc_type":"usermanual", - "p_code":"209", - "code":"216" + "p_code":"239", + "code":"242" }, { "desc":"DLI queues do not use resources or bandwidth when no job is running. In this case, the running status of DLI queues is not displayed on CES.", @@ -1949,8 +2183,8 @@ "title":"Why Cannot I View the Resource Running Status of DLI Queues on Cloud Eye?", "uri":"dli_03_0193.html", "doc_type":"usermanual", - "p_code":"209", - "code":"217" + "p_code":"239", + "code":"243" }, { "desc":"In DLI, 64 CU = 64 cores and 256 GB memory.In a Spark job, if the driver occupies 4 cores and 16 GB memory, the executor can occupy 60 cores and 240 GB memory.", @@ -1958,26 +2192,26 @@ "title":"How Do I Allocate Queue Resources for Running Spark Jobs If I Have Purchased 64 CUs?", "uri":"dli_03_0088.html", "doc_type":"usermanual", - "p_code":"209", - "code":"218" + "p_code":"239", + "code":"244" }, { "desc":"Queue plans create failed. The plan xxx target cu is out of quota is displayed when you create a scheduled scaling task.The CU quota of the current account is insufficien", "product_code":"dli", - "title":"What Should I Do If \"Queue plans create failed. The plan xxx target cu is out of quota\" Is Displayed When I Schedule CU Changes?", + "title":"Why Is Error \"Queue plans create failed. The plan xxx target cu is out of quota\" Reported When I Schedule CU Changes?", "uri":"dli_03_0159.html", "doc_type":"usermanual", - "p_code":"209", - "code":"219" + "p_code":"239", + "code":"245" }, { "desc":"After a SQL job was submitted to the default queue, the job runs abnormally. The job log reported that the execution timed out. The exception logs are as follows:[ERROR] ", "product_code":"dli", - "title":"What Should I Do If SQL Statements Fails to be Executed on the Default Queue, and a Timeout Exception is Reported?", + "title":"Why Is a Timeout Exception Reported When a DLI SQL Statement Fails to Be Executed on the Default Queue?", "uri":"dli_03_0171.html", "doc_type":"usermanual", - "p_code":"209", - "code":"220" + "p_code":"239", + "code":"246" }, { "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", @@ -1985,8 +2219,17 @@ "title":"Datasource Connections", "uri":"dli_03_0022.html", "doc_type":"usermanual", - "p_code":"85", - "code":"221" + "p_code":"91", + "code":"247" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"Datasource Connections", + "uri":"dli_03_0110.html", + "doc_type":"usermanual", + "p_code":"247", + "code":"248" }, { "desc":"You need to create a VPC peering connection to enable network connectivity. Take MRS as an example. If DLI and MRS clusters are in the same VPC, and the security group is", @@ -1994,8 +2237,8 @@ "title":"Why Do I Need to Create a VPC Peering Connection for an Enhanced Datasource Connection?", "uri":"dli_03_0128.html", "doc_type":"usermanual", - "p_code":"221", - "code":"222" + "p_code":"248", + "code":"249" }, { "desc":"An enhanced datasource connection failed to pass the network connectivity test. Datasource connection cannot be bound to a queue. The following error information is displ", @@ -2003,8 +2246,8 @@ "title":"Failed to Bind a Queue to an Enhanced Datasource Connection", "uri":"dli_03_0237.html", "doc_type":"usermanual", - "p_code":"221", - "code":"223" + "p_code":"248", + "code":"250" }, { "desc":"The outbound rule had been configured for the security group of the queue associated with the enhanced datasource connection. The datasource authentication used a passwor", @@ -2012,8 +2255,8 @@ "title":"DLI Failed to Connect to GaussDB(DWS) Through an Enhanced Datasource Connection", "uri":"dli_03_0238.html", "doc_type":"usermanual", - "p_code":"221", - "code":"224" + "p_code":"248", + "code":"251" }, { "desc":"A datasource connection is created and bound to a queue. The connectivity test fails and the following error information is displayed:failed to connect to specified addre", @@ -2021,8 +2264,8 @@ "title":"What Can I Do If the Datasource Connection is Created But the Network Connectivity Test Fails?", "uri":"dli_03_0179.html", "doc_type":"usermanual", - "p_code":"221", - "code":"225" + "p_code":"248", + "code":"252" }, { "desc":"Configuring the Connection Between a DLI Queue and a Data Source in a Private NetworkIf your DLI job needs to connect to a data source, for example, MRS, RDS, CSS, Kafka,", @@ -2030,8 +2273,8 @@ "title":"How Do I Configure the Network Between a DLI Queue and a Data Source?", "uri":"dli_03_0186.html", "doc_type":"usermanual", - "p_code":"221", - "code":"226" + "p_code":"248", + "code":"253" }, { "desc":"The possible causes and solutions are as follows:If you have created a queue, do not bind it to a datasource connection immediately. Wait for 5 to 10 minutes. After the c", @@ -2039,8 +2282,8 @@ "title":"What Can I Do If a Datasource Connection Is Stuck in Creating State When I Try to Bind a Queue to It?", "uri":"dli_03_0257.html", "doc_type":"usermanual", - "p_code":"221", - "code":"227" + "p_code":"248", + "code":"254" }, { "desc":"Enhanced datasource connections support only yearly/monthly and pay-per-use queues.You can bind a datasource connection only when you select Dedicated Resource Mode when ", @@ -2048,8 +2291,8 @@ "title":"How Do I Bind a Datasource Connection to a Pay-per-Use Queue?", "uri":"dli_03_0258.html", "doc_type":"usermanual", - "p_code":"221", - "code":"228" + "p_code":"248", + "code":"255" }, { "desc":"DLI enhanced datasource connection uses VPC peering to directly connect the VPC networks of the desired data sources for point-to-point data exchanges.", @@ -2057,8 +2300,17 @@ "title":"How Do I Connect DLI to Data Sources?", "uri":"dli_03_0259.html", "doc_type":"usermanual", - "p_code":"221", - "code":"229" + "p_code":"248", + "code":"256" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"Cross-Source Analysis", + "uri":"dli_03_0112.html", + "doc_type":"usermanual", + "p_code":"247", + "code":"257" }, { "desc":"To perform query on data stored on services rather than DLI, perform the following steps:Assume that the data to be queried is stored on multiple services (for example, O", @@ -2066,8 +2318,8 @@ "title":"How Can I Perform Query on Data Stored on Services Rather Than DLI?", "uri":"dli_03_0011.html", "doc_type":"usermanual", - "p_code":"221", - "code":"230" + "p_code":"257", + "code":"258" }, { "desc":"Connect VPCs in different regions.Create an enhanced datasource connection on DLI and bind it to a queue.Add a DLI route.", @@ -2075,8 +2327,8 @@ "title":"How Can I Access Data Across Regions?", "uri":"dli_03_0085.html", "doc_type":"usermanual", - "p_code":"221", - "code":"231" + "p_code":"257", + "code":"259" }, { "desc":"When data is inserted into DLI, set the ID field to NULL.", @@ -2084,8 +2336,17 @@ "title":"How Do I Set the Auto-increment Primary Key or Other Fields That Are Automatically Filled in the RDS Table When Creating a DLI and Associating It with the RDS Table?", "uri":"dli_03_0028.html", "doc_type":"usermanual", - "p_code":"221", - "code":"232" + "p_code":"257", + "code":"260" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"Datasource Connection O&M", + "uri":"dli_03_0256.html", + "doc_type":"usermanual", + "p_code":"247", + "code":"261" }, { "desc":"Possible CausesThe network connectivity is abnormal. Check whether the security group is correctly selected and whether the VPC is correctly configured.The network connec", @@ -2093,8 +2354,8 @@ "title":"Why Is the Error Message \"communication link failure\" Displayed When I Use a Newly Activated Datasource Connection?", "uri":"dli_03_0047.html", "doc_type":"usermanual", - "p_code":"221", - "code":"233" + "p_code":"261", + "code":"262" }, { "desc":"The cluster host information is not added to the datasource connection. As a result, the KRB authentication fails, the connection times out, and no error is recorded in l", @@ -2102,53 +2363,53 @@ "title":"Connection Times Out During MRS HBase Datasource Connection, and No Error Is Recorded in Logs", "uri":"dli_03_0080.html", "doc_type":"usermanual", - "p_code":"221", - "code":"234" + "p_code":"261", + "code":"263" }, { "desc":"When you create a VPC peering connection for the datasource connection, the following error information is displayed:Before you create a datasource connection, check whet", "product_code":"dli", - "title":"What Should I Do If the Subnet Cannot Be Found When I Create a DLI Datasource Connection?", + "title":"Why Can't I Find the Subnet When Creating a DLI Datasource Connection?", "uri":"dli_03_0111.html", "doc_type":"usermanual", - "p_code":"221", - "code":"235" + "p_code":"261", + "code":"264" }, { - "desc":"A cross-source RDS table was created in the DataArts Studio, and the insert overwrite statement was executed to write data into RDS. DLI.0999: BatchUpdateException: Incor", + "desc":"A datasource RDS table was created in the DataArts Studio, and the insert overwrite statement was executed to write data into RDS. DLI.0999: BatchUpdateException: Incorre", "product_code":"dli", - "title":"Error Message \"Incorrect string value\" Is Displayed When insert overwrite Is Executed on a Cross-Source RDS Table", + "title":"Error Message \"Incorrect string value\" Is Displayed When insert overwrite Is Executed on a Datasource RDS Table", "uri":"dli_03_0239.html", "doc_type":"usermanual", - "p_code":"221", - "code":"236" + "p_code":"261", + "code":"265" }, { - "desc":"The system failed to create a cross-source RDS table, and null pointer error was reported.The following table creation statement was used:The RDS database is in a PostGre", + "desc":"The system failed to create a datasource RDS table, and null pointer error was reported.The following table creation statement was used:The RDS database is in a PostGre c", "product_code":"dli", - "title":"Null Pointer Error Is Displayed When the System Creates a Cross-Source RDS Table", + "title":"Null Pointer Error Is Displayed When the System Creates a Datasource RDS Table", "uri":"dli_03_0250.html", "doc_type":"usermanual", - "p_code":"221", - "code":"237" + "p_code":"261", + "code":"266" }, { - "desc":"The system failed to execute insert overwrite on the cross-source GaussDB(DWS) table, and org.postgresql.util.PSQLException: ERROR: tuple concurrently updated was display", + "desc":"The system failed to execute insert overwrite on the datasource GaussDB(DWS) table, and org.postgresql.util.PSQLException: ERROR: tuple concurrently updated was displayed", "product_code":"dli", - "title":"Error Message \"org.postgresql.util.PSQLException: ERROR: tuple concurrently updated\" Is Displayed When the System Executes insert overwrite on a Cross-Source GaussDB(DWS) Table", + "title":"Error Message \"org.postgresql.util.PSQLException: ERROR: tuple concurrently updated\" Is Displayed When the System Executes insert overwrite on a Datasource GaussDB(DWS) Table", "uri":"dli_03_0251.html", "doc_type":"usermanual", - "p_code":"221", - "code":"238" + "p_code":"261", + "code":"267" }, { - "desc":"A cross-source table was used to import data to a CloudTable HBase table. This HBase table contains a column family and a rowkey for 100 million simulating data records. ", + "desc":"A datasource table was used to import data to a CloudTable HBase table. This HBase table contains a column family and a rowkey for 100 million simulating data records. Th", "product_code":"dli", - "title":"RegionTooBusyException Is Reported When Data Is Imported to a CloudTable HBase Table Through a Cross-Source Table", + "title":"RegionTooBusyException Is Reported When Data Is Imported to a CloudTable HBase Table Through a Datasource Table", "uri":"dli_03_0252.html", "doc_type":"usermanual", - "p_code":"221", - "code":"239" + "p_code":"261", + "code":"268" }, { "desc":"A table was created on GaussDB(DWS) and then a datasource connection was created on DLI to read and write data. An error message was displayed during data writing, indica", @@ -2156,17 +2417,80 @@ "title":"A Null Value Is Written Into a Non-Null Field When a DLI Datasource Connection Is Used to Connect to a GaussDB(DWS) Table", "uri":"dli_03_0253.html", "doc_type":"usermanual", - "p_code":"221", - "code":"240" + "p_code":"261", + "code":"269" }, { - "desc":"A cross-source GaussDB(DWS) table and the datasource connection were created in DLI, and the schema of the source table in GaussDB(DWS) were updated. During the job execu", + "desc":"A datasource GaussDB(DWS) table and the datasource connection were created in DLI, and the schema of the source table in GaussDB(DWS) were updated. During the job executi", "product_code":"dli", "title":"An Insert Operation Failed After the Schema of the GaussDB(DWS) Source Table Is Updated", "uri":"dli_03_0254.html", "doc_type":"usermanual", - "p_code":"221", - "code":"241" + "p_code":"261", + "code":"270" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"APIs", + "uri":"dli_03_0056.html", + "doc_type":"usermanual", + "p_code":"91", + "code":"271" + }, + { + "desc":"In the REST API provided by DLI, the request header can be added to the request URI, for example, Content-Type.Content-Type indicates the request body type or format. The", + "product_code":"dli", + "title":"Why Is Error \"unsupported media Type\" Reported When I Subimt a SQL Job?", + "uri":"dli_03_0060.html", + "doc_type":"usermanual", + "p_code":"271", + "code":"272" + }, + { + "desc":"If different IAM accounts call APIs in the same enterprise project in the same region, the accounts use the same project ID.", + "product_code":"dli", + "title":"Are Project IDs of Different Accounts the Same When They Are Used to Call APIs?", + "uri":"dli_03_0125.html", + "doc_type":"usermanual", + "p_code":"271", + "code":"273" + }, + { + "desc":"When the API call for submitting a SQL job times out, and the following error information is displayed:There are currently no resources tracked in the state, so there is ", + "product_code":"dli", + "title":"What Can I Do If an Error Is Reported When the Execution of the API for Creating a SQL Job Times Out?", + "uri":"dli_03_0178.html", + "doc_type":"usermanual", + "p_code":"271", + "code":"274" + }, + { + "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", + "product_code":"dli", + "title":"SDKs", + "uri":"dli_03_0058.html", + "doc_type":"usermanual", + "p_code":"91", + "code":"275" + }, + { + "desc":"When you query the SQL job results using SDK, the system checks the job status when the job is submitted. The timeout interval set in the system is 300s. If the job is no", + "product_code":"dli", + "title":"How Do I Set the Timeout Duration for Querying SQL Job Results Using SDK?", + "uri":"dli_03_0073.html", + "doc_type":"usermanual", + "p_code":"275", + "code":"276" + }, + { + "desc":"Run the ping command to check whether dli.xxx can be accessed.If dli.xxx can be accessed, check whether DNS resolution is correctly configured.If dli.xxx can be accessed,", + "product_code":"dli", + "title":"How Do I Handle the dli.xxx,unable to resolve host address Error?", + "uri":"dli_03_0255.html", + "doc_type":"usermanual", + "p_code":"275", + "code":"277" }, { "desc":"HUAWEI CLOUD Help Center presents technical documents to help you quickly get started with HUAWEI CLOUD services. The technical documents include Service Overview, Price Details, Purchase Guide, User Guide, API Reference, Best Practices, FAQs, and Videos.", @@ -2175,6 +2499,6 @@ "uri":"dli_01_00006.html", "doc_type":"usermanual", "p_code":"", - "code":"242" + "code":"278" } ] \ No newline at end of file diff --git a/docs/dli/umn/dli_01_00006.html b/docs/dli/umn/dli_01_00006.html index 936c0e4ca..bdf3125eb 100644 --- a/docs/dli/umn/dli_01_00006.html +++ b/docs/dli/umn/dli_01_00006.html @@ -8,7 +8,13 @@ -

2023-01-30

+

2023-05-11

+ +

Modified the following content:

+ + + +

2023-01-30

This issue is the first official release.

diff --git a/docs/dli/umn/dli_01_0002.html b/docs/dli/umn/dli_01_0002.html index c2e2316d6..877f5e706 100644 --- a/docs/dli/umn/dli_01_0002.html +++ b/docs/dli/umn/dli_01_0002.html @@ -1,40 +1,35 @@

Creating and Submitting a Spark SQL Job

-

You can use DLI to submit a Spark SQL job to query data. The general procedure is as follows:

-

Step 1: Logging in to the Cloud Platform

-

Step 2: Uploading Data to OBS

-

Step 3: Logging In to the DLI Management Console

-

Step 4: Creating a Queue

-

Step 5: Creating a Database

-

Step 6: Creating a Table

-

Step 7: Querying Data

-

The following illustrates how to query OBS data using DLI. Operations to query DLI data are similar.

-

Step 1: Logging in to the Cloud Platform

  1. Open the DLI homepage.
  2. On the login page, enter the username and password, and click Log In.
+

Scenarios

DLI can query data stored in OBS. This section describes how to us a Spark SQL job on DLI to query OBS data.

-

Step 2: Uploading Data to OBS

DLI allows you to query data stored on OBS. Before querying the data, you need to upload data to OBS.

-
  1. In the services displayed, click Object Storage Service (OBS) in Storage.
  2. The OBS console page is displayed.
  3. Create a bucket. The bucket name must be globally unique. In this example, assume that the bucket name is obs1.
    1. Click Create Bucket in the upper right corner.
    2. On the displayed Create Bucket page, enter the Bucket Name. Retain the default values for other parameters or set them as required.
    3. Click Create Now.
    +

    Procedure

    You can use DLI to submit a Spark SQL job to query data. The general procedure is as follows:

    +

    Step 1: Upload Data to OBS

    +

    Step 2: Create a Queue

    +

    Step 3: Create a Database

    +

    Step 4: Create a Table

    +

    Step 5: Query Data

    +
    +

    Step 1: Upload Data to OBS

    Before you use DLI to query and analyze data, upload data files to OBS.

    +
    1. Go to the DLI console.
    2. In the service list, click Object Storage Service under Storage. The OBS console page is displayed.
    3. Create a bucket. In this example, the bucket name is obs1.
      1. Click Create Bucket in the upper right corner.
      2. On the displayed Create Bucket page, enter the Bucket Name. Retain the default values for other parameters or set them as required.

        You must select the same region as the DLI management console.

        +
        +
      3. Click Create Now.
    4. Click obs1 to switch to the Overview page.
    5. In the left navigation pane, click Objects. Click Upload Object. In the displayed dialog box, drag files or folders to upload or add file, for example, sampledata.csv to the file upload box. Then, click Upload.
      You can create a sampledata.txt file, copy the following content separated by commas (,), and save the file as sampledata.csv.
      12,test

      After the file is uploaded successfully, the file path is obs://obs1/sampledata.csv.

      -

      For more information about OBS operations, see the Object Storage Service Console Operation Guide.

      -

      For more information about the tool, see the OBS Tool Guide.

      -

      You are advised to use an OBS tool, such as OBS Browser+, to upload large files because OBS Console has restrictions on the file size and quantity.

      -
      • OBS Browser+ is a graphical tool that provides complete functions for managing your buckets and objects in OBS.
      +
      • For more information about OBS operations, see the Object Storage Service Console Operation Guide.
      • For more information about the tool, see the OBS Tool Guide.
      • You are advised to use an OBS tool, such as OBS Browser+, to upload large files because OBS Console has restrictions on the file size and quantity.
        • OBS Browser+ is a graphical tool that provides complete functions for managing your buckets and objects in OBS.
        +
    -

    Step 3: Logging In to the DLI Management Console

    1. .
    2. The DLI management console page is displayed. If you log in to the DLI management console for the first time, you need to be authorized to access OBS.

      Note: For this guide, you need at least the Tenant Administrator (Global service) permission.

      -
    -
    -

    Step 4: Creating a Queue

    A queue is the basis for using DLI. Before executing an SQL job, you need to create a queue.

    -
    • An available queue default is preset in DLI.
    • You can also create queues as needed.
      1. On the DLI management console, click SQL Editor in the navigation pane on the left. The SQL Editor page is displayed.
      2. On the left pane, select the Queues tab, and click next to Queues.

        For details, see Creating a Queue.

        +

        Step 2: Create a Queue

        A queue is the basis for using DLI. Before executing an SQL job, you need to create a queue.

        +
        • An available queue default is preset in DLI.
        • You can also create queues as needed.
          1. Log in to the DLI management console.
          2. On the DLI management console, click SQL Editor in the navigation pane on the left. The SQL Editor page is displayed.
          3. On the left pane, select the Queues tab, and click next to Queues.

            For details, see Creating a Queue.

        -

        Step 5: Creating a Database

        Before querying data, create a database, for example, db1.

        -

        The default database is a built-in database. You cannot create the database named default.

        +

        Step 3: Create a Database

        Before querying data, create a database, for example, db1.

        +

        The default database is a built-in database. You cannot create the default. database.

        1. On the DLI management console, click SQL Editor in the navigation pane on the left. The SQL Editor page is displayed.
        2. In the editing window on the right of the SQL Editor page, enter the following SQL statement and click Execute. Read and agree to the privacy agreement, and click OK.
          create database db1;

          After database db1 is successfully created, db1 will be displayed in the Database list.

          @@ -42,12 +37,12 @@
    -

    Step 6: Creating a Table

    After database db1 is created, create a table (for example, table1) containing data in the sample file obs://obs1/sampledata.csv stored on OBS in db1.

    +

    Step 4: Create a Table

    After database db1 is created, create a table (for example, table1) containing data in the sample file obs://obs1/sampledata.csv stored on OBS in db1.

    1. In the SQL editing window of the SQL Editor page, select the default queue and database db1.
    2. Enter the following SQL statement in the job editor window and click Execute:
      create table table1 (id int, name string) using csv options (path 'obs://obs1/sampledata.csv');

      After the table is created, click the Databases tab and then select db1. The created table table1 is displayed in the Table area.

    -

    Step 7: Querying Data

    After performing the preceding steps, you can start querying data.

    +

    Step 5: Query Data

    After performing the preceding steps, you can start querying data.

    1. In the Table tab on the SQL Editor page, double-click the created table table1. The SQL statement is automatically displayed in the SQL job editing window in the right pane. Run following statement to query 1,000 records in the table1 table:
      select * from db1.table1 limit 1000;
    2. Click Execute. The system starts the query.

      After the SQL statement is executed successfully, you can view the query result in View Result under the SQL job editing window.

    diff --git a/docs/dli/umn/dli_01_0005.html b/docs/dli/umn/dli_01_0005.html index f6a4f3b3b..a9f8a4c1f 100644 --- a/docs/dli/umn/dli_01_0005.html +++ b/docs/dli/umn/dli_01_0005.html @@ -25,7 +25,7 @@

    Database Name

    • The database name can contain only digits, letters, and underscores (_), but cannot contain only digits or start with an underscore (_).
    • The database name is case insensitive and cannot be left blank.
    • The length of the database name cannot exceed 128 characters.
    -
    NOTE:

    The default database is a built-in database. You cannot create the database named default.

    +
    NOTE:

    The default database is a built-in database. You cannot create the default. database.

    DB01

    @@ -45,9 +45,9 @@

Creating a Table

Before creating a table, ensure that a database has been created.

-
  1. You can create a table on either the Databases and Tables page or the SQL Editor page.

    Datasource connection tables, such as View tables, HBase (MRS) tables, OpenTSDB (MRS) tables, DWS tables, RDS tables, and CSS tables, cannot be created. You can use SQL to create views and datasource connection tables. For details, see sections Creating a View and Creating a Datasource Connection Table in the Data Lake Insight SQL Syntax Reference.

    +
    1. You can create a table on either the Databases and Tables page or the SQL Editor page.

      Datasource connection tables, such as View tables, HBase (MRS) tables, OpenTSDB (MRS) tables, DWS tables, RDS tables, and CSS tables, cannot be created. You can use SQL to create views and datasource connection tables. For details, see sections Creating a View and Creating a Datasource Connection Table in the Data Lake Insight SQL Syntax Reference.

      -
      • To create a table on the Data Management page:
        1. On the left of the management console, choose Data Management > Databases and Tables.
        2. On the Databases and Tables page, select the database for which you want to create a table. In the Operation column, click More > Create Table to create a table in the current database.
        +
        • To create a table on the Data Management page:
          1. On the left of the management console, choose Data Management > Databases and Tables.
          2. On the Databases and Tables page, select the database for which you want to create a table. In the Operation column, click More > Create Table to create a table in the current database.
        • To create a table on the SQL Editor page:
          1. On the left of the management console, click SQL Editor.
          2. In the navigation pane of the displayed SQL Editor page, click Databases. You can create a table in either of the following ways:
            • Click a database name. In the Tables area, click on the right to create a table in the current database.
            • Click on the right of the database and choose Create Table from the shortcut menu to create a table in the current database.
        @@ -71,7 +71,7 @@

        Data storage location. Currently, DLI and OBS are supported.

        -

        OBS

        +

        DLI

        Description

        @@ -101,7 +101,7 @@

        Type

        Data type of a column. This parameter corresponds to Column Name.

        -
        • string: The data is of the string type.
        • int: Each integer is stored on four bytes.
        • date: The value ranges from 0000-01-01 to 9999-12-31.
        • double: Each number is stored on eight bytes.
        • boolean: Each value is stored on one byte.
        • decimal: The valid bits are positive integers between 1 to 38, including 1 and 38. The decimal digits are integers less than 10.
        • smallint/short: The number is stored on two bytes.
        • bigint/long: The number is stored on eight bytes.
        • timestamp: The data indicates a date and time. The value can be accurate to six decimal points.
        • float: Each number is stored on four bytes.
        • tinyint: Each number is stored on one byte. Only OBS tables support this data type.
        +
        • string: The data is of the string type.
        • int: Each integer is stored on four bytes.
        • date: The value ranges from 0000-01-01 to 9999-12-31.
        • double: Each number is stored on eight bytes.
        • boolean: Each value is stored on one byte.
        • decimal: The valid bits are positive integers between 1 to 38, including 1 and 38. The decimal digits are integers less than 10.
        • smallint/short: The number is stored on two bytes.
        • bigint/long: The number is stored on eight bytes.
        • timestamp: The data indicates a date and time. The value can be accurate to six decimal points.
        • float: Each number is stored on four bytes.
        • tinyint: Each number is stored on one byte. Only OBS tables support this data type.

        string

        @@ -137,7 +137,7 @@

        Data Format

        DLI supports the following data formats:

        -
        • Parquet: DLI can read non-compressed data or data that is compressed using Snappy and gzip.
        • CSV: DLI can read non-compressed data or data that is compressed using gzip.
        • ORC: DLI can read non-compressed data or data that is compressed using Snappy.
        • JSON: DLI can read non-compressed data or data that is compressed using gzip.
        • Avro: DLI can read uncompressed Avro data.
        +
        • Parquet: DLI can read non-compressed data or data that is compressed using Snappy and gzip.
        • CSV: DLI can read non-compressed data or data that is compressed using gzip.
        • ORC: DLI can read non-compressed data or data that is compressed using Snappy.
        • JSON: DLI can read non-compressed data or data that is compressed using gzip.
        • Avro: DLI can read uncompressed Avro data.

        CSV

        @@ -170,7 +170,7 @@

        User-defined Quotation Character

        -

        This parameter is valid only when Data Format is set to CSV and you select User-defined Quotation Character.

        +

        This parameter is valid only when Data Format is set to CSV and you select User-defined Quotation Character.

        The following quotation characters are supported:

        • Single quotation mark (')
        • Double quotation marks (")
        • Others: Enter a user-defined quotation character.
        @@ -189,7 +189,7 @@

        Date Format

        This parameter is valid only when Data Format is set to CSV or JSON.

        -

        This parameter specifies the format of the date in the table and is valid only Advanced Settings is selected. The default value is yyyy-MM-dd. For definition of characters involved in the date pattern, see Table 3 in the

        +

        This parameter specifies the format of the date in the table and is valid only Advanced Settings is selected. The default value is yyyy-MM-dd. For definition of characters involved in the date pattern, see Table 3 in .

        2000-01-01

        @@ -197,7 +197,7 @@

        Timestamp Format

        This parameter is valid only when Data Format is set to CSV or JSON.

        -

        This parameter specifies the format of the timestamp in the table and is valid only Advanced Settings is selected. The default value is yyyy-MM-dd HH:mm:ss. For definition of characters involved in the time pattern, see Table 3 in the

        +

        This parameter specifies the format of the timestamp in the table and is valid only Advanced Settings is selected. The default value is yyyy-MM-dd HH:mm:ss. For definition of characters involved in the time pattern, see Table 3 in .

        2000-01-01 09:00:00

        @@ -206,7 +206,7 @@
    2. -

  2. Click OK.

    After a table is created, you can view and select the table for use on the Data Management page or SQL Editor page.

    +

  3. Click OK.

    After a table is created, you can view and select the table for use on the Data Management page or SQL Editor page.

  4. (Optional) After a DLI table is created, you can decide whether to directly import data to the table.
diff --git a/docs/dli/umn/dli_01_0006.html b/docs/dli/umn/dli_01_0006.html index dfcf005e9..a80c5153e 100644 --- a/docs/dli/umn/dli_01_0006.html +++ b/docs/dli/umn/dli_01_0006.html @@ -6,40 +6,42 @@
  1. Apply for a cluster in MRS.

    If a cluster is available, you do not need to apply for one.

  2. In the navigation pane of the DLI management console, choose Datasource Connections.
  3. Click the Enhanced tab and click Create in the upper left corner.

    Enter the Connection Name, select the Bind Queue (optional), VPC, and Subnet, and enter the Host Information (optional). For details about the parameters, see Table 1.

    +

    -
    Table 1 Parameter description

    Parameter

    +
    - - - - - - - - - - -
    Table 1 Parameters

    Parameter

    Description

    +

    Description

    Connection Name

    +

    Connection Name

    Name of the created datasource connection.

    +

    Name of the created datasource connection.

    • The name can contain only letters, digits, and underscores (_). The parameter must be specified.
    • A maximum of 64 characters are allowed.

    Bound Queue

    +

    Resource Pool

    (Optional) Bind a queue that requires datasource connections.

    -
    NOTE:

    Before using an enhanced datasource connection, you must bind a queue and ensure that the VPC peering connection is in the Active state.

    +

    It binds an elastic resource pool or queue that uses a datasource connection. This parameter is optional.

    +

    In regions where this function is available, a resource pool with the same name is created by default for the queue created in "Creating a Queue."

    +
    NOTE:

    Before using an enhanced datasource connection, you must bind a queue and ensure that the VPC peering connection is in the Active state.

    VPC

    +

    VPC

    VPC used by the destination data source.

    +

    VPC used by the destination data source.

    Subnet

    +

    Subnet

    Subnet used by the destination data source.

    +

    Subnet used by the destination data source.

    Host Information

    +

    Host Information

    (Optional) When connecting to the HBase cluster of MRS, enter the host name and IP address of the ZooKeeper instance. Enter one record in each line. The format is as follows: IP address Host name/Domain name.

    +

    (Optional) When connecting to the HBase cluster of MRS, enter the host name and IP address of the ZooKeeper instance. Enter one record in each line. The format is as follows: IP address Host name/Domain name.

    To obtain the host name and IP address of the MRS cluster, perform the following steps (with MRS3.x as an example):

    1. Log in to the MRS management console.
    2. In the navigation pane, choose Clusters > Active Clusters. Click the target cluster name to access the cluster details page.
    3. Click Component Management.
    4. Click Zookeeper.
    5. Click the Instance tab to view the corresponding service IP address. You can select any service IP address.
    NOTE:

    If the MRS cluster has multiple IP addresses, enter any service IP address when creating a datasource connection.

    @@ -50,7 +52,7 @@
  4. Click OK.
  5. To connect to Kafka, DWS, and RDS instances, add security group rules for the DLI network segment to the security group where the instances belong. The following uses RDS as an example:
    1. Choose Resources > Queue Management in the navigation pane. Select the target queue, and click to expand the row containing the target queue to view its CIDR block.
    2. On the Instance Management page of the RDS console, click the instance name. In the Connection Information area, view the port number of the RDS database instance.
    3. In the Connection Information area locate the Security Group and click the group name to switch to the security group management page. Select the Inbound Rules tab and click Add Rule. Set the priority to 1, protocol to TCP, port to the database port number, and source to the CIDR block of the DLI queue. Click OK.
    -
  6. Test the connectivity between the DLI queue and the connection instance. The following example describes how to test the connectivity between DLI and an RDS DB instance.
    1. On the Instance Management page, click the target DB instance. On the displayed page, locate the Connection Information pane and view the floating IP address. In the Connection Information pane, locate the Database Port to view the port number of the RDS DB instance.
    2. Go back to the DLI console. On the Resources > Queue Management page, locate the target queue. In the Operation column, click More > Test Address Connectivity.
    3. Enter the connection address of the RDS DB instance and port number in the format of IP address:port to test the network connectivity.
    +
  7. Test the connectivity between the DLI queue and the connection instance. The following example describes how to test the connectivity between DLI and an RDS DB instance.
    1. On the Instance Management page, click the target DB instance. On the displayed page, locate the Connection Information pane and view the floating IP address. In the Connection Information pane, locate the Database Port to view the port number of the RDS DB instance.
    2. Go back to the DLI console. On the Resources > Queue Management page, locate the target queue. In the Operation column, click More and select Test Address Connectivity.
    3. Enter the connection address of the RDS DB instance and port number in the format of IP address:port to test the network connectivity.

    8. Querying an Enhanced Datasource Connection

    On the Enhanced tab page, you can enter the keyword of a connection name in the search box to search for the matching connection.

    diff --git a/docs/dli/umn/dli_01_0010.html b/docs/dli/umn/dli_01_0010.html index 5d31126ec..1cc248d26 100644 --- a/docs/dli/umn/dli_01_0010.html +++ b/docs/dli/umn/dli_01_0010.html @@ -5,61 +5,61 @@

    Precautions

    • The exported file can be in JSON format, and the text format can only be UTF-8.
    • Only the data in the DLI table (the table type is Managed) can be exported to the OBS bucket, and the export path must be specified to the folder level.
    • Data can be exported across accounts. That is, after account B authorizes account A, account A can export data to the OBS path of account B if account A has the permission to read the metadata and permission information about the OBS bucket of account B and read and write the path.

    Procedure

    1. You can export data on either the Data Management page or the SQL Editor page.

      • To export data on the Data Management page:
        1. On the left of the management console, choose Data Management > Databases and Tables.
        2. Click the name of the database corresponding to the table where data is to be exported to switch to the Manage Tables page.
        3. Select the corresponding table (DLI table) and choose More > Export in the Operation column. The Export Data page is displayed.
        -
      • To export data on the SQL Editor page:
        1. On the left of the management console, click SQL Editor.
        2. In the navigation tree on the left, click Databases to see all databases. Click the database name corresponding to the table to which data is to be exported. The tables are displayed.
        3. Click on the right of the managed table (DLI table) whose data is to be exported, and choose Export from the shortcut menu.

          -
        +
      • To export data on the SQL Editor page:
        1. On the left of the management console, click SQL Editor.
        2. In the navigation tree on the left, click Databases to see all databases. Click the database name corresponding to the table to which data is to be exported. The tables are displayed.
        3. Click on the right of the managed table (DLI table) whose data is to be exported, and choose Export from the shortcut menu.
      -

    2. In the displayed Export Data dialog box, specify parameters by referring to Table 1.

      -

      - diff --git a/docs/dli/umn/dli_01_0228.html b/docs/dli/umn/dli_01_0228.html index 3652407cc..6f15af68d 100644 --- a/docs/dli/umn/dli_01_0228.html +++ b/docs/dli/umn/dli_01_0228.html @@ -36,7 +36,6 @@ @@ -104,7 +103,7 @@ diff --git a/docs/dli/umn/dli_01_0318.html b/docs/dli/umn/dli_01_0318.html new file mode 100644 index 000000000..dd6cab368 --- /dev/null +++ b/docs/dli/umn/dli_01_0318.html @@ -0,0 +1,478 @@ + + +

      DLI Operations That Can Be Recorded by CTS

      +

      With CTS, you can record operations associated with DLI for later query, audit, and backtrack operations.

      + +
      Table 1 Parameter description

      Parameter

      +

    3. In the displayed Export Data dialog box, specify parameters by referring to Table 1.

      +
      - - - - - - - - - - - - - - - - -
      Table 1 Parameter description

      Parameter

      Description

      +

      Description

      Databases

      +

      Databases

      Database where the current table is located.

      +

      Database where the current table is located.

      Table Name

      +

      Table Name

      Name of the current table.

      +

      Name of the current table.

      Data Format

      +

      Data Format

      Format of the file storing data to be exported. Formats other than JSON will be supported in later versions.

      +

      Format of the file storing data to be exported. Formats other than JSON will be supported in later versions.

      Queue

      +

      Queue

      Select a queue.

      +

      Select a queue.

      Compression Format

      +

      Compression Format

      Compression format of the data to be exported. The following compression formats are supported:

      -
      • none
      • bzip2
      • deflate
      • gzip
      +

      Compression format of the data to be exported. The following compression formats are supported:

      +
      • none
      • bzip2
      • deflate
      • gzip

      Storage Path

      +

      Storage Path

      • Enter or select an OBS path.
      • The export path must be a folder that does not exist in the OBS bucket. Specifically, you need to create a folder in the target OBS directory.
      • The folder name cannot contain the special characters of \/:*? "<>|, and cannot start or end with a dot (.).
      +
      • Enter or select an OBS path.
      • The export path must be a folder that does not exist in the OBS bucket. Specifically, you need to create a folder in the target OBS directory.
      • The folder name cannot contain the special characters of \/:*? "<>|, and cannot start or end with a dot (.).

      Export Mode

      +

      Export Mode

      Storage mode of the data to be exported.

      -
      • New OBS directory: If the specified export directory exists, an error is reported and the export operation cannot be performed.
      • Existing OBS directory (Overwritten): If you create a file in the specified directory, the existing file will be overwritten.
      +

      Storage mode of the data to be exported.

      +
      • New OBS directory: If the specified export directory exists, an error is reported and the export operation cannot be performed.
      • Existing OBS directory (Overwritten): If you create a file in the specified directory, the existing file will be overwritten.

      Table Header: No/Yes

      +

      Table Header: No/Yes

      Whether the data to be exported contains the table header.

      +

      Whether the data to be exported contains the table header.
      +

    4. Click OK.
    5. (Optional) You can view the job status (indicated by Status), statements (indicated by Statement), and other information about exporting jobs on the SQL Jobs page.

      1. Select EXPORT from the Job Type drop-down list box and specify the time range for exporting data. The jobs meeting the requirements are displayed in the job list.
      2. Click to view details about an exporting job.

      6. diff --git a/docs/dli/umn/dli_01_0017.html b/docs/dli/umn/dli_01_0017.html index d4587d4b4..815b9d2cf 100644 --- a/docs/dli/umn/dli_01_0017.html +++ b/docs/dli/umn/dli_01_0017.html @@ -56,7 +56,7 @@
    6. Re-execute: Execute the job again.
    7. SparkUI: Display the Spark job execution page.
      NOTE:
      • When you execute a job on a created queue, the cluster is restarted. It takes about 10 minutes. If you click SparkUI before the cluster is created, an empty projectID will be cached. The SparkUI page cannot be displayed. You are advised to use a dedicated queue so that the cluster will not be released. Alternatively, wait for a while after the job is submitted (the cluster is created), and then check SparkUI.
      • Currently, only the latest 100 job information records are displayed on the SparkUI of DLI.
      8. -
      • In addition to the preceding operations, the following operations are available for QUERY jobs and asynchronous DDL jobs.
        • View Result: View the job running result.
        • Export Result: Export the job running result to the created OBS bucket. For details, see section Exporting Query Results.
        +
        • In addition to the preceding operations, the following operations are available for QUERY jobs and asynchronous DDL jobs.
          • View Result: View the job running result.
          • Export Result: Export the job running result to the created OBS bucket. For details, see Exporting Query Results.
        • In addition to the preceding operations, the EXPORT job also includes the following operations:
          • Download
        • View Log: Save job logs to the temporary OBS bucket created by DLI.
        • Export Log: Export logs to the created OBS bucket. If the job is in the Running state, logs cannot be exported.
        NOTE:

        To export the logs, you need to obtain the permission to create an OBS bucket.

        diff --git a/docs/dli/umn/dli_01_0021.html b/docs/dli/umn/dli_01_0021.html index 21a1da0b9..17ca1a768 100644 --- a/docs/dli/umn/dli_01_0021.html +++ b/docs/dli/umn/dli_01_0021.html @@ -1,12 +1,11 @@ -

        SQL Template Management

        +

        Managing SQL Templates

        To facilitate SQL operation execution, DLI allows you to customize query templates or save the SQL statements in use as templates. After templates are saved, you do not need to compile SQL statements. Instead, you can directly perform the SQL operations using the templates.

        SQL templates include sample templates and custom templates. The default sample template contains 22 standard TPC-H query statements, which can meet most TPC-H test requirements. For details, see TPC-H Sample Data in the SQL Template.

        SQL template management provides the following functions:

        Table Settings

        In the upper right corner of the SQL Template page, click Set Property to determine whether to display templates by group.

        -

        If you select Display by Group, the following display modes are available:

        • Expand the first group
        • Expand all
        • Collapse All
        @@ -71,7 +70,7 @@

      Operation

      • Execute: After you click this button, the system switches to the SQL Editor page, where you can modify or directly perform the statement as required. For details, see Executing the Template.
      • Modify: Click Modify. In the displayed Modify Template dialog box, modify the template information as required. For details, see Modifying a Template.
      +
      • Execute: After you click this button, the system switches to the SQL Editor page, where you can modify or directly perform the statement as required. For details, see Executing the Template.
      • Modify: Click Modify. In the displayed Modify Template dialog box, modify the template information as required. For details, see Modifying a Template.

      Enterprise Project

      Enterprise project to which the database belongs. An enterprise project facilitates project-level management and grouping of cloud resources and users.

      -

      For details about how to set enterprise projects, see .

      Operation

      diff --git a/docs/dli/umn/dli_01_0253.html b/docs/dli/umn/dli_01_0253.html index 22dbcbce8..2ba7e5e27 100644 --- a/docs/dli/umn/dli_01_0253.html +++ b/docs/dli/umn/dli_01_0253.html @@ -6,9 +6,8 @@

      Prerequisites

      The data to be imported has been stored on OBS.

      -

      Procedure

      1. You can import data on either the Data Management page or the SQL Editor page.

        • To import data on the Data Management page:
          1. On the left of the management console, choose Data Management > Databases and Tables.
          2. Click the name of the database corresponding to the table where data is to be imported to switch to the table management page.
          3. Locate the row where the target table resides and choose More > Import in the Operation column. The Import dialog box is displayed.

            -
          -
        • To import data on the SQL Editor page:
          1. On the left of the management console, click SQL Editor.
          2. In the navigation tree on the left of SQL Editor, click Databases to see all databases. Click the database where the target table belongs. The table list is displayed.
          3. Click on the right of the table and choose Import from the shortcut menu. The Import page is displayed.

            +

            Procedure

            1. You can import data on either the Data Management page or the SQL Editor page.

              • To import data on the Data Management page:
                1. On the left of the management console, choose Data Management > Databases and Tables.
                2. Click the name of the database corresponding to the table where data is to be imported to switch to the table management page.
                3. Locate the row where the target table resides and choose More > Import in the Operation column. The Import dialog box is displayed.
                +
              • To import data on the SQL Editor page:
                1. On the left of the management console, click SQL Editor.
                2. In the navigation tree on the left of SQL Editor, click Databases to see all databases. Click the database where the target table belongs. The table list is displayed.
                3. Click on the right of the table and choose Import from the shortcut menu. The Import page is displayed.

            2. In the Import dialog box, set the parameters based on Table 1.

              @@ -96,7 +95,7 @@

      Date Format

      This parameter is valid only when File Format is set to CSV or JSON.

      -

      This parameter specifies the format of the date in the table and is valid only Advanced Settings is selected. The default value is yyyy-MM-dd.

      +

      This parameter specifies the format of the date in the table and is valid only Advanced Settings is selected. The default value is yyyy-MM-dd. For definition of characters involved in the date pattern, see Table 3 in .

      2000-01-01

      Timestamp Format

      This parameter is valid only when File Format is set to CSV or JSON.

      -

      This parameter specifies the format of the timestamp in the table and is valid only Advanced Settings is selected. The default value is yyyy-MM-dd HH:mm:ss. For definition of characters involved in the time pattern, see Table 3 in the

      +

      This parameter specifies the format of the timestamp in the table and is valid only Advanced Settings is selected. The default value is yyyy-MM-dd HH:mm:ss. For definition of characters involved in the time pattern, see Table 3 in .

      2000-01-01 09:00:00

      + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
      Table 1 DLI operations that can be recorded by CTS

      Operation

      +

      Resource Type

      +

      Trace Name

      +

      Creating a database

      +

      database

      +

      createDatabase

      +

      Deleting a database

      +

      database

      +

      deleteDatabase

      +

      Modifying the Database Owner

      +

      database

      +

      alterDatabaseOwner

      +

      Creating a table

      +

      table

      +

      createTable

      +

      Deleting tables

      +

      table

      +

      deleteTable

      +

      Exporting table data

      +

      table

      +

      exportData

      +

      Importing table data

      +

      table

      +

      importData

      +

      Modifying the owner of a table

      +

      table

      +

      alterTableOwner

      +

      Creating a queue

      +

      queue

      +

      createQueue

      +

      Deleting a queue

      +

      queue

      +

      dropQueue

      +

      Granting permissions to a queue

      +

      queue

      +

      shareQueue

      +

      Modifying a Queue CIDR Block

      +

      queue

      +

      replaceQueue

      +

      Restarting a queue

      +

      queue

      +

      queueActions

      +

      Scaling out/in a queue

      +

      queue

      +

      queueActions

      +

      Submitting a job

      +

      queue

      +

      submitJob

      +

      Canceling a job

      +

      queue

      +

      cancelJob

      +

      Granting DLI the permission to access OBS buckets

      +

      obs

      +

      obsAuthorize

      +

      Checking the SQL syntax

      +

      job

      +

      checkSQL

      +

      Creating a job

      +

      job

      +

      createJob

      +

      Updating a job

      +

      job

      +

      updateJob

      +

      Deleting a job

      +

      job

      +

      deleteJob

      +

      Purchasing CUH packages

      +

      order

      +

      orderPackage

      +

      Freezing resources

      +

      resource

      +

      freezeResource

      +

      Unfreezing resources

      +

      resource

      +

      unfreezeResource

      +

      Terminating resources

      +

      resource

      +

      deleteResource

      +

      Clearing resources

      +

      resource

      +

      cleanResource

      +

      Granting data permissions

      +

      data

      +

      dataAuthorize

      +

      Granting permissions on other projects

      +

      data

      +

      authorizeProjectData

      +

      Exporting query results

      +

      data

      +

      storeJobResult

      +

      Saving a SQL template

      +

      sqlTemplate

      +

      saveSQLTemplate

      +

      Updating a SQL template

      +

      sqlTemplate

      +

      updateSQLTemplate

      +

      Deleting a SQL template

      +

      sqlTemplate

      +

      deleteSQLTemplate

      +

      Creating a Flink template

      +

      flinkTemplate

      +

      createStreamTemplate

      +

      Updating a Flink template

      +

      flinkTemplate

      +

      createStreamTemplate

      +

      Deleting a Flink template

      +

      flinkTemplate

      +

      deleteStreamTemplate

      +

      Creating a data upload task

      +

      uploader

      +

      createUploadJob

      +

      Obtaining the authentication to perform a data upload task

      +

      uploader

      +

      getUploadAuthInfo

      +

      Submitting a data upload task

      +

      uploader

      +

      commitUploadJob

      +

      Creating a datasource authentication and uploading a certificate

      +

      authInfo

      +

      uploadAuthInfo

      +

      Updating a datasource authentication

      +

      authInfo

      +

      updateAuthInfop

      +

      Deleting a datasource authentication

      +

      authInfo

      +

      deleteAuthInfo

      +

      Updating the quota

      +

      quota

      +

      updateQuota

      +

      Uploading a resource package

      +

      pkgResource

      +

      uploadResources

      +

      Deleting a resource package

      +

      pkgResource

      +

      deleteResource

      +

      Creating a basic datasource connection

      +

      datasource

      +

      createDatasourceConn

      +

      Deleting a basic datasource connection

      +

      datasource

      +

      deleteDatasourceConn

      +

      Reactivating a basic datasource connection

      +

      datasource

      +

      reactivateDSConnection

      +

      Creating an enhanced datasource connection

      +

      datasource

      +

      createConnection

      +

      Deleting an enhanced datasource connection

      +

      datasource

      +

      getConnection

      +

      Binding a queue

      +

      datasource

      +

      associateQueueToDatasourceConn

      +

      Unbinding a queue

      +

      datasource

      +

      disassociateQueueToDatasourceConn

      +

      Modifying the host information

      +

      datasource

      +

      updateHostInfo

      +

      Adding a route

      +

      datasource

      +

      addRoute

      +

      Deleting a route

      +

      datasource

      +

      deleteRoute

      +

      Creating a topic

      +

      smn

      +

      createTopic

      +

      Creating an agency

      +

      agency

      +

      createAgencyV2

      +

      Creating a batch processing job

      +

      batch

      +

      createBatch

      +

      Canceling a batch processing job

      +

      batch

      +

      cancelBatch

      +

      Creating a session

      +

      session

      +

      createSession

      +

      Deleting a session

      +

      session

      +

      deleteSession

      +

      Creating a statement

      +

      statement

      +

      createStatement

      +

      Canceling execution of a statement

      +

      statement

      +

      cancelStatement

      +

      Creating a global variable

      +

      globalVar

      +

      createGlobalVariable

      +

      Deleting a global variable

      +

      globalVar

      +

      deleteGlobalVariable

      +

      Modifying a global variable

      +

      globalVar

      +

      updateGlobalVariable

      +
      +
      +
    +
    +
    +
    Parent topic: Other Common Operations
    +
    +
    + diff --git a/docs/dli/umn/dli_01_0320.html b/docs/dli/umn/dli_01_0320.html index 06da4b319..a23561440 100644 --- a/docs/dli/umn/dli_01_0320.html +++ b/docs/dli/umn/dli_01_0320.html @@ -1,75 +1,47 @@

    SQL Editor

    -

    You can use SQL statements in the SQL job editor to execute data query. DLI supports SQL 2003 and complies with Spark SQL.

    -

    On the Overview page, click SQL Editor in the navigation pane on the left or Create Job in the upper right corner of the SQL Jobs pane. The SQL Editor page is displayed.

    -

    A message is displayed, indicating that a temporary DLI data bucket will be created. The created bucket is used to store temporary data generated by DLI, such as job logs. You cannot view job logs if you choose not to create it. You can to periodically delete objects in a bucket or transit objects between different storage classes. The bucket name is set by default.

    -

    If you do not need to create a DLI temporary data bucket and do not want to view this message, select Do not show again and click Cancel.

    -

    The SQL Editor page is composed of the following parts:

    -

    Navigation pane

    The navigation pane on the left consists of Databases, Queues, and Templates tabs. -
    Table 1 Navigation pane buttons

    No.

    +

    Introduction

    You can edit and run SQL statements in the SQL job editor to execute data query.

    +

    DLI supports SQL 2003 and complies with Spark SQL.

    +

    To access the SQL editor, click SQL Editor in the navigation pane on the left of the Overview page, or click Create Job in the upper right corner of the SQL Jobs pane. The SQL Editor page is displayed.

    +

    This topic describes the main functions of the SQL editor.

    +
    +

    Notes

    • When you go to the SQL editor page, a message will be displayed, indicating that a temporary DLI data bucket will be created. The created bucket is used to store temporary data generated by DLI, such as job logs.

      You cannot view job logs if you choose not to create the bucket. The bucket name will be set by the system.

      +

      On the OBS console, you can configure lifecycle rules for a bucket to periodically delete objects in it or change object storage classes.

      +
    +
    • SQL statements can be executed in batches on the SQL editor page.
    +
    • Commonly used keyworks in the job editing window are highlighted in different colors.
    • Both single-line comment and multi-line comment are allowed. Use two consecutive hyphens (--) in each line to comment your statements.
    +
    +

    Navigation pane

    The navigation pane on the left consists of Databases, Queues, and Templates tabs.

    +
    +
    - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - @@ -77,124 +49,105 @@ -

    SQL Editing Window

    The SQL job editing window is displayed in the upper right corner. The following describes the components of the window. -
    Table 1 Navigation pane buttons

    No.

    Tab/Button

    +

    Name

    Name

    -

    Description

    +

    Description

    1

    +

    1

    +

    Databases

    Databases

    -

    Displays all the existing databases and tables in these databases.

    +

    Displays all the existing databases and tables in these databases.

    • Click a database name to view the tables in the database.
    • Click a table name to view the metadata in the table. A maximum of 20 metadata records can be displayed.
    • After you double-click a table name, a SQL query statement is automatically entered in the editing window.

    2

    +

    2

    +

    Queues

    Queues

    -

    Displays existing queues.

    +

    Displays existing queues.

    3

    +

    3

    +

    Templates

    Templates

    -

    Click the drop-down button to view 22 built-in standard TPC-H query templates and custom templates.

    -

    4

    -

    -

    Create

    -

    Click the button on the related page to create a queue, database, or table. For details, see Creating a Queue and Creating a Database or a Table.

    -

    5

    -

    -

    Refresh

    -

    Click the button to refresh the existing queue, database, and table lists.

    -

    6

    -

    -

    Search

    -

    Enter a keyword to search for a database and table.

    +

    Click the drop-down button to view 22 built-in standard TPC-H query templates and custom templates.
    Table 2 Components of the SQL job editing window

    No.

    +

    SQL Editing Window

    SQL job editing window is displayed in the upper right part of the page.

    +

    The SQL statement editing area is below the operation bar. For details about keyboard shortcuts, see Table 3.

    +
    +
    - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
    Table 2 Components of the SQL job editing window

    No.

    Button

    +

    Button

    Description

    +

    Description

    2

    +

    2

    Queues

    +

    Queues

    Select a queue from the drop-down list box. If no queue is available, the default queue is displayed. Refer to Creating a Queue and create a queue.

    +

    Select a queue from the drop-down list box. If no queue is available, the default queue is displayed. Refer to Creating a Queue and create a queue.

    SQL jobs can be executed only on SQL queues.

    3

    +

    3

    Database

    +

    Database

    Select a database from the drop-down list box. If no database is available, the default database is displayed. For details about how to create a database, see section Creating a Database or a Table.

    +

    Select a database from the drop-down list box. If no database is available, the default database is displayed. For details about how to create a database, see Creating a Database or a Table.

    NOTE:

    If you specify the database in the SQL statements, the database you choose from the drop-down list will not be used.

    4

    +

    4

    Execute

    +

    Execute

    Click this button to run the SQL statements in the job editing window.

    +

    Click this button to run the SQL statements in the job editing window.

    5

    +

    5

    Format

    +

    Format

    Click this button to format the SQL statements.

    +

    Click this button to format the SQL statements.

    6

    +

    6

    Syntax Reference

    +

    Syntax Reference

    Click this button to view the Data Lake Insight SQL Syntax Reference.

    +

    Click this button to view the Data Lake Insight SQL Syntax Reference.

    7

    +

    7

    Settings

    +

    Settings

    Add parameters and tags.

    +

    Add parameters and tags.

    Parameter Settings: Set parameters in key/value format for SQL jobs.

    Tags: Set tags in key/value format for SQL jobs.

    8

    +

    8

    More

    +

    More

    The drop-down list includes the following options:

    -
    • Click Verify Syntax to check whether the SQL statements are correct.
    • Click Set as Template to set SQL statements as a template. For details, see SQL Template Management.
    • Click Change Theme to switch between dark and light modes.
    -

    9

    -

    SQL statement editing area

    -

    Area for you to write and edit SQL statements.

    -

    10

    -

    Cursor position

    -

    The line and column where the cursor is in the job editing area.

    -

    11

    -

    Shortcuts

    -

    For details, see Table 3.

    +

    The drop-down list includes the following options:

    +
    • Click Verify Syntax to check whether the SQL statements are correct.
    • Click Set as Template to set SQL statements as a template. For details, see Managing SQL Templates.
    • Click Change Theme to switch between dark and light modes.
    -
    Table 3 Keyboard shortcut description

    Shortcut

    +
    - - - - - - - - - - - @@ -202,93 +155,81 @@ -

    Execution Queries and View Result

    The Executed Queries (Last Day) and View Result tab pages are displayed in the lower part of the page.

    -
    • Executed Queries -
    Table 3 Keyboard shortcut description

    Shortcut

    Description

    +

    Description

    Ctrl+Enter

    +

    Ctrl+Enter

    Execute SQL statements. You can run SQL statements by pressing Ctrl+R or Ctrl + Enter on the keyboard.

    +

    Execute SQL statements. You can run SQL statements by pressing Ctrl+R or Ctrl + Enter on the keyboard.

    Ctrl+F

    +

    Ctrl+F

    Search for SQL statements. You can press Ctrl+F to search for a required SQL statement.

    +

    Search for SQL statements. You can press Ctrl+F to search for a required SQL statement.

    Shift+Alt+F

    +

    Shift+Alt+F

    Format SQL statements. You can press Shift + Alt + F to format a SQL statement.

    +

    Format SQL statements. You can press Shift + Alt + F to format a SQL statement.

    Ctrl+Q

    +

    Ctrl+Q

    Syntax verification. You can press Ctrl + Q to verify the syntax of SQL statements.

    +

    Syntax verification. You can press Ctrl + Q to verify the syntax of SQL statements.

    F11

    +

    F11

    Full screen. You can press F11 to display the SQL Job Editor window in full screen. Press F11 again to leave the full screen.

    +

    Full screen. You can press F11 to display the SQL Job Editor window in full screen. Press F11 again to leave the full screen.
    - - - - - - - -
    Table 4 Area description

    Area

    -

    Description

    -

    Executed Queries (Last Day)

    -
    Displays the latest daily information about the submitted jobs.
    • Queues: Queue name
    • Username: User who executes the SQL statements
    • Type: Type of the SQL job
    • Status: Execution status of the SQL job
    • Query
    • Created
    • Operation
      • Edit: Edit the SQL statement.
      • SparkUI: Switch to the SparkUI page to view the SQL statement execution process.
        NOTE:

        When you execute a job on a created queue, the cluster is restarted. It takes about 10 minutes. If you click SparkUI before the cluster is created, an empty projectID will be cached. The SparkUI page cannot be displayed. You are advised to use a dedicated queue so that the cluster will not be released. Alternatively, wait for a while after the job is submitted (the cluster is created), and then check SparkUI.

        -

        Currently, only the latest 100 job information records are displayed on the SparkUI of DLI.

        -

        This function is not supported for synchronization jobs and jobs running on the default queue.

        -
        -
      • More: The following operations vary depending on the SQL job types and running status.

        Cancel: Cancel a SQL job that is running or being submitted.

        -

        Re-execute: Execute the SQL statement again.

        -

        View Result: View the execution result of a QUERY job.

        -

        Export Result: Export the execution results of a QUERY job to a specified OBS path.

        -

        View Log: View the OBS path for storing SQL statement execution logs.

        -

        Export Log: Export SQL statement execution logs.

        -
        NOTE:

        To export the logs, you need to obtain the permission to create an OBS bucket.

        -

        View Log and Export Log buttons are not available for synchronization jobs and jobs running on the default queue.

        -
        -
      -
    -
    -
    -
    -

    You can filter the execution history in the following ways:

    +

    Execution Queries and View Result

    After the SQL job is executed, you can view the execution history and result in the lower part of the editing area.

    +
    • Executed Queries

      You can filter the execution history in the following ways:

      • In the search box in the upper right corner of the Executed Queries (Last Day) pane, select a queue name or enter an execution statement in the search box.
      • In the list, click the icon next to Created and choose Ascending or Descending.
      • Select a job status from the Status list.
      -
    -
    -
    • View Result -
      Table 5 Function description

      No.

      + +
      - - - - - - - - - - - - -
      Table 4 Area description

      Area

      Button

      -

      Description

      +

      Description

      1

      +

      Executed Queries (Last Day)

      Clear All

      -

      Clear the displayed SQL statement query results.

      -

      2

      -

      -

      Display the query result in a graph or table.

      -

      3

      -

      -

      Exports the query result to OBS. For details, see Exporting Query Results.

      -

      A maximum of 1000 records can be displayed in the query result on the console. To view more or all data, you can click Export Result to export the data to OBS.

      +
      The latest daily information about the submitted jobs, including the following items:
      • Queues: Queue name
      • Username: User who executes the SQL statements
      • Type: Type of the SQL job
      • Status: Execution status of the SQL job
      • Query
      • Created
      • Operation
        • Edit: Edit the SQL statement.
        • SparkUI: Switch to the SparkUI page to view the SQL statement execution process.
          NOTE:

          When you execute a job on a created queue, the cluster is restarted. It takes about 10 minutes. If you click SparkUI before the cluster is created, an empty projectID will be cached. The SparkUI page cannot be displayed. You are advised to use a dedicated queue so that the cluster will not be released. Alternatively, wait for a while after the job is submitted (the cluster is created), and then check SparkUI.

          +

          Currently, only the latest 100 job information records are displayed on the SparkUI of DLI.

          +

          This function is not supported for synchronization jobs and jobs running on the default queue.

          +
          +
        • More: The following operations vary depending on the SQL job types and running status.

          Cancel: Cancel a SQL job that is running or being submitted.

          +

          Re-execute: Execute the SQL statement again.

          +

          View Result: View the execution result of a QUERY job.

          +

          Export Result: Export the execution results of a QUERY job to a specified OBS path.

          +

          View Log: View the OBS path for storing SQL statement execution logs.

          +

          Export Log: Export SQL statement execution logs.

          +
          NOTE:

          To export the logs, you need to obtain the permission to create an OBS bucket.

          +

          View Log and Export Log buttons are not available for synchronization jobs and jobs running on the default queue.

          +
          +
        +
      +
      -

      SQL Query Procedure

      1. Log in to the Data Lake Insight management console, choose Job Management > SQL Jobs. In the displayed page, click Create Job to go to the SQL Editor page.
      2. After you enter the SQL Editor page, the system prompts you to create a temporary OBS bucket to store temporary data generated by DLI, such as job logs. You cannot view job logs if you choose not to create it. Click OK. The system displays a message indicating that the temporary bucket is created successfully.
      3. Select a queue from the queue list in the upper left corner of the SQL job editing window. For details about how to create a queue, see Creating a Queue.
      4. In the upper right corner of the SQL job editing window, select a database, for example, qw, from the Databases drop-down list.
      5. Create a table, for example, qw. For details about how to create a database and table, see Creating a Database or a Table.
      6. In the SQL job editing window, enter the following SQL statement:
        - diff --git a/docs/dli/umn/dli_01_0375.html b/docs/dli/umn/dli_01_0375.html index 07f02728c..14467bb11 100644 --- a/docs/dli/umn/dli_01_0375.html +++ b/docs/dli/umn/dli_01_0375.html @@ -1,43 +1,36 @@

        Creating and Submitting a Spark Jar Job

        -

        You can use DLI to submit Spark jobs for real-time computing. The general procedure is as follows:

        -

        Step 1: Logging in to the Cloud

        -

        Step 2: Uploading Data to OBS

        -

        Step 3: Logging In to the DLI Management Console

        -

        Step 4: Creating a Queue

        -

        Step 5: Creating a Package

        -

        Step 6: Submitting a Spark Job

        -

        Step 1: Logging in to the Cloud

        To use DLI, you need to log in to the cloud.

        +

        Scenarios

        DLI can query data stored in OBS. This section describes how to use a Spark Jar job on DLI to query OBS data in real time.

        -
        1. Open the DLI home page.
        2. On the login page, enter the username and password, and click Log In.
        -

        Step 2: Uploading Data to OBS

        Write a Spark Jar job program , and compile and package it as spark-examples.jar. Perform the following steps to submit the job:

        +

        Procedure

        You can use DLI to submit Spark jobs for real-time computing. The general procedure is as follows:

        +

        Step 1: Upload Data to OBS

        +

        Step 2: Create a Queue

        +

        Step 3: Create a Package

        +

        Step 4: Submit a Spark Job

        +
        +

        Step 1: Upload Data to OBS

        Write a Spark Jar job program , and compile and package it as spark-examples.jar. Perform the following steps to submit the job:

        Before submitting Spark Jar jobs, upload data files to OBS.

        -
        1. In the services displayed, click Object Storage Service (OBS) in Storage.
        2. The OBS console page is displayed.
        3. Create a bucket. The bucket name must be globally unique. In this example, assume that the bucket name is dli-test-obs01.
          1. Click Create Bucket.
          2. On the displayed Create Bucket page, enter the Bucket Name. Retain the default values for other parameters or set them as required.
          3. Click Create Now.
          +
          1. Log in to the DLI console.
          2. In the service list, click Object Storage Service under Storage. The OBS console page is displayed.
          3. Create a bucket. In this example, name it dli-test-obs01.
            1. Click Create Bucket.
            2. On the displayed Create Bucket page, enter the Bucket Name. Retain the default values for other parameters or set them as required.

              When creating an OBS bucket, you must select the same region as the DLI management console.

              +
              +
            3. Click Create Now.
          4. Click dli-test-obs01 to switch to the Overview page.
          5. From the left navigation tree, click Objects. Click Upload Object. In the displayed dialog box, drag files or folders to upload or add file to the file upload box, for example, spark-examples.jar. Then, click Upload.

            After the file is uploaded successfully, the file path is obs://dli-test-obs01/spark-examples.jar.

            -

            For more information about OBS operations, see the Object Storage Service Console Operation Guide.

            -

            For more information about the tool, see the OBS Tool Guide.

            -

            You are advised to use an OBS tool, such as OBS Browser+, to upload large files because OBS Console has restrictions on the file size and quantity.

            -
            • OBS Browser+ is a graphical tool that provides complete functions for managing your buckets and objects in OBS. You are advised to use this tool to create buckets or upload objects.
            +
            • For more information about OBS operations, see the Object Storage Service Console Operation Guide.
            • For more information about the tool, see the OBS Tool Guide.
            • You are advised to use an OBS tool, such as OBS Browser+, to upload large files because OBS Console has restrictions on the file size and quantity.
              • OBS Browser+ is a graphical tool that provides complete functions for managing your buckets and objects in OBS. You are advised to use this tool to create buckets or upload objects.
              +
        -

        Step 3: Logging In to the DLI Management Console

        To submit Spark jobs, you need to enter the Spark job creation page first.

        -
        1. In the list, choose .
        2. The DLI management console page is displayed.

          If you log in to the DLI management console for the first time, you need to be authorized to access OBS. For details, see "Service Authorization".

          -
          -
        -
        -

        Step 4: Creating a Queue

        If you submit a Spark job for the first time, you need to create a queue first. For example, create a queue named sparktest and set Queue Type to General Queue.

        -
        1. In the navigation pane of the DLI management console, choose Queue Management.
        2. In the upper right corner of the Queue Management page, click Create Queue to create a queue.
        3. Create a queue, name it sparktest, and set the queue usage to for general purpose. For details, see Creating a Queue.

          +

          Step 2: Create a Queue

          If you submit a Spark job for the first time, you need to create a queue first. For example, create a queue named sparktest and set Queue Type to General Queue.

          +
          1. Log in to the DLI management console.
          2. In the navigation pane of the DLI management console, choose Queue Management.
          3. In the upper right corner of the Queue Management page, click Create Queue to create a queue.
          4. Create a queue, name it sparktest, and set the queue usage to for general purpose. For details, see Creating a Queue.

          5. Click Create Now to create a queue.
          -

          Step 5: Creating a Package

          Before submitting a Spark job, you need to create a package, for example, spark-examples.jar.

          -
          1. In the navigation pane on the left of the DLI console, choose Data Management > Package Management.
          2. On the Package Management page, click Create in the upper right corner to create a package.
          3. In the Create Package dialog box, set Type to JAR, OBS Path to the path of the spark-examples.jar package in Step 2: Uploading Data to OBS, and Group to Do not use.

            +

            Step 3: Create a Package

            Before submitting a Spark job, you need to create a package, for example, spark-examples.jar.

            +
            1. In the navigation pane on the left of the DLI console, choose Data Management > Package Management.
            2. On the Package Management page, click Create in the upper right corner to create a package.
            3. In the Create Package dialog box, set Type to JAR, OBS Path to the path of the spark-examples.jar package in Step 1: Upload Data to OBS, and Group to Do not use.

            4. Click OK.

              You can view and select the package on the Package Management page.

            For details about how to create a package, see "Creating a Package".

            -

            Step 6: Submitting a Spark Job

            1. On the DLI management console, choose Job Management > Spark Jobs in the navigation pane on the left. On the displayed page, click Create Job.
            2. On the Spark job editing page, set Queues to the queue created in Step 4: Creating a Queue and Application to the package created in Step 5: Creating a Package.

              For details about other parameters, see the description of the Spark job editing page in "Creating a Spark Job".

              +

              Step 4: Submit a Spark Job

              1. On the DLI management console, choose Job Management > Spark Jobs in the navigation pane on the left. On the displayed page, click Create Job.
              2. On the Spark job editing page, set Queues to the queue created in Step 2: Create a Queue and Application to the package created in Step 3: Create a Package.

                For details about other parameters, see the description of the Spark job editing page in "Creating a Spark Job".

              3. Click Execute in the upper right corner of the Spark job editing window, read and agree to the privacy agreement, and click OK. Submit the job. A message is displayed, indicating that the job is submitted.

              4. (Optional) Switch to the Job Management > Spark Jobs page to view the status and logs of the submitted Spark job.

                When you click Execute on the DLI management console for the first time, you need to read the privacy agreement. Once agreed to the agreement, you will not receive any privacy agreement messages for subsequent operations.

                diff --git a/docs/dli/umn/dli_01_0377.html b/docs/dli/umn/dli_01_0377.html index b92ff84b1..2671fe2cb 100644 --- a/docs/dli/umn/dli_01_0377.html +++ b/docs/dli/umn/dli_01_0377.html @@ -1,91 +1,17 @@

                DLI Console Overview

                -

                Overview

                Log in to DLI and go to the Overview page.

                -

                The following table describes the functional areas of the Overview page.

                - -
        1
        SELECT * FROM qw.qw LIMIT 10;
+
        +
        • View Result +
          + + + + + + + + + + + + + +
          Table 5 Operations in the result tab

          Operation

          +

          Description

          +

          Clear the result

          +

          Clear the displayed SQL statement query results.

          +

          View chart/table

          +

          Click to view the query result in a chart or table.

          +

          Export the result

          +

          Click to export the query result to OBS. For details, see Exporting Query Results.

          +

          A maximum of 1000 records can be displayed in the query result on the console. To view more or all data, you can click Export Result to export the data to OBS.

          +
          +
          +
        +

        SQL Query Procedure

        1. Log in to the Data Lake Insight management console, choose Job Management > SQL Jobs. In the displayed page, click Create Job to go to the SQL Editor page.

          After you enter the SQL Editor page, the system prompts you to create a temporary OBS bucket to store temporary data generated by DLI, such as job logs. You cannot view job logs if you choose not to create it. Click OK. The system displays a message indicating that the temporary bucket is created successfully.

          +
          +
        2. Select a queue from the queue list in the upper left corner of the SQL job editing window. For details about how to create a queue, see Creating a Queue.
        3. In the upper right corner of the SQL job editing window, select a database, for example, qw, from the Databases drop-down list.
        4. Create a table, for example, qw. For details about how to create a database and table, see Creating a Database or a Table.
        5. In the SQL job editing window, enter the following SQL statement:
          1
          SELECT * FROM qw.qw LIMIT 10;

          Alternatively, you can double-click the table name qw. The query statement is automatically entered in the SQL job editing window.

        6. On top of the editing window, click More > Verify Syntax to check whether the SQL statement is correct.
          1. If the verification fails, check the SQL statement syntax by referring to Data Lake Insight SQL Syntax Reference.
          2. If the syntax verification is successful, click Execute. Read and agree to the privacy agreement. Click OK to execute the SQL statement.
          3. After the execution is complete, you can view the execution result in the area under the SQL job editing window.
          -
        7. (Optional) A maximum of 1000 records can be displayed in the query result on the current console. To view more or all data, click to export the data to OBS.

          -
        8. (Optional) In the View Result tab page, click in the upper right corner to display the result in a graph. Click to display the query result in a table.

          -
          • If no column of the numeric type is displayed in the execution result, the result cannot be represented in charts.
          • You can view the data in a bar chart, line chart, or fan chart.
          • In the bar chart and line chart, the X axis can be any column, while the Y axis can only be columns of the numeric type. The fan chart displays the corresponding legends and indicators.
          +
        9. (Optional) A maximum of 1000 records can be displayed in the query result on the current console. To view more or all data, click to export the data to OBS.
        10. (Optional) In the View Result tab, click to display the query result in a chart. Click to switch back to the table view.
          • If no column of the numeric type is displayed in the execution result, the result cannot be represented in charts.
          • You can view the data in a bar chart, line chart, or fan chart.
          • In the bar chart and line chart, the X axis can be any column, while the Y axis can only be columns of the numeric type. The fan chart displays the corresponding legends and indicators.
        -

        Operation Skills in the Job Editing Window

        • A simple method for importing SQL statements in the SQL job editing window:
          • Double-click a table name in the navigation pane on the left to import the query statement of the selected table into the SQL statement editing window, and then click Execute to query.
          • You can click More and choose Save as Template to save the SQL statement as a template for future use.

            To use the SQL statement template, click Templates from the left pane of the SQL editor page. Double-click the required template in the template list, and click Execute or modify it as required before executing the SQL statements.

            -

            -
          • SQL statements can be executed in batches.
          -
        • Features of the job editing window
          The job editing window has the following three features:
          • Highlighting: Statement keywords are highlighted.
          • Comment support: You can write comments in a single line or multiple lines. In each line, the comments follow two consecutive hyphens (--).
          • Cursor location display: After you click in a line in the job editing window, the location of your cursor in the job editing window, including the column number and line number, will be automatically displayed in the lower left corner of the window.
          -
          +

          Quickly Importing SQL Statements

          • Double-click a table name in the navigation pane on the left to import the query statement of the selected table into the SQL statement editing window, and then click Execute to query.
          • You can click More and choose Save as Template to save the SQL statement as a template for future use.

            To use the SQL statement template, click Templates from the left pane of the SQL editor page. Double-click the required template in the template list, and modify it as required before executing the SQL statements.

        diff --git a/docs/dli/umn/dli_01_0363.html b/docs/dli/umn/dli_01_0363.html index 58e280bc4..e55152384 100644 --- a/docs/dli/umn/dli_01_0363.html +++ b/docs/dli/umn/dli_01_0363.html @@ -24,7 +24,7 @@

        Type

        • For SQL: compute resources used for SQL jobs.
        • For general purpose: compute resources used for Spark and Flink jobs.
          NOTE:

          In Dedicated Resource Mode, you can create enhanced datasource connections.

          +
        • For SQL: compute resources used for SQL jobs.
        • For general purpose: compute resources used for Spark and Flink jobs.
        • NOTE:

          In Dedicated Resource Mode, you can create enhanced datasource connections.

        - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
        Table 1 Areas

        No.

        -

        Area

        -

        Description

        -

        1

        -

        Navigation pane

        -

        The navigation bar on the DLI management console, including Overview, SQL Editor, Job Management, Queue Management, Data Management, Job Templates, Datasource Connections, and Global Configuration.

        -

        2

        -

        DLI introduction

        -

        Data Lake Insight (DLI) is a fully hosted big data processing and analysis service. It frees you from managing any server. DLI supports standard SQL and is compatible with Spark and Flink SQL. It also supports multiple access modes, and is compatible with mainstream data formats.

        -

        3

        -

        Upper right corner

        -

        Click Create Queue to create a queue.

        -

        4

        -

        SQL job introduction

        -

        Click Create Job in this area to access the SQL Editor page. For details about how to create a package, see SQL Editor.

        -

        5

        -

        Flink job introduction

        -

        Click Create Job in this area to go to the Flink Jobs page. For details about how to create a package, see Flink Job Management.

        -

        6

        -

        Spark job introduction

        -

        Click Create Job in this area to access the Spark Jobs page. For details about how to create a Spark job, see Creating a Spark Job.

        -

        8

        -

        Queue usage (hours)

        -

        This area displays the usage of all queues of the last day, week, or month.

        -

        9

        -

        Selected queue usage (hours)

        -

        This area displays the usage of a queue in the last week or month.

        -

        10

        -

        Common links

        -

        Including:

        -
        • User Guide
        • API Reference
        • SDK Download
        -

        11

        -

        Get started in four simple steps

        -
        1. Create a queue
        2. Preparing data
        3. Editing and submitting a job
        4. Viewing job status
        -
        +

        The Overview page of the DLI console provides you with the DLI workflow and resource usage.

        +

        How to Use DLI

        The process of using DLI is as follows:

        +
        1. Create a queue.

          Queues are computing resources of DLI. There are queues for SQL jobs and for general purpose. You can submit Spark SQL jobs only to SQL queues, and Spark programs, Flink SQL jobs, and Flink Jar jobs to general queues.

          +
        2. Prepare data.

          Create databases and tables before you run a Spark SQL job. Upload a program package before you run a Spark job or a Flink Jar job.

          +
        3. Edit and submit a job.

          After you set the job parameters, you can submit the job.

          +
        4. View job status.

          Go to the Job Management page to view the job execution status.

          +

          +
        +

        Queue Usage (hours)

        The overview page provides usage durations of all queues or a specific queue.

        +
        • Usage Usage (hours): an overview of the usage of all resources.
        • Selected Queue Usage (hours): recent usage of a single queue.
        diff --git a/docs/dli/umn/dli_01_0378.html b/docs/dli/umn/dli_01_0378.html index 5b2a5346e..5d1791ae6 100644 --- a/docs/dli/umn/dli_01_0378.html +++ b/docs/dli/umn/dli_01_0378.html @@ -1,12 +1,12 @@ -

        DLI Introduction

        -

        What Is Data Lake Insight?

        Data Lake Insight (DLI) is a serverless data processing and analysis service fully compatible with Apache Spark and Apache Flink ecosystems. It frees you from managing any server.

        +

        What Is Data Lake Insight?

        +

        DLI Introduction

        Data Lake Insight (DLI) is a serverless data processing and analysis service fully compatible with Apache Spark and Apache Flink ecosystems. It frees you from managing any servers.

        DLI supports standard SQL and is compatible with Spark SQL and Flink SQL. It also supports multiple access modes, and is compatible with mainstream data formats. DLI supports SQL statements and Spark applications for heterogeneous data sources, including CloudTable, RDS, GaussDB(DWS), CSS, OBS, custom databases on ECSs, and offline databases.

        -

        Function Description

        You can query and analyze heterogeneous data sources such as RDS, and DWS on the cloud using access methods, such as visualized interface, RESTful API, JDBC, ODBC, and Beeline. The data format is compatible with five mainstream data formats: CSV, JSON, Parquet, and ORC.

        -