forked from docs/doc-exports
Su, Xiaomeng
66d959f7d2
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Su, Xiaomeng <suxiaomeng1@huawei.com> Co-committed-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
17 lines
4.0 KiB
HTML
17 lines
4.0 KiB
HTML
<a name="dli_08_15108"></a><a name="dli_08_15108"></a>
|
|
|
|
<h1 class="topictitle1">Flink OpenSource SQL 1.15 Usage</h1>
|
|
<div id="body0000001980818738"><p id="dli_08_15108__p1353602516336">When switching from Flink 1.12 to Flink 1.15 for job execution, keep in mind the following considerations when utilizing Flink OpenSource SQL 1.15:</p>
|
|
<ul id="dli_08_15108__ul122032311331"><li id="dli_08_15108__li126304551339">Flink SQL utilizes a SQL client submission method. To configure this submission method in Flink 1.15, you need to use the <strong id="dli_08_15108__b10135173782019">SET 'key'='value'</strong> command in your SQL script. This is different from the optimization parameters used in Flink 1.12. For details about the syntax, see <a href="https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/dev/table/sqlclient/" target="_blank" rel="noopener noreferrer">SQL Client Configuration</a>.</li><li id="dli_08_15108__li420316315330">The following Flink connectors are added to Flink 1.15: Doris Connector and Hive Connector. For details, see <a href="dli_08_15012.html">Overview</a>.</li><li id="dli_08_15108__li2220151643417">In Flink 1.15, you need to configure a custom agency on the tenant plane and configure agency information in the job. The permissions included an agency should be configured based on the specific service scenario requirements of the job. </li><li id="dli_08_15108__li1024712367126">Methods to manage credentials for Flink 1.15 jobs:<ul id="dli_08_15108__ul164580283139"><li id="dli_08_15108__li1203133118333">You are advised to use DEW to manage access credentials, such as passwords and keys, in Flink OpenSource SQL. </li><li id="dli_08_15108__li132034319334">Manage fixed AKs/SKs used by Flink Jar jobs to access OBS, temporary AKs/SKs used by Flink Jar jobs to obtain agencies, and temporary AKs/SKs used by Flink SQL UDFs to obtain agencies. </li></ul>
|
|
</li><li id="dli_08_15108__li154861389347">There are differences in the way Flink 1.15 Jar reads custom configuration files compared to Flink 1.12. </li><li id="dli_08_15108__li1020313312338">The Flink 1.15 Jar program uses a child-first reverse class loading mechanism. By setting the <strong id="dli_08_15108__b96251671551">parent.first.classloader.jars</strong> parameter to include the names of the desired jars, for example, <strong id="dli_08_15108__b1842105611554">test1.jar,test2.jar</strong>, certain dependency packages can be loaded by the parent class loader.</li><li id="dli_08_15108__li11734930191620">For the built-in JAR file list of Flink 1.15 Jar, obtain information about Flink 1.15 dependency packages from Flink job logs.<ol id="dli_08_15108__ol126781114181617"><li id="dli_08_15108__li3678101419168">Check the logs of a Flink job.<ol type="a" id="dli_08_15108__ol16679111441612"><li id="dli_08_15108__li13679414171615">Log in to the DLI management console. In the navigation pane on the left, choose <strong id="dli_08_15108__b15644154310582">Job Management</strong> > <strong id="dli_08_15108__b156441743205814">Flink Jobs</strong>.</li><li id="dli_08_15108__li1667911419166">Click the name of the desired job. On the displayed page, click the <strong id="dli_08_15108__b313151075914">Run Log</strong> tab.</li><li id="dli_08_15108__li067931410169">Check the latest run logs. For more logs, check the OBS bucket where the job logs are stored.</li></ol>
|
|
</li><li id="dli_08_15108__li2679151420165">Search for dependency information in the logs.<p id="dli_08_15108__p9679111414168"><a name="dli_08_15108__li2679151420165"></a><a name="li2679151420165"></a>Search for <strong id="dli_08_15108__b6852113145919">Classpath:</strong> in the logs to check the dependencies.</p>
|
|
</li></ol>
|
|
</li><li id="dli_08_15108__li9958173512259">Flink 1.15 no longer supports DLI package management. To upload dependency packages and files, select the OBS path directly when editing the job.</li></ul>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_08_15000.html">Flink OpenSource SQL 1.15 Syntax Reference</a></div>
|
|
</div>
|
|
</div>
|
|
|