forked from docs/doc-exports
Su, Xiaomeng
04ae6632a7
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: Su, Xiaomeng <suxiaomeng1@huawei.com> Co-committed-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
908 lines
80 KiB
HTML
908 lines
80 KiB
HTML
<a name="dli_02_0124"></a><a name="dli_02_0124"></a>
|
|
|
|
<h1 class="topictitle1">Creating a Batch Processing Job</h1>
|
|
<div id="body8662426"><div class="section" id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_s1f0e4fd3d502405199f36f78e68721aa"><h4 class="sectiontitle">Function</h4><p id="dli_02_0124__en-us_topic_0103343302_p28958103151626">This API is used to create a batch processing job in a queue.</p>
|
|
<div class="note" id="dli_02_0124__note17368145781814"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_02_0124__p077216294153">During the Spark job submission process, if the job fails to acquire resources successfully for an extended period, the job status will change to <strong id="dli_02_0124__b4363173217556">dead</strong> after waiting for approximately 3 hours. For details about Spark job statuses, see <a href="#dli_02_0124__en-us_topic_0103343302_table16701351161919">Table 7</a>.</p>
|
|
</div></div>
|
|
</div>
|
|
<div class="section" id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_s9e1b8ec5b57c422a942b19835da7d66e"><h4 class="sectiontitle">URI</h4><ul id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077927_ul10082125"><li id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077927_li23630265">URI format<p id="dli_02_0124__en-us_topic_0103343302_p37583371151729"><a name="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077927_li23630265"></a><a name="en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077927_li23630265"></a>POST /v2.0/{project_id}/batches</p>
|
|
</li><li id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_li1725612218454">Parameter descriptions
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077803_table60779388" frame="border" border="1" rules="all"><caption><b>Table 1 </b>URI parameter</caption><thead align="left"><tr id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077803_row61411666"><th align="left" class="cellrowborder" valign="top" width="13.41%" id="mcps1.3.2.2.2.1.2.5.1.1"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_a420a62a594f9410eaea229ffc8037a61">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="11.73%" id="mcps1.3.2.2.2.1.2.5.1.2"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077803_p873025824211">Mandatory</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="12.76%" id="mcps1.3.2.2.2.1.2.5.1.3"><p id="dli_02_0124__p4661929163816">Type</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="62.1%" id="mcps1.3.2.2.2.1.2.5.1.4"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_a692d3cd97b464aed90ba6d841900a4a5">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077803_row48589216"><td class="cellrowborder" valign="top" width="13.41%" headers="mcps1.3.2.2.2.1.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077803_p43412436">project_id</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.73%" headers="mcps1.3.2.2.2.1.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_en-us_topic_0069077803_p26746391">Yes</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="12.76%" headers="mcps1.3.2.2.2.1.2.5.1.3 "><p id="dli_02_0124__p1266122917382">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="62.1%" headers="mcps1.3.2.2.2.1.2.5.1.4 "><p id="dli_02_0124__p12841111193519"><strong id="dli_02_0124__b3680857514059">Definition</strong></p>
|
|
<p id="dli_02_0124__p18513202722714">Project ID, which is used for resource isolation. For how to obtain a project ID, see <a href="dli_02_0183.html">Obtaining a Project ID</a>.</p>
|
|
<p id="dli_02_0124__p476513559276">Example: <strong id="dli_02_0124__b203358078642759">48cc2c48765f481480c7db940d6409d1</strong></p>
|
|
<p id="dli_02_0124__p1779921913513"><strong id="dli_02_0124__b5182619154114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p16166233143510">None</p>
|
|
<p id="dli_02_0124__p19789423113517"><strong id="dli_02_0124__b2071518036416">Range</strong></p>
|
|
<p id="dli_02_0124__p20527112713361">The value can contain 1 to 64 characters. Only letters and digits are allowed.</p>
|
|
<p id="dli_02_0124__p1049772653519"><strong id="dli_02_0124__b5942754814749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p6928441113513">None</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</li></ul>
|
|
</div>
|
|
<div class="section" id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_section20458182103"><h4 class="sectiontitle">Request Parameters</h4>
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_table1944164663513" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Request parameters</caption><thead align="left"><tr id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_row29441446113518"><th align="left" class="cellrowborder" valign="top" width="17.46%" id="mcps1.3.3.2.2.5.1.1"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_p1935161415364">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="11.4%" id="mcps1.3.3.2.2.5.1.2"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_p1036131419366">Mandatory</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="16.17%" id="mcps1.3.3.2.2.5.1.3"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_p17381114123617">Type</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="54.97%" id="mcps1.3.3.2.2.5.1.4"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_p1340121413614">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dli_02_0124__en-us_topic_0103343302_row42140185151841"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p56138383151841">file</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_p50915163151841">Yes</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p30487499151841">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p14391114919239"><strong id="dli_02_0124__b9643417014059">Definition</strong></p>
|
|
<p id="dli_02_0124__p1539264932316">Name of the package that is of the JAR or pyFile type and has been uploaded to the DLI resource management system.</p>
|
|
<p id="dli_02_0124__p793418915295">You can also specify an OBS path, for example, <strong id="dli_02_0124__b10463173612113">obs://</strong><em id="dli_02_0124__i4463103612116">Bucket name</em><strong id="dli_02_0124__b10463163611114">/</strong><em id="dli_02_0124__i144636368116">Package name</em>.</p>
|
|
<p id="dli_02_0124__p1339212491238"><strong id="dli_02_0124__b13875468464114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p845651720914">Spark 3.3.<em id="dli_02_0124__i16408194412510">x</em> or later supports only packages in OBS paths.</p>
|
|
<p id="dli_02_0124__p183928496232"><strong id="dli_02_0124__b431123734416">Range</strong></p>
|
|
<p id="dli_02_0124__p439294972316">None</p>
|
|
<p id="dli_02_0124__p239218496238"><strong id="dli_02_0124__b8998114214749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p9392184962317">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__en-us_topic_0103343302_row27860897151841"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p35630586151841">className</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_p396334151841">Yes</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p32103087151841">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p6301629122611"><strong id="dli_02_0124__b17148345184059">Definition</strong></p>
|
|
<p id="dli_02_0124__p4620173814291">Java/Spark main class of the batch processing job</p>
|
|
<p id="dli_02_0124__p730629182612"><strong id="dli_02_0124__b10142774794114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p193072952614">None</p>
|
|
<p id="dli_02_0124__p113062982615"><strong id="dli_02_0124__b1448750715416">Range</strong></p>
|
|
<p id="dli_02_0124__p13022918266">None</p>
|
|
<p id="dli_02_0124__p18304291265"><strong id="dli_02_0124__b21198919294749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p03052992611">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__en-us_topic_0103343302_row25465276151841"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p171410613012">queue</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p717261002">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p191816209">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p1413113732618"><strong id="dli_02_0124__b13942196854059">Definition</strong></p>
|
|
<p id="dli_02_0124__p1417618602611">Queue name. Set this parameter to the name of the created DLI queue. The queue must be of the general-purpose type.</p>
|
|
<p id="dli_02_0124__p6131379262"><strong id="dli_02_0124__b14808952954114">Constraints</strong></p>
|
|
<ul id="dli_02_0124__ul4167717202719"><li id="dli_02_0124__li131675177275">This parameter is compatible with the <strong id="dli_02_0124__b14989190192315">cluster_name</strong> parameter. That is, if <strong id="dli_02_0124__b415513412313">cluster_name</strong> is used to specify a queue, the queue is still valid.</li><li id="dli_02_0124__li116811710273">The <strong id="dli_02_0124__b18879172013610">queue</strong> parameter is recommended. If <strong id="dli_02_0124__b387952012361">queue</strong> and <strong id="dli_02_0124__b1187918203366">cluster_name</strong> are both set, the value of <strong id="dli_02_0124__b113224410386">queue</strong> is used.</li></ul>
|
|
<p id="dli_02_0124__p151323712618"><strong id="dli_02_0124__b658181281416">Range</strong></p>
|
|
<p id="dli_02_0124__p1413133717262">None</p>
|
|
<p id="dli_02_0124__p113113732620"><strong id="dli_02_0124__b859376064749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p81316373262">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row153511293916"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p171410613012">cluster_name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p717261002">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p191816209">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p5535144432611"><strong id="dli_02_0124__b7015740674059">Definition</strong></p>
|
|
<p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p41911613013">Queue name. Set this parameter to the created DLI queue name.</p>
|
|
<p id="dli_02_0124__p1453584414261"><strong id="dli_02_0124__b20364015204114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p9704122114376">You are advised to use the <strong id="dli_02_0124__b5449517714">queue</strong> parameter. The <strong id="dli_02_0124__b8450217712">queue</strong> and <strong id="dli_02_0124__b124501117712">cluster_name</strong> parameters cannot coexist.</p>
|
|
<p id="dli_02_0124__p1953513442264"><strong id="dli_02_0124__b199805280416">Range</strong></p>
|
|
<p id="dli_02_0124__p553510446267">None</p>
|
|
<p id="dli_02_0124__p1753515449263"><strong id="dli_02_0124__b9352678034749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p1553564415267">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__en-us_topic_0103343302_row5518185484813"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p5519175474817">args</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_p951914544484">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p11519165417484">Array of strings</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p74201495263"><strong id="dli_02_0124__b9084922064059">Definition</strong></p>
|
|
<p id="dli_02_0124__en-us_topic_0103343302_p2519754174819">Input parameters of the main class, that is, application parameters.</p>
|
|
<p id="dli_02_0124__p4420749132615"><strong id="dli_02_0124__b8503348694114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p19420114912261">None</p>
|
|
<p id="dli_02_0124__p15420174919263"><strong id="dli_02_0124__b449807632416">Range</strong></p>
|
|
<p id="dli_02_0124__p13420204913262">None</p>
|
|
<p id="dli_02_0124__p12421164982616"><strong id="dli_02_0124__b4933284504749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p242114932610">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__en-us_topic_0103343302_row47568717151841"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p1620267012">sc_type</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p15211969014">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p1222668011">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p1068611531265"><strong id="dli_02_0124__b4726651454059">Definition</strong></p>
|
|
<p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p14241762015">Compute resource type. Currently, resource types A, B, and C are available. If this parameter is not specified, the minimum configuration (type A) is used. For details about resource types, see <a href="#dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_table1656812183429">Table 3</a>.</p>
|
|
<p id="dli_02_0124__p1268612533262"><strong id="dli_02_0124__b6337571854114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p19686135382619">None</p>
|
|
<p id="dli_02_0124__p36867532262"><strong id="dli_02_0124__b1962007283416">Range</strong></p>
|
|
<p id="dli_02_0124__p14686165332612">None</p>
|
|
<p id="dli_02_0124__p3686853122620"><strong id="dli_02_0124__b437841514749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p106861536263">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__en-us_topic_0103343302_row57481196151841"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p1259614019">jars</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p6265617019">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p926765018">Array of strings</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p186221655102620"><strong id="dli_02_0124__b14140835144059">Definition</strong></p>
|
|
<p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p1729269015">Name of the package that is of the JAR type and has been uploaded to the DLI resource management system. You can also specify an OBS path, for example, <strong id="dli_02_0124__b779035511509">obs://</strong><em id="dli_02_0124__i179116559501">Bucket name</em><strong id="dli_02_0124__b579111556504">/</strong><em id="dli_02_0124__i1179285505012">Package name</em>.</p>
|
|
<p id="dli_02_0124__p13622155572613"><strong id="dli_02_0124__b3051622174114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p8622155122620">None</p>
|
|
<p id="dli_02_0124__p4622115502615"><strong id="dli_02_0124__b170695953416">Range</strong></p>
|
|
<p id="dli_02_0124__p1862205515267">None</p>
|
|
<p id="dli_02_0124__p12622165518261"><strong id="dli_02_0124__b1803366344749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p7622055122610">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__en-us_topic_0103343302_row58582582151841"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p2072111261753">pyFiles</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p172482381686">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p122491138782">Array of strings</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p94821758142619"><strong id="dli_02_0124__b1305969504059">Definition</strong></p>
|
|
<p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p13251183811817">Name of the package that is of the PyFile type and has been uploaded to the DLI resource management system. You can also specify an OBS path, for example, <strong id="dli_02_0124__b13679456175015">obs://</strong><em id="dli_02_0124__i186791256175013">Bucket name</em><strong id="dli_02_0124__b1367905625012">/</strong><em id="dli_02_0124__i268017568506">Package name</em>.</p>
|
|
<p id="dli_02_0124__p4482155842613"><strong id="dli_02_0124__b5453741544114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p13482058132618">None</p>
|
|
<p id="dli_02_0124__p1248245812266"><strong id="dli_02_0124__b1501896421416">Range</strong></p>
|
|
<p id="dli_02_0124__p1548235817268">None</p>
|
|
<p id="dli_02_0124__p0482185882614"><strong id="dli_02_0124__b9197144174749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p54823586264">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__en-us_topic_0103343302_row1349812204465"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p4655202164617">files</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_p265762113466">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p126581621164614">Array of strings</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p123871910275"><strong id="dli_02_0124__b7696814574059">Definition</strong></p>
|
|
<p id="dli_02_0124__en-us_topic_0103343302_p265912124618">Name of the package that is of the file type and has been uploaded to the DLI resource management system. You can also specify an OBS path, for example, <strong id="dli_02_0124__b20927135665020">obs://</strong><em id="dli_02_0124__i39271856155013">Bucket name</em><strong id="dli_02_0124__b092795617502">/</strong><em id="dli_02_0124__i149281560503">Package name</em>.</p>
|
|
<p id="dli_02_0124__p1938791172717"><strong id="dli_02_0124__b10251749394114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p133871419277">None</p>
|
|
<p id="dli_02_0124__p1738710119276"><strong id="dli_02_0124__b624000258416">Range</strong></p>
|
|
<p id="dli_02_0124__p63875118277">None</p>
|
|
<p id="dli_02_0124__p12387614275"><strong id="dli_02_0124__b16738130704749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p938701132718">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row139937181292"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p0966333424">modules</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p149672331823">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p8967143313219">Array of strings</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p123611552276"><strong id="dli_02_0124__b2496025254059">Definition</strong></p>
|
|
<p id="dli_02_0124__p43611058278">Name of the dependency system resource module. You can check the module name using the <a href="dli_02_0172.html">Querying Resource Packages in a Group (Deprecated)</a> API.</p>
|
|
<p id="dli_02_0124__p6361115132719"><strong id="dli_02_0124__b420550874114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p1836114510271">None</p>
|
|
<p id="dli_02_0124__p83611459276"><strong id="dli_02_0124__b545823598416">Range</strong></p>
|
|
<div class="p" id="dli_02_0124__p231983472818">DLI provides dependencies for executing datasource jobs. The following table lists the dependency modules corresponding to different services.<ul id="dli_02_0124__ul863182613314"><li id="dli_02_0124__li1763926193110">CloudTable/MRS HBase: sys.datasource.hbase</li><li id="dli_02_0124__li1631426183116">CloudTable/MRS OpenTSDB: sys.datasource.opentsdb</li><li id="dli_02_0124__li206392643113">RDS MySQL: sys.datasource.rds</li><li id="dli_02_0124__li36362611311">RDS Postgre: preset</li><li id="dli_02_0124__li46319265318">DWS: preset</li><li id="dli_02_0124__li96372663114">CSS: sys.datasource.css</li></ul>
|
|
</div>
|
|
<p id="dli_02_0124__p1536155152710"><strong id="dli_02_0124__b12089241084749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p0361852271">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__en-us_topic_0103343302_row13965716151841"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p20306616013">resources</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p1130196707">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p831867011">Array of objects</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p38351680277"><strong id="dli_02_0124__b18567314284059">Definition</strong></p>
|
|
<p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p53236406">JSON object list, including the name and type of the JSON package that has been uploaded to the queue. For details, see <a href="#dli_02_0124__table31211426423">Table 4</a>.</p>
|
|
<p id="dli_02_0124__p583518892719"><strong id="dli_02_0124__b19624333044114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p7106232185715">Spark 3.3.<em id="dli_02_0124__i8484304612">x</em> or later does not support this parameter. Configure resource package information in <strong id="dli_02_0124__b157915591618">jars</strong>, <strong id="dli_02_0124__b229672876">pyFiles</strong>, and <strong id="dli_02_0124__b923517412715">files</strong>.</p>
|
|
<p id="dli_02_0124__p38354892714"><strong id="dli_02_0124__b1166838847416">Range</strong></p>
|
|
<p id="dli_02_0124__p188351881279">None</p>
|
|
<p id="dli_02_0124__p17835789276"><strong id="dli_02_0124__b9841089554749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p11835081276">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row11806152817332"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p14911912182916">groups</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p991111232912">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p9911712192920">Array of objects</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p8161812132719"><strong id="dli_02_0124__b19684271984059">Definition</strong></p>
|
|
<p id="dli_02_0124__p1291161282919">JSON object list, including the package group resource. For details about the format, see the request example. If the type of the <span class="parmname" id="dli_02_0124__parmname6759125312019"><b>name</b></span> in <span class="parmname" id="dli_02_0124__parmname14290164720011"><b>resources</b></span> is not verified, the package with the name exists in the group. For details, see <a href="#dli_02_0124__table1212244016391">Table 5</a>.</p>
|
|
<p id="dli_02_0124__p171611216273"><strong id="dli_02_0124__b19484929234114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p122691019019">Spark 3.3.<em id="dli_02_0124__i22105411569">x</em> or later does not support group information configuration.</p>
|
|
<p id="dli_02_0124__p141621219271"><strong id="dli_02_0124__b115991273416">Range</strong></p>
|
|
<p id="dli_02_0124__p5162012142715">None</p>
|
|
<p id="dli_02_0124__p181641222712"><strong id="dli_02_0124__b15612563074749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p4162121273">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__en-us_topic_0103343302_row31377908151841"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p2679424131411">conf</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p9679152441416">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p480955018467">Object</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p1779231562718"><strong id="dli_02_0124__b18783861334059">Definition</strong></p>
|
|
<p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902454_p106793241146"><strong id="dli_02_0124__b723815935913">Batch</strong> configuration item.</p>
|
|
<p id="dli_02_0124__p10792115122720"><strong id="dli_02_0124__b617475974114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p17792161512275">None</p>
|
|
<p id="dli_02_0124__p11792101542714"><strong id="dli_02_0124__b1422006287416">Range</strong></p>
|
|
<p id="dli_02_0124__p11792161514273">None</p>
|
|
<p id="dli_02_0124__p147921915122716"><strong id="dli_02_0124__b5564397434749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p579217159274">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__en-us_topic_0103343302_row1974423311228"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p19358384119">name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_p6921124161213">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p16351838111114">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p172721018142714"><strong id="dli_02_0124__b5806629164059">Definition</strong></p>
|
|
<p id="dli_02_0124__en-us_topic_0103343302_p1351338101118">Batch processing task name. The value contains a maximum of 128 characters.</p>
|
|
<p id="dli_02_0124__p927215187277"><strong id="dli_02_0124__b5228000264114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p82721618142714">None</p>
|
|
<p id="dli_02_0124__p82729182274"><strong id="dli_02_0124__b2020559666416">Range</strong></p>
|
|
<p id="dli_02_0124__p1927221862718">None</p>
|
|
<p id="dli_02_0124__p327220186277"><strong id="dli_02_0124__b1881652694749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p10272018192716">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row1856225185616"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p1872916192153">driverMemory</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p37291819191513">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p1072961910153">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p108927208277"><strong id="dli_02_0124__b10988126474059">Definition</strong></p>
|
|
<p id="dli_02_0124__p13731131971510">Driver memory of the Spark application, for example, <strong id="dli_02_0124__b913104616583">2 GB</strong> and <strong id="dli_02_0124__b10137164612587">2048 MB</strong>. This configuration will replace the default settings in <strong id="dli_02_0124__b92311234104012">sc_type</strong>. When using it, you must include the unit, otherwise it will fail to start.</p>
|
|
<p id="dli_02_0124__p12892620202714"><strong id="dli_02_0124__b5698726674114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p148922209278">None</p>
|
|
<p id="dli_02_0124__p10892182052719"><strong id="dli_02_0124__b657641090416">Range</strong></p>
|
|
<p id="dli_02_0124__p118921920112717">None</p>
|
|
<p id="dli_02_0124__p158928206276"><strong id="dli_02_0124__b7216337314749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p189218201275">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row556219518561"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p1873121915158">driverCores</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p473111199152">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p10731141910154">Integer</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p4358192314276"><strong id="dli_02_0124__b1823861534059">Definition</strong></p>
|
|
<p id="dli_02_0124__p14731119101519">Number of CPU cores of the Spark application driver. This configuration item replaces the default parameter in <strong id="dli_02_0124__b842352706172957">sc_type</strong>.</p>
|
|
<p id="dli_02_0124__p1435811230275"><strong id="dli_02_0124__b16229808494114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p11358122315275">None</p>
|
|
<p id="dli_02_0124__p1135815232275"><strong id="dli_02_0124__b938857101416">Range</strong></p>
|
|
<p id="dli_02_0124__p335811236272">None</p>
|
|
<p id="dli_02_0124__p133581623152714"><strong id="dli_02_0124__b3059924844749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p133581123152712">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row25629514566"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p7731519131518">executorMemory</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p11731219141517">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p873151991511">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p887702552710"><strong id="dli_02_0124__b9362844604059">Definition</strong></p>
|
|
<p id="dli_02_0124__p1073141910152">Executor memory of the Spark application, for example, <strong id="dli_02_0124__b1995145015581">2 GB</strong> and <strong id="dli_02_0124__b1610185017584">2048 MB</strong>. This configuration will replace the default settings in <strong id="dli_02_0124__b44969399459">sc_type</strong>. When using it, you must include the unit, otherwise it will fail to start.</p>
|
|
<p id="dli_02_0124__p12877152572717"><strong id="dli_02_0124__b14963181514114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p98773257279">None</p>
|
|
<p id="dli_02_0124__p687772552711"><strong id="dli_02_0124__b35844965416">Range</strong></p>
|
|
<p id="dli_02_0124__p58771625102716">None</p>
|
|
<p id="dli_02_0124__p387732542716"><strong id="dli_02_0124__b12693648564749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p88772025182719">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row10562175175616"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p19731819141510">executorCores</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p6731161911152">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p11731101919159">Integer</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p737012285275"><strong id="dli_02_0124__b6178043434059">Definition</strong></p>
|
|
<p id="dli_02_0124__p173111194155">Number of CPU cores of each Executor in the Spark application. This configuration item replaces the default parameter in <strong id="dli_02_0124__b216111168811">sc_type</strong>.</p>
|
|
<p id="dli_02_0124__p173707287279"><strong id="dli_02_0124__b4296653344114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p113707288277">None</p>
|
|
<p id="dli_02_0124__p5370228192710"><strong id="dli_02_0124__b2017417583416">Range</strong></p>
|
|
<p id="dli_02_0124__p5370228162716">None</p>
|
|
<p id="dli_02_0124__p173709288271"><strong id="dli_02_0124__b7272344434749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p123701828202714">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row19563135114568"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p11657103111512">numExecutors</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p156571131161513">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p1657183112158">Integer</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p15581830152717"><strong id="dli_02_0124__b12712082374059">Definition</strong></p>
|
|
<p id="dli_02_0124__p15657163113153">Number of Executors in a Spark application. This configuration item replaces the default parameter in <strong id="dli_02_0124__b2055621052">sc_type</strong>.</p>
|
|
<p id="dli_02_0124__p16581153012717"><strong id="dli_02_0124__b15222364514114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p858193014278">None</p>
|
|
<p id="dli_02_0124__p1458153062713"><strong id="dli_02_0124__b1130999208416">Range</strong></p>
|
|
<p id="dli_02_0124__p758123062711">None</p>
|
|
<p id="dli_02_0124__p458117305279"><strong id="dli_02_0124__b8644631914749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p1958143092713">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row93444526208"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p143445520209">obs_bucket</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p20344115212207">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p1434515215206">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p157681532152720"><strong id="dli_02_0124__b799598654059">Definition</strong></p>
|
|
<p id="dli_02_0124__p83451526207">OBS bucket for storing the Spark jobs. Set this parameter when you need to save jobs.</p>
|
|
<p id="dli_02_0124__p9768133213279"><strong id="dli_02_0124__b714426594114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p14768532122713">None</p>
|
|
<p id="dli_02_0124__p11768183218276"><strong id="dli_02_0124__b267925584416">Range</strong></p>
|
|
<p id="dli_02_0124__p676813326277">None</p>
|
|
<p id="dli_02_0124__p12768932202712"><strong id="dli_02_0124__b20185020574749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p19768133214270">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row115382611461"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p145384664618">auto_recovery</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p1853917674613">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p14539106204614">Boolean</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p171091935102718"><strong id="dli_02_0124__b8417156844059">Definition</strong></p>
|
|
<p id="dli_02_0124__p953906144618">Whether to enable the retry function. If enabled, Spark jobs will be automatically retried after an exception occurs. The default value is <strong id="dli_02_0124__b19261192713554">false</strong>.</p>
|
|
<p id="dli_02_0124__p910913520276"><strong id="dli_02_0124__b18792453944114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p1310917352277">None</p>
|
|
<p id="dli_02_0124__p1109203519275"><strong id="dli_02_0124__b2080734334416">Range</strong></p>
|
|
<p id="dli_02_0124__p10109035182717">None</p>
|
|
<p id="dli_02_0124__p1410953517279"><strong id="dli_02_0124__b19484400124749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p4109203511275">false</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row13539146114617"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p1753918619465">max_retry_times</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p17539963467">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p145391863464">Integer</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p255812373279"><strong id="dli_02_0124__b6566229144059">Definition</strong></p>
|
|
<p id="dli_02_0124__p115394684613">Maximum retry times. The maximum value is <strong id="dli_02_0124__b10856173719552">100</strong>, and the default value is <strong id="dli_02_0124__b879794055516">20</strong>.</p>
|
|
<p id="dli_02_0124__p9558173712273"><strong id="dli_02_0124__b16185385124114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p145581137192712">None</p>
|
|
<p id="dli_02_0124__p1558837182718"><strong id="dli_02_0124__b100341052416">Range</strong></p>
|
|
<p id="dli_02_0124__p16558113732714">None</p>
|
|
<p id="dli_02_0124__p1255863762717"><strong id="dli_02_0124__b20751659314749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p15558193712279">20</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row155021239144912"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p148061031114015">execution_agency_urn</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p38351058144015">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p483515587401">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p107532509276"><strong id="dli_02_0124__b7435307194059">Definition</strong></p>
|
|
<p id="dli_02_0124__p1780610316406">Name of the agency authorized to DLI. This parameter is configurable in Spark 3.3.1.</p>
|
|
<p id="dli_02_0124__p167531650122716"><strong id="dli_02_0124__b39638744114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p14754185019273">None</p>
|
|
<p id="dli_02_0124__p1375425016277"><strong id="dli_02_0124__b1209181824416">Range</strong></p>
|
|
<p id="dli_02_0124__p8754125062710">None</p>
|
|
<p id="dli_02_0124__p18754250202711"><strong id="dli_02_0124__b7306497524749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p147543508277">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row5290141873118"><td class="cellrowborder" valign="top" width="17.46%" headers="mcps1.3.3.2.2.5.1.1 "><p id="dli_02_0124__p229041816318">catalog_name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.4%" headers="mcps1.3.3.2.2.5.1.2 "><p id="dli_02_0124__p15291818143114">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.17%" headers="mcps1.3.3.2.2.5.1.3 "><p id="dli_02_0124__p82911318143115">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.97%" headers="mcps1.3.3.2.2.5.1.4 "><p id="dli_02_0124__p10118115610274"><strong id="dli_02_0124__b27394264059">Definition</strong></p>
|
|
<p id="dli_02_0124__p142917188319">To access metadata, set this parameter to <strong id="dli_02_0124__b314882611411">dli</strong>.</p>
|
|
<p id="dli_02_0124__p311895682719"><strong id="dli_02_0124__b8610722924114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p151181056112711">None</p>
|
|
<p id="dli_02_0124__p1011875614271"><strong id="dli_02_0124__b1986489570416">Range</strong></p>
|
|
<p id="dli_02_0124__p11184567274">None</p>
|
|
<p id="dli_02_0124__p171184565273"><strong id="dli_02_0124__b8317061504749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p5118145602717">None</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
|
|
<div class="tablenoborder"><a name="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_table1656812183429"></a><a name="en-us_topic_0103343292_en-us_topic_0102902454_table1656812183429"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_table1656812183429" frame="border" border="1" rules="all"><caption><b>Table 3 </b>Resource types</caption><thead align="left"><tr id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_row1656811816422"><th align="left" class="cellrowborder" valign="top" width="9.080000000000002%" id="mcps1.3.3.3.2.8.1.1"><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p4558132410427">Resource Type</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="13.970000000000002%" id="mcps1.3.3.3.2.8.1.2"><p id="dli_02_0124__en-us_topic_0103343292_p6651820612">Physical Resource</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="13.660000000000002%" id="mcps1.3.3.3.2.8.1.3"><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p1656242494217">driverCores</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="16.300000000000004%" id="mcps1.3.3.3.2.8.1.4"><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p9564192494215">executorCores</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="14.780000000000001%" id="mcps1.3.3.3.2.8.1.5"><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p155668246423">driverMemory</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="17.160000000000004%" id="mcps1.3.3.3.2.8.1.6"><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p5570124184218">executorMemory</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="15.050000000000002%" id="mcps1.3.3.3.2.8.1.7"><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p1357210241429">numExecutor</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_row2056814184423"><td class="cellrowborder" valign="top" width="9.080000000000002%" headers="mcps1.3.3.3.2.8.1.1 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p35751124204210">A</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.3.3.2.8.1.2 "><p id="dli_02_0124__en-us_topic_0103343292_p106613203119">8 vCPUs, 32 GB memory</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="13.660000000000002%" headers="mcps1.3.3.3.2.8.1.3 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p1857717243428">2</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.300000000000004%" headers="mcps1.3.3.3.2.8.1.4 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p105791243427">1</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="14.780000000000001%" headers="mcps1.3.3.3.2.8.1.5 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p1458242412426">7 GB</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="17.160000000000004%" headers="mcps1.3.3.3.2.8.1.6 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p658562484219">4 GB</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15.050000000000002%" headers="mcps1.3.3.3.2.8.1.7 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p65871024164212">6</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_row11568718144211"><td class="cellrowborder" valign="top" width="9.080000000000002%" headers="mcps1.3.3.3.2.8.1.1 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p65911024114213">B</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.3.3.2.8.1.2 "><p id="dli_02_0124__en-us_topic_0103343292_p633880217">16 vCPUs, 64 GB memory</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="13.660000000000002%" headers="mcps1.3.3.3.2.8.1.3 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p20592624134213">2</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.300000000000004%" headers="mcps1.3.3.3.2.8.1.4 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p13594202411428">2</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="14.780000000000001%" headers="mcps1.3.3.3.2.8.1.5 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p1859632413429">7 GB</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="17.160000000000004%" headers="mcps1.3.3.3.2.8.1.6 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p19599324114218">8 GB</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15.050000000000002%" headers="mcps1.3.3.3.2.8.1.7 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p2602124164215">7</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_row45681518114212"><td class="cellrowborder" valign="top" width="9.080000000000002%" headers="mcps1.3.3.3.2.8.1.1 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p1760622434216">C</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.3.3.2.8.1.2 "><p id="dli_02_0124__en-us_topic_0103343292_p19794198826">32 vCPUs, 128 GB memory</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="13.660000000000002%" headers="mcps1.3.3.3.2.8.1.3 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p18608524104211">4</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.300000000000004%" headers="mcps1.3.3.3.2.8.1.4 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p6609152415425">2</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="14.780000000000001%" headers="mcps1.3.3.3.2.8.1.5 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p8611224204210">15 GB</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="17.160000000000004%" headers="mcps1.3.3.3.2.8.1.6 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p10614124134214">8 GB</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15.050000000000002%" headers="mcps1.3.3.3.2.8.1.7 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p161532410428">14</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
|
|
<div class="tablenoborder"><a name="dli_02_0124__table31211426423"></a><a name="table31211426423"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_02_0124__table31211426423" frame="border" border="1" rules="all"><caption><b>Table 4 </b>resources parameters</caption><thead align="left"><tr id="dli_02_0124__row1413164210425"><th align="left" class="cellrowborder" valign="top" width="17.130000000000003%" id="mcps1.3.3.4.2.5.1.1"><p id="dli_02_0124__p10136427425">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="26.35%" id="mcps1.3.3.4.2.5.1.2"><p id="dli_02_0124__p0131142124214">Mandatory</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="25.77%" id="mcps1.3.3.4.2.5.1.3"><p id="dli_02_0124__p1313164213421">Type</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="30.75%" id="mcps1.3.3.4.2.5.1.4"><p id="dli_02_0124__p161304213425">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dli_02_0124__row1913042124211"><td class="cellrowborder" valign="top" width="17.130000000000003%" headers="mcps1.3.3.4.2.5.1.1 "><p id="dli_02_0124__p81314422426">name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="26.35%" headers="mcps1.3.3.4.2.5.1.2 "><p id="dli_02_0124__p1713144214218">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="25.77%" headers="mcps1.3.3.4.2.5.1.3 "><p id="dli_02_0124__p113144214427">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="30.75%" headers="mcps1.3.3.4.2.5.1.4 "><p id="dli_02_0124__p19129175293919"><strong id="dli_02_0124__b19609046364059">Definition</strong></p>
|
|
<p id="dli_02_0124__p161314426427">Resource name You can also specify an OBS path, for example, <strong id="dli_02_0124__b3266641145116">obs://</strong><em id="dli_02_0124__i427115415519">Bucket name</em><strong id="dli_02_0124__b15271104116515">/</strong><em id="dli_02_0124__i4271941165116">Package name</em>.</p>
|
|
<p id="dli_02_0124__p612917528392"><strong id="dli_02_0124__b16452628484114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p131294529399">None</p>
|
|
<p id="dli_02_0124__p4129195213393"><strong id="dli_02_0124__b1264395369416">Range</strong></p>
|
|
<p id="dli_02_0124__p10129165219396">None</p>
|
|
<p id="dli_02_0124__p112965223912"><strong id="dli_02_0124__b21165170974749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p512915263918">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row71304214423"><td class="cellrowborder" valign="top" width="17.130000000000003%" headers="mcps1.3.3.4.2.5.1.1 "><p id="dli_02_0124__p1813194214429">type</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="26.35%" headers="mcps1.3.3.4.2.5.1.2 "><p id="dli_02_0124__p1414042114216">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="25.77%" headers="mcps1.3.3.4.2.5.1.3 "><p id="dli_02_0124__p161444224217">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="30.75%" headers="mcps1.3.3.4.2.5.1.4 "><p id="dli_02_0124__p10418175410397"><strong id="dli_02_0124__b7365441534059">Definition</strong></p>
|
|
<p id="dli_02_0124__p1214042144220">Resource type.</p>
|
|
<p id="dli_02_0124__p24182543393"><strong id="dli_02_0124__b18875818584114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p1641835413397">None</p>
|
|
<p id="dli_02_0124__p174181544392"><strong id="dli_02_0124__b1390753904416">Range</strong></p>
|
|
<p id="dli_02_0124__p19418354133911">None</p>
|
|
<p id="dli_02_0124__p11418175453914"><strong id="dli_02_0124__b15119282844749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p0418165473911">None</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
|
|
<div class="tablenoborder"><a name="dli_02_0124__table1212244016391"></a><a name="table1212244016391"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_02_0124__table1212244016391" frame="border" border="1" rules="all"><caption><b>Table 5 </b>groups parameters</caption><thead align="left"><tr id="dli_02_0124__row7123164093915"><th align="left" class="cellrowborder" valign="top" width="13.969999999999999%" id="mcps1.3.3.5.2.5.1.1"><p id="dli_02_0124__p28418154407">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="15.27%" id="mcps1.3.3.5.2.5.1.2"><p id="dli_02_0124__p118410151401">Mandatory</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="18.740000000000002%" id="mcps1.3.3.5.2.5.1.3"><p id="dli_02_0124__p14841315124018">Type</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="52.019999999999996%" id="mcps1.3.3.5.2.5.1.4"><p id="dli_02_0124__p118431511400">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dli_02_0124__row1612415402393"><td class="cellrowborder" valign="top" width="13.969999999999999%" headers="mcps1.3.3.5.2.5.1.1 "><p id="dli_02_0124__p11311532134319">name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15.27%" headers="mcps1.3.3.5.2.5.1.2 "><p id="dli_02_0124__p63111332104314">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="18.740000000000002%" headers="mcps1.3.3.5.2.5.1.3 "><p id="dli_02_0124__p1731219324431">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="52.019999999999996%" headers="mcps1.3.3.5.2.5.1.4 "><p id="dli_02_0124__p734515175425"><strong id="dli_02_0124__b1671400804059">Definition</strong></p>
|
|
<p id="dli_02_0124__p6892534134419">User group name</p>
|
|
<p id="dli_02_0124__p103451617194212"><strong id="dli_02_0124__b7450515024114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p2034551712421">None</p>
|
|
<p id="dli_02_0124__p33456176425"><strong id="dli_02_0124__b481651085416">Range</strong></p>
|
|
<p id="dli_02_0124__p173451817134212">None</p>
|
|
<p id="dli_02_0124__p1834517177422"><strong id="dli_02_0124__b297282254749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p1634591720428">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row111251404396"><td class="cellrowborder" valign="top" width="13.969999999999999%" headers="mcps1.3.3.5.2.5.1.1 "><p id="dli_02_0124__p031217328439">resources</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15.27%" headers="mcps1.3.3.5.2.5.1.2 "><p id="dli_02_0124__p531253224317">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="18.740000000000002%" headers="mcps1.3.3.5.2.5.1.3 "><p id="dli_02_0124__p16312113294318">Array of objects</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="52.019999999999996%" headers="mcps1.3.3.5.2.5.1.4 "><p id="dli_02_0124__p632651954214"><strong id="dli_02_0124__b15457638164059">Definition</strong></p>
|
|
<p id="dli_02_0124__p152845004411">User group resource For details, see <a href="#dli_02_0124__table31211426423">Table 4</a>.</p>
|
|
<p id="dli_02_0124__p153263191427"><strong id="dli_02_0124__b18328861894114">Constraints</strong></p>
|
|
<p id="dli_02_0124__p0326119154210">None</p>
|
|
<p id="dli_02_0124__p6326519174217"><strong id="dli_02_0124__b573346218416">Range</strong></p>
|
|
<p id="dli_02_0124__p1326201912426">None</p>
|
|
<p id="dli_02_0124__p7326131916423"><strong id="dli_02_0124__b18239000104749">Default Value</strong></p>
|
|
<p id="dli_02_0124__p532671924210">None</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_sd1ecb66580054b2ea403be8b2272a2c7"><h4 class="sectiontitle">Response Parameters</h4>
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_table1391425172812" frame="border" border="1" rules="all"><caption><b>Table 6 </b>Response parameters</caption><thead align="left"><tr id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_row239272520282"><th align="left" class="cellrowborder" valign="top" width="13.970000000000002%" id="mcps1.3.4.2.2.5.1.1"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_p73934250283">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="11.870000000000001%" id="mcps1.3.4.2.2.5.1.2"><p id="dli_02_0124__p1874917140152">Mandatory</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="18.28%" id="mcps1.3.4.2.2.5.1.3"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_p93931525182819">Type</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="55.88000000000001%" id="mcps1.3.4.2.2.5.1.4"><p id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_p339412542814">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dli_02_0124__en-us_topic_0103343302_row30137760152012"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p49479537152012">id</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p5749111412154">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p48419590152012">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p193684019424"><strong id="dli_02_0124__b15339664384059">Definition</strong></p>
|
|
<p id="dli_02_0124__en-us_topic_0103343302_p29672740152012">ID of a batch processing job.</p>
|
|
<p id="dli_02_0124__p09361340134218"><strong id="dli_02_0124__b573682158416">Range</strong></p>
|
|
<p id="dli_02_0124__p79361640154216">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row1715520461916"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p53400622152012">appId</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p175091410153">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p30483143152012">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p2852145354216"><strong id="dli_02_0124__b14235029384059">Definition</strong></p>
|
|
<p id="dli_02_0124__en-us_topic_0103343302_p53215488152012">Back-end application ID of a batch processing job.</p>
|
|
<p id="dli_02_0124__p10852853134215"><strong id="dli_02_0124__b837653305416">Range</strong></p>
|
|
<p id="dli_02_0124__p16852125317423">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row12104169121916"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__p1093121011518">name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p1693111105515">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__p1893119108518">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p26910552428"><strong id="dli_02_0124__b13743222424059">Definition</strong></p>
|
|
<p id="dli_02_0124__p11931510256">Batch processing task name. The value contains a maximum of 128 characters.</p>
|
|
<p id="dli_02_0124__p18691655154217"><strong id="dli_02_0124__b1737419634416">Range</strong></p>
|
|
<p id="dli_02_0124__p186945513427">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row284815473574"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p9567203491719">owner</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p971613132910">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p856703421714">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p989475611423"><strong id="dli_02_0124__b7966576774059">Definition</strong></p>
|
|
<p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p1556713421713">Owner of a batch processing job.</p>
|
|
<p id="dli_02_0124__p14894195644213"><strong id="dli_02_0124__b1035793716416">Range</strong></p>
|
|
<p id="dli_02_0124__p138941756134215">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row10710796586"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p85671734141718">proxyUser</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p071791122914">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p13567183431711">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p18950115774216"><strong id="dli_02_0124__b1444403044059">Definition</strong></p>
|
|
<p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p6567133420178">Proxy user (resource tenant) to which a batch processing job belongs.</p>
|
|
<p id="dli_02_0124__p995035716427"><strong id="dli_02_0124__b1957871291416">Range</strong></p>
|
|
<p id="dli_02_0124__p49501057154219">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__en-us_topic_0103343302_row40631342152012"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p22373378152012">state</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p1750314181515">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p304348152012">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p13246185911421"><strong id="dli_02_0124__b18407939394059">Definition</strong></p>
|
|
<p id="dli_02_0124__en-us_topic_0103343302_p24652218152012">Status of a batch processing job. For details, see <a href="#dli_02_0124__en-us_topic_0103343302_table16701351161919">Table 7</a>.</p>
|
|
<p id="dli_02_0124__p19247145910426"><strong id="dli_02_0124__b194048360416">Range</strong></p>
|
|
<p id="dli_02_0124__p62471597424">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__en-us_topic_0103343302_row64166917152012"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__p1667115691116">kind</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p471712117295">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p556793417178">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p7660100114314"><strong id="dli_02_0124__b3019898634059">Definition</strong></p>
|
|
<p id="dli_02_0124__en-us_topic_0103343292_en-us_topic_0102902454_p65676340174">Type of a batch processing job. Only Spark parameters are supported.</p>
|
|
<p id="dli_02_0124__p1366090154310"><strong id="dli_02_0124__b1499319653416">Range</strong></p>
|
|
<p id="dli_02_0124__p16608034319">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__en-us_topic_0103343302_row57958994152012"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p61787004152012">log</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p475051411159">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p38691391152012">Array of strings</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p1783811437"><strong id="dli_02_0124__b12227709444059">Definition</strong></p>
|
|
<p id="dli_02_0124__en-us_topic_0103343302_p46995004152012">Last 10 records of the current batch processing job.</p>
|
|
<p id="dli_02_0124__p07831111434"><strong id="dli_02_0124__b1733455651416">Range</strong></p>
|
|
<p id="dli_02_0124__p87831111437">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row174513588123"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__p41226725615">sc_type</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p14750101491511">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__p412210718560">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p1282014718012"><strong id="dli_02_0124__b12136147674059">Definition</strong></p>
|
|
<p id="dli_02_0124__p573095413395">Compute resource type. Currently, the value can be <strong id="dli_02_0124__b16321132872612">A</strong>, <strong id="dli_02_0124__b932116282268">B</strong>, or <strong id="dli_02_0124__b6321328162616">C</strong>. If the compute resource type is customized, value <strong id="dli_02_0124__b465793382615">CUSTOMIZED</strong> is returned.</p>
|
|
<p id="dli_02_0124__p12820134714017"><strong id="dli_02_0124__b1381712522260">Range</strong></p>
|
|
<ul id="dli_02_0124__ul633940171310"><li id="dli_02_0124__li1933104019139"><strong id="dli_02_0124__b115851554182616">A</strong>: physical resources, with 8 vCPUs and 32 GB of memory<ul id="dli_02_0124__ul556343131310"><li id="dli_02_0124__li173334012137">driverCores: 2;</li><li id="dli_02_0124__li1133164012137">executorCores: 1;</li><li id="dli_02_0124__li143316405139">driverMemory: 7G;</li><li id="dli_02_0124__li23314021316">executorMemory: 4G;</li><li id="dli_02_0124__li633194091314">numExecutor: 6.</li></ul>
|
|
</li><li id="dli_02_0124__li1933640101313"><strong id="dli_02_0124__b14482972716">B</strong>: physical resources, with 16 vCPUs and 64 GB of memory<ul id="dli_02_0124__ul8984748151314"><li id="dli_02_0124__li7984194812136">driverCores: 2;</li><li id="dli_02_0124__li598410485137">executorCores: 2;</li><li id="dli_02_0124__li998419488135">driverMemory: 7G;</li><li id="dli_02_0124__li2984448131316">executorMemory: 8G;</li><li id="dli_02_0124__li1398494851314">numExecutor: 7.</li></ul>
|
|
</li><li id="dli_02_0124__li163354020139"><strong id="dli_02_0124__b1570312163279">C</strong>: physical resources, with 32 vCPUs and 128 GB of memory<ul id="dli_02_0124__ul131671056151319"><li id="dli_02_0124__li8388105371317">driverCores: 4;</li><li id="dli_02_0124__li538815316131">executorCores: 2;</li><li id="dli_02_0124__li173881453181312">driverMemory: 15G;</li><li id="dli_02_0124__li153881153111317">executorMemory: 8G;</li><li id="dli_02_0124__li113887535136">numExecutor: 14.</li></ul>
|
|
</li></ul>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row2667120171313"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__p8993199175614">cluster_name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p5750161414153">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__p4993999566">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p1155812419438"><strong id="dli_02_0124__b20490810454059">Definition</strong></p>
|
|
<p id="dli_02_0124__p1099316912566">Queue where a batch processing job is located.</p>
|
|
<p id="dli_02_0124__p1955818484317"><strong id="dli_02_0124__b522565948416">Range</strong></p>
|
|
<p id="dli_02_0124__p255817484311">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row1393123914012"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__p129317396016">queue</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p69917153316">Yes</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__p16996151310">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p9186121510436"><strong id="dli_02_0124__b17912636174059">Definition</strong></p>
|
|
<p id="dli_02_0124__p29991517312">Queue name. Set this parameter to the name of the created DLI queue.</p>
|
|
<ul id="dli_02_0124__ul18114132334415"><li id="dli_02_0124__li13997151537">This parameter is compatible with the <strong id="dli_02_0124__b90017342">cluster_name</strong> parameter. That is, if <strong id="dli_02_0124__b1393295212">cluster_name</strong> is used to specify a queue, the queue is still valid.</li><li id="dli_02_0124__li1511462374416">You are advised to use the <strong id="dli_02_0124__b559172581714">queue</strong> parameter. The <strong id="dli_02_0124__b9591162510174">queue</strong> and <strong id="dli_02_0124__b35915258174">cluster_name</strong> parameters cannot coexist.</li></ul>
|
|
<p id="dli_02_0124__p1575342713445"><strong id="dli_02_0124__b919413611416">Range</strong></p>
|
|
<p id="dli_02_0124__p1818651594317">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row47742308113823"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__p41921755113823">create_time</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p47501914151513">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__p40219023113823">Long</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p8769019194313"><strong id="dli_02_0124__b1455009544059">Definition</strong></p>
|
|
<p id="dli_02_0124__p36515431113823">Time when a batch processing job is created. The timestamp is in milliseconds.</p>
|
|
<p id="dli_02_0124__p476971994312"><strong id="dli_02_0124__b1507562020416">Range</strong></p>
|
|
<p id="dli_02_0124__p137701719104317">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row1542185572918"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__p1954285562913">update_time</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p115431555122913">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__p45437552294">Long</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p148241121154315"><strong id="dli_02_0124__b13427118734059">Definition</strong></p>
|
|
<p id="dli_02_0124__p19543145512915">Time when a batch processing job is updated. The timestamp is in milliseconds.</p>
|
|
<p id="dli_02_0124__p138244211439"><strong id="dli_02_0124__b1537434366416">Range</strong></p>
|
|
<p id="dli_02_0124__p19824521154317">None</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row17132185716314"><td class="cellrowborder" valign="top" width="13.970000000000002%" headers="mcps1.3.4.2.2.5.1.1 "><p id="dli_02_0124__p32369184237">duration</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.870000000000001%" headers="mcps1.3.4.2.2.5.1.2 "><p id="dli_02_0124__p323681852313">No</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="18.28%" headers="mcps1.3.4.2.2.5.1.3 "><p id="dli_02_0124__p12236918162310">Long</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="55.88000000000001%" headers="mcps1.3.4.2.2.5.1.4 "><p id="dli_02_0124__p1790414237437"><strong id="dli_02_0124__b4679980574059">Definition</strong></p>
|
|
<p id="dli_02_0124__p923731815236">Job running duration, in milliseconds.</p>
|
|
<p id="dli_02_0124__p090452310434"><strong id="dli_02_0124__b90123617416">Range</strong></p>
|
|
<p id="dli_02_0124__p149042023174312">None</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
|
|
<div class="tablenoborder"><a name="dli_02_0124__en-us_topic_0103343302_table16701351161919"></a><a name="en-us_topic_0103343302_table16701351161919"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_02_0124__en-us_topic_0103343302_table16701351161919" frame="border" border="1" rules="all"><caption><b>Table 7 </b>Batch processing job statuses</caption><thead align="left"><tr id="dli_02_0124__en-us_topic_0103343302_row1670615114198"><th align="left" class="cellrowborder" valign="top" width="19.8%" id="mcps1.3.4.3.2.4.1.1"><p id="dli_02_0124__en-us_topic_0103343302_p97084513196">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="11.76%" id="mcps1.3.4.3.2.4.1.2"><p id="dli_02_0124__en-us_topic_0103343302_p1271095120195">Type</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="68.44%" id="mcps1.3.4.3.2.4.1.3"><p id="dli_02_0124__en-us_topic_0103343302_p20711105141911">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dli_02_0124__en-us_topic_0103343302_row11712165171920"><td class="cellrowborder" valign="top" width="19.8%" headers="mcps1.3.4.3.2.4.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p75311359151918">starting</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.76%" headers="mcps1.3.4.3.2.4.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_p2024084872012">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="68.44%" headers="mcps1.3.4.3.2.4.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p353325971910">The batch processing job is being started.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__en-us_topic_0103343302_row471945112192"><td class="cellrowborder" valign="top" width="19.8%" headers="mcps1.3.4.3.2.4.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p155363596193">running</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.76%" headers="mcps1.3.4.3.2.4.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_p924064814204">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="68.44%" headers="mcps1.3.4.3.2.4.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p15386594193">The batch processing job is executing a task.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__en-us_topic_0103343302_row1972725120192"><td class="cellrowborder" valign="top" width="19.8%" headers="mcps1.3.4.3.2.4.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p1054119599194">dead</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.76%" headers="mcps1.3.4.3.2.4.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_p1523811485203">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="68.44%" headers="mcps1.3.4.3.2.4.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p1754365915191">The batch processing job has exited.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__en-us_topic_0103343302_row1973445112193"><td class="cellrowborder" valign="top" width="19.8%" headers="mcps1.3.4.3.2.4.1.1 "><p id="dli_02_0124__en-us_topic_0103343302_p115451559101920">success</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.76%" headers="mcps1.3.4.3.2.4.1.2 "><p id="dli_02_0124__en-us_topic_0103343302_p162373486205">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="68.44%" headers="mcps1.3.4.3.2.4.1.3 "><p id="dli_02_0124__en-us_topic_0103343302_p18547959161910">The batch processing job is successfully executed.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row124898049219"><td class="cellrowborder" valign="top" width="19.8%" headers="mcps1.3.4.3.2.4.1.1 "><p id="dli_02_0124__p4871875792112">recovering</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="11.76%" headers="mcps1.3.4.3.2.4.1.2 "><p id="dli_02_0124__p5390521192112">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="68.44%" headers="mcps1.3.4.3.2.4.1.3 "><p id="dli_02_0124__p579570539219">The batch processing job is being restored.</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="dli_02_0124__section1217010661112"><h4 class="sectiontitle">Example Request</h4><p id="dli_02_0124__p8896124319415">Create a Spark job. Set the Spark main class of the job to <strong id="dli_02_0124__b1630091315559">org.apache.spark.examples.SparkPi</strong>, specify the program package to <strong id="dli_02_0124__b14449235135518">batchTest/spark-examples_2.11-2.1.0.luxor.jar</strong>, and load the program package whose type is <strong id="dli_02_0124__b1390522101016">jar</strong> and the resource package whose type is <strong id="dli_02_0124__b43014373103">files</strong>.</p>
|
|
<pre class="screen" id="dli_02_0124__en-us_topic_0103343302_screen706141715215">{
|
|
"file": "batchTest/spark-examples_2.11-2.1.0.luxor.jar",
|
|
"className": "org.apache.spark.examples.SparkPi",
|
|
"sc_type": "A",
|
|
"jars": ["demo-1.0.0.jar"],
|
|
"files": ["count.txt"],
|
|
"resources":[
|
|
{"name": "groupTest/testJar.jar", "type": "jar"},
|
|
{"name": "kafka-clients-0.10.0.0.jar", "type": "jar"}],
|
|
"groups": [
|
|
{"name": "groupTestJar", "resources": [{"name": "testJar.jar", "type": "jar"}, {"name": "testJar1.jar", "type": "jar"}]},
|
|
{"name": "batchTest", "resources": [{"name": "luxor.jar", "type": "jar"}]}],
|
|
"queue": " test",
|
|
"name": "TestDemo4"
|
|
|
|
"execution_agency_urn": "myAgencyName",
|
|
|
|
}</pre>
|
|
<div class="note" id="dli_02_0124__en-us_topic_0103343302_note48113336152111"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="dli_02_0124__en-us_topic_0103343302_p58663258152128">The <strong id="dli_02_0124__b19369555268">batchTest/spark-examples_2.11-2.1.0.luxor.jar</strong> file has been uploaded through API involved in <a href="dli_02_0130.html">Uploading a Package Group (Deprecated)</a>.</p>
|
|
</div></div>
|
|
</div>
|
|
<div class="section" id="dli_02_0124__en-us_topic_0103343302_en-us_topic_0102902523_section17446171164041"><h4 class="sectiontitle">Example Response</h4><pre class="screen" id="dli_02_0124__en-us_topic_0103343302_screen63729817152224">{
|
|
"id": "07a3e4e6-9a28-4e92-8d3f-9c538621a166",
|
|
"appId": "",
|
|
"name": "",
|
|
"owner": "test1",
|
|
"proxyUser": "",
|
|
"state": "starting",
|
|
"kind": "",
|
|
"log": [],
|
|
"sc_type": "CUSTOMIZED",
|
|
"cluster_name": "aaa",
|
|
"queue": "aaa",
|
|
"create_time": 1607589874156,
|
|
"update_time": 1607589874156
|
|
}</pre>
|
|
</div>
|
|
<div class="section" id="dli_02_0124__sf39cfd445ad24e9e82754fcb0027179d"><h4 class="sectiontitle">Status Codes</h4><p id="dli_02_0124__a04144ca3a08e4576b386c6a98f43a2ae"><a href="#dli_02_0124__tb12870f1c5f24b27abd55ca24264af36">Table 8</a> describes status codes.</p>
|
|
|
|
<div class="tablenoborder"><a name="dli_02_0124__tb12870f1c5f24b27abd55ca24264af36"></a><a name="tb12870f1c5f24b27abd55ca24264af36"></a><table cellpadding="4" cellspacing="0" summary="" id="dli_02_0124__tb12870f1c5f24b27abd55ca24264af36" frame="border" border="1" rules="all"><caption><b>Table 8 </b>Status codes</caption><thead align="left"><tr id="dli_02_0124__r8d54231f95b14c01a5e55e95f3b2e838"><th align="left" class="cellrowborder" valign="top" width="30%" id="mcps1.3.7.3.2.3.1.1"><p id="dli_02_0124__ab49d21f312644072a331f43e92baf853">Status Code</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="70%" id="mcps1.3.7.3.2.3.1.2"><p id="dli_02_0124__aea1d3bd107bb4c499da79a88832d256c">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dli_02_0124__r211ad4eb571d4d938e5579998723174e"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.7.3.2.3.1.1 "><p id="dli_02_0124__a3153e07b3a9749adba92599fe6628fbf">200</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.7.3.2.3.1.2 "><p id="dli_02_0124__p104431642124811">The job is created successfully.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row44937531727"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.7.3.2.3.1.1 "><p id="dli_02_0124__p184941532219">400</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.7.3.2.3.1.2 "><p id="dli_02_0124__p2049413539219">Request error.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dli_02_0124__row65331212142411"><td class="cellrowborder" valign="top" width="30%" headers="mcps1.3.7.3.2.3.1.1 "><p id="dli_02_0124__p5537171216249">500</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="70%" headers="mcps1.3.7.3.2.3.1.2 "><p id="dli_02_0124__p953813124249">Internal server error.</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="dli_02_0124__section13596141025715"><h4 class="sectiontitle">Error Codes</h4><p id="dli_02_0124__p420584425712">If an error occurs when this API is called, the system does not return the result similar to the preceding example, but returns an error code and error message. For details, see <a href="dli_02_0056.html">Error Codes</a>.</p>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dli_02_0109.html">Spark Job-related APIs</a></div>
|
|
</div>
|
|
</div>
|
|
|