forked from docs/doc-exports
chenxiaoxiong
f9e2808b7c
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: chenxiaoxiong <chenxiaoxiong@huawei.com> Co-committed-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
108 lines
21 KiB
HTML
108 lines
21 KiB
HTML
<a name="dataartsstudio_07_006"></a><a name="dataartsstudio_07_006"></a>
|
|
|
|
<h1 class="topictitle1">Notes and Constraints</h1>
|
|
<div id="body1555916447705"><div class="section" id="dataartsstudio_07_006__section11512122132311"><h4 class="sectiontitle">Browser Constraints</h4><div class="p" id="dataartsstudio_07_006__p128091534162313">The following table lists the recommended browser for logging in to <span id="dataartsstudio_07_006__text710553319124">DataArts Studio</span>.
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_07_006__table18710936" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Browser compatibility</caption><thead align="left"><tr id="dataartsstudio_07_006__row42135876"><th align="left" class="cellrowborder" valign="top" width="14.078592140785922%" id="mcps1.3.1.2.2.2.5.1.1"><p id="dataartsstudio_07_006__p57562809">Browser</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="16.46835316468353%" id="mcps1.3.1.2.2.2.5.1.2"><p id="dataartsstudio_07_006__p1369744618463">Recommended Version</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="15.408459154084591%" id="mcps1.3.1.2.2.2.5.1.3"><p id="dataartsstudio_07_006__p32672014194711">Recommended OS</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="54.04459554044595%" id="mcps1.3.1.2.2.2.5.1.4"><p id="dataartsstudio_07_006__p32075938">Remarks</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dataartsstudio_07_006__row48014184"><td class="cellrowborder" valign="top" width="14.078592140785922%" headers="mcps1.3.1.2.2.2.5.1.1 "><p id="dataartsstudio_07_006__p20977134317355">Google Chrome</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.46835316468353%" headers="mcps1.3.1.2.2.2.5.1.2 "><p id="dataartsstudio_07_006__p1563613632118">133, 132, or 131</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15.408459154084591%" headers="mcps1.3.1.2.2.2.5.1.3 "><p id="dataartsstudio_07_006__p19267141474715">Windows 10</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.04459554044595%" headers="mcps1.3.1.2.2.2.5.1.4 "><p id="dataartsstudio_07_006__p11325143210339">1920x1080 and 2560x1440 are recommended.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_07_006__row9146142115231"><td class="cellrowborder" valign="top" width="14.078592140785922%" headers="mcps1.3.1.2.2.2.5.1.1 "><p id="dataartsstudio_07_006__p314672162317">Firefox</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.46835316468353%" headers="mcps1.3.1.2.2.2.5.1.2 "><p id="dataartsstudio_07_006__p1060122002116">135 or 134</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15.408459154084591%" headers="mcps1.3.1.2.2.2.5.1.3 "><p id="dataartsstudio_07_006__p51461921112315">Windows 10</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.04459554044595%" headers="mcps1.3.1.2.2.2.5.1.4 "><p id="dataartsstudio_07_006__p21461921182311">1920x1080 and 2560x1440 are recommended.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_07_006__row195399365283"><td class="cellrowborder" valign="top" width="14.078592140785922%" headers="mcps1.3.1.2.2.2.5.1.1 "><p id="dataartsstudio_07_006__p1453913615280">Microsoft Edge</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="16.46835316468353%" headers="mcps1.3.1.2.2.2.5.1.2 "><p id="dataartsstudio_07_006__p8539153682815">N/A (The version is updated with W10.)</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15.408459154084591%" headers="mcps1.3.1.2.2.2.5.1.3 "><p id="dataartsstudio_07_006__p453973682814">Windows 10</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="54.04459554044595%" headers="mcps1.3.1.2.2.2.5.1.4 "><p id="dataartsstudio_07_006__p154003613285">1920x1080 and 2560x1440 are recommended.</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="dataartsstudio_07_006__section589144052312"><h4 class="sectiontitle">Use Constraints</h4><div class="p" id="dataartsstudio_07_006__p192671625192217">Before using <span id="dataartsstudio_07_006__text1486217312126">DataArts Studio</span>, you must read and understand the following restrictions:
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_07_006__table1284816117315" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Restrictions for using <span id="dataartsstudio_07_006__text862672619310">DataArts Studio</span></caption><thead align="left"><tr id="dataartsstudio_07_006__row28481111936"><th align="left" class="cellrowborder" valign="top" width="12.72%" id="mcps1.3.2.2.2.2.3.1.1"><p id="dataartsstudio_07_006__p4848215311">Module</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="87.28%" id="mcps1.3.2.2.2.2.3.1.2"><p id="dataartsstudio_07_006__p128481011537">Restriction</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="dataartsstudio_07_006__row1012110508304"><td class="cellrowborder" valign="top" width="12.72%" headers="mcps1.3.2.2.2.2.3.1.1 "><p id="dataartsstudio_07_006__p1012125019302">Public</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="87.28%" headers="mcps1.3.2.2.2.2.3.1.2 "><ol id="dataartsstudio_07_006__ol1499105918309"><li id="dataartsstudio_07_006__li78363561425"><span id="dataartsstudio_07_006__text1687310254313">DataArts Studio</span> is a one-stop platform that provides data integration, development, and governance capabilities. <span id="dataartsstudio_07_006__text199011944143">DataArts Studio</span> has no storage or computing capability and relies on the data lake base.</li><li id="dataartsstudio_07_006__li21671246152817">Only one <span id="dataartsstudio_07_006__text1765212311300">DataArts Studio</span> instance can be bound to an enterprise project. If an enterprise project already has an instance, no more instance can be added.</li><li id="dataartsstudio_07_006__li1449915591308">Different modules of <span id="dataartsstudio_07_006__text5495513123012">DataArts Studio</span> support different data sources. You need to select a data lake foundation based on your service requirements. For details about the data lakes supported by <span id="dataartsstudio_07_006__text1714010464301">DataArts Studio</span>, see "Management Center" > "Data Sources Supported by <span id="dataartsstudio_07_006__text614019464307">DataArts Studio</span>" in <em id="dataartsstudio_07_006__i2141124618308"><span id="dataartsstudio_07_006__text71412046203011">DataArts Studio</span> User Guide</em>.</li></ol>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_07_006__row8701152418249"><td class="cellrowborder" valign="top" width="12.72%" headers="mcps1.3.2.2.2.2.3.1.1 "><p id="dataartsstudio_07_006__p177027249244">Management Center</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="87.28%" headers="mcps1.3.2.2.2.2.3.1.2 "><ol id="dataartsstudio_07_006__ol1885663416246"><li id="dataartsstudio_07_006__li166467514341">Due to the constraints of Management Center, other modules (such as DataArts Architecture, DataArts Quality, and DataArts Catalog) do not support databases or tables whose names contain Chinese characters or periods (.).</li><li id="dataartsstudio_07_006__li3292512132914">You are advised to use different CDM clusters for a data connection agent in Management Center and a CDM migration job. If an agent and CDM job use the same cluster, they may contend for resources during peak hours, resulting in service unavailability.</li><li id="dataartsstudio_07_006__li19813120221">If you use the same CDM cluster as the agent for multiple connections to MRS clusters with Kerberos authentication enabled, jobs will fail. You are advised to plan multiple CDM clusters based on service requirements.</li><li id="dataartsstudio_07_006__li17711340949"><p id="dataartsstudio_07_006__p5525353247"><a name="dataartsstudio_07_006__li17711340949"></a><a name="li17711340949"></a>If a CDM cluster functions as the agent for a data connection in Management Center, the cluster supports a maximum of 200 concurrent active threads. If multiple data connections share an agent, a maximum of 200 SQL, Shell, and Python scripts submitted through the connections can run concurrently. Excess tasks will be queued. You are advised to plan multiple agents based on the workload.</p>
|
|
<p id="dataartsstudio_07_006__p138202146254"></p>
|
|
</li><li id="dataartsstudio_07_006__li158651822510">A maximum of 200 data connections can be created in a workspace.</li><li id="dataartsstudio_07_006__li1498310611284">The concurrency restriction for APIs in Management Center is 100 QPS.</li></ol>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_07_006__row08481511432"><td class="cellrowborder" valign="top" width="12.72%" headers="mcps1.3.2.2.2.2.3.1.1 "><p id="dataartsstudio_07_006__p1784818115319">DataArts Migration</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="87.28%" headers="mcps1.3.2.2.2.2.3.1.2 "><ol id="dataartsstudio_07_006__ol6969951192411"><li id="dataartsstudio_07_006__li146652521018">You can enable automatic backup and restoration of CDM jobs. Backups of CDM jobs are stored in OBS buckets. For details, see <strong id="dataartsstudio_07_006__b111583414543">DataArts Migration</strong> > <strong id="dataartsstudio_07_006__b111589419546">Job Management</strong> > <strong id="dataartsstudio_07_006__b1715819414548">Job Configuration Management</strong> in <em id="dataartsstudio_07_006__i115916465416">DataArts Studio User Guide</em>.</li><li id="dataartsstudio_07_006__li19172736481">There is no quota limit for CDM jobs. However, it is recommended that the number of jobs be less than or equal to twice the number of vCPUs in the CDM cluster. Otherwise, job performance may be affected.</li><li id="dataartsstudio_07_006__li182712251596">The DataArts Migration cluster is deployed in standalone mode. A cluster fault may cause service and data loss. You are advised to use the CDM Job node of DataArts Factory to invoke CDM jobs and select two CDM clusters to improve reliability. For details, see <strong id="dataartsstudio_07_006__b102051523164912">DataArts Factory</strong> > <strong id="dataartsstudio_07_006__b82052232499">Nodes</strong> > <strong id="dataartsstudio_07_006__b320517234497">CDM Job</strong> in <em id="dataartsstudio_07_006__i17205423134917">DataArts Studio User Guide</em>.</li><li id="dataartsstudio_07_006__li123051719173713">If changes occur in the connected data source (for example, the MRS cluster capacity is expanded), you need to edit and save the connection.</li><li id="dataartsstudio_07_006__li19664195412344">If you have uploaded an updated version of a driver, you must restart the CDM cluster for the new driver to take effect.</li><li id="dataartsstudio_07_006__li10256684491">The number of concurrent extraction tasks for a job ranges from 1 to 300, and the total number of concurrent extraction tasks for a cluster ranges from 1 to 1,000. The maximum number of concurrent extraction tasks for a cluster depends on the CDM cluster specifications. You are advised to set the maximum number of concurrent extraction tasks to no larger than twice the number of vCPUs. The number of concurrent extraction tasks for a job should not exceed that for a cluster. If the number of concurrent extraction tasks is too large, memory overflow may occur. Exercise caution when changing the maximum number of concurrent extraction tasks.</li></ol>
|
|
<p id="dataartsstudio_07_006__p12848711136">For more constraints on DataArts Migration, see "DataArts Migration" > "Constraints" in <em id="dataartsstudio_07_006__i16771162054520">DataArts Studio User Guide</em>.</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_07_006__row158486114316"><td class="cellrowborder" valign="top" width="12.72%" headers="mcps1.3.2.2.2.2.3.1.1 "><p id="dataartsstudio_07_006__p1735415471435">DataArts Factory</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="87.28%" headers="mcps1.3.2.2.2.2.3.1.2 "><ol id="dataartsstudio_07_006__ol18572103114523"><li id="dataartsstudio_07_006__li115721031155211">You can enable backup of assets such as scripts and jobs to OBS buckets. For details, see <strong id="dataartsstudio_07_006__b18117195519461">DataArts Factory</strong> > <strong id="dataartsstudio_07_006__b71181955154619">O&M and Scheduling</strong> > <strong id="dataartsstudio_07_006__b1111816553466">Managing Backups</strong> in <em id="dataartsstudio_07_006__i191181055124612">DataArts Studio User Guide</em>.</li><li id="dataartsstudio_07_006__li159914301786">The execution history of scripts, jobs, and nodes is stored in OBS buckets. If no OBS bucket is available, you cannot view the execution history.</li><li id="dataartsstudio_07_006__li14254102212918">Resources from an HDFS can be used only by MRS Spark, MRS Flink Job, and MRS MapReduce nodes.</li><li id="dataartsstudio_07_006__li25721331145218">A workspace can contain a maximum of 10,000 scripts (including SQL, Shell, and Python scripts), 5,000 script directories, and 10 directory levels.</li><li id="dataartsstudio_07_006__li163617817584">A workspace can contain a maximum of 10,000 jobs (including batch processing jobs, real-time processing jobs, offline migration jobs, and real-time migration jobs), 5,000 job directories, and 10 directory levels.</li><li id="dataartsstudio_07_006__li19596193317311">A workspace can contain a maximum of 500 real-time jobs (including real-time processing jobs and real-time migration jobs).</li><li id="dataartsstudio_07_006__li195727313523">A maximum of 1,000 execution results can be displayed for RDS SQL, DWS SQL, Hive SQL, DLI SQL, and Spark SQL scripts, and the data volume is less than 3 MB. If the number of execution results exceeds 1,000, you can dump them. A maximum of 10,000 execution results or 3 MB data can be dumped.</li><li id="dataartsstudio_07_006__li1139812441577">Only data of the last six months can be displayed on the <strong id="dataartsstudio_07_006__b31311636173812">Monitor Instance</strong> and <strong id="dataartsstudio_07_006__b121321836133818">Monitor PatchData</strong> pages.</li><li id="dataartsstudio_07_006__li163685920710">Only notification records of the last 30 days can be displayed.</li><li id="dataartsstudio_07_006__li156485341899">The download records age out every seven days. When aged out, download records and the data dumped to OBS are both deleted.</li></ol>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_07_006__row495915314248"><td class="cellrowborder" valign="top" width="12.72%" headers="mcps1.3.2.2.2.2.3.1.1 "><p id="dataartsstudio_07_006__p138481254102417">DataArts Architecture</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="87.28%" headers="mcps1.3.2.2.2.2.3.1.2 "><ol id="dataartsstudio_07_006__ol196871659132414"><li id="dataartsstudio_07_006__li208488545246">DataArts Architecture supports ER modeling, dimensional modeling (only star models), and data mart.</li><li id="dataartsstudio_07_006__li128482548242">The maximum size of a file to be imported is 4 MB. A maximum of 3,000 metrics can be imported. A maximum of 500 tables can be exported at a time.</li><li id="dataartsstudio_07_006__li18407429173717">A maximum of 200 objects can be operated at a time in DataArts Architecture.</li><li id="dataartsstudio_07_006__li2068718597242">The quotas for the objects in a workspace are as follows:<ul id="dataartsstudio_07_006__ul15943151911298"><li id="dataartsstudio_07_006__li29431193292">Subjects: 5,000</li><li id="dataartsstudio_07_006__li544712992910">Data standard directories: 500; data standards: 20,000</li><li id="dataartsstudio_07_006__li20636014515">Business metrics: 100,000</li><li id="dataartsstudio_07_006__li155763525298">Atomic, derivative, and compound metrics: 5,000 for each</li></ul>
|
|
</li><li id="dataartsstudio_07_006__li388172352716"><div class="p" id="dataartsstudio_07_006__p1655172432711"><a name="dataartsstudio_07_006__li388172352716"></a><a name="li388172352716"></a>The quotas for different custom objects are as follows:<ul id="dataartsstudio_07_006__en-us_topic_0189921424_ul11702193818183"><li id="dataartsstudio_07_006__en-us_topic_0189921424_li7702838121812">Custom subjects: 10</li><li id="dataartsstudio_07_006__en-us_topic_0189921424_li127029380187">Custom tables: 30</li><li id="dataartsstudio_07_006__en-us_topic_0189921424_li157021738101814">Custom attributes: 10</li><li id="dataartsstudio_07_006__en-us_topic_0189921424_li2702143810186">Custom business metrics: 50</li></ul>
|
|
</div>
|
|
</li><li id="dataartsstudio_07_006__li192684151162">The name of a physical model table can contain a maximum of 200 characters.</li><li id="dataartsstudio_07_006__li5291471886">If you select <strong id="dataartsstudio_07_006__b1873121815478">Description</strong>, field comments of a table must be unique.</li><li id="dataartsstudio_07_006__li136682119341">If DataArts Architecture uses MRS Spark connections and DataArts Catalog uses MRS Hive connections to collect data, and if there are multiple Hive connections in the same cluster, you must use all these Hive connections to collect data in DataArts Catalog. Otherwise, tables may not be found during reversing in DataArts Architecture.</li></ol>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_07_006__row14848514315"><td class="cellrowborder" valign="top" width="12.72%" headers="mcps1.3.2.2.2.2.3.1.1 "><p id="dataartsstudio_07_006__p1290136646">DataArts Quality</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="87.28%" headers="mcps1.3.2.2.2.2.3.1.2 "><ol id="dataartsstudio_07_006__ol16461257312"><li id="dataartsstudio_07_006__li0646425173119">The execution duration of quality jobs and comparison jobs depends on the data engine. If the data engine does not have sufficient resources, the execution of data quality jobs may be slow.</li><li id="dataartsstudio_07_006__li1758174674516">A maximum of 50 subjobs (rules) can be configured for a quality job. If necessary, you can create multiple quality jobs.</li><li id="dataartsstudio_07_006__li990365310267">A maximum of five subjobs (rules) can be configured for a comparison job. If necessary, you can create multiple comparison jobs.</li><li id="dataartsstudio_07_006__li6624171682512">Each subjob of a quality job or comparison job can have a maximum of 300 data objects (databases, tables, and fields).</li><li id="dataartsstudio_07_006__li1715135525912">By default, a maximum of 1,000 SQL statements associated with a quality job of a data connection can be executed concurrently. Excess SQL statements will be queued. The value ranges from 10 to 1000.</li><li id="dataartsstudio_07_006__li05693174117">By default, a maximum of 10,000 SQL statements associated with a quality job in a region can be executed concurrently. Excess SQL statements will be queued.</li><li id="dataartsstudio_07_006__li646315253919">In the <strong id="dataartsstudio_07_006__b27241351203817">Quantity Changes</strong> area on the <strong id="dataartsstudio_07_006__b1072435113389">Dashboard</strong> page on the <strong id="dataartsstudio_07_006__b17724551163812">Quality Monitoring</strong> page, data of 30 days can be displayed. In the <strong id="dataartsstudio_07_006__b1772414510383">Alarm Trend by Severity</strong> and <strong id="dataartsstudio_07_006__b27241251103816">Rule Quantity Trend</strong> areas, data of the last seven days can be displayed.</li><li id="dataartsstudio_07_006__li874517714100">Quality reports are generated in batches on the T+1 day and retained for 90 days.</li><li id="dataartsstudio_07_006__li4103015106">If you export a quality report to OBS, the report is exported to the OBS path for storing job logs configured for the workspace. The exported record is retained for three months.</li></ol>
|
|
</td>
|
|
</tr>
|
|
<tr id="dataartsstudio_07_006__row1184819118316"><td class="cellrowborder" valign="top" width="12.72%" headers="mcps1.3.2.2.2.2.3.1.1 "><p id="dataartsstudio_07_006__p15848815312">DataArts Catalog</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="87.28%" headers="mcps1.3.2.2.2.2.3.1.2 "><ol id="dataartsstudio_07_006__ol17792029103118"><li id="dataartsstudio_07_006__li82091594311">A maximum of 100 metadata collection tasks can be created in a workspace.</li><li id="dataartsstudio_07_006__li37922297312">Metadata collection tasks can be obtained through DDL SQL statements of the engine. You are not advised to collect more than 1,000 tables through a single task. If necessary, you can create multiple collection tasks. In addition, you need to set the scheduling time and frequency properly based on your requirements to avoid heavy access and connection pressure on the engine. The recommended settings are as follows:<ul id="dataartsstudio_07_006__ul1235693945416"><li id="dataartsstudio_07_006__li1735673912548">If your service requires a metadata validity period of one day, set the scheduling period to max(one day, one-off collection period). This rule also applies to other scenarios.</li><li id="dataartsstudio_07_006__li335673915541">If your service mainly runs in the daytime, set a scheduling time in the night during which the metadata collection has the minimum impact on the data source. This rule also applies to other scenarios.</li></ul>
|
|
</li><li id="dataartsstudio_07_006__li3792122911319">Only the jobs that are scheduled and executed in DataArts Factory generate data lineages. Tested jobs do not generate data lineages.</li><li id="dataartsstudio_07_006__li7629466435">Historical data connections of the last seven days, 15 days, or 30 days can be displayed on the <strong id="dataartsstudio_07_006__b1669651123919">Dashboard</strong> page on the <strong id="dataartsstudio_07_006__b5696171173916">Metadata Collection</strong> page.</li></ol>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_12_0001.html">Service Overview</a></div>
|
|
</div>
|
|
</div>
|
|
|