yexinru/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
Files
a41a4e0331fbc0beff63bb28fa59228cc9a751df
doc-exports/docs/dataartsstudio/umn/dataartsstudio_01_0077.html
chenxiaoxiong c3942cbc2c DataArts UMN 20241028 version 
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Co-authored-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
Co-committed-by: chenxiaoxiong <chenxiaoxiong@huawei.com>
2025-07-09 13:09:06 +00:00

345 lines
33 KiB
HTML
Raw Blame History

<a name="dataartsstudio_01_0077"></a><a name="dataartsstudio_01_0077"></a>
<h1 class="topictitle1">Reference: CDM Performance Test Data</h1>
<div id="body8662426"><div class="section" id="dataartsstudio_01_0077__en-us_topic_0000001286166764_section10689131411396"><h4 class="sectiontitle">Background</h4><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p490832433920">The performance metrics provided in this document are for reference only. The performance at your site may be affected by factors such as the data source performance at the source or destination, network bandwidth, latency, and the data and service model. It is recommended that you test the speed with a small amount of data before migration.</p>
</div>
<div class="section" id="dataartsstudio_01_0077__en-us_topic_0000001286166764_section78988265434"><h4 class="sectiontitle">Environment</h4><ul id="dataartsstudio_01_0077__en-us_topic_0000001286166764_ul196081419133312"><li id="dataartsstudio_01_0077__en-us_topic_0000001286166764_li196081419203319">An xlarge CDM cluster of the 2.9.1 200 version</li><li id="dataartsstudio_01_0077__en-us_topic_0000001286166764_li12608121963310">A table which has 50 million rows and 100 columns, and three HDFS binary files which have 35.97 million rows and 100 columns, 66.67 million rows and 100 columns, and 100 million rows and 100 columns, respectively.</li><li id="dataartsstudio_01_0077__en-us_topic_0000001286166764_li20811743155114">Number of concurrent extraction jobs for determining the maximum extraction/write rate: 1, 10, 20, 30, and 50</li></ul>
</div>
<div class="section" id="dataartsstudio_01_0077__en-us_topic_0000001286166764_section17521720134110"><h4 class="sectiontitle">Data Source Extraction and Write Performance Test Data</h4><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p665110573336"><a href="#dataartsstudio_01_0077__en-us_topic_0000001286166764_table15735135655411">Table 1</a> and <a href="#dataartsstudio_01_0077__en-us_topic_0000001286166764_table15458173732111">Table 2</a> provide the data extraction and write performance, respectively.</p>
<div class="tablenoborder"><a name="dataartsstudio_01_0077__en-us_topic_0000001286166764_table15735135655411"></a><a name="en-us_topic_0000001286166764_table15735135655411"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0077__en-us_topic_0000001286166764_table15735135655411" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Data extraction performance</caption><thead align="left"><tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row1967785785412"><th align="left" class="cellrowborder" valign="top" width="18.57814218578142%" id="mcps1.3.3.3.2.6.1.1"><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p56781557185413">Data Source</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="19.638036196380362%" id="mcps1.3.3.3.2.6.1.2"><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p66788575542">Specifications</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="15.038496150384962%" id="mcps1.3.3.3.2.6.1.3"><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1467885775412">Version</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="22.00779922007799%" id="mcps1.3.3.3.2.6.1.4"><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p19678175719540">Extraction Rate for a Single Job (Lines per Second)</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="24.737526247375264%" id="mcps1.3.3.3.2.6.1.5"><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p2678195715545">Extraction Rate for Multiple Jobs (Lines per Second)</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row1467995715415"><td class="cellrowborder" valign="top" width="18.57814218578142%" headers="mcps1.3.3.3.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p137451926104014">RDS for MySQL</p>
</td>
<td class="cellrowborder" valign="top" width="19.638036196380362%" headers="mcps1.3.3.3.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p46795575547">8 vCPUs, 32 GB</p>
</td>
<td class="cellrowborder" valign="top" width="15.038496150384962%" headers="mcps1.3.3.3.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1667920576545">MySQL 5.7</p>
</td>
<td class="cellrowborder" valign="top" width="22.00779922007799%" headers="mcps1.3.3.3.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p868095710542">42,052</p>
</td>
<td class="cellrowborder" valign="top" width="24.737526247375264%" headers="mcps1.3.3.3.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p76808574545">195,313 (concurrency: 40)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row1768025765416"><td class="cellrowborder" valign="top" width="18.57814218578142%" headers="mcps1.3.3.3.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p7680657115414">Oracle</p>
</td>
<td class="cellrowborder" valign="top" width="19.638036196380362%" headers="mcps1.3.3.3.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1680195795415">8 vCPUs, 16 GB</p>
</td>
<td class="cellrowborder" valign="top" width="15.038496150384962%" headers="mcps1.3.3.3.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p15680357155415">19C</p>
</td>
<td class="cellrowborder" valign="top" width="22.00779922007799%" headers="mcps1.3.3.3.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p8681175713546">18,539</p>
</td>
<td class="cellrowborder" valign="top" width="24.737526247375264%" headers="mcps1.3.3.3.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p76806579543">18,706 (concurrency: 10)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row12681057165413"><td class="cellrowborder" valign="top" width="18.57814218578142%" headers="mcps1.3.3.3.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p2681057105413">MRS HBase</p>
</td>
<td class="cellrowborder" valign="top" width="19.638036196380362%" headers="mcps1.3.3.3.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p76811057195419">Master: 16 vCPUs, 64 GB x 3</p>
<p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p16681557135411">Node: 8 vCPUs, 32 GB x 3</p>
</td>
<td class="cellrowborder" valign="top" width="15.038496150384962%" headers="mcps1.3.3.3.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p46811357185416">MRS 3.1.0</p>
</td>
<td class="cellrowborder" valign="top" width="22.00779922007799%" headers="mcps1.3.3.3.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p4682135718545">6,296</p>
</td>
<td class="cellrowborder" valign="top" width="24.737526247375264%" headers="mcps1.3.3.3.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p13682057145419">69,156 (concurrency: 30)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row4682115710548"><td class="cellrowborder" valign="top" width="18.57814218578142%" headers="mcps1.3.3.3.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p168266540519">MRS Hive</p>
</td>
<td class="cellrowborder" valign="top" width="19.638036196380362%" headers="mcps1.3.3.3.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p86822057205415">Master: 16 vCPUs, 64 GB x 3</p>
<p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p14682195735417">Node: 8 vCPUs, 32 GB x 3</p>
</td>
<td class="cellrowborder" valign="top" width="15.038496150384962%" headers="mcps1.3.3.3.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p168219574545">MRS 3.1.0</p>
</td>
<td class="cellrowborder" valign="top" width="22.00779922007799%" headers="mcps1.3.3.3.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1268355795415">22,321</p>
</td>
<td class="cellrowborder" valign="top" width="24.737526247375264%" headers="mcps1.3.3.3.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p6683185795417">170,068 (concurrency: 30)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row26839578549"><td class="cellrowborder" rowspan="3" valign="top" width="18.57814218578142%" headers="mcps1.3.3.3.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p9594181034113">MRS HDFS (binary files)</p>
</td>
<td class="cellrowborder" rowspan="3" valign="top" width="19.638036196380362%" headers="mcps1.3.3.3.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p15683257105416">Master: 16 vCPUs, 64 GB x 3</p>
<p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p668316572546">Node: 8 vCPUs, 32 GB x 3</p>
</td>
<td class="cellrowborder" rowspan="3" valign="top" width="15.038496150384962%" headers="mcps1.3.3.3.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p10684457195412">MRS 3.1.0</p>
</td>
<td class="cellrowborder" valign="top" width="22.00779922007799%" headers="mcps1.3.3.3.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p10684155755412">138,727</p>
</td>
<td class="cellrowborder" valign="top" width="24.737526247375264%" headers="mcps1.3.3.3.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p368485735419">141,468 (concurrency: 20)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row1068412571543"><td class="cellrowborder" valign="top" headers="mcps1.3.3.3.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p15685135712549">125,556</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.3.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p768517575540">126,990 (concurrency: 10)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row7685145745416"><td class="cellrowborder" valign="top" headers="mcps1.3.3.3.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p14685115720549">120,919</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.3.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p9685657195417">120,919 (concurrency: 10)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row1068616576547"><td class="cellrowborder" valign="top" width="18.57814218578142%" headers="mcps1.3.3.3.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1968615577540">DWS</p>
</td>
<td class="cellrowborder" valign="top" width="19.638036196380362%" headers="mcps1.3.3.3.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p468635719549">8 vCPUs, 16 GB</p>
</td>
<td class="cellrowborder" valign="top" width="15.038496150384962%" headers="mcps1.3.3.3.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1768614570540">8.1.1.300</p>
</td>
<td class="cellrowborder" valign="top" width="22.00779922007799%" headers="mcps1.3.3.3.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p166861657145417">13,434</p>
</td>
<td class="cellrowborder" valign="top" width="24.737526247375264%" headers="mcps1.3.3.3.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p4686115719548">/</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row668685714545"><td class="cellrowborder" valign="top" width="18.57814218578142%" headers="mcps1.3.3.3.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p196874579547">DLI</p>
</td>
<td class="cellrowborder" valign="top" width="19.638036196380362%" headers="mcps1.3.3.3.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1687157195414">16 vCPUs</p>
</td>
<td class="cellrowborder" valign="top" width="15.038496150384962%" headers="mcps1.3.3.3.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p0687195785410">SQL queue</p>
</td>
<td class="cellrowborder" valign="top" width="22.00779922007799%" headers="mcps1.3.3.3.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p66879579547">71,023</p>
</td>
<td class="cellrowborder" valign="top" width="24.737526247375264%" headers="mcps1.3.3.3.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p46879573547">19,290 (concurrency: 20)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row16075314384"><td class="cellrowborder" valign="top" width="18.57814218578142%" headers="mcps1.3.3.3.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p360773110384">MRS Hudi (MOR)</p>
</td>
<td class="cellrowborder" valign="top" width="19.638036196380362%" headers="mcps1.3.3.3.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p8482342134510">Master: 16 vCPUs, 64 GB x 3</p>
<p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1248294234514">Node: 8 vCPUs, 64 GB x 3</p>
</td>
<td class="cellrowborder" valign="top" width="15.038496150384962%" headers="mcps1.3.3.3.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1560710314388">MRS 3.2.0</p>
</td>
<td class="cellrowborder" valign="top" width="22.00779922007799%" headers="mcps1.3.3.3.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p14607123120385">75187</p>
</td>
<td class="cellrowborder" valign="top" width="24.737526247375264%" headers="mcps1.3.3.3.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1960713173813">467,289 (concurrency: 30)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row71911536143813"><td class="cellrowborder" valign="top" width="18.57814218578142%" headers="mcps1.3.3.3.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p17191173633813">MRS Hudi (COW)</p>
</td>
<td class="cellrowborder" valign="top" width="19.638036196380362%" headers="mcps1.3.3.3.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p56581343104518">Master: 16 vCPUs, 64 GB x 3</p>
<p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1465819430455">Node: 8 vCPUs, 64 GB x 3</p>
</td>
<td class="cellrowborder" valign="top" width="15.038496150384962%" headers="mcps1.3.3.3.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p419112360385">MRS 3.2.0</p>
</td>
<td class="cellrowborder" valign="top" width="22.00779922007799%" headers="mcps1.3.3.3.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p71911836173819">84033</p>
</td>
<td class="cellrowborder" valign="top" width="24.737526247375264%" headers="mcps1.3.3.3.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1191143616383">485,436 (concurrency: 30)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row11120142173819"><td class="cellrowborder" valign="top" width="18.57814218578142%" headers="mcps1.3.3.3.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1412084243820">ClickHouse</p>
</td>
<td class="cellrowborder" valign="top" width="19.638036196380362%" headers="mcps1.3.3.3.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p18120194263814">Node: 8 vCPUs, 32 GB x 2</p>
</td>
<td class="cellrowborder" valign="top" width="15.038496150384962%" headers="mcps1.3.3.3.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p5776121715010">ClickHouse 22.3.2.2</p>
</td>
<td class="cellrowborder" valign="top" width="22.00779922007799%" headers="mcps1.3.3.3.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1272518498492">187265</p>
</td>
<td class="cellrowborder" valign="top" width="24.737526247375264%" headers="mcps1.3.3.3.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p412024273811">/</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row2855111175413"><td class="cellrowborder" valign="top" width="18.57814218578142%" headers="mcps1.3.3.3.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p208551011205416">Elasticsearch</p>
</td>
<td class="cellrowborder" valign="top" width="19.638036196380362%" headers="mcps1.3.3.3.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1039511419550">4 vCPUs, 8 GB x 6</p>
</td>
<td class="cellrowborder" valign="top" width="15.038496150384962%" headers="mcps1.3.3.3.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p148551511105415">Elasticsearch 7.10.2</p>
</td>
<td class="cellrowborder" valign="top" width="22.00779922007799%" headers="mcps1.3.3.3.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p98551511105413">28752</p>
</td>
<td class="cellrowborder" valign="top" width="24.737526247375264%" headers="mcps1.3.3.3.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p8855311165413">/</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row95896278465"><td class="cellrowborder" valign="top" width="18.57814218578142%" headers="mcps1.3.3.3.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1589102724610">RDS for PostgreSQL</p>
</td>
<td class="cellrowborder" valign="top" width="19.638036196380362%" headers="mcps1.3.3.3.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p758952711460">4 vCPUs, 32 GB (active/standby)</p>
</td>
<td class="cellrowborder" valign="top" width="15.038496150384962%" headers="mcps1.3.3.3.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p158919274466">PostgreSQL 13.12</p>
</td>
<td class="cellrowborder" valign="top" width="22.00779922007799%" headers="mcps1.3.3.3.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p55891627184619">128865</p>
</td>
<td class="cellrowborder" valign="top" width="24.737526247375264%" headers="mcps1.3.3.3.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p145892027184615">1,351,351 (concurrency: 30)</p>
</td>
</tr>
</tbody>
</table>
</div>
<div class="tablenoborder"><a name="dataartsstudio_01_0077__en-us_topic_0000001286166764_table15458173732111"></a><a name="en-us_topic_0000001286166764_table15458173732111"></a><table cellpadding="4" cellspacing="0" summary="" id="dataartsstudio_01_0077__en-us_topic_0000001286166764_table15458173732111" frame="border" border="1" rules="all"><caption><b>Table 2 </b>Data write performance</caption><thead align="left"><tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row945803752112"><th align="left" class="cellrowborder" valign="top" width="18.8%" id="mcps1.3.3.4.2.6.1.1"><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1459237112119">Data Source</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="19.45%" id="mcps1.3.3.4.2.6.1.2"><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p6459193713218">Specifications</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="15.040000000000001%" id="mcps1.3.3.4.2.6.1.3"><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p345983717211">Version</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="22.42%" id="mcps1.3.3.4.2.6.1.4"><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p18459193719216">Write Rate for a Single Job</p>
<p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p345993742114">(Rows per Second)</p>
</th>
<th align="left" class="cellrowborder" valign="top" width="24.29%" id="mcps1.3.3.4.2.6.1.5"><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p18459037152120">Write Rate for Multiple Jobs</p>
<p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p6459143719213">(Rows per Second)</p>
</th>
</tr>
</thead>
<tbody><tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row2459737112116"><td class="cellrowborder" valign="top" width="18.8%" headers="mcps1.3.3.4.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p18459193715219">RDS for MySQL</p>
</td>
<td class="cellrowborder" valign="top" width="19.45%" headers="mcps1.3.3.4.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p18459163722111">8 vCPUs, 32 GB</p>
</td>
<td class="cellrowborder" valign="top" width="15.040000000000001%" headers="mcps1.3.3.4.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p4459123711218">MySQL 5.7</p>
</td>
<td class="cellrowborder" valign="top" width="22.42%" headers="mcps1.3.3.4.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p18460037192115">2,658</p>
</td>
<td class="cellrowborder" valign="top" width="24.29%" headers="mcps1.3.3.4.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p4459137192111">/</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row2046013742116"><td class="cellrowborder" valign="top" width="18.8%" headers="mcps1.3.3.4.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p84609373218">Oracle</p>
</td>
<td class="cellrowborder" valign="top" width="19.45%" headers="mcps1.3.3.4.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p12460123752110">8 vCPUs, 16 GB</p>
</td>
<td class="cellrowborder" valign="top" width="15.040000000000001%" headers="mcps1.3.3.4.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p94604377218">19C</p>
</td>
<td class="cellrowborder" valign="top" width="22.42%" headers="mcps1.3.3.4.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p0460163714213">/</p>
</td>
<td class="cellrowborder" valign="top" width="24.29%" headers="mcps1.3.3.4.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p14460173772111">/</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row846016377218"><td class="cellrowborder" valign="top" width="18.8%" headers="mcps1.3.3.4.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p104601737142119">MRS HBase</p>
</td>
<td class="cellrowborder" valign="top" width="19.45%" headers="mcps1.3.3.4.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p0460203712117">Master: 16 vCPUs, 64 GB x 3</p>
<p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p10460163711213">Node: 8 vCPUs, 32 GB x 3</p>
</td>
<td class="cellrowborder" valign="top" width="15.040000000000001%" headers="mcps1.3.3.4.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p174603371214">MRS 3.1.0</p>
</td>
<td class="cellrowborder" valign="top" width="22.42%" headers="mcps1.3.3.4.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p4461133712211">3,959</p>
</td>
<td class="cellrowborder" valign="top" width="24.29%" headers="mcps1.3.3.4.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p194611437102118">4,120 (concurrency: 10)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row5461437172113"><td class="cellrowborder" valign="top" width="18.8%" headers="mcps1.3.3.4.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1146193772110">MRS Hive</p>
</td>
<td class="cellrowborder" valign="top" width="19.45%" headers="mcps1.3.3.4.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p54611637162118">Master: 16 vCPUs, 64 GB x 3</p>
<p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p14461143772114">Node: 8 vCPUs, 32 GB x 3</p>
</td>
<td class="cellrowborder" valign="top" width="15.040000000000001%" headers="mcps1.3.3.4.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p74611837112114">MRS 3.1.0</p>
</td>
<td class="cellrowborder" valign="top" width="22.42%" headers="mcps1.3.3.4.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p19461133782118">25,813</p>
</td>
<td class="cellrowborder" valign="top" width="24.29%" headers="mcps1.3.3.4.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p046114373219">26,882 (concurrency: 10)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row5461203718211"><td class="cellrowborder" rowspan="3" valign="top" width="18.8%" headers="mcps1.3.3.4.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1146111379214">MRS HDFS (binary files)</p>
</td>
<td class="cellrowborder" rowspan="3" valign="top" width="19.45%" headers="mcps1.3.3.4.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1446173742118">Master: 16 vCPUs, 64 GB x 3</p>
<p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p64617379212">Node: 8 vCPUs, 32 GB x 3</p>
</td>
<td class="cellrowborder" rowspan="3" valign="top" width="15.040000000000001%" headers="mcps1.3.3.4.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p15461153782112">MRS 3.1.0</p>
</td>
<td class="cellrowborder" valign="top" width="22.42%" headers="mcps1.3.3.4.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1046273752113">65,075</p>
</td>
<td class="cellrowborder" valign="top" width="24.29%" headers="mcps1.3.3.4.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p194628377213">90,155 (concurrency: 10)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row1246213717212"><td class="cellrowborder" valign="top" headers="mcps1.3.3.4.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p17462537162119">86,248</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.4.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p146223714215">86,248 (concurrency: 1)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row1446263715217"><td class="cellrowborder" valign="top" headers="mcps1.3.3.4.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1846263702117">76,687</p>
</td>
<td class="cellrowborder" valign="top" headers="mcps1.3.3.4.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p246216372215">76,687 (concurrency: 1)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row5462737132114"><td class="cellrowborder" valign="top" width="18.8%" headers="mcps1.3.3.4.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p194621037182111">DWS</p>
</td>
<td class="cellrowborder" valign="top" width="19.45%" headers="mcps1.3.3.4.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p15462337142112">8 vCPUs, 16 GB</p>
</td>
<td class="cellrowborder" valign="top" width="15.040000000000001%" headers="mcps1.3.3.4.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p18463937182113">8.1.1.300</p>
</td>
<td class="cellrowborder" valign="top" width="22.42%" headers="mcps1.3.3.4.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p44631937132118">26,624</p>
</td>
<td class="cellrowborder" valign="top" width="24.29%" headers="mcps1.3.3.4.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p74631537172112">27,902 (concurrency: 10)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row7463137172118"><td class="cellrowborder" valign="top" width="18.8%" headers="mcps1.3.3.4.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1546363714215">DLI</p>
</td>
<td class="cellrowborder" valign="top" width="19.45%" headers="mcps1.3.3.4.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p174631037202110">16 vCPUs</p>
</td>
<td class="cellrowborder" valign="top" width="15.040000000000001%" headers="mcps1.3.3.4.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p946313714214">SQL queue</p>
</td>
<td class="cellrowborder" valign="top" width="22.42%" headers="mcps1.3.3.4.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1146363752118">15,211</p>
</td>
<td class="cellrowborder" valign="top" width="24.29%" headers="mcps1.3.3.4.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p174631037102115">18,430 (concurrency: 10)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row3273103355212"><td class="cellrowborder" valign="top" width="18.8%" headers="mcps1.3.3.4.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1273103365214">MRS Hudi (MOR)</p>
</td>
<td class="cellrowborder" valign="top" width="19.45%" headers="mcps1.3.3.4.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p12806953368">Master: 16 vCPUs, 64 GB x 3</p>
<p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p28062531168">Node: 8 vCPUs, 64 GB x 3</p>
</td>
<td class="cellrowborder" valign="top" width="15.040000000000001%" headers="mcps1.3.3.4.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p98882344536">MRS 3.2.0</p>
</td>
<td class="cellrowborder" valign="top" width="22.42%" headers="mcps1.3.3.4.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1974613491449">16345</p>
</td>
<td class="cellrowborder" valign="top" width="24.29%" headers="mcps1.3.3.4.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p42735334528">183,150 (concurrency: 10)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row63111046165213"><td class="cellrowborder" valign="top" width="18.8%" headers="mcps1.3.3.4.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p5311946205216">MRS Hudi (COW)</p>
</td>
<td class="cellrowborder" valign="top" width="19.45%" headers="mcps1.3.3.4.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p376415414615">Master: 16 vCPUs, 64 GB x 3</p>
<p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p876412542613">Node: 8 vCPUs, 64 GB x 3</p>
</td>
<td class="cellrowborder" valign="top" width="15.040000000000001%" headers="mcps1.3.3.4.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p46114354533">MRS 3.2.0</p>
</td>
<td class="cellrowborder" valign="top" width="22.42%" headers="mcps1.3.3.4.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p2061359845">21088</p>
</td>
<td class="cellrowborder" valign="top" width="24.29%" headers="mcps1.3.3.4.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p133128463526">88,183 (concurrency: 20)</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row141298508527"><td class="cellrowborder" valign="top" width="18.8%" headers="mcps1.3.3.4.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p88820605317">ClickHouse</p>
</td>
<td class="cellrowborder" valign="top" width="19.45%" headers="mcps1.3.3.4.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p108628101211">Node: 8 vCPUs, 32 GB x 2</p>
</td>
<td class="cellrowborder" valign="top" width="15.040000000000001%" headers="mcps1.3.3.4.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p4929193313615">ClickHouse 22.3.2.2</p>
</td>
<td class="cellrowborder" valign="top" width="22.42%" headers="mcps1.3.3.4.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p313017505526">93984</p>
</td>
<td class="cellrowborder" valign="top" width="24.29%" headers="mcps1.3.3.4.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p43610612238">/</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row1463312386110"><td class="cellrowborder" valign="top" width="18.8%" headers="mcps1.3.3.4.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p263313381519">Elasticsearch</p>
</td>
<td class="cellrowborder" valign="top" width="19.45%" headers="mcps1.3.3.4.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p17103053717">4 vCPUs, 8 GB x 6</p>
</td>
<td class="cellrowborder" valign="top" width="15.040000000000001%" headers="mcps1.3.3.4.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p286451514615">Elasticsearch 7.10.2</p>
</td>
<td class="cellrowborder" valign="top" width="22.42%" headers="mcps1.3.3.4.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p297118191415">22271</p>
</td>
<td class="cellrowborder" valign="top" width="24.29%" headers="mcps1.3.3.4.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p763419381517">/</p>
</td>
</tr>
<tr id="dataartsstudio_01_0077__en-us_topic_0000001286166764_row194301953135216"><td class="cellrowborder" valign="top" width="18.8%" headers="mcps1.3.3.4.2.6.1.1 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p199791421155317">RDS for PostgreSQL</p>
</td>
<td class="cellrowborder" valign="top" width="19.45%" headers="mcps1.3.3.4.2.6.1.2 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p24301853185217">4 vCPUs, 32 GB (active/standby)</p>
</td>
<td class="cellrowborder" valign="top" width="15.040000000000001%" headers="mcps1.3.3.4.2.6.1.3 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p543085312525">PostgreSQL 13.12</p>
</td>
<td class="cellrowborder" valign="top" width="22.42%" headers="mcps1.3.3.4.2.6.1.4 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p1630715119414">34746</p>
</td>
<td class="cellrowborder" valign="top" width="24.29%" headers="mcps1.3.3.4.2.6.1.5 "><p id="dataartsstudio_01_0077__en-us_topic_0000001286166764_p2430135319522">153,374 (concurrency: 10)</p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dataartsstudio_01_0018.html">Improving Migration Performance</a></div>
</div>
</div>
View Git Blame Copy Permalink